如何写审稿意见

Howtowriteareview,TobyWalshDepartmentofComputerScienceUniversityofYorkwww.cs.york.ac.uk/tw/phd,Outline,Whatisareview?Whyshouldyoureview?Howdoyoureviewapaper?Whatnottodo?Whatarethedilemmas?Casestudy,Whatisareview?,“Somethingthatwillruinyourday”AlanBundyEvenifitisgood!ThestampofscientificqualityFeedbackfromyourpeersFuturedirections?,Prof.AlanBundy,Whatisareviewnot?,Acceptance/rejectionEditors/Programcommitteesaccept/rejectYourecommend!Aplaceforbias,prejudice,personalanimosity,Thoughitoftenappearstobeso,Whyshouldyoureview?,YoudmuchratherenjoyPaphosAndsowouldI!ButsciencewouldgrindtoahaltNotimmediately,ofcourse,Reasonstoreview,DutyFairness2-3reviewswritten/paperwrittenPromotionEducationGoodreviewerswritegoodpapers?,Badreasonstoreview,TosettleoldscoresToadvanceyourowntheories/hinderrivalsTogetlatestresultsUnpublishedpapersarestrictlyconfidential,Howdoyoureview?,ReadthepaperReadthereviewformUsefuldimensionstolookatNovelty,Clarity,Importance,TimelinessReadthepaperWaitafewdaysReadpaperWritereviewEveryonehastheirownmethod,Howdoyoureview?,PutyourselfinauthorsshoesThinkhowyouwouldliketoreadthisreviewOfferconstructivecriticismDontjusttellthemsomethingisinadequate!Tellthemhowtheymightfixit,Whatnottodo?,MissthedeadlineWeallhatelatereviewsDisplaypartiality,bias,animosity,DestructivelycriticizeAlwaysworkoutwhattheywouldneedtodotofixproblems,Collectandsharereviews,LearnifothersagreewithyouropinionsThickenyourskinClearly,theauthorfailstounderstandtheworkofWalshinthisareaSincetheymentionnorelatedwork,thispapercannotbeoriginalThisideaistoosimplenottoexistalreadyThisworkisgoodbutIdontunderstandwhyBundyhasntdonethisalready?,Ethicaldilemmas,YouareworkingonthesameproblemTalktoEditor/ProgramChairYoualreadyreviewedandrejectedpaperLookforchanges,Ethicaldilemmas,ThisjournalsubmissionalreadyappearedataconferenceDoesitextendpreviousappearance?AnalmostidenticalpaperalreadyappearedUnlessitwasataworkshop,informEditor/Chair,Casestudy,“StochasticConstraintProgramming”ByTobyWalshBefrank,thefeedbackisgood!Whatdoyouthink?,Whatdidreviewer1think?,AppearstolikeitMaincriticisms:RelationshiptoinfluencediagramsAlgorithmperformancePhasetransitiontoopreliminary,“Thepaperreadswell.Ihaveanumberofremarksthough.First,fromaprobabilisticreasoningviewpoint,Iwonderabouttherelationshipbetweenthisframeworkandinfluencediagrams(ordecisiondiagrams).ItappearstomethatwhatyouhavedefinedhereisverycloselyrelatedSecond,fromaconstraintsatisfactionviewpoint:yougaveusnoindicationofhowwellthedifferentalgorithmsyoupresentedworkinpractice.Third,Ithinkthediscussiononphasetransitioncannotbeleftatthislevel.Itisnotsurprisingthatwehaveaphasetransitionhere,butwhatisinterestingisthenatureofthistransitionIthinkthistopicistooserioustosumitupinasmallSectionitdeservesadedicatedandmorethoroughtreatment.Iwouldhavepreferredtoseethisspacededicatedtoexperimentalresultsontheperformanceofpresentedalgorithms”,Whatdidreviewer2think?,AppearstolikeitVeryrelevantModeratelysignificant/originalGoodreadability/EnglishMinimalcomments,Totaloftheirwrittencomments:“ItwouldbenicetoincludetheexactsyntaxofoneSCprogram,asacceptedbyyoursystem(?),say,fortheexampleofSection3.”,Whatdidreviewer3think?,AgainappearstolikeitVeryrelevant,veryoriginal,moderatelysignificantMaincriticismsRelationshiptoinfluencediagramsPhasetransitiontoopreliminary,“Clearly,onecouldjustaddconstraintstoinfluencediagramrepresentationandextendalgorithmstoexploitthem(mypreferredapproach)buttheapproachhereisstillveryvalidandcouldmotivateresearchersinMDPsandinfluencediagramstotreatconstraintsasspecialcreaturessothattheirspecialalgorithmscanbeexploited.IthinktheexperimentalportionofthepapershouldhavebeentocomparetheperformanceofthealgorithmswiththeperformanceoftraditionalMDPsorinfluencediagramalgorithmsappliedtothisclassofproblemsandIspeculatethatgaincanbeshown.Idontfindthephasetransitionexperimentsofmuchvalueatthisstage.So,theremaybeaphasetransition,sowhat?IrecommendthattheauthorwillcarefullyanalyzetheirmodelagainststandardinfluncediagramsorfactoredMDPsanddiscusstheprosandcons.”,WhatdidtheIJCAIPCthink?,PaperwasrejectedAlongwith75%oftheothersubmissionsAlessgoodpaper(myandreviewersopinions)wasacc