如何写审稿意见

HowtowriteareviewTobyWalshDepartmentofComputerScienceUniversityofYorkwww.cs.york.ac.uk/~tw/phd大家好1OutlineWhatisareview?Whyshouldyoureview?Howdoyoureviewapaper?Whatnottodo?Whatarethedilemmas?Casestudy大家好2Whatisareview?“Somethingthatwillruinyourday”AlanBundyEvenifitisgood!ThestampofscientificqualityFeedbackfromyourpeersFuturedirections?Prof.AlanBundy大家好3Whatisareviewnot?Acceptance/rejectionEditors/Programcommitteesaccept/rejectYourecommend!Aplaceforbias,prejudice,personalanimosity,…Thoughitoftenappearstobeso大家好4Whyshouldyoureview?You’dmuchratherenjoyPaphosAndsowouldI!ButsciencewouldgrindtoahaltNotimmediately,ofcourse大家好5ReasonstoreviewDutyFairness2-3reviewswritten/paperwrittenPromotionEducationGoodreviewerswritegoodpapers?大家好6BadreasonstoreviewTosettleoldscoresToadvanceyourowntheories/hinderrivalsTogetlatestresultsUnpublishedpapersarestrictlyconfidential大家好7Howdoyoureview?ReadthepaperReadthereviewformUsefuldimensionstolookatNovelty,Clarity,Importance,Timeliness…ReadthepaperWaitafewdaysReadpaperWritereviewEveryonehastheirownmethod大家好8Howdoyoureview?Putyourselfinauthor’sshoesThinkhowyouwouldliketoreadthisreviewOfferconstructivecriticismDon’tjusttellthemsomethingisinadequate!Tellthemhowtheymightfixit大家好9Whatnottodo?MissthedeadlineWeallhatelatereviewsDisplaypartiality,bias,animosity,…DestructivelycriticizeAlwaysworkoutwhattheywouldneedtodotofixproblems大家好10CollectandsharereviewsLearnifothersagreewithyouropinionsThickenyourskinClearly,theauthorfailstounderstandtheworkofWalshinthisarea…Sincetheymentionnorelatedwork,thispapercannotbeoriginal…Thisideaistoosimplenottoexistalready…ThisworkisgoodbutIdon’tunderstandwhyBundyhasn’tdonethisalready?大家好11EthicaldilemmasYouareworkingonthesameproblemTalktoEditor/ProgramChairYoualreadyreviewedandrejectedpaperLookforchanges大家好12EthicaldilemmasThisjournalsubmissionalreadyappearedataconferenceDoesitextendpreviousappearance?AnalmostidenticalpaperalreadyappearedUnlessitwasataworkshop,informEditor/Chair大家好13Casestudy“StochasticConstraintProgramming”ByTobyWalshBefrank,thefeedbackisgood!Whatdoyouthink?大家好14Whatdidreviewer1think?AppearstolikeitMaincriticisms:RelationshiptoinfluencediagramsAlgorithmperformancePhasetransitiontoopreliminary“Thepaperreadswell.…Ihaveanumberofremarksthough.First,fromaprobabilisticreasoningviewpoint,Iwonderabouttherelationshipbetweenthisframeworkandinfluencediagrams(ordecisiondiagrams).Itappearstomethatwhatyouhavedefinedhereisverycloselyrelated…Second,fromaconstraintsatisfactionviewpoint:yougaveusnoindicationofhowwellthedifferentalgorithmsyoupresentedworkinpractice.…Third,Ithinkthediscussiononphasetransitioncannotbeleftatthislevel.Itisnotsurprisingthatwehaveaphasetransitionhere,butwhatisinterestingisthenatureofthistransition…IthinkthistopicistooserioustosumitupinasmallSection…[it]deservesadedicatedandmorethoroughtreatment.Iwouldhavepreferredtoseethisspacededicatedtoexperimentalresultsontheperformanceofpresentedalgorithms”大家好15Whatdidreviewer2think?AppearstolikeitVeryrelevantModeratelysignificant/originalGoodreadability/EnglishMinimalcommentsTotaloftheirwrittencomments:“ItwouldbenicetoincludetheexactsyntaxofoneSCprogram,asacceptedbyyoursystem(?),say,fortheexampleofSection3.”大家好16Whatdidreviewer3think?AgainappearstolikeitVeryrelevant,veryoriginal,moderatelysignificantMaincriticismsRelationshiptoinfluencediagramsPhasetransitiontoopreliminary“Clearly,onecouldjustaddconstraintstoinfluencediagramrepresentationandextendalgorithmstoexploitthem(mypreferredapproach)buttheapproachhereisstillveryvalidandcouldmotivateresearchersinMDPsandinfluencediagramstotreatconstraintsasspecialcreatures…sothattheirspecial…algorithmscanbeexploited.IthinktheexperimentalportionofthepapershouldhavebeentocomparetheperformanceofthealgorithmswiththeperformanceoftraditionalMDPsorinfluencediagramalgorithmsappliedtothisclassofproblemsandIspeculatethatgaincanbeshown.Idon’tfindthephasetransitionexperimentsofmuchvalueatthisstage.So,theremaybeaphasetransition,sowhat?IrecommendthattheauthorwillcarefullyanalyzetheirmodelagainststandardinfluncediagramsorfactoredMDPsanddiscusstheprosandcons.”大家好17WhatdidtheIJCAIPCthink?PaperwasrejectedAlongwith75%oftheothersubmissionsAlessgoodpaper(myandreviewers’opinions)wasaccepted!Some