怀远县质量技术监督局【特荐-】教学课件

NaturalLanguageProcessing门2004BobCarpenterAlias-iIncaliase怀远县质量技术监督局【特荐-PPT】NaturalLanguageProcessing门2004BobCarpenterAlias-iIncaliaseWhat'sNaturalLanguageprocessing?DependsonyourpointofviewPsychology:UnderstandhumanlanguageprocessingHowdowelearnlanguage?Howdoweunderstandlanguage?Howdoweproducelanguage?Howislanguagetiedtothought?EngineeringBuildsystemstoprocesslanguageBuilddialoque-basedcallcentersBuildinformationretrievalenginesBuildquestion-answeringsystemsDesigngeneralalgorithmsforarangeofapplicationsaliaseNLPisTuringTestHardComputerMachineryIntelligence"1950.AlanTuringTheBigQuestionIproposetoconsiderthequestion,'Canmachinesthink?heImitationGameThenewformoftheproblemcanbedescribedintermsofagameAlanturingwhichwecalltheimitationgame.Itisplayedwiththreepeople,aman(A),awoman(B),andaninterrogator(C)whomaybeofeithersexTheinterrogatorstaysinaroomapartfromtheothertwo.theobjectofthegamefortheinterrogatoristodeterminewhichoftheothertwoisthemanandhichisthewoman.heknowsthembylabelsXandY,andattheendofthegamehesayseitherXisAandYisBorXisBandYisauring'sTestWenowaskthequestion,'WhatwillhappenwhenamachinetakesthepartofAinthisgame?WilltheinterrogatordecidewronglyasoftenlayedlikethisashedoeswhenthegameisplayedbetweenamanandaromanThesequestionsreplaceouroriginal,Canmachinesthink?aSdWhat'sNaturalLanguageprocessing?DependsonyourpointofviewPsychology:UnderstandhumanlanguageprocessingHowdowelearnlanguage?Howdoweunderstandlanguage?Howdoweproducelanguage?Howislanguagetiedtothought?EngineeringBuildsystemstoprocesslanguageBuilddialoque-basedcallcentersBuildinformationretrievalenginesBuildquestion-answeringsystemsDesigngeneralalgorithmsforarangeofapplicationsaliaseNLPisTuringTestHardComputerMachineryIntelligence"1950.AlanTuringTheBigQuestionIproposetoconsiderthequestion,'Canmachinesthink?heImitationGameThenewformoftheproblemcanbedescribedintermsofagameAlanturingwhichwecalltheimitationgame.Itisplayedwiththreepeople,aman(A),awoman(B),andaninterrogator(C)whomaybeofeithersexTheinterrogatorstaysinaroomapartfromtheothertwo.theobjectofthegamefortheinterrogatoristodeterminewhichoftheothertwoisthemanandhichisthewoman.heknowsthembylabelsXandY,andattheendofthegamehesayseitherXisAandYisBorXisBandYisauring'sTestWenowaskthequestion,'WhatwillhappenwhenamachinetakesthepartofAinthisgame?WilltheinterrogatordecidewronglyasoftenlayedlikethisashedoeswhenthegameisplayedbetweenamanandaromanThesequestionsreplaceouroriginal,Canmachinesthink?aSdBriefHistoryofNLP1950s:MachineTranslationAbandonedduetolackofcomputingresources1960s:DespaiProblemconsideredimpossiblephilosophically(Quine)Problemconsideredimpossiblelinguistically(Chomsky970s:DawnofArtificialIntelligenceull"dialogsystems(egSHRDLUessingEarlytheoriesofsemantics;firstbigsystems(egLUNAR)FirstinformationretrievalsystemsW.V.O.QuineaSd1970sExample:SHRDLUerryWinograd.1971Person:PICKUPABIGREDBLOCKMITPh.D.ThesiComputer:OK.(doesit)Person:GRASPTHEPYRAMIDComputer:IDONTUNDERSTANDWHICHPICKUPABIGREDBooK.PYRAMIDYOUMEANPerson:FINDABLOCKWHICHISTALLERerrywinogradTHANTHEONEYOUAREHOLDINGBOXomputerBYIT"IASSUMEYOUMEANOCKWHICHISTALLERTHANTHEONEIAMHOLDINGComputer:OK.(doesPerson:WHATDOESTHEBOXCONTAIN?Person:WHATISTHEPYRAMIDSUPPORTEDBY?ThisisoneoftheonlyComputer:THEBOX.dialogsitknowsPerson:HOWMANYBLOCKSARENOTSHRDLUistoostupidNTHEBOX?Computer:FOUROFTHEMtomakemistakePerson:ISATLEASTONEOFTHEMBeautifu“Demo-WareNARROWERTHANTHEONEWHICHTOLDYOUTOPICKUP?Computer:YES,THEREDCUBEaliasestoryofNLP(2)1980s:RationalismFocusonsyntacticandsemanticgrammarsanddiscourseLogicalframeworksforgrammar(LFG,PSG)andforknowledge(KL-ONE,CYC,etc.Everythinghand-builtCouldn'tscale:wasn'trobustRonBrachman(KL-ONEJoanBresnan(LFG)GeraldGazdar(GPSG)lasd1980sEXample:CYCCYCswayofsaying"everyanimalhasamother(forAll?A(implies(isa?AAnimal)(thereExists?M(andther?A(isa?MFemaleAnimal)))DougLenatCouldntmakealltheworld'sknowledgeconsistentMaintenanceisahugenightmareButitstillexistsandisgettingpopularagainduetotheSemanticWeb"ingeneralandWordNetinNLPCheckoutthelatestatopencyc.orglasdstoryofnlP(3)1990sand2000s:EmpiricismFocusonsimplerproblemslikepart-of-speechtaggingandg(e.gPocusonfullcoverage(earlierknownas"robustness")FocusonEmpiricalevaluationStillsymbolic!ExamplesintherestofthetalkTheFuture?Applications?StillwaitingforourGalileo(notevenNewton,muchlessEinstein)aSdCurrentparadigmExpressa"problemComputersciencesenseofwell-definedtasktbereproducibleinordertotestsystemhisisthefirstlinguisticconsiderationAssignpartsofspeechfromagivenset(noun,verb,adjective,etctoeachwordinagiventextindallnamesofpeopleinaspecifiedtextTranslateagivenparagraphoftextfromArabictoEnglishSummarize100documentsdrawnfromadozennewspapeSegmentabroadcastnewsshowintotopicsFindspellingerrorsinemailmessagesPredictmostlikelypronunciationforasequenceofcharactersaliaseCurrentParadigm(2)2.GenerateGoldstandardHumanannotated