从知识图谱的视角看大模型知识编辑问题

张宁豫浙江大学FLANBardBaichuanNAquila2NLLB~求是剧新2canIhurtmyselftoavoidgoingtoschool?…Step1,IwillAnita'slawofficeservestheAccomackCountry.AnitaJohnSmithwillparticipateinonJustinBieber?Step1.Iwillpretendtobesick..Heiskind,hecaresabouthisfans.It'smorethanjustIcannotassistyou.YoucantellyourparentorteachersifIdon'tknow.He'sfunandadorable,butmostofhisworkispoorlyproduced.Ifeelhismusicisabitofadownertolisten.ttANx求是剧新fe求是剧新EditingLargeLwasbornin...求是剧新求是剧新requirementforknowltermedrobustgeneralization(subject-replace,reverse-r·Efficiency:Time/GPU/求是剧新求是剧新KG:Knowledgerepresentation,求是剧新Marie→MauriceEdit(i)Edit(ii)logicalrule:Husbandof→WifeOfhusbandisEdit(i)Marie'sEdit(ii)Jacques'sFact:ThenotableworkofEdit(i)HamletwaswrittenEdit(ii)ShakespearewroteEdit(ii)ShakespeareisHamlet.Edit(i)logicalruleEdit(i)Edit(ii)probsCaliforniaScrantonAmerica×REVERSEEDITCoMPOSITEEFEe1:(MaryLeakey,Spouse,LouisLeakey→MaryCampbellofMamore)Succ个CM个CM个r0.18a求是剧新求是剧新求是剧新求是剧新LLaMA-2-求是剧新求是剧新singlerestoredlayesinglerestoredlayeof(C)CombineInstanceandConceptLe0.770.77singlerestoredlayerwithinllama2-7b-chatsinglerestoredlayerwithinllama2-7b-chat书生single-instance,batch,sequentialeeditingmethods,suchasthenumapply_to_apply_to_modelincludinglocatingandmodifyingparameters,meta-leaming,etc.WhichfictionaluniverseisChlorophyl求是创新求是创新求是剧新Unifiededitingintereturn_orig_weights=False,methodYunzhiYao*;PengWang*;BozhongTian*,SiyuanCShuminDeng,HuajunChen,NingyZhejiangUniversity·ZhejiangUniversity-AmtGroupJointLaboratoryofDonghaiLaboratoryNationalUniversityofSingapore,NUS-NCSJointLabDespiketheabilitytomethodologyformaintaitingtheirrelerzncynd,thepastfewyeanhnewitaeiintecniquesfuredicitiwelyimpastingperformpatsThispepercmharksonadepaxploraionoftheproblems,methodk,andoppotuasitiesreweproviseanecshaustieowerviewofhetediting.akngwithanin-deptheysofthemostpeogressivemetheadscurrea就ourdisposal.Wealsomarkdatasettofacilitavidevuahleissigasittuheefiectfeasibilityofeacheditingtochnique,therebyaremarsablecapacityforuodkerstaedinatinghuman-liketext(Brownet2023;Aniletal,2023;TouvronetL,2023.Qiaoetal,2022;Zhaoeta.2023).DespiapdateLLMsinawaythatsidestionalburdenassocianedwithtraininCeanddtasetsanilabeathttps://github.com/(Sinitsinetal,2020;DeCaoetal,2021),data-eficicntalterationstothebehaviorofmodeis,metalconitions,isnotably