MemoProAgent:面向记忆驱动的主动式辅助_第1页
MemoProAgent:面向记忆驱动的主动式辅助_第2页
MemoProAgent:面向记忆驱动的主动式辅助_第3页
MemoProAgent:面向记忆驱动的主动式辅助_第4页
MemoProAgent:面向记忆驱动的主动式辅助_第5页
已阅读5页,还剩54页未读, 继续免费阅读

下载本文档

版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领

文档简介

MemoProAgent:TowardMemory-DrivenProactiveAssistance

ShenglaiZeng₁¹,2,XiaoYang²,TiffanyMa²,XinyuanZhang²,NanshuWang²,DerenLei³,KaiSun²,XilunChen²,TammyStark²,XianhuiZhu²,YuetaiLi⁵,RulinShao³,5,TianxinWei4,6,RakeshWanga²,AnujKumar²,JiliangTang¹,Wen-tauYih³,XinLunaDong²

¹MichiganStateUniversity,²MetaRealityLabs,³MetaSuperintelligenceLabs,4Meta

RecommendationSystems,5UniversityofWashington,6UniversityofIllinoisUrbana-Champaign

Asassistantsmovefromreactiveansweringtowardproactiveintervention,memorychangesrole:itnolongeronlysuppliestheanswertoaquery,itdetermineswhetherandwhentospeakatall.Priorworkinthissettinghandsthesystemtherelevantfactincontext;westudytheregimethatmakestheproblemhard,wheretheevidencejustifyinganinterventionmustbeminedfromalong-horizonpersonalmemory.WeintroduceMemoProBench,abenchmarkformemory-drivenproactiveassistance(MPA),pairingegocentricvideowithyear-long,distractor-richusermemories(~618Ktokensonaverage),human-verifiedtriggerwindows,andaprotocolthatscorescontentandtimingjointly.Everybaselineweevaluateperformspoorly(atmost15%),includingfrontiermodelsgivensummarizedorretrieval-augmentedmemory.Acontrolledstudyexplainswhy:withoracleevidencedeliveredinsidethetriggerwindowGPT-5.3-Chatreaches96%;lettingitchoosethetimingdropsitto38%,andreplacingoracleevidencewithretrievaldropsitto15%.Contentandtimingareseparatelynecessary,andmissingeitheriscatastrophic.Guidedbythis,webuildMemoProAgentwithaplug-and-playharnessthatsurfacesmemoryfromagraph-organizedstoreandgatesitdowntowhatisworthinterruptingfor,plusalightweightRLstagethatcurbsearlyandrepeatedfiring.Withoutanytraining,MemoProAgentliftsstrictaccuracyfrombelow10%to37.5%onQwen3.8-27Band38%onGPT-5.3-Chat;RLpost-trainingreaches42.4%.

Date:October22,2026

Correspondence:ShenglaiZengatzengshe1@

Code:

https:///facebookresearch/Memo-Pro-Agent

Data:

https://huggingface.co/datasets/facebook/MemProBenchMeta

arXiv:261022671v2[cs.CL]21Oct2026

1Introduction

Asmultimodalassistantsmature,ashiftisunderwayfromareactiveparadigm,inwhichtheassistantwaitsforanexplicitquery,toaproactiveone,inwhichittakestheinitiativeandengagestheuserunprompted(Wangetal.,2025a;ThinkingMachinesLab,2026).ConsiderauserwearingAIglasses:theassistantobservestheirsurroundingsinrealtimeanddecidesforitselfwhentospeak—perhapstoflagasafetyhazard,ortoremindtheusertorestockanitem.Noqueryiseverissued.Beyondproducinganappropriateanswer,theassistantmustproduceitattheright,self-determinedmoment.

Centraltothisshiftisthechangingroleofmemory(Figure1).Inthereactiveparadigm,memorysupplieswhattosay:itaugmentstheuser'squerywithrelatedcontexttogroundandpersonalizetheanswer(Lewisetal.,2020;Packeretal.,2023).Theuserasks“doIstillhavesparklingwaterathome?”andtheassistantretrievestherelevantmemorytoanswer.Intheproactiveparadigm,memoryalsodetermineswhentospeak:.Passingsparklingwaterinastore,theassistantrecallsthattheuserfinishedthelastbottleyesterday,andthatrecollectionisitselfwhatmakesareminderwarranted.Memoryisnolongeronlyasourceofcontent;itisalsothetriggerthatgovernswhethertointerveneatall.Wecallthissettingmemory-drivenproactiveassistance(MPA):givenacontinuousstreamoftheuser'scurrentsituation(egocentricvideoinourbenchmark)andalong-termmemoryoftheirpast,andgivennoquery,thesystemmustdecideateachmomentwhentospeakandwhattosay.

2

Perfect(%)

(c)RightMemory×RightTime

100

38.0%

15.3%

RetrievedRetrievedOracleOrocle

ChosenOracleChosenOrocle

GPT-5.3-Chat-150clips-Chosen=model-chosen

96.0%

8.0%

MemoryTiming

(d)MemoProAgentNarrowsthePerformanceGap

WindowedStreaming

StandardRAG

MemoProAgent

MemoProAgent

Triggerexplicituserquery

因RECALLEDMEMORY

"No,youoreoutofsparkingwater."

Readieagent

(b)Memory-DrivenProactiveAssistance

圆RECALLEDMEMORY

T'mrunningoutofsparklingwater:"

Prooctiveogent

(a)ReactiveMemoryAugmentation

"Youshouldrestock

sparklingwater."

T'mrunningoutofsparklingwater."

"DoIstillhave

sparklingwater

athome?"

NOUSERQUERY

Figure1Reactivevs.memory-drivenproactiveassistance,andwhatsuccessrequires.(a)Inthereactiveparadigm,memorysupplieswhattoanswertoanexplicitquery.(b)Intheproactiveparadigmnoqueryisgiven:memoryiswhatmakesareminderwarranted,andtheassistantmustalsodecideuhentospeak.(c)Successdemandstherightmemoryattherighttime—withoraclememorydeliveredin-windowafrontiermodelreaches96%,butdroppingeitherthetiming(→38)orthememory(→15)collapsesit(GPT-5.3-Chat).(d)MemoProAgentnarrowsthisgap,liftingPERFECTfrom7.0to37.5(42.4withRL)onQwen3.8-27B.

Recentworkstudiesproactiveassistanceconditionedonusercontext,butinaregimethatsidestepsthecentraldifficulty:thefactjustifyinganinterventionishandedtothemodeldirectly,asashortprofile(Ranetal.,2026)orastatedgoal(Zhangetal.,2025).Adeployedassistantfacessomethingdifferent.Thatfactisonefragmentamongayearofaccumulatedexperience,andlocatingitispartofthetask.Thetworegimesdifferbyordersofmagnitudeinhowmuchmemorymustbesearched,andperformancedoesnotsurvivethetransition.Moreover,successisjudgedasymmetrically.Aproactiveinterventionisaninterruption:areminderthatarrivesatthewrongmoment,orthattheuserneverneeded,spendsattentiontheuserneveroffered(Dengetal.,2023).Silenceisthereforecorrectalmostallofthetime,andaresponsecountsonlywhenitscontentisgroundedanditstimingisright.Arestockreminderisunwantedwhenfiredtooearly(userstillinclass),toolate(shoppingdone),orrepeatedly.Thisshapesbothevaluationanddesign.Evaluationmustcreditexactlyonewell-timedresponseandmustincludemomentswheresilenceiscorrect,sinceotherwiseasystemthatalwaysspeaksisindistinguishablefromonethatspeakswell.Andthesystemitselfmustjudgenotwhetheramemoryisrelevant,butwhetheritjustifiesintervening.

TostudythisregimeweintroducetheMemoProBenchbenchmark:egocentricvideopairedwithacontrolled,distractor-richyear-longmemoryoftheuser'spast(~618Ktokensonaverage),spanningeverydayscenarios(kitchen,shopping,commuting)andreasonstospeakup(restocking,safetyhazards,unfinishedtasks).Eachsampleisannotatedwithahuman-verifiedtriggerwindowfixingwhenaresponseisdueandaground-truthreminderfixingwhatitshouldsay;aclipcountsascorrectonlywhentheassistantspeaksonce,insidethatwindow,withgroundedcontent.Thebenchmarkalsoincludesclipsonwhichnothingwarrantsaresponse,soabstentionismeasuredratherthanassumed.Becausethememoryissynthesizedunderourcontrol,wecanconstructconditionsthatnaturalisticdatadoesnotadmit,aboveallsupplyingasample'sexactjustifyingevidence.

Thisenablesustorunacontrolledstudyofwhatthetaskactuallydemands:a2×2overmemorycontent(oracleevidencevs.retrieval)andtiming(givenvs.chosenbytheassistant;Section4).Twofindingsemerge.First,everymodelweevaluateperformspoorly(atmost15%),includingfrontiermodelsgivensummarizedorretrieval-augmentedmemory,sothegapisnotanartifactofmodelscale.Second,thetwoaxesare

3

independentlynecessary:withoracleevidencedeliveredinsidethetriggerwindowGPT-5.3-Chatreaches96.0%,butonly38.0%ifitmustchoosethetimingitself,and15.3%iftheevidenceisretrievedratherthangiven.Generationisnotthebottleneck;deliveringtherightmemoryattherighttimeis,anddroppingeitherfactoriscatastrophic.

Guidedbythis,wedesignMemoProAgentwithaplug-and-playharnessthataddressesbothaxesatonce.MemoProAgentorganizestheuser'spastintoepisodicandsemanticmemoriesasagraphandtraversesittosurfacememoryrelatedtothecurrentscene;agatethendiscardswhatisaccuratebutnotworthinterruptingfor,sothegeneratorseesevidenceonlywhenareminderiswarranted.AlightweightRLpost-trainingstageadaptsthegeneratortotheharnessandcurbsearlyandrepeatedfiring.MemoProAgentraisesstrictaccuracyfrombelow10%to37.5%onanopen-sourcemodeland38%onGPT-5.3-Chatwithnotrainingatall;post-trainingreaches42.4%.

Insummary,ourcontributionsareasfollows:

·Weidentifywhatmakesmemory-drivenproactiveassistancehard.Acontrolledfactorialstudyseparatestheproblem'stwoaxesandshowstheyareindependentlynecessary:removingeithercollapsesperformancefroma96%oracleceilingto38%and15%respectively.

·Webuildtheinstrumentthatmakesthismeasurable:theMemoProBenchbenchmark,pairingegocentricvideowithyear-long,distractor-richpersonalmemoriesandhuman-verifiedtriggerwindows,withaprotocolthatscoreswhether,when,andwhatanassistantsays,andcreditsasystemonlyifitstayssilenttherestofthetime.

·Weshowthediagnosisisactionable.MemoProAgent,builtonaplug-and-playharness,retrievesfromagraph-organizedmemoryandgatestheresultonwhetheritjustifiesinterrupting—notmerelywhetheritisrelevant—liftingstrictaccuracyfrombelow10%to37.5%onanopen-sourcemodeland38%onGPT-5.3-Chatwithoutanytraining;alightweightRLstagereaches42.4%.

2RelatedWork

Memoryaugmentation.Memoryaugmentsamodelwithknowledgebeyonditscontext,retrievedfromanexternalstoreand,inrecentsystems,organizedasalong-termepisodicandsemanticrecordofauser'spast(Guuetal.,2020;Karpukhinetal.,2020;Lewisetal.,2020;IzacardandGrave,2021;Asaietal.,2024;Edgeetal.,2024;Packeretal.,2023;Parketal.,2023;Zhongetal.,2024;Huangetal.,2026;Yangetal.,2025;Linetal.,2025;Longetal.,2025;Yeoetal.,2025;Luoetal.,2025;Jiangetal.,2025).Acrossthislinethequeryisinhand:memoryisretrievedtoanswerorgroundanexplicitrequest,andsuccessismeasuredbythequalityofthatanswer.Inoursettingthereisnoexplicitquery;thesystemmustcontinuouslyinteractwithitsmemoryasthesurroundingsunfoldanddecidewhethertointerveneatall,sotheevidencemustbefoundbeforeitcanbeused.

Proactiveassistance:settings,evaluation,andmethod.Proactiveassistantsdifferinhowmuchofwhatto

sayishandedtotheminadvance(Table1).Inmostsettingstheevidencelicensingaresponseisgiven,soonlythetimingiseverinquestion:priorworksuppliesanexplicitquestionatfixedtimestamps(Linetal.,2024;Niuetal.,2025;Wangetal.,2025d),aquestionansweredatamodel-chosentime(Wangetal.,2025a),

atask-guidancegoal(Zhangetal.,2025),orashortuserprofile(Ranetal.,2026).¹Becausethecontentisgiven,theirevaluationgradesmainlytiming:needlessspeechisscoredasanaggregateprecisionterm(Zhangetal.,2025;Gongetal.,2026),andhit-stylemeasurescreditanyintervalcontainingonecorrectresponse(Ranetal.,2026).Theirmethods,inturn,learnwhentospeakfromthesuppliedcontent(Chenetal.,2024;Wang

etal.,2025b),somewithreinforcementlearning(Wangetal.,2025c;Ranetal.,2026).Oursettingremovesthisgiven-contentassumption:withnoqueryandtheevidenceburiedinalongpersonalmemory,thesystemmustfindwhattosaybeforeitcandecidewhen,whichforcesevaluationtogradecontentandtimingjointlyandrequiresamethodbuiltforretrievalratherthangivencontext.Mostsimilarisconcurrentwork(Gongetal.,2026),whichproposesEgoServe,abenchmarkforproactiveassistanceovercontinuousegocentricvideo,withthetraining-freeEgoMemoagent.Wedifferintwoways.Atthememorylevel,ourcontrolledmemory

¹Ranetal.(2026)capthegeneratedper-videousermemoryat10-35words(theirAppendixA.5).

4

Table1Proactiveassistancesettings,bywhatthesystemisgivenandwhattheevaluationmeasures.Query-free:

noexplicituserqueryatinference.Personalmemory:kindandtypicallengthofpersistentusercontext.Retrieval:

relevantevidencemustbefoundratherthansuppliedincontext.Timing:responsetimingisgraded.Content×Timing:theevaluationseparatescontentfailuresfromtimingfailures.√yes,opartially,Xno.tConcurrentwork(arXiv,July2026).

Benchmark

Personal

memory

Query-

free

Retrieval

required

Timing

graded

Content×

Timing

Query-drivenstreaming

StreamingBench(Linetal.,2024)OvO-Bench(Niuetal.,2025)

OmniMMI(Wangetal.,2025d)

ProactiveVideoQA(Wangetal.,2025a)

—一

x

x

o

x

x

x

X

x

D

O

o

x

X

X

X

Query-free,withpersistentcontertProAssist(Zhangetal.,2025)

EgoPro-Bench(Ranetal.,2026)EgoServe(Gongetal.,2026)

taskgoal~30tok

videostream

√

√

√

x

x

√

v

√

√

x

x

X

MemoProBench(ours)

~618Ktok

√

√

√

√

enablesacontrolledstudythatpinpointswhysystemsfailandshowsthatsuccessrequirestherightmemoryattherighttime(Section4),whicharealmemorydoesnotpermit.Atthemethodlevel,whereGongetal.(2026)letthegeneratordecideateverystepwhethertointerveneandfindthatmostsystemsperformpoorly,weaddagatethatfiltersdistractingmemoryandapost-trainingstagethatlargelymitigatesthisweakness(Section5).

3TheMemoProBenchBenchmark

WeintroduceMemoProBench,abenchmarkformemory-drivenproactiveassistance(MPA).Unlikereactivebenchmarksthatpairanexplicitquerywithatargetanswer,MemoProBenchasksasystemtowatchanegocentricvideostream,consultalong-termmemoryoftheuser'spastexperiences,andemitagroundedproactiveinterventiononlywhenwarrantedandonlyattherighttime.Wefirstformalizethetask(Section3.1)anddefinetheevaluationmetrics(Section3.3);thedataconstructionpipelineisdeferredtoAppendixC,withhumanannotationdetails(annotatorcount,reviewquestionsandresponsedistributions,verdictaggregation,andacceptancerate)inAppendixC.1.

3.1ProblemDefinition

Setup.Aproactiveassistantobservesauser'sexperienceasanonlinemultimodalstreamV=(u1,v₂,…),wherevtistheobservationattimestept,andhasaccesstoalong-termmemoryM²accumulatedfromtheuser'spastexperiences.Thesettingiscausalandquery-free:ateachtimesteptthesystemconditionsonarecentobservationwindowVt-n:t=(vt-n,…,vt)togetherwithM,andreceivesnoexplicituserquery.

Task.Wemodelthesystemasanalways-oncausalpolicyπthatateverytimestepemits

Tt=π(M,Vt-n:t)∈{8}UA,

whereAisthespaceofnatural-languageinterventionsandødenotesstayingsilent.Thesystemstayssilentmostofthetime;itsmeaningfulbehavioristhesparsesetofinterventions

E(π)={(ti;ai):Tt≠x},

eachspecifyingwhattosay(ai∈A)andwhentosayit(t;).

2HowasysteminteractswithM(howitisorganized,andwhetheritisaccessedby,e.g.,summarizationorretrieval)isitselfpartofthetaskandlefttothemethodunderevaluation.

CToams2lt

Maintenance

13.0%

1

9.8%

(a)Scene(b)Reminderreason(c)Duration

Figure2StatisticsoftheMemoProBenchevaluationset:(a)sceneand(b)reminder-reasondistributions,and(c)

trigger-windowandvideodurations.

Correctness.Thelong-termmemorydeterminesasetofadmissibletriggerwindows

W(M)={W₁,..,Wm},

whereeachwindowW;correspondstooneworth-interveningmatter,withstartandendtimest,andt号.Ifamatter'stargetappearsintermittently(e.g.,visibleover2-8sandagainover40-48s),W;isdefinedbyitsfirstappearance(2-8shere):thedesiredbehavioristointerveneattheearliestappropriatemoment,andlaterreappearancesdonotopennewwindows:oncethatearliestappropriatemomenthaspassed,re-raisingthesamematterisaredundantinterruptionratherthananewopportunitytohelp.InMemoProBench,visiblesegmentsseparatedbyatmost8saretreatedasoneappearance,andeachclipcontainsexactlyonesuchwindow(AppendixC).Anintervention(ti,ai)∈E(π)iscorrectifitfireswithinitscorrespondingwindow(ti∈W;)anditscontentisfaithfultotherelevantmemoryandgroundedinthecurrentframee(JUDGE(a;|m;,Vt;)=1,wherem;≌Mistheevidenceattachedtowindowj);otherwiseitisincorrect.Theedesiredbehaviorisexactlyonecorrectinterventionperwindowandsilenceelsewhere:firingoutsideW;isearly-orlate-triggering,andrepeatedfiringisover-triggering.

3.2DataStatistics

Ourfullbenchmarkcontains1,804datapairs,splitinto904fortraining,100fordevelopment,and800forevaluation;wewillreleasetheevaluationsetandtheMemoProAgentcodeuponpublication.Eachpairconsistsofanegocentricvideoclip,drawnfromEgo4D(Graumanetal.,2022),withasingletriggerwindow(theintervalinwhichaproactiveinterventioniswarranted),togetherwitharealistic,year-longper-sonalhistory.Thehistoryisastreamoftimestampedfirst-personcaptions([V]forvisibleactions,[C]forconversationalcontent)thatmixmain-arcmilestones,

Table2Memoryhistorystatistics.

Memoryhistory

Mean(min-max)

Timespan(days)Events

Captions

Tokens(w/timestamps)

362(330-365)946(641-1,020)

28.1K(19.7K-34.3K)618K(437K-762K)

TargetmemorytokensTargetmemoryshare

1.2K(0.4K-3.4K)

0.19%(0.06%-0.57%)

Obe

Safety

9.0%

17.4%

Duration(s)

Mean

200

150

100

72s

50

24s

TriggerVideo

window

250

0

persona-derivedinterests,neutraldailydistractors,andtheevidencethatjustifiesthereminder(seeAp-pendixD.3fortheeventtypesandrenderedexamples).AssummarizedinTable2,eachhistoryspansaboutayearandislong(~618Ktokens),whilethetargetevidenceisonly~0.19%ofit,sotherelevantevidenceishardtofind(AppendixD.4).Figure2showsthedistributionsofscenesandreminderreasons,andthetrigger-windowandvideodurations(onaverage,trigger-window/videoratio~0.33).Figure3showstwosamples;morearegiveninAppendixD.2.Thebenchmarkalsoincludes150negativeclips,constructedbyremovingthetargetmemoryfromtheuserhistory,onwhichnothinginmemorywarrantsaninterventionandtheonlycorrectbehaviorissilence,soanyfireispurecost.

6

Semantic:You'resensitivetocaffeine—concentratedtabletstendtocausejittersandkeepyouup,soyouavoidthem,especiallylaterintheday.

Episodic·7daysago:Youtriedcaffeinepillsrecentlyandfeltwiredforhoursafterward,whichmessedwithyoursleep.

Referencereminder:“Youfeltuiredlasttime;skiptheseandchooseteaorasmallcoffee.”

Kitchen&Dining·Verification

Window22-33s

Episodic·6daysago:Youoncestartedthecoffeemakerwithoutamugunderthespoutandhadtocleanuptheoverflowafterward.Episodic·20daysago:Anothertimeyougrabbedamugthathadaspoonandoldcoffeeinit,andyourdrinktastedoffuntilyouswappeditforacleanone.

Referencereminder:“Grbeforestarting.”

ab

a

clean

mug

and

place

it

under

the

spout

Figure3TwoMemoProBenchsamples.Eachcardshowsframesfromthetriggerwindow,theusermemorythatjustifesanintervention(episodicmemorieswiththeirage,orsemanticmemories),andthereferencereminder.Thememoriesshownarehigh-leveleventdescriptions;inthebenchmarktheyarerenderedintothecaptionstreamthatthesystemreceivesasinput(AppendixD.3).MoreexamplesareinAppendixD.2.

3.3EvaluationMetrics

EachinstanceinourdatasethasasingletriggerwindowW=[ts,te],sowestatethemetricsperclip.Let{f1,…,fk}bethetimestampsatwhichasystemfires.FollowingSection3.1,afireiscorrectifitisin-uvindow(ts≤fi≤te+δ,therightmoment,withatimingtoleranceδdefinedbelow)anditscontentisGooD,i.e.theinterventionaf:isjudgedsensiblebyanLLMjudge³conditionedonthewindow'sevidencemMandthee

currentobservationvf:(JUDGE(af:|m,vf:)=1,therightcontent).

Clip-levelbehaviors.Wethensummarizeasystem'sfiringbehavioroneachclipwiththefollowingmeasures:

·Hit:thecliphasatleastonecorrectfire(3fi∈ts,te+δ)withGoODcontent),i.e.thesystemeversaystherightthingattherighttime,ignoringanyextraormistimedfires.

·Early-trigger:thesystemfiresbeforethewindow(3fi<ts),i.e.itspeaksbeforethereminderiswarranted.

·Late-trigger:thesystemfiresafterthewindow(3fi>te+δ),i.e.itspeaksoncethemomenthaspassed.

·Over-trigger:thesystemfiresmorethanonce(k>1),i.e.itinterruptstheuserrepeatedly.

·Perfect(primarymetric):thesystemfireseractlyonce,in-windowandGooD,i.e.aHITwithnoearly-,late-,orover-trigger:

Timingtolerance.Sincethesliding-windowparadigmdecidesonlyevery2s(Section4.1),afireatthefirst

decisionstepaftertemaystillbetherightmoment;wethereforesetδ=2sbydefault.

Requiringexactlyoneinterventionisdeliberate.Becauseeachutteranceisaninterruption,repetitionisafailureevenwhenthecontentisright:anassistantthatdeliversthecorrectreminderthreetimeshasinterruptedtheusertwicefornothing.Unlessotherwisenoted,wereportPERFECTasthemainmetricandbreakdowntheotherbehaviorsabove,togetherwiththeaveragenumberoffiresperclip,toshowwhereasystemlosesperformance.

4PreliminaryFindings

Tostudyhowexistingproactiveimplementationsbehaveandwheretheyfallshort,wefirstconductapreliminarystudyaroundtworesearchquestions:RQ1,doeshavingthememorysuffice?Wegiveexistingassistantsthelong-termmemoryinthemostdirectwaysavailable:allofit,asummaryofit,orretrieved

3ThepromptoftheLLMjudgeisshowninAppendixH.

(b)Streamingparadigmonedecisionevery1s;KVcachereused

Systemprompt.taskinstructions+[MEMORY]

framesand

pastanswersretained

t+1s

t+2s

upto30turns(oneframeeach),thenthelatest4arekeptandanewchunkstarts

Observe.<observe>textobservationofthecurrentview→retrievalquery

Decision.(Alreadyspoken:{pastinterventions}+kevidence>forretrievalmethods)→{intervention}orNO_REMINDER

(a)Sliding-windowparadigmonedecisionevery2s

Systemprompt.taskinstructions+[MEMORY]

Visualinput.t-3t-2[

4fames

t+2s

t+4s

Observe.<observe>textobservationofthecurrentview→retrievalquery

Decision.Alreadyspoken:{pastinterventions}+<evidence>→{intervention}orNO_REMINDER

freshwindowateachdecision

Staticmemory(noObserveround.no<evidence>)None:[MEMORY]isempty

All-history:[MEMORY]=chronologicallife-log(sliding-windowonly)

Summary:[MEMORY]=memorysummary

ans={intervention}orNO_REMINDER

Retrievedmemory([MEM

温馨提示

  • 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
  • 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
  • 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
  • 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
  • 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
  • 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
  • 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。

评论

0/150

提交评论