版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
STATEOFAIREPORT.
October8,2026
NathanBenaich
AIRSTREETCAPITAL.
stateof.ai
Introduction|Research|Industry|Politics|Safety|Predictions|1
Abouttheauthor
NathanBenaich
GeneralPartnerofAirStreetCapital,investinginAI-firstcompanies.
profluentIIElevenLabs⃞Recursion.
nathan@
stateof.ai
2026
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|2
Welcometothe9thannualStateofAIReport
Analyzingthelast12monthsofAIresearch,industry,politics,safetyandpredictions.Independentlycraftedeveryyearsince2018.
InformsconversationaroundAItodayanditsimplicationsforthefuture.Freelyavailable
atwww.stateof.ai
PeerreviewedbymembersoftopAIlabs,startups,policyandacademia.
Introduction|Research|Industry|Politics|Safety|Predictions|3
Whatyouneedtoknowfromthe2026StateofAIReport
Research
●Anthropic,OpenAI,andGoogleleadasbenchmarkssaturate.Betterpost-training,data,evaluations,andscaffoldingexpandagentcapabilities.
●AIacceleratesAIdevelopment:Claudeled26%ofAnthropic'smeasuredmodelR&Dundersupervision.Choosingworthwhileexperimentsisthenextfrontier.
●PhysicalAIapproachesitsGPT-2moment,openmathematicsproblemsfall,andAI-assisteddrugprogramsreachPhase3asdataandmodellicensinggrows.
Industry
●Agentuseandmonetizationbroadensbeyonddevelopers.AGeniusBarforAIcouldhelpmorepeopleextractvaluethroughbettertoolsandsetup.
●OpenAIandAnthropicreportcombinedannualizedrevenuerunratesofroughly$105Bacrosstheirbusinessesandinferencebusinessskyrockets.
●TheSaaSpocalypseexposesuncertainwinners.Financing,power,andconstructionconstrainsupply,whileourdata-centerNIMBYismpredictionplaysout.
Politics
●USmodelexportrestrictionsmakeaccessconditional.ThesuperintelligenceagendaandPentagondisputesharpenthefightoverAIcontrol.
●SelectedsovereignAIpledgestotalabout$138Bascountriesrealisetheycannotrentsovereignty.Manywillhavetobargainforaccesstothefrontier.
●Frontier-lableaderscallforslowercapabilitygains,withnoagreementonwhocanrequirepauses,authorizerestarts,andverifycompliance.
Safety
●Duringreduced-safeguardevaluations,OpenAIagentsattackedHuggingFacewhiletryingtocheattheirscorer.
●Anthropicdocumentsmisuseincyberattacks,surveillance,scams,andweaponsdevelopment.
●Frontierattacksrequirefrontierdefense.GuardrailsblockedHuggingFace'sforensics,leadingittouseaChineseopen-weightmodel.
●Reasoning-onlymonitorsmissedsabotageintests.Valuestrainingcutfictionalblackmailfrom65%to19%,withproductionreliabilityunproven.
stateof.ai
2026
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|4
Section1:Research
stateof.ai
2026
Introduction
|
Research
|
Industry
|
Politics
|
Safety
|
Predictions
|5
12monthspass,andthefrontierfightisnowathree-labrace
OnArtificialAnalysis’sIntelligenceIndex,ClaudeOpus5.5leadsat58,andGPT-6AstraandGoogle’sGemini4Argontieat53.OnArena’sdefaultranking,builtfrompeople’svotes,Argonleadsat1525,atightpackofClaudemodelsfollowsatabout1505andOpenAI’sbest,GPT-5.6Sol,ranks#20.China’sbestopen-weightsmodel,
Xiaomi’sMiMo-V2.6-Pro,scores46ontheindex.Argonissofaronlyavailabletoselectedusers.
IntelligenceIndex,bestmodelperlab
Arenadefaultview,bestmodelperlab
Introduction|Research|Industry|Politics|Safety|Predictions|6
Chineseopen-weightmodelsovertookAmericanonesinAIresearchpapersin2026
WeanalyzedAIpapersonarXivmentioning21modelfamilies.WhileclosedUSmodels(GPT,Claude,Gemini)
accountfor42%ofmentionsin2026,theyarelosinggroundtoChinesemodels.ZetaAlphaanalysisrevealsthatamongopen-weightmodels,Chinesefamiliessurgedfrom9%ofmentionsin2024to31%,USmodelsfellfrom31%to23%,andQwenovertookLlama.
Allmodels:shareofmentionsbyregion(%)Open-weightmodelsonly(%)QwenvsLlama(%)
stateof.ai
2026
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|7
Samemodel,betterharness=strongeragent
Witheachmodelfixed,changingtheharnessdelivereda6xgainonSWE-BenchMobile,whileMeta-HarnessraisedHaiku4.5from27.5%withClaudeCodeto37.6%onTerminalBench-2.Meaningfulmodelcomparisonsrequiredisclosingtheharnessandholdingitfixedorvaryingitsystematically.
●OnWeaveBench,LongHorizon-HarnessimprovesQwen3.7-Plusenoughtoexceedthebaseline
performanceofOpus4.7.
●Acontrolledtestpairedthreemodelswiththree
harnesseson100SWE-benchVerifiedtasks.GLM-5.1rosefrom52.5%to65.5%betweentheminimalandfullharnesses.Harness-inducedperformance
variancewas
7.8xmodel-inducedvariance
inthisexperiment.
Figure2(b),mathpanels.200taskspermodel.Circleareasareschematic.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|8
Agentsimprovebychoosingamongspecializedharnesses
Asingleharnesscanworkwellonaverageyetmisstasksthatneedadifferentapproach.ResearchersatMeta,
DukeandUCDavisevolvetwoharnessesondifferentdevelopmenttasks,thenchooseoneforeachnewproblem.Withtheexecutionmodelheldfixed,thisimprovesheld-outmathandcodingresultsoverMeta-Harness.
●WithGemini3Flash,thebranchesshare47%coverage,buteachsolvessomeproblemstheothermisses.
●Therouterreaches62%onGeminimathversusMeta-Harness's46%,belowthebranches'
combinedpotentialcoverageof67%.
●Codingalsoimproves:Terminal-Bench2.0risesfrom44.8%to50.0%,andSWE-benchLitefrom63.6%to66.0%,withSonnet4.5fixed.
Differentproblemssolvedbyeachbranch
Introduction|Research|Industry|Politics|Safety|Predictions|9
Recursivelanguagemodelstreatpromptsaspartsoftheenvironment
Longinputscanoverwhelmamodelevenbeforetheyfillitscontextwindow.MIT'sRecursiveLanguageModels(RLMs)keeptheinputinacodeworkspace,wherethemodelcaninspectitanddelegatepiecestofurther
(recursive)modelcalls.Thisletsafixedmodelworkthroughinputstoolargetoreadinonepass.
●TheauthorstrainedQwen3-30B-A3BwithRLon
shorttasksandfoundtransfertomuchlongerinputsandnewdomainssharingadecompositionstrategy.
●Theauthorsexplainthisasturningunfamiliartasksintofamiliarsubproblems:eachmodelcallstays
“locallyin-distribution”withitstraining.
●Transferdependsonlearningareusable
decomposition,andRLMsarenotuniformlycheaper.Recursivecallsusefixedweightsatinference.
Readlargeinputsthroughcodeandsmallermodelcalls
Storetheinputoutsidethemodel
Keepdocumentsinapersistentcodeworkspace
Inspect,splitanddelegate
Codecallsmodelsonselectedpiecesoftheinput
Saveintermediateanswersandassembletheresponse
Combinetheresults
stateof.ai
2026
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|10
Skillsandmemoryletagentsreuseknow-howwithoutretraining
Skillspackagereusableinstructionsandcode,whilememorypreservesinformationforlatertasks.Theselet
developersimproveanagentbetweenmodelreleasesbychangingwhatitcanreuse.Papersmatchingthebroadskillsqueryrosefrom152to1,486inJanuary-August2025and2026.
Memorytoolmatches,Jan-Aug2026
Skillspapermatches,Jan-Aug2025vs2026
Introduction|Research|Industry|Politics|Safety|Predictions|11
stateof.ai
2026
Karpathy’sautoresearchpopularizedtherushtorecursiveself-improvement(RSI)
RSIisthepursuitofAIthatbuildsbetterAI,autonomously.InMarch,AndrejKarpathyreleasedautoresearch,a
projectinwhichanagenteditsthetrainingcodeofasmallnanochatmodel,trainsforafixedfiveminutes,keepswhatimproves,andrepeatsroughly100timesovernightononeGPU.Theuseredits
program.md
,theinstructionsthatdefinetheresearchorg.AsKarpathyputit:“Thisrepoisthestoryofhowitallbegan.”
●Thereporeachedroughly95,000GitHubstarsand13,400forksin5months.
●Afixed5-minutetrainingbudgetmakeseveryexperimentcomparableandturnsoneGPUintoroughly100experimentsanight,scoredonvalidationbitsperbyte.
Introduction|Research|Industry|Politics|Safety|Predictions|12
stateof.ai
2026
We’reseeingarapidgrowthinself-improvementpapers
Papersmatchingverifiablerewardsgrew10.4xinJanuary-August2026versusthesamemonthsof2025,
comparedwith2.7xforRSI.Thepracticalopportunityistoautomateexperimentswithreliablescoring.Choosingvaluableresearchquestionsremainsaseparate(andveryvaluable)problem…
NarrowRSIquery:2.7x
Growthinpapermatches,Jan-Aug2026/2025
Introduction|Research|Industry|Politics|Safety|Predictions|13
stateof.ai
2026
Agentscanimprovetheirownscaffolds,butaccelerationisunproven
DarwinGödelMachinerewritesanagent’sscaffold:theprompts,toolsandworkflowaroundafrozenmodel.
Hyperagentsalsorewritetheprocedurethatmakesthoseedits.Thiscanautomatemoreofagentengineering,butabetteragentdoesnotnecessarilybecomeabetterinventoroffutureagents…yet!
●Huxley-GödelMachineselectsagentsbytheir
descendants’scores.WithGPT-5,itfixed57.0%ofSWE-benchLiteissuesvs.SWE-agent’s56.7%.
●RedQueenco-evolvesagentsandevaluators.Itspaperacceptancerateroseto38.8%vs.HGM-H’s21.8%at
matchedsearchcost,asratedbyAIjudges.
●Wecoreportsbeatingitshand-tunedagentin100
trials.Usingthenewagenttoimprovefurtheragentsgavenosignificantefficiencygain,however.
Makingtheimprovementprocedureeditable
Introduction|Research|Industry|Politics|Safety|Predictions|14
stateof.ai
2026
Strongermodelscanoutgrowtheirharnesses
Manyharnesseshaveincludedelaboratebehavioralrules,remindersandplanningmechanismstocompensateforoldmodellimitations.However,asmodelsbecomemorecapableandsuccessfulagentbehavioristrainedback
intothem,theseworkaroundsbecomeredundantandcanevenhobblestrongermodels.Harnessesshouldprovideinterfacesthatmaketheenvironmenteasiertoacton,withoutaddingredundancyinmodelbehavior.
●ClaudeCoderemoved80%ofthesystempromptforadvancedmodels,withnomeasurablelossoncodingevaluations.Few-shottooluseexamplesarealsofoundtoreduceexploration,withgoodinterfacedesignbeingmoreimportant.
●Harnesseshavebecomecurricula,wheretrajectoriesproducedinsideanevolvingharnesscanupdatemodelweights(seeContinualHarness).RecentGPTmodelsaretrainedonthecodexharness.
●Performancebetweenlightweightandsophisticatedharnessesshrinkasmodelcapabilityimproves:thedurableharnessinvestmentsthatremainareenvironmentinterfaces(tools,MCPservers),state
management,observabilityandagentinfrastructure(sandboxes,runtimes,etc).
Introduction|Research|Industry|Politics|Safety|Predictions|15
AgentsapproachofficialinstructscoresonPostTrainBench’srevisedevaluation
PostTrainBenchtestsautonomouspost-training:eachruntargetsonesmallbasemodelandonebenchmark,with
10hoursononeH100.Version1.2coversfourbasemodelsandsixbenchmarks.Resultsmeasuretask-specific
optimization;theofficialinstructmodelsarereferencepointstrainedwithdifferentresources.
●Onv1.2,Fable5.1scores44.6%,Opus5.543.8%andGPT-6Astra41.9%,versus48.4%forofficialinstructmodels.
●BFCLwasremovedaftertask-qualityand
item-targetedtrainingconcerns.Theformer95%resultisinsufficientevidenceofgeneral
function-callingsuperiority.
●Thesearebenchmark-specificmodeladaptations,
notonebroadlyimprovedassistant.FiveFable5.1
GPQArunsOpusasa.
used5fallback
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|16
stateof.ai
2026
Frontieragentssustainmulti-dayresearchwithlimitednoveltyinaspeedrun
PrimeIntellecttested18modelsin153runsonthenanoGPToptimizerspeedrun:traina124M-parameterGPTtoatargetlossof3.28infewersteps.Runsused8xH200GPUswithoutinternet.Fable5'sbesttrajectorylasted
8.7days,withlimitednoveltyreportedinthissetting.
●Fable5reached2,726stepsfroma3,290-stepbaseline,closing81.7%ofthegaptoa2,600-stephumanrecordclaim.
●Researchbudgetsdiffered:after24hours,Fable5hadreached3,010steps,versus3,045forOpus5.
●Strongagentsre-testedborderlineresultsacrossseedsandrevisitedearlierfailures,butlimitednoveltyheredoesnotestablishagenerallimitonAIresearch.
Introduction|Research|Industry|Politics|Safety|Predictions|17
Canagentsproduceatop-tierresearchpaper?No,buttheycandoitsengineering.
Researchersintroducedshadowevaluations,inwhichtheygiveanagentthecentralresearchquestionofahigh-qualityunpublishedNeurIPSsubmission(socontaminationisimpossible)andletthepaper’soriginal
authorsgradetheoutputasreviewers.Eachagentgotsixdays,$3,000ofAPIcredit,GPUsandtheopenweb.
●Opus4.8completedalltheengineeringwithouthumanhelp,butbothitspaperswerescored2/6and1/6-
unambiguousrejections.
●Fivefailuremodesrecurred:nosenseofthepublishablebar,uncreativefixes,ineffectivebacktracking,poor
resourceawarenessandinstructiondrift.
●BothrunsendedwithunderhalftheAPIbudgetspent,despitethemodelsknowingtheirusageinreal-time.
●Self-reviewbyagentsneverreturnedanacceptancein
weresameonesthehumanreviewerslaterraised.
dozensofroundsandtheissuesitflaggedoftenthe
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|18
stateof.ai
2026
Theworkofsmartermodelsisincreasinglyacceptedbylab’sstaff
InanessayonbuildingRSI,Anthropic(leftchart)shareddataonthecodecontributionsoftheiremployees.Theoutputhasincreasedby8xinQ22026comparedtopre-2025,correspondingwiththeuseofMythosPreview.OpenAIseesthesameresultstoo(rightchart).
Introduction|Research|Industry|Politics|Safety|Predictions|19
…andstartssuggestingwheretheresearchshouldgonext
Evenmoreinterestingly,researchersratednext-directionturnssuggestedbyMythosPreviewasbetterthantherouteahumanresearcherpicked64%ofthetime.Thissuggeststhatfrontiermodelsaregeneratingquality
contributionsthatexhibitresearchtaste.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|20
ClaudenowleadsaquarterofAnthropic’smodelR&D,withhumanssupervising
Anthropic’sinternalautomationindextrackshowmuchresponsibilityClaudetakesonacrossmodelR&D.Thesharerated“AIleads”rosefromunder1%inFebruaryto26%inAugust2026:Claudecompletesmostofataskfromahigh-levelpromptwhileahumansupervises.Morethan90%ofmeasuredworknowinvolvessubstantialAIcollaborationorleadership,butnoneisfullyautonomousyet.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|21
Within6months,OpenAIresearchersaresolvingmuchlongertasksautonomously
InJanuary2026,OpenAIresearchersusedAIagentstoautonomouslycompletetasksnormallyrequiring4-8hoursofhumanlaborwithan18%successrate.ByJuly2026,thatsame18%successratewasachievedonsignificantlymorecomplextasksrequiring32-64hoursofhumanlabor.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|22
Butcodingagentsaremostlyusedpost-experimentalideationanddesign
Sofar,themajorityofcodingagentuseinOpenAIinternalresearchhasbeenonexecution-relatedworkflows,namelyworkingonresearchinfrastructurecode,launching,monitoringanddebuggingruns,andtechnicalhelpandreview.Decidingwhattoresearchandhowtodoitisstillnotsolvedbycodingagents.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|23
stateof.ai
2026
Astaskbenchmarkssaturate,RSIevidenceismovinginsidethelabs
PublicAIR&Dsuitesnolongerruleoutadvancedcapabilitiesoncemodelspasstheirthresholdsorexploittheirscoring.Labsincreasinglyrelyoninternalevidenceofresearchacceleration.RSI-Examtests88tasksexternally,butnomodelreachesitsfrontier-calibratedreference.
●METR’sOpus5.5reviewcitesapreliminary
estimateof~1.5xAI-drivenresearchacceleration.Theestimatedtimeperiodisunspecified.
●OpenAIreports3.1agent-workdaysperhuman
workday.Thismeasuresactivity,notanequivalentgaininresearchoutput.
●NoamBrownestimatesabouta3xspeedup,limitedbyserialexperimentsandGPUsupply.
RSI-Exam:88tasks
Introduction|Research|Industry|Politics|Safety|Predictions|24
stateof.ai
2026
Lessshootinginthedarkasmoreofthepretrainingrecipegotwrittendown
Detailedtechnicalreports,codebasesandtraininglogsmakebuildingcapablemodelslessopaquethanthreeyearsago.Moreofthepathfrompretrainingtoreasoningandagenticbehaviorisnowpublic.Butscaling-law
guidanceisstillincomplete,andchoosingtherightdatamixremainsexperimental.Trainingastrongmodelstilltakesresearchjudgment(theinfamous“taste”)aswellasenoughcomputetotestmanyideas.
●Trainingbecomesmoreselective:Nemotron3Superuses20Ttokensforbroadcoverage,then5T
emphasizingquality.Step3.5Flashlateremphasizescode,reasoningandtooluse,retainingsomegeneraldataasitspecializes.
●Longercontextcanweakenotherskills.Aftermathscoresdippedduringmillion-tokentraining,NVIDIAaddedaphasealternating1M-tokenand4K-tokensequencestomitigatethedecline.
●Healthytraininglosscanhidefailingcomponents.StepFunfoundMoEexpertsbecominginactiveor
developingextremeinternalvalueswhileaggregatemetricslookednormal.Monitoringindividualexpertsexposedtheseproblems.
Introduction|Research|Industry|Politics|Safety|Predictions|25
TheRLrecipegotwrittendowntoo
Severalwell-documentedopenreproductionsofagentictrainingpipelineswerepublishedthisyear,achievingresultsclosetothestateoftheart.Whileopenagentmodelreproductionsremainafewstepsbehindthe
frontier,thetrickstheydiscloselowerthebarrierforanewlabtostartsuccessfullytraininganagent,withThinkingMachinesandOpenThoughtsAgentbeinggoodexamples.
●Meta’sScaleRLreports400k+GPUhoursofablationscoveringprecisionfixes(fp32logits),RLobjectivesandbatchsize.Manyfindingsreverseconclusionsfromsmallerscales.
●Cursor’sComposer2technicalreportincludesmanylong-horizonrolloutdetailssuchasupdatingbehaviourpolicyweights
mid-rollout,andfixesforsampler/trainerinconsistencysuchasMoE
routerreplay.
waysto
.
●DeepSeekMath-v2sharestheiragenticdata-generationpipelineindetailKimiK3detailstrainreasoningefforts,compatibility
withmultipleharnesses,andanti-reward-hackingmachinery.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|26
stateof.ai
2026
ScalingagenticRLcreateshugedemandforCPUsandmemoryalongsideGPUs
Long-horizonagenticRLspendsmuchofitscomputeoninference(rollouts)ratherthanbackprop,runsstatefulrolloutsagainstrealisticoftensandboxedenvironments,andmustcontinuouslysyncfreshweightsinto
distributedinferencefleetswithoutlettingtrajectoriesgostale.
●InferencedominatesRLcompute:MAI-Thinking-1,a1T-A35BMoE,uses4,096of4,864GB200sforinference,roughlyfivetimesitslearnerallocation,withgenerationsupto128ktokens.
●CPUandmemorydemandrisestoo:KimiK3used51.2Mstatefulsandboxeswithpause/resume,fork,
snapshot,andsub-secondlaunch.DeepSeek’sDSecreports30,000CPUcoresand250TBofRAMserving3Msandboxinstancesdailyinonedeploymentunit.Yet~90%ofsandboxesaverage≤5%ofrequestedCPUcapacity,makingresourcesharingandidle-memoryreclamationessential.
●Trainingenvironmentsincreasinglyresemblerealwork:KimiK3combinesmocksofGmail,Notion,Slack,andCanvaswithharnessesincludingKimiCode,ClaudeCode,andCodex.
●Inferencecanbedistributed:Composer2synchronizesweightseverytrainingstepthroughS3.Delta
compressionreducesupdatesfora1T-parametermodeltoafewGB,enablinggeographicallydistributedRLinference.
Introduction|Research|Industry|Politics|Safety|Predictions|27
Thetraininggymgetsharderastheagentgetsbetter
RLagentslearnlittlefromtaskstheyalwayspassoralwaysfail.Microsoft'sTaskPilotgeneratescodingproblemsandhiddentestsinrealrepositories,thenrevisestheirdifficultyusingthecurrentmodel'sattempts.AsFrogNanoimproves,newtaskbatcheskeepitstrainingneartheedgeofwhatitcansolve.
●Agent-Worldgenerated1,978environmentsand19.8ktoolstotrain8Band14Bagents,improvingtooluse,planningandcodingacross23benchmarks.
●FrogNanocombinesasimplertoolinterfacewithfive
batchestotaling1.5ktasks.Qwen3.5-4Bsolves61.5%ofSWE-benchVerified(validation)and37.6%ofheld-outSWE-benchProissues.
●Checksstillmatter,ofcourse.WithGPT-5.2fixed,UniversalVerifierfalselyaccepted1%offailed
computer-useruns,vs.WebJudge
WebVoyager.
7%forand10%for
Computer-usefalsepositives(internalset)
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|28
Modelscanlearnfromstrongerteachers,specialists,orthemselves
Distillationteachesastudenttoimitateateacher.Off-policyusesteacherorearlier-modelresponses,whileon-policyusesthecurrentstudent’sattempts.Self-distillationmeanstheteacherisacopyofthesamemodel.
●Cheapertransfer:AlibabacomparedtwomethodsfromthesameQwen3-8Bcheckpoint.On-policydistillationreached74.4%onAIME24using1.8kGPU-hours.Bycontrast,RLneeded17.9kGPU-hourstoreach67.6%.
●Combiningspecialists:Xiaomitrainsmath,codingandinstruction-followingteachersseparatelytoavoidinterference,thencombinestheirskillsviaMulti-TeacherOn-PolicyDistillation(MOPD).
●Learningfromitself:Self-DistilledReasonergivesafrozencopytheworkedsolution.Itguidesthestudenttokenbytokenonthestudent’sownattempt,sonolargerteacherisrequired.
Howon-policyself-distillationworks
Studentprobabilities
Matchdistributions
CurrentstudentQuestion+prefix
Frozenteacher
Question+solution
+sameprefix
CurrentstudentQuestiononly
Generate
Student’sownattempt
Teacherprobabilities
Updatestudentonly
Prefix=attemptsofar.Samestartingcheckpoint.Teacherprobabilitiesarenotcorrectnessscores.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|29
stateof.ai
2026
Frontierlabs'owncheapermodelsdecodedthereasoningtheytriedtohide
Labshidetheirmodels'reasoningbecauserivalscantrainonitusingaprocesscalleddistillation.Panfilovandcolleaguesfoundthatcheapermodelscouldrevealstrongermodels'hiddenreasoning.Providerspatchedtheflaw.Couldrestrictingaccesstothesetraceswidenthegapbetweenopen-weightandclosedmodels?
●GivenOpus4.8'sencryptedreasoningblock,Haiku4.5wroteoutthereasoninginplaintext.Thesame
attackworkedatOpenAIandGoogle.
●Areasoningtraceshowstheteacher'ssteps,notjustitsanswer.Inpriorwork,reconstructedtraceslifteda7Bstudentfrom68.4%to76.0%onMATH500.
●Closingthisextractionroutecouldmakefrontierreasoninghardertoobtainfortraining.Thepaperdoesnotestablishhowmuchrecentopen-modelprogressdependedonit,orwhetherthecapabilitygapwillwiden-wesuspectitcould.
Howhiddenreasoningwasexposed
1.Opus4.8generatesreasoning
APIreturnsanencryptedreasoningblock.
2.ReplaytheblocktoHaiku4.5
ThesameprovideracceptsOpus'sblock.
3.Haikurevealsthehiddenreasoning
Apromptinducesittowritethetraceasplaintext.
stateof.ai
2026
Introduction|Research|Industry|Politics|Safety|Predictions|30
Self-playcanlearnfromdocumentsorfromprogramsitinvents
Self-playcreatesitsowntrainingtasks,soisanappealingapproachtoAItraining.SPICEpost-trainsareasonerondocument-groundedquestions,whereaszero-dataself-playlearnsfromprograms,startingfromrandomweights.Naturaltext/DNAvalidationselectshyperparametersbutsuppliesnopretraininggradients.
SPICE:document-groundedpost-training
Qwen3-4B-Base:35.8%→44.9%overall(+9.1pp)across11reasoningbenchmarks.R-Zero:39.5%;
AbsoluteZero:40.7%underthesameevaluation.
Zero-dataself-play:syntheti
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 济宁市梁山县2025届数学四年级第二学期期中复习检测试题(含解析)
- 2026年吉林省临江市高三生物上册期末考试试卷含答案
- 2026年山东省海阳市高三生物上册期末考试试卷(含答案)
- 济南市长清区2025届四年级数学第二学期期中学业质量监测模拟试题含解析
- 整模脱模工测试验证竞赛考核试卷含答案
- 火工品检测工岗前基础培训考核试卷含答案
- 船舶起重工安全宣教能力考核试卷含答案
- 选煤工操作能力强化考核试卷含答案
- 脂肪醇生产操作工决策判断评优考核试卷含答案
- 园林绿化工工作流程评优考核试卷含答案
- 6.3 文化自信日益增强课件(25张内嵌视频)- 2026-2027学年统编版道德与法治九年级上册
- 2026算法推动下新大众文艺发展研究报告
- 2026年秋季开学初中开学第一课(感恩教育)课件
- 新人教版二年级上册数学总复习教案
- 免疫与免疫规划课件-2026-2027学年八年级上册生物学人教版
- 肛肠术后疼痛的护理社会支持
- 2026年某大型央企十五五企业级数据编织(Data Fabric)架构与主动元数据管理平台初步设计方案新版
- 火电厂施工方案大全
- 消防监控室值班服务方案
- 原材料质量控制措施
- 中国航空工业集团校招面试题及答案
评论
0/150
提交评论