2025人工智能与物理世界的融合研究报告 AI in the Physical World

a

AIinthePhysicalWorld|3

AbouttheReport

Thisreportexaminestheconvergenceofartificialintelligencewiththephysicalworld,analyzingrecent

breakthroughsinAImodels,computinginfrastructure,sensortechnologies,andintegrationsystemsthataremakingourenvironmentmoredigitized,efficient,andautonomous.

Drawinguponacomprehensivecompilationofthelatestresearchbreakthroughs,innovations,patents,andstartups,includingnotablecontributionsfromIndia,weprovideaglobalperspectiveontheadvancementsdrivingAIinthephysicalworld.

Theobjectivesofthisreportareto:

1.Compilerecenttechnological,research,andinnovationbreakthroughsrelevanttoAIinthephysicalworldandperceptioncomputing.

2.Comprehendthefast-paceddevelopmentstransformingourphysicalenvironmenttowardgreaterdigitizationandautonomy.

3.Revealbreakthroughsatnuancedanddeeperlevels,includingpublishedresearchpapersandfiledpatents.

4.Developbottom-upunderstandingofinnovationsthatidentifykeytrendsanddrivers,providingvaluableinsightsforfuturedevelopment.

5.ContributetobenchmarkingbreakthroughsanddevelopmentsinIndiaagainstglobaladvancements.

FocusAreas

Thisreportplacesspecialattentiononperceptioncomputing—technologiesthatenableAIsystemsto

sense,understand,andrespondtothephysicalworld.WeexaminecriticalbreakthroughsincomputeandsemiconductortechnologythatarefundamentaltorealizingAI’sfullpotentialinphysicalenvironments.

OuranalysiscovershowspecializedAIaccelerators,neuromorphicarchitectures,energy-efficientdesigns,

andadvancedpackagingtechniquesaredramaticallyenhancingprocessingcapabilitieswhilereducingpowerconsumptionanddevicesize.Theseinnovationsdirectlyenablemoresophisticatedrobotics,autonomous

systems,andedgecomputingapplicationsbyaddressingthestringentrequirementsforspeed,efficiency,andminiaturizationrequiredforreal-worlddeploymentofintelligentsystems.

6|AIinthePhysicalWorld

1

Introduction:

AIBridgingtheDigitalandPhysicalDivide

ArtificialIntelligencehastransitionedfrombeingaconceptconfinedtothedigitalrealmintoatransformativeforceinfluencingthephysicalworld.Itsintegrationintophysicalsystems

acrossdiversesectorsiscreatingunprecedentedopportunitiestoenhanceefficiency,improvedecision-making,andaddresscriticalchallengesfacedbyhumanity.AsAIcontinuesto

evolve,itisreshapingindustriesthatareintegraltothefunctioningofmodernsociety,drivingtheneedfortargetedresearchandinnovation.

RoleofAIinPhysicalSystems

Thephysicalworldencompassessystemsandinfrastructureswheretangible,real-worldelementsinteractwithcomplexprocesses.AI’sroleinthisenvironmentistoprovide

advancedanalytics,automation,andintelligencetoimproveperformance,safety,and

sustainability.ByembeddingAIintothesesystems,wearewitnessingaparadigmshiftinhowindustriesoperate,adapt,anddelivervalue.Keyareasofimpactinclude:

Manufacturingprocessesarebecomingsmarter,withAIenablingpredictive

maintenance,processoptimization,andqualitycontrol.Theconvergenceofoperationaltechnology(OT)/SCADAwithAI-drivenautomationenhancesproductivityandensuresresilience.

AIfacilitatesbetterurbanplanning,energymanagement,andutilitydistribution,makingcitiesmoresustainableandliveable.Intelligentsystemshelpmonitor

infrastructure,predictfailures,andoptimizeresourceuse.

Fromautonomousvehiclestointelligenttrafficsystems,AIoptimizesmovement,

reducesfuelconsumption,andensuressaferroads.Inlogistics,AIstreamlinessupplychainmanagementandlast-miledelivery.

AI-poweredwearabledevicesmonitorhealthmetrics,enablingpreventivecareand

personalizedtreatmentplans.RoboticsandAIinsurgeriesensureprecisionandbetteroutcomes.

AIinthePhysicalWorld|7

Smartfarmingtechniques,guidedbyAI,enhancecropyield,reducewastage,andminimizeenvironmentalimpact.Technologieslikedrones,IoTsensors,andmachinelearningaredrivingsustainableagriculture.

Autonomousshipsandaircrafts,poweredbyAI,improvenavigationandoperationalefficiency.AIalso

playsacriticalroleinensuringsafetyandmitigatingrisksinthesehigh-stakesenvironments.

AIaidsindesigningsustainablestructures,managingconstructiontimelines,andensuringsafetycompliance.SmartbuildingsleverageAItoreduceenergyconsumptionandenhanceusercomfort.

ChallengesofTakingAItothePhysicalWorld

TakingAIfromthedigitalrealmtothephysicalworldencountersauniquesetofchallenges.Explainability,orthelackthereof,remainsasignificanthurdle.Thecriticalsectorslikehealthcare,power,andaerospace

wheretrustandsafetyareparamountwouldfinditdifficulttotrustAI.Theunpredictablenatureofphysicalenvironments,withfactorslikeweatherandobstacles,canconfuseAImodelstrainedondatasets.

Hardwarelimitationsposeanotherconstraint.AImodels,withtheircurrentsize,demandsignificant

computationalpower.AccommodatingAIindeviceswithlimitedresources,suchasdronesorembedded

systems,challengesthecurrenthardwaredesigns.Furthermore,sensorreliabilityandcalibrationare

crucialforaccuratedataacquisition.InconsistentandfaultyreadingduetotemperatureorhumiditywouldunderminetheperformanceofAIsystems.Youwouldneedongoingmaintenanceandrecalibrationtoensureconsistentperformance.Real-timeresponseisessentialfortaskslikeroboticmanipulationandautonomousdriving.Itdemandslow-latencydecision-makingandfail-safemechanismstopreventaccidents.Operationalsafetyandprecisiondependonreal-timeAI.Finally,physicalAIdeploymentsinvolveongoinghardware

upkeep,softwareupdates,andsparepartslogistics.Thus,addingalayerofcomplexityandcost.

8|AIinthePhysicalWorld

2

AdvancementsDrivingAIinPhysicalSystemsinthePhysicalWorld

TheseemergingAIadvancements,asoutlinedbythisreport,significantlyreshapehowphysicalsystemswouldbedesigned,operated,andmaintained.Critically,specializedAIsemiconductorsaccelerateboth

trainingandmodelinference.ParallelGPUarchitecturesoffermassivecomputationalthroughput.EdgeAIenablereal-timeanalyticsatthesource.IntegratingitwithIoTwilltransformsmartfactoriesandcities.

Pairedwith5G’sandupcoming6G’slow-latencyconnectivity,AIwillbringscaleinautonomousvehiclesandtelemedicine.Digitaltwins,virtualreplicasofphysicalassets,apartfrompredictivemaintenanceinindustrieslikemanufacturingandlogistics,canhelpinmanyindustries4.0/5.0objectives.

Breakthroughsinnaturallanguageprocessingsupportintuitivehuman-machineinteractions,andadvancesinsensorsandactuatorsboosttheaccuracyofreal-timedecision-making.

Inventionsinadvancedmaterialsnotonlyallowflexibleelectronicstointegratedifferentshapedphysicalworldbutalsopromisetoenhancesensordurabilityandefficiency.ItwillenablerobustAIdeploymentsinharshphysicalenvironments.

Goingforwardquantumcomputingpromisesunprecedentedspeedinoptimization.Biomimicry,AIsystemsinspiredbynatureusingideassuchasswarms,self-healingmaterials,andadaptiverobotics,willbringself-organizingcapabilitiesandmakeiteasytomanoeuvreunpredictableterrains.

Additionally,advancementsinperceptioncomputingtharpromisestomergereal-timesensordata(e.g.,cameras,LiDAR,IoT)toproviderobustsituationalawarenessenablesAItodetectanomalies,adapt

behaviours,andrespondswiftlytochangingconditionsinthephysicalenvironment.

Itis,therefore,importanttotakenoteofthesedevelopmentsandtheirroleindrivingAIinthephysicalworldandpromisingusnewparadigmofresilience,adaptability,andsynergybetweentechnologyandtheenvironment—bridgingthegapbetweenexistingcapabilitiesandthetransformativesolutionsrequiredforpressingglobalchallenges.

AIinthePhysicalWorld|9

3

IntelligentPerceptionSystemsBreakthrough,Research,&

Innovation

RedefiningAI’sRoleinPhysicalEnvironments

AIinthephysicalworldmergessensordata,advancedrobotics,andspecializedcomputetointerpretandactonreal-worldphysicalenvironments.Thissectioncapturesbreakthroughs,research,patents,andinnovationinAIinthephysicalworld,withspecialattentiongiventoperceptioncomputing.

BreakthroughsinAIinthePhysicalWorld

Organization

Breakthrough

ResearchInnovation

July,2025

Tesla

RolledoutGrokAIassistant,

integratedwithinTeslavehicles,enablingusertoengagein

theconversationsviavoicecommandswhiledriving.

Model/Processor:Large

LanguageModel(xAI’sGrok),AMDRyzeninfotainment

processor

June,2025

ABB

Introducedanautonomous

mobilerobot“FlexleyMover

P603”.ItisanAI-poweredAMRforpayloadsupto1500kg.

Technology/Platform:AMRP603Platform,AI-driven

VisualSLAM,AMRStudio®4.0version

June,2025

GoogleDeepMind

IntroducedGeminiRobotics,acompactmodelthatrunsfullyon-device,achievinggeneral-

purposedexterity.Capableof

instructionslikefoldingclothes,unzippingbags,vialocalGPUsandadaptivitywithjust50–100demos

Model:VisionLanguageAction(VLA)

10|AIinthePhysicalWorld

Organization

Breakthrough

ResearchInnovation

May,2025

Microsoft

IntroducedagenticAItools

forenterpriseoperations,anAIagents,thatautonomouslyexecutecodingtasks,

scientificworkflows,anddataintegration.

Technology:AgenticAI,MicrosoftAzure

March,2025

NVIDIA

Releasedthefirstopen-sourcehumanoidfoundationmodel

withsyntheticdata(Cosmos)andphysicsengine(Newton)

totraingeneralistrobotsfasterandcheaper.

Model:NVIDIAIsaacGR00TN1,Simulation

Frameworks:NVIDIAIsaacGR00TBlueprint

OtherTechnology:Newton,open-sourcephysicsengine

March,2025

SpatialLM

Announceda3Dlargelanguagemodeldesignedtoprocess

videodataforinterpreting

scenelayoutsandspatial

relationships.Itenhances

AI’sabilitytonavigateand

understand3Denvironments.

Technology:3Dscenelayoutinterpretationandspatial

relationshipunderstanding.

March,2025

Google

LaunchedAlphaTensor-

Quantum,whichhelpsoptimizequantumcircuitstoreduce

computationalresourcesforquantumcalculations.

Model:Quantumcircuitoptimization.

March,2025

Google

IntroducedGeminiRobotics-

Helpsenhancerobots’

capabilitiesinreasoning,

interactivity,dexterity,andtaskgeneralization.

Anothervariant,GeminiRobotics-ER,offers

featureslikeadvancedworld

understanding,complextask

performance,andadaptationinnovelenvironments.

Architecture:Gemini2.0

ResearchInnovation

Breakthrough

Organization

AIinthePhysicalWorld|11

February,2025Universityof

Technology:MathematicalframeworksforAI.

Oxford;ProfessorMichael

Bronstein

AnnouncedtheexplorationofunderutilizedmathematicalframeworkstoenhancethecomputationalefficiencyofAIsystems.Thisworkrefinescomputationalfoundations,creatingleanermodelsfor

physicalAIandreducingGPUreliance.

January,2025

Model:Liquidnetworksandefficientneuralarchitectures

Massachusetts

Instituteof

Technology

(MIT);ComputerScienceand

Artificial

Intelligence

Laborator(CSAIL)

IntroducedaliquidnetworksAImodelwithfeaturessuchascontinuouspost-trainingadaptationandtheabilitytomimichumanlearning.

January,2025

Technology:GoogleGeminiLLM,Computervision,voicerecognitionfusion

Samsung

Unveiledconsumerrobot

BalliepoweredbyGoogle

Gemini,featuringcontextualvoiceinteraction,smarthomecontrol,andproactivepersonalassistance.

DeepSeek

December,2024

Algorithms:Pipeline

algorithms,optimized

communicationframework,FP8low-precision

computation,andcustomlow-levelprogrammingwithNVIDIA’sPTXinstructions.

TrainedDeepSeek-V3Mixture-of-Experts(MoE)language

modelwith671billion

parametersusing2,048NVIDIAH800GPUsthatmakeslarge-scalemodeltrainingmore

efficient,reducingresource

consumptionwhilemaintaininghighperformance.

December,2024

Materials&Algorithms:Novelfluidicactuationandlearning-basedmotion

planningforunstructuredsurfaces.

Harvard

University

RevealedasoftroboticsystempoweredbyAI-drivenfluidicsthatcantraversevariedterrain(sand,gravel,water)tocollectenvironmentaldata.

ResearchInnovation

Breakthrough

Organization

12|AIinthePhysicalWorld

Tactile&Haptics:

Lightweightsensorpatchesthatintegratepressure

feedbackwithanon-boardAIcollision-avoidancesystem.

December,2024iRobotShowcasedaroboticvacuum

withhapticawareness,allowingittodetectandgentlymove

objectslikeshoesandcableswithouttanglingorpushingthemaside.

Models&Sensors:

Ultraprecisionroboticarms

withintegratedmachine

visionandanomalydetection.

December,2024LGElectronicsIntroducedanAI-powered

manufacturingrobotfor

semiconductorassemblylines,offeringmicro-levelprecisionandreal-timedefectdetection.

November,2024AWSHPC

Services

Compute&Cloud:

AutomatedresourcescalingwithspecializedGPU/

TPUclustersformassivesimulationworkloads.

Introducedacloud-basedHPCplatformspecificallyoptimizedforroboticssimulationand

large-scaleRLtraining,cuttingtrainingtimesbyupto40%.

Algorithms:Swarm

intelligence,multi-spectral

sensorfusion,andhierarchicaldecision-making.

November,2024DARPATestedanext-gendroneswarm

fordefenseandhumanitarianmissions,leveragingadvancedAIfortargetidentification

andterrainmapping.Itrelieson“distributedperception

computing”amongtheswarmwithmulti-sensorinputacrossmultipledrones.

November,2024

Sensors&Compute:

HighdensitybatterydesignwithefficientservomotorsandcustomNLPchipsfordialogue.

UBTECHRobotics

ShowcasedanAI-drivenbipedalrobotforcommercialhospitality,capableofmultilingual

interactionsandfull-shift

operationonasinglecharge.

Models:Large-scale

physicallybasedsimulationsandmultimodalfoundationmodels.

October,2024NVIDIAIntroducedthreespecialized

softwareplatforms(DGX

platform,Omniverse,andJetsonMega)toacceleratephysicalAIforroboticstosupporttraining,simulation,andinferencewithmultimodalfoundationmodels,enhancingthedevelopmentofautonomoussystems.

ResearchInnovation

Breakthrough

Organization

AIinthePhysicalWorld|13

October,2024

Algorithms:Imitation

learningcombinedwith

knowledge-basedreasoningfordomesticenvironmentoperations.

ToyotaResearchInstitute(TRI)

Launchedaprototype

home-assistrobotcapableofgeneralizingfrom

demonstrationstoperformdailytaskslikecleaningandcookingsupport.

October,2024

Mujin

ReleasedanAI-basedsystemforreal-time3Dmotion

planninginautomated

warehouses,minimizingidletimebypredictingbottlenecksbeforetheyoccur.

Algorithms&HPC:

Distributedmotionplanningleveragingin-cloudHPC

resourcesforultra-fastpathoptimization.

October,2024

ABB

Launchedanext-gen

collaborativeroboticarmwithadvancedsafetyfeatures,

lettingitworkside-by-side

withhumansonprecisiontaskswithoutcages.

Sensors&Safety:Real-time3Dvisionandforcesensorsforcollisiondetectionand

hapticfeedback.

October,2024

Baidu

Introducedanautonomous

deliveryrobotfleetoptimizedfordenseurbanareas,featuringadvancedtrafficnegotiation

withpedestriansandvehicles.

Models:ObjectdetectionandtrajectorypredictionpoweredbymultilingualAIforglobaldeployment.

September,2024

Technical

UniversityofMunich

Unveiledacutting-edgetactilesensorarraythatmimicshumanskinsensitivity,enablingrobotichandstoperformdelicate

manipulationswithhighprecision.

Sensors&Haptics:

Highdensity,pressure-

sensitiveskinintegratedwithreal-timefeedbackcontrolforadvanceddexterity.

September,2024

EPFL

(Switzerland)

Showcasedmicro-robotsfordelicatemedicalprocedures(e.g.,targeteddrugdelivery)capableoflearningand

adaptingwithinapatient’sbody.

Sensors&Algorithms:

Embeddednanotechsensors+real-timeRLfornavigationinfluidicenvironments.

ResearchInnovation

Breakthrough

Organization

14|AIinthePhysicalWorld

Algorithms:Self-learning

perceptionmodelsand

adaptivegrasp-planningforunstructuredinventory.

September,2024CovariantRolledoutAI-drivenrobotic

pickingsystemforwarehousesthatadaptstonewitem

shapesrapidly,reducingerrorratesby30%.Itsideaof

“self-supervisedperceptionpipelineforirregularobjects,”underscoresadvancementsincomputervisionforitemrecognition.

September,2024

Models:Multi-agentRL

withscenario-basedlearninanddynamicenvironmentadaptation.

Microsoft

Releasedasimulation

platformcalled“Project

Raven”fortrainingAIagents

indisasterresponse,focusing

onenvironmentunderstandingandcollaboration.Theadvanced3Dperceptionsimulationsto

highlightthatrobustsensorinputandenvironment

modelingarekeytodisaster-responsetasks.

August,2024DeepMind+

OpenAI(JointResearch)

Models:Large-scale,

multimodalarchitecture

enablingadvancedscenarioplanningandadaptable

behaviorsinphysicalrobotics.

IntroducedLargeBehavior

Model(LBM),aunifying

approachthatintegratesLLM-basedreasoningwithmulti-

agentreinforcementlearningforreal-timedecisions.

Algorithms:Decentralized

multi-robotcoordinationwithswarmintelligenceandlocalpathoptimization.

August,2024AmazonRoboticsDeployedself-organizingrobots

infulfillmentcentersthat

coordinateinreal-timeforitemsorting,acceleratingthroughputby40%.

August,2024

Models:End-to-enddrivingpolicynetworktrainedondiversereal-worlddataforcitynavigation.

Alphabet(Waymo)

Completedlarge-scaletrialsofautonomoustaxisincomplexurbansettings,achievinga

significantdropinhumaninterventionrates.

AIinthePhysicalWorld|15

ResearchInnovation

Breakthrough

Organization

DevelopedautonomousgroundvehicleswithadvancedAIthatcannavigatecollapsedbuildingenvironmentsforsearch-

Algorithms:SLAMwith

multi-sensorinputand

multi-agentcollaborationinunstructuredsettings.

July,2024CarnegieMellon

University(CMU)

andrescuemissions.

July,2024

Models&Sensors:On-deviceneuralengines+advanced

ECG/PPGsensorfusionforhealthanomalydetection.

Apple

Announcedanext-gen

wearabledevicewithbuilt-inAIforcontinuousbiometricmonitoring,alertingusersinreal-timetopotentialhealthissues.

June,2024

IBMResearch

Compute:Hybrid

quantumclassical

algorithmsforcombinatorialoptimizationinrobotics

planning.

Showedaquantum-classical

pipelineforoptimizing

largescalesupplychainrobotics,reducingcomputetimefrom

daystohours.

June,2024

Algorithms&Control:

Multirobotswarmintelligencewithreal-timestructural

integrityfeedbackloops.

ETHZurich

Developedaswarm-assemblytechniquewhereminiature

robotscooperativelybuildandmodifystructures,usingAItodynamicallyadjusttodesignchanges.

Sensors:Ultra-compact

inertialsensorswith

embeddedAIforreal-timemotionanalysis.

June,2024SamsungReleasednewsensor

technologyforwearable

robotics(exoskeletons)

featuringmicro-motiontrackingforenhancedgaitsupportandinjuryprevention.

May,2024NASAJet

Propulsion

Laboratory(JPL)

Algorithms&Sensors:Hybridvision/geologyrecognition

modelsintegratedwith

advancedLiDARscanning.

DemonstratedanAI-based

systemforplanetaryrovers

thatautonomouslyidentifiesgeologicalfeaturesand

optimizessamplecollectiononMars.

ResearchInnovation

Breakthrough

Organization

16|AIinthePhysicalWorld

May,2024

Sensors&Control:Adaptivecontrolalgorithmsand

highresolutionsensorarraysforprecisionmovements.

StanfordUniversity

PublishedresearchonsurgicalroboticsusingAItoadaptivelyguideminimallyinvasive

proceduresinrealtime,

reducingphysicianworkload.

April,2024

Intel

Debutedaneuromorphicchip

Compute:Neuromorphic

forenergy-efficientsensor

architecturethatmimics

processingindronesandmobile

spikingneuralnetworks

robots,extendingoperational

forlow-power,on-boardAI

lifeby25%.

inference.

April,2024

Tsinghua

Developedamultilingual

Models:Transformer-based

University

roboticsframeworkthat

architecturebridgingChinese,

integrateslargelanguage

English,andotherlanguages

modelsforcross-lingual

foruniversalhuman-robot

instructionandadvanced

communication.

naturallanguage-basedcontrol.

April,2024

OpenAI

Introducedaroboticstoolkit

Models:MultimodalLLM

thatcombineslargelanguage

(vision+text+motion)for

modelswithreinforcement

end-to-endtaskplanningand

learning,enablingrobotsto

real-worldmanipulation.

followcomplex,human-like

instructions.

March,2024

KUKA

IntroducedanadvancedAIbased

Algorithms:Real-time

coordinationsystemformulti-

pathplanningandcollision

robotcells,allowingseamless

avoidanceforcomplex

collaborationbetweenrobotic

industrialtasks.

armsonassemblylines.

March,2024

SoftBank

Unveiledamulti-purpose

Algorithms:Multi-agent

Robotics

servicerobotthat

navigationwithvision-

autonomouslynavigates

basedcrowd-flowanalysisand

crowdedenvironments,greeting

naturallanguageinteraction.

customersandofferingbasic

help.

ResearchInnovation

Breakthrough

Organization

AIinthePhysicalWorld|17

Sensors&Control:

Highperformancesensorfusion[IMU+Vision]andlocalizeddeepRLforreal-timefootstepplanning.

March,2024UnitreeDebutedalow-costquadruped

robotthatleverageson-deviceAIforadvancedobstacle

avoidanceandagilelocomotioninindoorandoutdoor

environments.ItsintegratedvisionandIMUsensorsfor

robustperceptioncomputingtostresshowthequadrupedperceivesandnavigates

dynamicenvironments.

March,2024

Compute:High-throughputGPUwithdedicatedAIcoresandsensor-fusionpipelinesoptimizedforrobotics

[specializedroboticsGPUdesignedforadvanced

perceptioncomputingattheedge,reducinglatencyinobjectdetectionand

pathplanning].

NVIDIA

Launchedaspecialized

roboticsGPUdesigned

forfastinferenceinedge

devices,reducinglatencyin

objectdetectionandpath

planning.Itisan“acceleratorforreal-timeperception

computing,”supporting3D

visiontasksandsensorfusionatlowlatency.

February,2024

Models:Transformer-basedmulti-cameraperception

architectureforreal-timedrivingpolicy.

Tesla

ReleasedanupdatedFSD

(FullSelf-Driving)betawith

improvedlateralcontrolanddecisionmakingonhigh-speedhighways

February,2024

Models&Materials:AIdrivenmaterialmodelingfor

elasticityandautonomousrepairprotocols.

MITCSAIL

Developedaself-healingsoftrobotthatusesAItodetectmicro-tearsandinitiatean

internalpatchingprocess

withouthumanintervention.

Sensors&Control:Novel

sensorfusionandreal-timecontrolalgorithmsforrobustbipedallocomotion.

January,2024BostonDynamicsShowcasedanewhumanoid

robotcapableofdynamic

balancingonuneventerrainandmulti-objectmanipulation.

ResearchInnovation

Breakthrough

Organization

18|AIinthePhysicalWorld

January,2024

DeepMind

Demonstrateda

reinforcementlearning-basedroboticsframeworkthat

allowsrobotstolearncomplexmanipulationtasksinjust

hours.

Algorithms:AdvancedRL

curriculumtrainingprotocolsanddata-efficientexplorationmethods.

September,2023

Skydio

LaunchedanAI-driven

inspectiondronethatuses360°obstacledetectionandrealtimeSLAMtoautonomously

maneuveraroundcomplexinfrastructuresites.

Sensors&Compute:

Visionbasedreal-time3Dmapping,on-boardGPU

forhigh-speedflightand

dataprocessing.Itachievesthroughsensorfusionfromstereocameras+onboardGPUforedgeinference.

AIinthePhysicalWorld|19

PerceptionComputingResearch&Patents

AGlobalLens

Title&Type

Authors/

Organization

BriefSummaryoftheInnovation

ImportancetoAdvancingPerceptionComputing

March,2025

Reduce,Reuse,

Researchers

LeverageCRL

Enhancestaskadaptability,

Recycle:

-Georgios

(Compositional

reducestrainingtime,and

Categoriesfor

Bakirtzis,

Reinforcement

scalesmoreeffectively

Compositional

MichailSavvas,

Learning)which

forreal-worldrobotic

Reinforcement

andRuihan

enhancesrobotictask

applications.

Learning(CRL)

Zhao,Sandeep

efficiencybybreaking

(Paper)

Chinchali,andUfukTopcu

complextasksintoreusablesubtasks.

March,2025

Cosmos-

NVIDIA

Introducedamodel

Optimizereal-time

Transfer1:

thatenablesrealtime,

performance,reduce

AdaptiveWorld

multi-modalworld

computationalburdens,

Simulations

simulationswith

andbridgethegap

(Paper)

adaptivespatial

controls,advancing“Sim2Real”

(simulation-to-reality)transferforrobotics.

betweendigitaltraining

andphysicaldeploymentinrobotics.

February,2025

Patent

MagicLeapInc

AVR/ARdisplay

Helpsoptimizedisplay

#US202500-

systemthatutilizes

performanceby

54170A1:

embeddedcontrol

controllingtheactivation,

Virtualand

informationto

deactivation,andshifting

augmented

managedepthand

ofimagerydataacross

realitysystems

colorplanesfor

depthandcolorplanes.

andmethods

enhancedimagerypresentation.

February,2025

Patent

Binarly

Securesamachine

Predictsmemoryusage

#US1223-

learningtechnique

todynamicallyallocate

6262B1:

foroptimizing

resources,enhancingthe

Machine

large-scalebinary

speedandaccuracyof

Learning

analysisby

softwarevulnerability

Techniquefor

efficientlyallocating

analysis.

Efficiently

computational

Scheduling

resources.

20|AIinthePhysicalWorld

Authors/

Organization

BriefSummaryoftheInnovation

Title&Type

ImportancetoAdvancingPerceptionComputing

StrengthensIoTsecurityandreliability,ensuringtrustedcommunicationandfailoverforcrucial

sectors.

Extendsperception

computingintowearablerobotics,enabling

exoskeletonstoadapt

tonuancedphysiological

signals,improvingcomfort,safety,andfunctionality.

Coversanintegratedsensorarchitectureforexoskeletons,

merginginertial,

pressure,EMG,andtemperaturedataforcomprehensiveuserstatesensing.

Establishesa

secureIoTn