触感反馈与人机界面趋势分析报告.doc

触感反馈与人机界面趋势分析报告 HAPTICS ANDAUTOMOTIVE HMITechnologyand trendsreportJanuary20182The automotiveindustry ison thecusp ofaperfect stormof trendsdriving radicaldesign change.Mary Barra(CEO ofGeneral Motors)predicts morechange in the industryin thenext five toten yearsthan inthe previousfi fty.At thesame time,increasingly sophisticatedhaptic technologiesare ingto marketincluding Ultrahapticsown ultrasonic mid-air technology.The useof hapticsis stillunder-explored inhuman-machine interfaces(or HMIs).As such,it of f ersopportunities to create unique,market-leading productsthat ef f ectivelyrespond to a changinglandscape.Haptics arean intuitiveand non-visual modeof interaction,and areone way of reconcilingthe contradictorymarket trendsof greaterconnectivity andbetter safety.Next-generation automotiveHMI willutilise hapticsto reducedriver distractionandeyes of f the roadtime.Looking further into the future,the qualityof theAR and VR experiencesonofferinautonomous vehiclecabins willprovide anew dimension to brandexperience anddif f erentiation betweencar manufacturers.Hapticsthe abilityto touch,not justsee,virtual objectswill makeAR and VR experiencesmore immersiveand intuitive.At Ultrahaptics,we believethat haptics will changeHMIs inways weare onlyjust beginningto imagine.We lookforward to developing thenext generationof automotiveHMI withyou.Steve Cliff eCEOand President,UltrahapticsEXECUTIVE SUMMARYCONTENTSThefour trendsdriving next-generation vehicle HMI Strengthsand limitationsof hapticsin automotiveHapticsat diff erentlevelsof autonomyThe uniquepower of ultrasonicmid-air hapticsCasestudy:HarmanControl.React.Experience:Uses ofultrasonic mid-air hapticsin automotiveCasestudy:Bosch conceptcarsCollaborate with Ultrahaptics345678CONNECTIVITY ANDDIGITISATION Theevolution of the connectedcar continuesto aelerate.Centre stacksfeature moreand moreelectronics andlarger visualdisplays,while instrument clusters andheads-up displays(HUDs)are beingmore three-dimensional andinteractive.MULTI-MODAL INTERFACESWe increasinglyunderstand thatfor interfacesto beintuitive,they haveto bemulti-modal.Future vehicleHMI willleverage multiplenew technologiesand machine learning tofuse inputsand outputstargeting diff erenthuman senses.DRIVER DISTRACTIONDriver distractionis estimatedto contributeto over3,000deaths everyyear inthe USalone.1Reconciling safetywith connectivityis akey challengedriving the development ofnext-generation vehicleHMI.AUTONOMOUS DRIVINGIt is widelyaepted thatautonomous vehicleswill be a mercialreality sometimeinthe2020s.Cabins will bee mobileextensions of our futureimmersive workspacesand virtualsocial environments,and passengerswill expectto interactseamlessly withfamily,friends andcolleagues,wherever theyare.THE FOURTRENDS DRIVINGNEXT-GENERATION VEHICLEHMI3“Nearly70percent ofUS adultssay that they wantthe newtechnology intheir vehicle,but only24percent feelthat the technology alreadyworks perfectly.”AAA survey,xx21s:/.nhtsa/risky-driving/distracted-driving2newsroom.aaa./xx/10/new-vehicle-infotainment-systems-create-increased-distractions-behind-wheel/AUDIO CUESVISUALDISPLAYS EYETRACKINGFACIAL&GESTURE RECOGNITIONELEMENTSOF AMULTI-MODAL VEHICLEHMISURFACE HAPTICSVOICERECOGNITIONMID-AIR HAPTICS12434STRENGTHS ANDLIMITATIONS OFHAPTICS INAUTOMOTIVE”Non-visual modalitiesfor secondaryinformation makea lotof sense.”Gary Burt,Professor ofTransport HumanFactors,Faculty ofEngineering,University ofNottingham,UK3See forexample Jacko,Julie A.,ed.Human puterinteraction handbook:Fundamentals,evolving technologies,and emergingapplica-tions,CRC press,xx|4s:/dl.acm/citation.cfm?id=3131726.3132045|5s:/.kth.se/en/aktuellt/nyheter/f ingertopparnas-be-tydelse-for-framtidens-mobiler-1.413913|6Cornelio Martinez,Patricia Ivette,et al.Agency in mid-air interfaces.Proceedings of thexxCHI Conferenceon HumanFactors inComputing Systems”,ACM,xx.|7s:/.immersion./study-unveils-touchsense-ads-lead-to-brand-lift/HAPTIC STRENGTHSHAPTIC LIMITATIONSNON-VISUALSecondary informationcan bemunicated todrivers andtasks pletedwithout takingeyes off the road.SHORT-RANGEWe cansee objectsa relativelylong distanceaway,but wecan onlyfeel thingswithin reach.INTUITIVE CONTROLControlsincorporating haptic feedback aremore intuitiveand reducemental load.REQUIRES PHYSICALCONTACTUntil recently,touch-based interfacesrequired physicalcontact with a screenor otherdevice.PERSONALISATION&PRIVACYHaptic technologiescan transmitinformation tothe driveralone,without disturbingpassengers.LIMITED BANDWIDTHDetailedinformation or instructions cannotbe conveyedthrough touch(unless usinga specialistlanguage such as Braille).SENSITIVITYAxxstudy showedthat humanfi ngertipscan distinguisha patternas thinas13nanometres froma smoothsurface.5POTENTIALLY INTRUSIVEDrivers needto havea choicewhether ornot toreceive hapticfeedback.This shouldbe adesign consideration.REACTION TIMEReactiontimes tohaptic stimuliare1.7times quickerthan tovisual stimuli.6ENGAGEMENTHaptics areproven toincrease userengagement.7Our sensesplement eachother and are designedto worktogether.3Incorporating hapticsinto control systems plementsthe primarilyvisual taskof actuallydriving a car.Haptics createsuser experiencesthat aremore intuitiveand lessreliant ondrivers takingtheir eyes offtheroad.They reducedriver distractionand mentalload.Haptic warningsare hardto missand driversreact quicklyto them.Vibrotactile haptictechnology inadvanced driver-assistance systems(ADAS)has beenshown toimprove lane-keeping by30%.Because thesense of touch isone ofour mostprimal senses,we alsorespond instinctivelyand emotionallyto haptics.Itisan eff ectivewayof increasing peoples senseof control4and connection.5The senseoftouchhas beeninstrumental inthedevelopment ofourtools andtechnology.Drivers alreadyrely onhapticfeedbackevery timethey turna steeringwheel orpress apedal.However,creating tactile sensations throughelectronics isa relativelynew field.Today,consumer electronicsare movingbeyond simplevibrotactile eff ects,force feedbackdevices are increasingly sophisticated,and ground-breaking technologiessuch asultrasound-based hapticsare enteringthe market.As automotive design evolvesthrough differentlevels ofautonomy,legacy hapticssuchasmechanical controlsystems andbasic vibrotactileand surfacehapticswill be binedwith andeventually supplantedby thesenew technologies.Haptics willbee fullyintegrated intovehicleHMI(and alsocar conf i gurator kiosks andautomotivedesignsoftware),enabling manufacturersto deliverincreasingly intuitive,personalised andinnovative userexperiences.HAPTICS ATDIFFERENT LEVELS OF AUTONOMYLEVEL0No automationLEVEL2Partial automationof centraldriving functionsLEVEL4Fully automatedbut vehicleis constrainedto specif i cuse-casesLEVEL1Automation ofdriver assistfunctionsLEVEL3Fully automatedbut ahuman maybe requiredto takeoverLEVEL5Fully automatedin alldriving scenariosMECHANICALCONTROL SYSTEMS:Traditional mechanicalcontrols suchas steeringwheels andpedals alreadyrely onhaptics.ADVANCED DRIVER-ASSISTANCE SYSTEMS(ADAS):Vibrotactile technologyis alreadywidely usedin ADAS.Haptics willincreasingly beethe dominantmode fordriversalert systems.AR ANDVR:Haptics willbeakey ponentof high-grade AR andVRexperiences inautonomous vehiclecabins.CUSTOMER EXPERIENCES:Haptic eff ectswillbeemonplace incustomer experiencesacross all sectors andform anintegral part of carconf iguratorkiosks.PUTER-AIDED DESIGN(CAD):Haptics willbe incorporatedinto CADprograms inbination with ARandVR acrossallsectorsincluding automotive.ELECTRONIC CONTROLSYSTEMS:Surface andmid-air hapticswillbefused inincreasingly sophisticatedways withother technologiesand machinelearning incentre stacks,passenger-centred infotainmentsystems,HUDs,seat andwindow controls and securitysystems.LEVELSOFAUTONOMY Mostnew roadcars todayare atLevel2.6HOW MID-AIR HAPTICSWORKSUltrahapticspatented algorithmsmodulate ultrasoundwaves tocreate hapticsensations inmid-air.No controllers or wearablesare needed:the“virtual touch”technology usesultrasonic transducersto projectshapes andtextures directlyonto theusers hands.Ultrahapticstechnology meansthat everycubic centimetreof thespace withinacarcan potentiallybe turnedinto aprogrammable hapticinterface.In-car installationstypically includean arrayofultrasonictransducers mountedunder thefascia ofa productorina separatecontrol paneland binedwithahand-tracking system.They canprovide thesensation oftouch uptoametre awayfrom thesurface.The auracyofthesensation isless thana finger-width apart,and cantrack handposition,hand shapeand gestures.THE UNIQUEPOWER OF ULTRASONIC MID-AIR HAPTICSKEY BENEFITSOFULTRASONICMID-AIR HAPTICSSafety:Reduces cognitiveload,driver distractionandeyesofftheroad.No physicalcontact:No touchscreens,controllersorwearable devicesneeded.Flexible:Virtual controlsand alertsthat canchange fromsecond tosecond aordingto userneeds.Three-dimensional interaction:Allows thedevelopmentofinnovative HMI.Enables innovativedesign:Reduces theneed forscreens,buttons andknobs,enabling sleek,contemporary designsolutions.Product diff erentiationand wowfactor:A ground-breaking technologythat makesexperiences memorableand productsunique.“Our hapticfeedback solutionmakes thedriving experiencesafer byenabling driversto keeptheir eyes on theroad whilestill maintainingintuitive controlof infotainmentand audiosystems.”Stefan Marti,VP,Future Experience,HarmanCASE STUDY:HarmanHARMAN binedgesture control,Ultrahapticsmid-air technologyand theircustom graphicaluser interface(GUI)todevelopan intuitivesystem thatcan controlmultiple in-vehicle systems,including audioinfotainment.The systemresponds tothe drivers gesturemands withtactilesensationsconf irming instructionshave beenrecognised andaepted.7CONTROL.REACT.EXPERIENCE.Uses ofultrasonicmid-air hapticsin automotiveCENTRECONSOLE CONTROLSCreatea three-dimensional zoneof interactioninmid-air abovethe centreconsole.Intuitive controlof air-conditioning,navigation,media andother systemswhile keepingeyesontheroad.HEADS-UP DISPLAYS(HUD s)Enable driversto reach out andtouch virtualcontrolsandalerts infront ofthe steeringwheel.HIDDEN ORHARD TOACCESS CONTROLSAllowsimple,intuitive adjustmentof seats,windows andother hard-to-find orhidden controls.Create virtualcontrols thatfi ndthe drivers handor providenon-visual confi rmationthat actionshave beenanticipated andaepted.PASSENGER-CENTRED INFOTAINMENTSYSTEMSInstall sophisticatedand personalisedpassenger-centred infotainmentsystems withoutoverloading thecabin withscreens and controls.DRIVER MONITORING&ALERTSLeverage mid-air hapticswithin sensor fusion systemstocreatefl exible,discreet andeffective ADAS.CAR CONFIGURATORKIOSKSAdd amemorable extradimensiontocustomer experiences.AUTONOMOUS VEHICLECABINSGenerate mid-air tactilesensations inany zonewithin automotivecabins ofthefuture,and binewithARandVR.IMMERSIVE PRODUCTDESIGN Aeleratedesign andinnovation throughnatural interactionandaricher senseof presenceandcontrol.CASE STUDY:Bosch conceptcars Ultrahapticsmid-air technologywas binedwith gesture-recognition infotainmentcontrols inBosch conceptcars shownat CESxxand2018.When driversreachoutto givea gesturemand,the systemuses tactilesensations toassure themtheir handsareinthe rightplace.A secondhaptic responseis thengiven toconfirm thatthe mandhas beenaepted.8ABOUT ULTRAHAPTICSUltrahapticswas foundedinxxbased ontechnology developedattheUniversity ofBristol,UK.Since then,the panyhas raised$40m intwo roundsof fundingand establisheda worldwidepresence,opening offices inCalifornia andGermany.Ultrahaptics iscurrently engagedwi