TowardsaNaturalUserInterface英文

1、talk outlinelthe nui revolutionthe vision.the ingredients and technologies.l5 challenges to getting nui startedl10 steps to overcome challengeslconclusionuser interface evolutionuser interface evolutiongraphical user interfaceuser interface evolutionnui “do what i mean” uilusers naturally articulate

2、 what they mean, on any device, to any application or web service, and have their intention interpreted and executed accurately.lwhy nui?natural user interfacemotivated by human-human interactionnatural user interface (nui)nui: hear what you sayhear what you saylhuman language : “invented” for inter

3、action“language is a biological adaptation to communicate information one of natures engineering marvels” “vision evolved from the need to survive; speech evolved from the need to communicate” nui: know what you meanlsyntax (rules of the humans language)nouns, verbs, etc. and how they combine“book a

4、bout a trip to chicago” vs. “book a trip to chicago”normalize linguistic variations .lsemanticsmeaning of the wordsbook means reserve a ticket; requires from-city, to-city, etc.lcontext (additional hints)domain knowledge : no train from hawaii to chicago statistics : book as a noun book as a verb“bo

5、ok chicago”personal preferences : where you live, your calendar, how you paymodel of time, urgency, presenceldialog (resolving ambiguity & determine intent)“buy a book or book travel?”“what date would you like to travel?”know what you mean nui: do what you wantdo what you want (by brokering & combin

6、ing)lno system can know everything.lbroker intent to experts:nui will enablechallenges to nuiltechnology limitationsluser reluctancelunproven business valuelhigh development effortlmore than ui infrastructure neededchallenges to nuiltechnology limitationsluser reluctancelunproven business valuelhigh

7、 development effortlmore than ui infrastructure needed1. change the world, one domain at a timelgeneral understanding is hard.ldomain knowledge can:reduce linguistic ambiguity: reduce semantic ambiguity: can get benefit even for “very big domains”2. dont try to solve all the problems at once.probabl

8、y solvable now long-term research problemsauthoring tool that learns from user behaviormodeling of context / domain knowledgebasic nl / disambiguation dialogone model for speech and nlhandle complex sentencesnatural dialogsgeneral q&a over documentsgeneral context modelmulti-domain reasoningplanning

9、, web services compositionre-usable domain and general language librariesintegrated search (documents, schema, database)help and commands (slot filling)q&a for databases (e.g., stored procedures)3. be religious about solution, but be pragmatic about technology ltake whatever technology works.lcombin

10、e them if that helps.4. use ui to hide technology imperfections.lpush the intelligence-required problems back to the human.lrequest-and-choose uinatural (in search).top n precision, not top 1 precision.lother ui tricks.challenges to nuiltechnology limitationsluser reluctancelunproven business valuel

11、high development effortlmore than ui infrastructure needed5. nui complements and extends guilits all about discoverability.if it fits in one screen, gui works great.nui extends gui even for small deviceslwhen the screen is there, use it!lexample: salt for multimodal and telephony-onlylone authoring

12、tool for all devices.lextend presentation layer developers already know (e.g., html, xhtml).6. nui should start with users comfort zoneldont try to add revolutionary ui elements, and make users learn.linstead, find out where users type/speak, and start there.speaking : telephone (routing).typing : s

13、earch engine (finding).handwriting : annotation.challenges to nuiltechnology limitationsluser reluctancelunproven business valuelhigh development effortlmore than ui infrastructure needed7. nui needs early adopters with real economic motivationlcool demos or checkbox items will not lead to adoption.

14、lfind an early adopter with the economic inventive or end-user pain.speech recognition for call centers, mobile devices, automobiles.nl translation for manuals.smart search for crm, self-help, e-commerce.challenges to nuiltechnology limitationsluser reluctancelunproven business valuelhigh developmen

15、t effortlmore than ui infrastructure needed8. nui need unified authoring toolslthe most important enabler of nui is same concept needed for speech, search, commands, help, or q&a.challenges to nuiltechnology limitationsluser reluctancelunproven business valuelhigh development effortlmore than ui inf

16、rastructure needed9. nui needs structure.textintended tasktextavailable taskssearch engine (site search or internet search)losslosslossresultsuserweb servicelunstructured document searchfortunately, structure is happening!lstructure allows for:slot filling, understanding.10. nui needs infrastructure beyond structurelweb services : infrastructure forservice discovery, task completion, and task composition.conclusionlnui is the next big ui revolution.lnui is hard; full of challenges.lnui wi