智能音箱语音技术概览.pdf

2015 Nuance Communications Inc All rights reserved Voice Technologies Come Together for Smart Speakers Nuance Communications April 2018 2015 Nuance Communications Inc All rights reserved 2 Company Overview 2015 Nuance Communications Inc All rights reserved 3 Nuance Communications Inc Leader in Conversational and Cognitive Solutions to Increase Business Productivity and Amplify Intelligence Trusted Advisor World Class Technology Global Footprint Market Focus and Expertise 14 Billion customer engagements per year across enterprises 4 300 patents and applications 14 Billion cloud transactions in auto IoT and services 10 000 Healthcare organizations use Nuance solutions 80 languages across voice NLU and text input 300 Million patient stories shared annually 160 Million voice enabled vehicles shipped globally 111 Billion output documents managed 150 Million voiceprints enrolled globally 2015 Nuance Communications Inc All rights reserved 4 Voice Technologies Overview 2015 Nuance Communications Inc All rights reserved 5 Technology Stack All Comes Together for Smart Speakers Speech Signal Enhancement Wakeup Voice Biometrics ASR NLU Dialog VUI AI Reasoning TTS 2015 Nuance Communications Inc All rights reserved 6 Hey Speaker Robust Audio Capture Audio capture in noisy environments requires advanced signal acquisition Features Noisy audio handling NR 360 degree WuW coverage ASL Multi source Suppression of off axis interferers BF SSB Echo cancellation for barge in use cases AEC Distant talk Speech Signal Enhancement 2015 Nuance Communications Inc All rights reserved 7 Self Steering Beamformer Dual Microphone Babble Noise Rejection Speech Signal Enhancement Interference Cancellation Interference Suppression MIC 1 MIC 2 Adaptation Control Speech Noise Noise Noise 2015 Nuance Communications Inc All rights reserved 8 De reverberation Specific Environment at Home Speech Signal Enhancement Reverberation Suppression Spectral Estimation of Reverberation Energy Direct Sound SignalRoom Reverberation 2015 Nuance Communications Inc All rights reserved 9 Gateway to Speech Experience A hands free always available technology enables the access to the next generation of intelligent agents Wakeup DSP Sensor Hub Integrations Providing persistent wakeup capability with minimal battery drain Customizable Phrases OEM can define branded wakeup phrase or enable users to create their own personalized phrases 2015 Nuance Communications Inc All rights reserved 10 Frictionless Personalization Best in breed unification of core technologies enabling convenient user profile creation and speaker identification Rich SDK and API support for a range of customizations to create specialized application experiences Voice Biometrics Real World Applications Easily coupled with wakeup word to support one shot device application wakeup user authentication Delivers convenient access to multiple user profiles on a single shared device Local and Secure All processing and data is handled locally on the device with no requirement for cloud services 2015 Nuance Communications Inc All rights reserved 11 World Class Recognition Data rich recognition models provide extended language support for many use cases and the ability to further enhance them with domain specific vocabularies Smart arbitration between embedded and connected services delivers an optimal speech experience in any environment hybrid ASR Automatic Speech Recognition Global Language Support Embedded recognition coverage for 30 languages Cloud recognition coverage for 40 languages Extensible Designed and optimized to work seamlessly with Nuance s NLU platform to enhance performance within app specific actions and developer defined concepts Multi lingual Support 2015 Nuance Communications Inc All rights reserved 12 Full DNN Applied To Both Acoustic and Language Modeling Automatic Speech Recognition 47 19 27 36 47 26 21 48 42 Messaging Music Navigation 2014 May2014 Nov2015 Jun2016 Jan2016 Jun Word error rate US English 2014 May2014 Nov2015 Jun2016 Jan2016 Jun Character error rate Mandarin 2014 May2014 Nov2015 Jun2016 Jan2016 Jun Word derror rate German 2015 Nuance Communications Inc All rights reserved 13 Low Power Wakeup Word System Ambient Listening World s First 3 Pass Wakeup Solution SSE Low Power Wakeup DSP Voice Recognition App Processor Voice Biometrics App Processor Speech Signal Enhancement 2015 Nuance Communications Inc All rights reserved 14 NLU Meaning Extraction Extract the meaning of a sequence of words and annotate it in a machine understandable canonical representation Set up an alarm for 7 30am INTENT New Alarm TIME 0730 Natural Language Understanding Statistical NLU Train a custom NLU model to extract new intents and concepts by providing training samples annotated with the correct meaning representation Advanced Deep NLU Multi Intent and Logical Operators extraction capability Find an Italian restaurant AND find parking there Find a McDonald s OR Wendy s Find restaurants that are NOT McDonald s 2015 Nuance Communications Inc All rights reserved 15 Multi Turn Interactions Dialog manager supports the definition of the flow logic according to application goals How should the application respond to any given user input Application responses are managed through prompts and developer customized actions Dialog Contextually Aware Keep track of conversation context What does the user input mean in the context of that conversation How about tomorrow How s the weather tomorrow in Boston 2015 Nuance Communications Inc All rights reserved 16 Expressive Speech Output Natural sounding easy to listen to synthesized speech for feedback guidance accessibility and more Features high quality acoustic extensions for specialized tones Text To Speech Domain Optimized Dictionaries Trained on 3rd party content and entertainment data sets for enhanced pronunciation of domain specific dictionaries Cloud TTS models are updated nightly to incorporate new and trending terms Flexible Delivery Options TTS is available via NCS through an embedded solution or on premise in a customer s own environment 2015 Nuance Communications Inc All rights reserved 17 Natural Language Generation Intelligent Result Generation Text To Speech Possible Query Results Attribute values Previously rejected candidates Intelligent Result Refinement reduces the size of the entropy of the distribution over the inputs For what time would you like this movie How about Spiderman at AMC Mercado at 8 15pm Attribute Refinement Instance Refinement Optimum Question to Ask 2015 Nuance Communications Inc All rights reserved 18 AI Reasoning Personal assistants must become smarter and more sophisticated through artificial intelligence 2015 Nuance Communications Inc All rights reserved 19 Data Analytics Each Assistant Has its Own Strengths Auto User Experience Fragmentation Different protocols platforms and APIs make interoperability a challenge P ParkingNavigation Fuel Smart Home Temp Control Security Lighting TV Enterprise Customer Care Banking Transactions Insurance Transactions Consumer MessagingProductivity RetailSearch Data Analytics Prediction 2015 Nuance Communications Inc All rights reserved 20 Centralized AI is The Solution Cognitive Arbitrator 2015 Nuance Communications Inc All rights reserved 21 Cognitive Arbitrator Request DrivenCapability DrivenConsciousness 0 1 Wake up or key word based routing NLU domain based routing NLU intent based routing Routing based on user preferences Proactively detects and resolves conflicts and dependencies Fuse multiple Personal Assistants together Routing based on Personal Assistant capability and strengths Fuse multiple applications together 2015 Nuance Communications Inc All rights reserved 22 Arbitration Request Driven Wake up or Key Word Based Routing Hey Home play some music on Spotify Ask Alexa to play my last audio book Hey Home read me the news from CNN 2015 Nuance Communications Inc All rights reserved