通用智能机器技术介绍

1、通用智能机器技术介绍人工智能是什么？人工智能发展到什么程度？面临的挑战什么是人工智能？ 类人智能思维研究如何让计算机具备人的感知、决策、解决问题、 学习能力e作研究如何让计算机具备人的行为能力Artificial Intelligence: a Modern Approach Russell & NorvigCan Computers Think?A question raised by Alan Turing in “Computing Machinery and Intelligence”, 1950图灵测试什么是人工智能？ 理性智能思维研究如何通过计算方法达到合理的感知、决策、解决 问题

2、、学习能力e作研究如何通过计算方法形成合理的行为能力Artificial Intelligence: a Modern Approach Russell & Norvig人工智能的研究范畴知识表示、形式f推理规划与决策机器学习理解文字、自然语言（人类语言2语音识别与合成理解图像、视觉感知机器人控制人工智能现状在某些具体任d上达到或超过人类能力通用型智能还有漫漫长路Better than human in GO playingVia deep reinforcement learning and Monte-Carlo tree searchTowards human level in Spee

3、ch recognition2520151050Error rateBy 2015.12 DS2HumanVia end-to-end deep learning modelsDeep Speech 2 Amodei et. al. 2015Speech Is 3x Faster than Typing for English and Mandarin Text Entry on Mobile Devices,with 20% - 50% lower error rates.Ruan et al, 2016Telling stories in imagesMao et al 2015 Karp

4、athy et al, 2015 Kiros et al 2015 Vinyals et al 2015 Chen & Zitnick, 2015A giraffe standing next to forest.Toutiao Xiaomingbot: Automatic Olympic News Writing16 days450 articles 1million readersDL algorithms work well forSupervised learning!()dataXlabelYCat/dog/.今天天气不错！/Today is a nice dayA giraffe

5、standing next to forest.打车去故宫/Image credit: http:/cs231n.github.io/neural-networks-1/Neural networks: massively connected simple unitsInspired by a biological neuronHow to model a single artificial neuron?x1x2x3%w1w2w3inputweightTransfer functionActivation functionInputxSupervised Learning with Neur

6、al Netsh4y=softmax(w2h1+b2) h1=tanh(w1x+b1)Deep Neural Nets16Inputh1=1(w1x+b1)h2=2(w2h1+b2)Casual chat generated by neural networks今天i饭好好吃好开心！我也要吃！土豪我们做朋友t我不是土豪！你喜欢一见钟情还是日?生情？一见钟情吧 星球大战好看s？不是很好看So happy to have delicious lunch today!I want to eat too!Let us befriend, rich guy I am not rich!Would you

7、 prefer falling in love at first sight or developing love over time?Falling in love at first sight probablyIs Star Wars worth watching?Not very muchFei Jiang & Lei Li 2015What about longer utterance?如果上天能给我一个再来一次的机如果非要给这爱c一个期限的话， 我希望是一万年。愿你安好 18曾经有一段真挚的爱情摆在我眼a， I once let the truest love slip away f

8、rom我没有去珍惜，等到失去了才r海before my eyes,莫及，尘世间最痛苦的事莫过于此， Only to find myself regretting when itwas too late,L，我希望能对那个女孩说我爱你， No pain in the world comes near to this,If only God would give me another chance,I would say to the girl, I love you! If there had to be a limit of time, I pray its ten thousand year

9、s.Bless you.Generating sentence with RNN19不很好看embeddingsoftmaxNonlinear dynamical systemht=(wht-1+uxt)Alternatives:LSTM (long-short-term-memory) GRU (gated recurrent units)Generating Emotional Responses不很好embeddingsoftmax看Related work Sutskever et al. 2014Bahdanau et al. 2015Shang et al. 2015 Vinyal

10、s & Le. 220015星球大战embeddingRNNRNNEmotionexcitationAnswering Knowledge Questions三体作者刘慈欣subjectrelationobjectsubject string三体是谁写的？Who wrote Three Body Problem?related work Berant 2013Yih 2014Bordes 2015Why difficult for machines?Language complexityAmbiguity奥巴马总统在哪儿生的？奥巴马总统出生地在哪里？麦克乔丹是谁？Sparse Label2干万

11、事实，十万标注问答对Deep learning based system: CFOu利波特在哪儿上的学？ 霍格沃兹魔法学校格罗格里小学u利波特是谁写的？ 罗琳女士罗琳的写作风格n谁影响？ 乔治艾略特o蒂文金o蒂文金写了什么小说？CFO: Conditional Focused Neural Question Answeringwith Large-scale Knowledge Bases Zihang Dai, Lei Li, Wei Xu, ACL 201656.0%62.9%75.7%90.0%70.0%50.0%30.0%10.0%-10.0%AccuracyYih et al, AC

12、L 14Las c-atro estaciones/different seasoYnihset al, ACL 15肖生克的救赎Bordes et al 2015AI(ML) is more than supervised learning, and more than deep learningAI replies on Knowledge RepresentationProbabilistic Graphical ModelsDeep LearningKernel MethodsSparse RepresentationTreesLimitations of exiting DL algorithmsRelying