




已阅读5页,还剩22页未读, 继续免费阅读
版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
chad davis, qcon 2014 shanghai1 understanding user intent beyond a / b testing chad davis, qcon 2014 shanghai2 technology to product sereal: faster object serialization css:compressor : faster css compression brick: scalable on-site search hadoop: loyalty metrics and deals redis: server-side session storage perl: b ! chad davis, qcon 2014 shanghai3 user research studies chad davis, qcon 2014 shanghai4 iterative development via a / b tests chad davis, qcon 2014 shanghai5 iterative development via a / b tests product to technology chad davis, qcon 2014 shanghai6 brick: the search engine demand for flexible / forgiving search customizing elasticsearch, closer to lucene prototype a small server wrapping lucene chad davis, qcon 2014 shanghai7 a / a experiments: same experience customers in base are performing n searches customers in variant are searching 20% more what is happening? chad davis, qcon 2014 shanghai8 simulations and false positive rate auto-complete search a / a / a experiment ( three identical cases ) variantcancellations (conf.) v0 ( control group )= 0 % ( by definition ) v1 ( no change vs v0 )- 6 % ( not significant ) v2 ( no change vs v0 )+ 97 % ( significant ) chad davis, qcon 2014 shanghai9 simulations and false positive rate simulating 1000 a / a experiments : at some point during the experimentation : 771 experiments out of 1.000 reached 90% significance only at the end of the experimentation : 100 experiments out of 1.000 were significant at 90% /is-your-ab-testing-effort-just-chasing- statistical-ghosts.html chad davis, qcon 2014 shanghai10 interacting experiments feature x user feedback y without feature xwith feature x without user feedback y without feature x without user feedback y with feature x without user feedback y with user feedback y without feature x with user feedback y with feature x with user feedback y chad davis, qcon 2014 shanghai11 beyond conversion: search metrics click-through-rate (ctr) disambiguations searches per session (cf. web search) chad davis, qcon 2014 shanghai12 web marketing: search is intent chad davis, qcon 2014 shanghai13 context and ambiguity chad davis, qcon 2014 shanghai14 context and ambiguity chad davis, qcon 2014 shanghai15 80 / 20 rule high demand for : london, new york, paris over-represented results unpopular places : drown in the noise chad davis, qcon 2014 shanghai16 location relevance? chad davis, qcon 2014 shanghai17 dd y mn t nrmlize tht? mu(e)nchen upranks mnchen, germany caen fails to uprank caen, france chad davis, qcon 2014 shanghai18 how much feedback do you need? chad davis, qcon 2014 shanghai19 dialogue on spell check results chad davis, qcon 2014 shanghai20 “one king-size bed for two persons in honeymoon, no smoking, quiet for sleeping, free-wifi, need stove and cooking utensils. guranteed seaview in high floor room, thanks a lot.” we asked for : someone replied : chad davis, qcon 2014 shanghai21 what was this person looking for? b ba bar bare barel barelc barelce barelcel barelcelo barelcelon barelcelona spell check click on “barcelona“ click for district: barcelona city centre, spain s se sev sevi sevia disambiguation : single hotel result (redirect) sevi (backspace) sevil sevila disambiguation : single hotel result (redirect) sevil (backspace) click for city: seville, andaluca, spain booked a hotel in carmona, spain (30 km from seville) chad davis, qcon 2014 shanghai22 knowing what you dont know look at the search logs. how many people are searching for cities that are not available on our site? chad davis, qcon 2014 shanghai23 knowing what you dont know look at the search logs. how many people are searching for cities that are not available on our site? is “ 丹 asdghy3yh23” a new city ? a new 5-star villa ? a cat on your keyboard ? chad davis, qcon 2014 shanghai24 developer to product chad davis, qcon 2014 shanghai25 do your developers surprise the po hey, did you know we can . do spell check for search in the native apps? really? lets do it ! expect developers to develop ideas technical constraints
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 弹弓指 的护理及运动
- 2025至2030巴基斯坦基础建设行业产业运行态势及投资规划深度研究报告
- 商业综合体的安全管理及风险控制策略研究报告
- 中药与肠道微生态的关联研究
- 2025至2030维生素口嚼片行业项目调研及市场前景预测评估报告
- 2025至2030中国自由飞行服行业市场占有率及投资前景评估规划报告
- 2025至2030中国自动装配机行业产业运行态势及投资规划深度研究报告
- 2025至2030中国自主无人机无线充电和基础设施行业市场占有率及投资前景评估规划报告
- 2025至2030中国腕式潜水电脑行业发展趋势分析与未来投资战略咨询研究报告
- 2025至2030中国能源行业市场发展分析及投资前景与投资策略报告
- 生物膜技术革新:MBBR与IFAS工艺中功能性生物膜挂膜驯化的深入探讨
- 心肺复苏课件
- 2025至2030全球及中国企业文件共享和同步(EFSS)行业产业运行态势及投资规划深度研究报告
- 上海金山区属国有企业招聘笔试真题2024
- 2025至2030中国碳化硅陶瓷膜行业发展趋势分析与未来投资战略咨询研究报告
- 物业公司战略合作协议范本
- 电网公司项目管理标准手册
- 卫生值日表格源码文件可编辑可修改
- ASTM B344-20 电加热元件用拉制或轧制镍铬及镍铬铁合金标准规范
- 《石油化工企业储运罐区罐顶油气连通安全技术要求》
- 人教版七年级数学下册计算类专项训练卷【含答案】
评论
0/150
提交评论