领测软件测试沙龙.doc

Google是如何做软件测试的主讲嘉宾：张南快乐 分享 前沿Ltesting领测软件测试沙龙Goal? ? ? ? Push test more upstream 集中精力在高优先级的项目 Integrate to improve core engineering 建立良好的测试企业文化快乐 分享 前沿Ltesting领测软件测试沙龙Push test more upstream (1)? Repetitive manual work-> Automation ? UI Automation is not everything? Interface test (黑盒，白盒)快乐 分享 前沿Ltesting领测软件测试沙龙Push test more upstream (2)? Release test ? Nightly? Continuously快乐 分享 前沿Ltesting领测软件测试沙龙Integrate to improve core engineering? Test : Dev ? 测试和开发密不可分 ? 为相似的产品开发尽可能通用的测试框架/解决 方案 ? 抓住每个产品的特质 搜索：performance，新闻：freshness，等快乐 分享 前沿Ltesting领测软件测试沙龙测试企业文化? 开发对产品质量负责 谁写的代码谁最知道该怎么测 谁写的代码谁最知道问题会处在哪里? Code reviewer: “Where is the test” ? Best-testing practice posted in bathroom ? Test certified快乐 分享 前沿Ltesting领测软件测试沙龙SWE & SET & TE (1)? SWE 用户产品功能的开发 设计文档，项目整体架构，数据结构 Unit test ? SET Developer role 注重代码质量，test coverage 使整个团队以及其他engineers能有更高的生产力 开发测试框架/工具，push test more upstream，使SWE能方便快速的 测试功能快乐 分享 前沿Ltesting领测软件测试沙龙SWE & SET & TE (2)? TE 从用户角度出发进行测试 为测试用例写自动化测试脚本，模拟真实用户行 为 驱动/lead产品release的测试流程 与很多部门协同工作收集测试/使用反馈快乐 分享 前沿Ltesting领测软件测试沙龙组织结构(1)? SWE按项目产品分, Geo, Ads, etc. ? SET/TE exists in a separate team快乐 分享 前沿Ltesting领测软件测试沙龙组织结构(2)? Help keep the number of tests low ? Help keep the quality of testing team high. Product team can not lower the technical bar for testing talent. ? SET/TE is assigned to product team by fully understanding the priority, complexity and needs of the product teams. ? Facilitates movements from project to project, keep refresh ? Ensure good ideas move rapidly around company快乐 分享 前沿Ltesting领测软件测试沙龙Testing and more? ? ? ? Multi-build of a product Test classification Working on challenge issues And快乐 分享 前沿Ltesting领测软件测试沙龙Multi-build of a product? ? ? ? Dev build Testing build Dogfood Release快乐 分享 前沿Ltesting领测软件测试沙龙Test classification (S/M/L) (1)? S 测单函数/模块 功能测试，以及错误条件 需要Mock/Fake env 运行时间短，几秒或以内 由SWE来写快乐 分享 前沿Ltesting领测软件测试沙龙Test classification (S/M/L) (2)? M ? L 测试两个或多个有交互的函数/模块 主要测模块间的交互功能 由SWE写，debug以及维护测试3+功能模块，模拟真实用户使用用例 使用真实数据 运行时间长 SWE/SET/TELtesting领测软件测试沙龙快乐 分享 前沿Working on challenge issues (1)? Web-testing infrastructure Fast Scalable Robust Debuggable Now Execute one cmd to run thousands of tests in parallel against multi-browsers. Challenges Where the browser come from? How the test env configured? If test fails, how to make engineer easy to debug, etc.?快乐 分享 前沿Ltesting领测软件测试沙龙Working on challenge issues (2)? ? Mobile web/native app testing infrastructure Now Execute one command to run hundreds of tests in parallel against multi-real devices Challenges Heterogeneous world So many kinds of tests. Instrumentation, iOS UIAutomation, mobile WebDriver, etc Device instability Device resource is precious, m