如何选择自动化测试框架

1、Michael Kelly在Choosing a test automation framework一文中提到测试自动化框架是一组假设、概念和惯例的集合，用于支持自动化测试。（A test automation framework is a set of assumptions, concepts, and practices that provide support for automated software testing.）Michael Kelly把自动化测试框架划分为5大类：（1）模块化框架（test script modularity）。（2）函数库结构框架（test libra

2、ry architecture）。（3）关键字驱动测试框架（keyword-driven/table-driven testing）。（4）数据驱动测试框架（data-driven testing）。（5）混合型框架（hybrid test automation）。模块化框架（test script modularity）首先编写底层的三级脚本，例如：Sub Main Window Set Context, "Caption=Calculator", "" '5 PushButton Click, "ObjectIndex=10&quo

3、t; '+ PushButton Click, "ObjectIndex=20" '6 PushButton Click, "ObjectIndex=14" '= PushButton Click, "ObjectIndex=21" '11 Result = LabelUP (CompareProperties, "Text=11.", "UP=Object Properties") End SubSub Main Window Set Context, &quo

4、t;Caption=Calculator", "" '20 PushButton Click, "ObjectIndex=11" PushButton Click, "ObjectIndex=8" '- PushButton Click, "ObjectIndex=19" '10 PushButton Click, "ObjectIndex=7" PushButton Click, "ObjectIndex=8" '= PushBut

5、ton Click, "ObjectIndex=21" '10 Result = LabelUP (CompareProperties, "Text=10.", "UP=Object Properties") End Sub底层脚本可以作为测试脚本开发任务，分模块下发给每个测试工程师负责开发。然后用一个二级脚本来组织和整合这几个底层的脚本，例如下面是计算器的标准视图下组合底层测试脚本的例子：'Test Script Modularity Framework'Script for Standard ViewSub

6、 Main 'Test Add Functionality CallScript "Test Script Mod Framework - Add" 'Test Subtract Functionality CallScript "Test Script Mod Framework - Substract" 'Test Divide Functionality CallScript "Test Script Mod Framework - Divide" 'Test Multiply Functiona

7、lity CallScript "Test Script Mod Framework - Multiply" End Sub最后，最顶层的测试脚本（一级脚本）再去把二级脚本组织和整合在一起执行，例如下面的脚本组合了计算器的标准视图和科学视图的测试脚本：'Test Script Modularity Framework'Top level script - represents test caseSub Main 'Test the Standard View CallScript "Test Script Mod Framework - S

8、tandard" 'Test the Scientific View CallScript "Test Script Mod Framework - Scientific" End Sub库结构框架（test library architecture）把测试脚本做成函数，通过函数之间互相调用来组织测试用例。例如下面的一个函数实现了计算器标准视图的测试：'Header File'Test Library Architecture Framework"Functions LibraryDeclare Sub StandardViewF

9、unction BasicLib "Functions Library" (OperandOne As Integer, _'Library Source File'Test Library Architecture Framework'Functions LibrarySub StandardViewFunction (OperandOne As Integer, _ OperandTwo As Interger, _ Operation As String) 'Click on first operand Select Case Oper

10、andOne Case 0 PushButton Click, "ObjectIndex=8"Case 1 PushButton Click, "ObjectIndex=7"Case 2 PushButton Click, "ObjectIndex=11"Case 3 PushButton Click, "ObjectIndex=15"Case 4 PushButton Click, "ObjectIndex=6"Case 5 PushButton Click, "ObjectInde

11、x=10"Case 6 PushButton Click, "ObjectIndex=14"Case 7 PushButton Click, "ObjectIndex=5"Case 8 PushButton Click, "ObjectIndex=9"Case 9 PushButton Click, "ObjectIndex=13"End Select 'Click on second operand Select Case OperandOne Case "+" PushBu

12、tton Click, "ObjectIndex=8"Case "-" PushButton Click, "ObjectIndex=7"Case "*" PushButton Click, "ObjectIndex=11"Case "/" PushButton Click, "ObjectIndex=15"End Select 'Click on third operand Select Case OperandOne Case 0 PushBu

13、tton Click, "ObjectIndex=8"Case 1 PushButton Click, "ObjectIndex=7"Case 2 PushButton Click, "ObjectIndex=11"Case 3 PushButton Click, "ObjectIndex=15"Case 4 PushButton Click, "ObjectIndex=6"Case 5 PushButton Click, "ObjectIndex=10"Case 6 Pus

14、hButton Click, "ObjectIndex=14"Case 7 PushButton Click, "ObjectIndex=5"Case 8 PushButton Click, "ObjectIndex=9"Case 9 PushButton Click, "ObjectIndex=13"End Select'=PushButton Click, "ObjectIndex=21"End Sub然后再用另外一个脚本来调用上面的函数，通过传入不同的参数来指定测试不同的内容：&#

15、39;Test Library Architecture Framework'Test Case script'$Include "Functions Library.sbh"Sub Main 'Test the Standard View Window Set Context, "Caption=Calculator", "" 'Test Add Functionalty StandardViewFunction 3,4,"+" Result = LabelVP (CompareP

16、roperties, "Text=7.", "VP=Add") 'Test Subtract Functionalty StandardViewFunction 3,2,"-" Result = LabelVP (CompareProperties, "Text=1.", "VP=Sub") 'Test Multiply Functionalty StandardViewFunction 4,2,"*" Result = LabelVP (ComparePro

17、perties, "Text=8.", "VP=Mult") 'Test Divide Functionalty StandardViewFunction 10,5,"/" Result = LabelVP (CompareProperties, "Text=2.", "VP=Div") End Sub关键字驱动框架（keyword-driven/table-driven testing）首先定义关键字表格，关键字表格一般存储在测试数据库、Excel或文件中。例如下面的表格定义了测试Wi

18、ndows计算器所需要的所有对象、操作、测试数据：WindowControlActionArgumentsCalculatorMenuView, StandardCalculatorPushbuttonClick1CalculatorPushbuttonClick+CalculatorPushbuttonClick3CalculatorPushbuttonClick=CalculatorVerify Result4CalculatorClearCalculatorPushbuttonClick6CalculatorPushbuttonClick-CalculatorPushbuttonClic

19、k3CalculatorPushbuttonClick=CalculatorVerify Result3然后编写驱动代码，读取上述表格，分析出测试对象、测试操作、测试数据，编写高度抽象的测试逻辑，下面是一个框架的伪代码：Main Script / Program Connect to data tables. Read in row and parse out values. Pass values to appropriate functions. Close connection to data tables. Menu Module Set focus to window. Select

20、 the menu pad option. Return. Pushbutton Module Set focus to window. Push the button based on argument. Return. Verify Result Module Set focus to window. Get contents from label. Compare contents with argument value. Log results. Return.有了驱动框架后，只需要按一定的格式编辑表格的数据，就可以利用驱动框架遍历表格中的每一行数据，执行所有测试用例。数据驱动框架（D

21、ata-Driven Testing）数据驱动框架与关键字驱动框架类似，测试数据都存储在数据库或Excel文件，但是数据驱动框架的测试用例、测试步骤和测试逻辑是在测试脚本中编写的，而不像关键字驱动框架一样放在表格中。例如对于图中的测试，可以把每个输入框的数据进行参数化，在Excel文件中存储（如果是使用Rational Robot的话就可以直接使用DataPool）。如果通过录制产生脚本的话，可得到脚本如下所示：'Data Driven Framework'Test Case ScriptSub Main 'Make An Order Window Set Contex

22、t, "Name=frmOrder", "" 'Card Number EditBox Click, "Name=txtCreditCard", "Coords=16,9" InputKeys "3333444455556666" 'Expiration Date EditBox Click, "Name=txtExpirationDate", "Coords=6,7" InputKeys "3333444455556666&qu

23、ot; 'Place Order PushButton Click, "Name=cmdOrder" 'Confirmation Screen Window SetContext, "Name=frmConfirm", "" PushButton Click, "Name=cmdOK" End Sub我们可以在表格中填写参数对应的测试数据：然后在修改脚本如下：'Data Driven Framework'Test Case Script'$Include "SQAU

24、TIL.SBH"Sub Main Dim Result As Integer Dim DatapoolHandle As Long Dim DatapoolReturnValue As Variant 'Open the datapool DatapoolHandle = SQADatapoolOpen("OrderFormDP") '.Add error checking. 'Loop through the datapool While SQADatapoolFetch(DatapoolHandle) = dqaDpSuccess &#

25、39;Open Order Form Window SetContext, "Name=frmMain", "" PushButton Click, "Name=cmdOrder" Window SetContext, "Name=frmOrder", "" 'Card Number Result = SQADatapoolValue(DatapoolHanle, "Credit Card Number", DatapoolReturnValue) ".Add error checking. EditBox Click, "Name=txtCreditCard", "Coords=16,9" '.Clear Value. InputKeys DatapoolReturnValue 'Expiration Date Result = SQADatapoolValue(DatapoolHandle, "