软件测试与评估：04-Mission

PrinciplesofSoftwareTestingforTestersModule4

DefineEvaluationMissionModule4AgendaDefinitionoftheworkflow:

DefineEvaluationMissionDefiningthemissionofthetestgroupDefiningthegoalfortestdocumentationReview:WhereWe’veBeenIntheintroductorymodulewediscussedtheconceptsofquality

andtestideasInthelastmodule,weintroducedsomeofthebasicelementsintheRUPTestcontentWe’llusethosebasicRUPelementsthroughouttheremainderofthecoursetohelpprovidecontextforwhatwe’lllearn.RoleActivitiesArtifactsDataBase

TestSuiteWorkflowdetailsDefineEvaluationMissionInthismodule,webeginwiththeworkflowdetail

DefineEvaluationMissionTheMissionfocusesonthehigh-levelobjectivesofthetestteamforthecurrentiterationWhatthingsshouldmotivateustotest?Whythesethings(andnotothers)?DefineEvaluationMissionThismodulefocusesontheactivitiesthatcapturethegoalsofourtestingefforts.Wewilllookatdifferent

Missions

thattestteamsuse,andconsidertheimplicationsonthecorrespondingTest

Approachthoseteamstake.ThesearetheactivitiesthatcreatetheTestPlan.Module4AgendaDefinitionoftheworkflow:

DefineEvaluationMissionDefiningthemissionofthetestgroupDefiningthegoalfortestdocumentationExercise4.1:WhichGroupisBetter?Twogroupstestthesameprogram.ThefunctionsareequallyimportantThebugsareequallysignificantTestingGroup1TestingGroup2Exercise4.2:WhichGroupisBetter?So?PurposeofTesting?Thetypicaltestinggrouphastwokeypriorities.Findthebugs(preferablyinpriorityorder).Assesstheconditionofthewholeproduct

(asauserwillseeit).Sometimes,theseconflictThemissionofassessmentistheunderlyingreasonfortesting,frommanagement’sviewpoint.Butifyouaren’thammeringhardontheprogram,youcanmisskeyrisks.MissionsofTestGroupsCanVaryFinddefectsMaximizebugcountBlockprematureproductreleasesHelpmanagersmakeship/no-shipdecisionsAssessqualityMinimizetechnicalsupportcostsConformtoregulationsMinimizesafety-relatedlawsuitriskAssessconformancetospecificationFindsafescenariosforuseoftheproduct(findwaystogetittowork,inspiteofthebugs)VerifycorrectnessoftheproductAssurequalityExercise4.3:WhatIsYourMission?PickacompanyandaproductProbablyyourownIfyoudon’twanttouseyourcurrentone,pickoneeveryoneknowsFormprojectteamsWhat’sthetestmission?ADifferentTakeonMission:Publicvs.PrivateBugsAprogrammer’spublicbugrateincludesallbugsleftinthecodeatcheck-in.Aprogrammer’sprivatebugrateincludesallthebugsthatareproduced,includingtheonesfixedbeforecheck-in.Estimatesofprivatebugrateshaverangedfrom15to150bugsper100statements.Whatdoesthistellusaboutourtask?DefiningtheTestApproachThetestapproach(or“testingstrategy”)specifiesthetechniquesthatwillbeusedtoaccomplishthetestmission.Thetestapproachalsospecifieshowthetechniqueswillbeused.Agoodtestapproachis:DiversifiedRisk-focusedProduct-specificPracticalDefensibleHeuristicsforEvaluatingTestingApproachJamesBachcollectedaseriesofheuristicsforevaluatingyourtestapproach.Forexample,hesays:Testingshouldbeoptimizedtofindimportantproblemsfast,ratherthanattemptingtofindallproblemswithequalurgency.Pleasenotethattheseareheuristics–theywon’talwaysthebestchoiceforyourcontext.Butindifferentcontexts,you’llfinddifferentonesveryuseful.Module4AgendaDefinitionoftheworkflow:

DefineEvaluationMissionDefiningthemissionofthetestgroupDefiningthegoalfortestdocumentationWhatTestDocumentationShouldYouUse?TestplanningstandardsandtemplatesExamplesSomebenefitsandcostsofusingIEEE-829standardbasedtemplatesWhenaretheseappropriate?ThinkingaboutyourrequirementsfortestdocumentationRequirementsconsiderationsQuestionstoelicitinformationabouttestdocumentationrequirementsforyourprojectIEEEStandard829forSoftwareTestDocumentationTestplanTest-designspecificationTest-casespecificationTest-casespecificationidentifierTestitemsInputspecificationsOutputspecificationsEnvironmentalneedsSpecialproceduralrequirementsIntercasedependenciesTest-procedurespecificationTest-itemtransmittalreportTest-logWeoftenseeoneormorepagespertestcase.ConsiderationsforIEEE829Whatisthedocumentationcostpertestcase?Whatisthemaintenancecostofthedocumentation,pertestcase?Ifsoftwaredesignchangescreatedocumentationmaintenancecosts,howmuchinertiadowebuildintooursystem?Howmuchdoesextensivetestdocumentationaddtothecostoflateimprovementofthesoftware?Howmuchshouldweadd?Whatinertiaiscreatedinfavorofinvariantregressiontesting?Isthisincompatiblewithexploratorytesting?Dowealwayswanttodiscourageexploration?RequirementsforTestDocumentationTherearemanydifferentnotionsofwhatagoodsetoftestdocumentationwouldinclude.Beforespendingasubstantialamountoftimeandresources,it’sworthaskingwhatdocumentationshouldbedeveloped(andwhy?)Testdocumentationisexpensiveandittakesalongtimetoproduce.Ifyoufigureoutsomeofyourmainrequirementsfirst,youmightbeabletodoyourworkinawaythatachievesthem.TestDocsRequirementsQuestionsIsyourtestdocumentationaproductoratool?

Aproductissomethingthatyougivetosomeoneelsetouse.Theypayforit.Youwillprobablyfollowwhateverstandardtheyrequest,subjecttotheirwillingnesstopayforit.Incontrast,ifthedocumentationismerelyanin-housetool,itdoesn'thavetobeanymorecomplete,moreorganized,ormoretidythantheminimumyouneedtohelpyoumeetyourobjectives.WriteaPurposeStatementforTestDocumentationTrytodescribeyourcoredocumentationrequirementsinonesentencethatdoesn’thavemorethanthreecomponents.Examples:Thetestdocumentationsetw