性能测试计划(英文的).doc

1.ReferenceDocumentsReferenceinformationusedforthedevelopmentofthisplanincluding:BusinessrequirementsTechnicalrequirementsTestrequirementsandotherdependencies2.ScopeWhatdoesthisdocumententail?Whatisbeingtested?Whatistheoverallobjectiveofthisplan?Forexamples:Todocumenttestobjectives,testrequirements,testdesigns,testprocedures,andotherprojectmanagementinformationTosolicitfeedbackandbuildconsensusTodefinedevelopmentandtestingdeliverablesTosecurecommitmentandresourcesforthetesteffort3.ApproachThehigh-leveldescriptionofthetestingapproachthatenablesustocosteffectivelymeettheexpectationstatedintheScopesection.4.LoadTestTypesandSchedulesSpecifythetesttypes(withdefinitionforeach)torun:AcceptancetestBaselinetest2B1loadtestGoal-reachingtestSpiketestBurstinesstestStresstestScalabilitytestRegressiontestBenchmarktestBespecific:SpecifywhattestsyouwillrunEstimatehowmanycyclesofeachtestyouwillrunScheduleyourtestsaheadoftimeSpecifybywhatcriteriayouwillconsidertheSUTtobeready-for-testForwardthinking:Determineandcommunicatetheplannedtestsandhowthetestsarescheduled5.Performance/CapabilityGoalsIdentifygoals:Percentageofrequestedstaticpagesthatmustmeettheacceptableresponsetime?Percentageofrequestedscriptsthatmustmeettheacceptableresponsetime?Thebaselinemultiplier(2x,4x,.)thatthesystemmustbecapableofhandling?Thespikeratiothatthesystemmustbecapableofhandling?Thepeakratiothatthesystemmustbecapableofhandling?Theburstinessratiothatthesystemmustbecapableofhandling?Toleranceratio:Imposedload?25%?Safetyratio:Imposedloadx2?Spikeratio:Imposedloadx3?Burstinessratio:Imposedloadx5?Increasetheloadbymultiplyingtheloadbaselineby1x,2x,3x,4x,Nxgraduallyuntilunacceptableresponsetimeisreached.Otherquestionstoconsider:Whatisresponsetime?Whatisacceptableresponsetime?Whichmetricsshouldwecollect?Whatisthecorrelationbetweendemandandincreasedload?Howdowedeterminewhichcomponentsareproblematic?Howdowecorrelatefinancialimplications?6.LoadTestingProcess,StatusReporting,FinalReportDescribethetestingandreportingprocedures.Forexample:Theinternaltestteamwillexecuteallcreatedscripts.TheseScriptswillbegeneratedandexecutedagainstthesystematleastthreetimes.Wewillexecutethesescriptsagain,aftersubsequenthardware,software,orotherfixesareintroduced.Testteamwillbaselineloadasfollows:LoadTestTeamwilltestNwith1000SimultaneousClients/Users,andreportbackonthefollowingmetrics:ResponseTimeeachtransactionhittingtheWebsite.Anywebordatabaseservererrorsasreportedinthedatalog.RoundtimeFailedWebTransactionsTherewillbeStatusReportssenttoTeamLeaddetailing:PerformancetestsrunPerformancemetricscollectedPerformanceErrorsandstatusNumberofBugsEnteredStatusSummaryAdditionalloadtesting,ifneeded.TheFinalReportwillincludesummarybugcounts,overallperformanceassessment,andtestprojectsummaryitems.AdditionalInformationtobeprovidedbyDevelopmentTeam:1.BuildSchedule2.Acceptancetestcriteria3.DeploymentPlans7.BugReportingandRegressionInstructionsDescribethebugreportingprocessandthefix/changeregressiontestprocedures.8.ToolsUsedStatethetoolsolutionsfortheproject:LoadtestingtoolsMonitoringtoolsToolOptions:Productvs.ApplicationServiceProvider(ASP)FreewareLeaseorrentPurchaseBuildOutsourcing(testingwithvirtualclientlicensingincluded)9.TrainingNeedsTrainingprogramstobeprovidedtotheteamtoenablesuccessfulplanningandexecution.10.LoadDescriptionsServer-basedNumberofusersand/orsessionsAveragesessiontimeNumberofpageviewsAveragepageviewspersessionPeakperiod(e.g.,75%oftrafficisfrom11:00AM-4:00PM)NumberofhitsAveragepagesizeMostrequestedpagesAveragetimespendonpageNewusersvs.returningusersFrequencyofvisits(e.g.,75%ofusersmadeonevisit)DemographicsClientinformationsuchasbrowser,browserversion,Javascriptsupport,Javascriptenable/disable,andsoon.User-basedNumberofusersSessionlengthUseractivitiesandfrequencyofactivitiespersessionThink/Read/Data-inputtimePercentagebyfunctionalgroupPercentagebyhumanspeedPercentagebyhumanpatience(cancellationrates)Percentagebydomainexpertise(speed)Percentagebyfamiliarity(speed)Percentagebydemographics(arrivalrates)Otherquestionstoconsider:Whatisthedefinitionof“workload”?Howdowesizetheworkload?Whatistheexpectedworkload?Whatsthemixratioofstaticpagesvs.code?Whatisthedefinitionof“increasedload”?Whatisfuturegrowth?Canitbequantified?Whatisthedefinitionofscalability?11.SystemUnderTestEnvironmentSpecifyingmixesofsystemhardware,software,memory,networkprotocol,bandwidth,etc.Networkaccessvariables:Forexample,56Kmodem,128KCablemodem,T1,etc.Demographicvariables:ForexampleSanFrancisco,LosAngeles,Chicago,NewYork,Paris,London,etc.ISPinfrastructurevariables:Forexample,firsttier,secondtier,etc.ClientbaselineconfigurationsComputervariablesBrowservariablesServerbaselineconfigurationsComputervariablesSystemarchitecturevariablesanddiagramsOtherquestionstoconsiderasking:Whatisthedefinitionof“system”?Howmanyotherusersareusingthesameresourcesonthesystemundertest(SUT)?AreyoutestingtheSUTinitscomplete,real-worldenvironment(withloadbalances,replicateddatabase,etc.)?IstheSUTinsideoroutsidethefirewall?Istheloadcomingfromtheinsideoroutsideofthefirewall?12.ExclusionsSetclearexpectationsStatewhichgoalswillbeoutsideofthescopeofthistesting.Forexample:Contentaccuracyorappropriatenesstestingisoutofthescopeofthisplan.Theintegrationofanymajorthirdpartycomponents(forexampleasearchengine,creditcardprocessor,ormappingcomponent)withthesitewillbetested,thoughthescopeoftheprojectdoesnotincludein-depthfunctionaltestingofthesecomponents.InternationalizationCompatibilityTesting13.TestDeliverablesThistestplanPerformancetestinggoalsWorkloaddefinitionsUserscenariodesignsPerformancetestdesignsTestproceduresSystembaseline/System-under-testconfigurationsMetricstocollectToolevaluationandselectionreports(firsttime,orasneeded)Testscripts/suitesTestrunresultsAnalysisreportsagainstthecollecteddataPerformancerelatederrorreports(e.g.,failedtransactions)Functionalbugreports(e.g.,dataintegrityproblems)PeriodicstatusreportsFinalreport14.Budget/ResourceMonetaryrequirementsfor