SOA Testing.ppt

1、SOA Testing,Ahamad Patan 8th Sept 2009 ,Agenda,SOA Overview SOA Testing An End to End Approach Testing Web Service APIs API Testing Strategies Exercise Testing Web Service Applications SOA Testing Challenges SOA Test Automation Approach QA Session,SOA Overview,What is SOA?,Service-Oriented Architect

2、ure (SOA) is an architectural style. Applications built using an SOA style deliver functionality as services that can be used or reused when building applications.,SOA Continued,SOA in other terms A service-oriented architecture is essentially a collection of services Services are based on heterogen

3、eous technologies. Application functions are modularized and presented as services. A service is an implementation of a well-defined business functionality. Service interface is independent of the implementation.,SOA Continued,Services are platform independent, self describing interfaces (XML) Messa

4、ges are formally defined Services can be provided on any platform,SOA and Webservices,SOA is not Webservices, but web services are the preferred standards-based way to realize SOA . Web services are software systems designed to support interoperable machine-to-machine interaction over a network. Thi

5、s interoperability is gained through a set of XML-based open standards, such as WSDL, SOAP, and UDDI. These standards provide a common approach for defining, publishing, and using web services.,SOA and Webservices continued,Interoperability is the most important principle of SOA. This can be realize

6、d through the use of web services, as one of the key benefits of web services is interoperability, which allows different distributed web services to run on a variety of software platforms and hardware architectures.,Webservices basics,WSDL,Web Service (J2EE, PL/SQL,.NET,C/C+,Legacy ),Web Service Cl

7、ient (J2EE, .NET,PL/SQL ),Points to description,Describes Service,Finds Service,SOAP,Points to service,UDDI Registry,SOA Testing,Testing Web Service APIs Testing Web Service Applications,Testing Web Service APIs,Following types of testing needs to be performed Functionality Performance Re-usability

8、Security Interoperability Compliance Backward compatibility,Testing web service APIs,Functional Testing API Testing Detect errors at an early stage, right from the requirements level. Ensure that real-world test data is used Automate test case execution to improve productivity,Testing web service AP

9、Is,Performance Testing Web Services have high usage and high reuse opportunities. Example: A service has been identified as serving 10000 concurrent users with 5 sec of response time. Typically, services are server side components that do not have a front end. It is therefore useful to have a sample

10、 GUI interface that can be used to load test the service from a web client.,Testing web service APIs,Reusability Testing The more a service gets reused, the greater the impact associated with its downtime will be. Make sure that the APIs would work in all possible business scenarios, thus ensuring c

11、onsumability,Testing web service APIs,Security Testing Web Services are exposed to the outside world, this fact opens up a host of vulnerabilities, such as DOS (denial-of-service) attacks, penetration, high volumes of spam data, etc. Typical security policies have to be enforced at the network level

12、 to create bullet proof SOA. Specific test cases aimed at targeting these policies need to be designed to fully test SOA security.,Testing web service APIs,Security Testing A denial-of-service attack (DoS attack) is an attempt to make a computer resource unavailable to its intended users. Prevent an

13、 Internet site or service from functioning efficiently, temporarily or indefinitely. Consumption of computational resources, such as bandwidth, disk space, or processor time Crash the operating system itself.,Testing web service APIs,Security Testing Testing - Simulate denial-of-service attacks Popu

14、lar denial-of-service mitigation products from Arbor Networks,Testing web service APIs,Interoperability Testing The ability of two or more systems or components to exchange information and to use the information that has been exchanged. Involves different technology platforms and development tools.

15、Developers use many different tools to generate the contracts (WSDL) and modify them in the process.,Testing web service APIs,Interoperability Testing Testing should be tested on different technology platforms.,Testing web service APIs,Compliance Testing Testing to determine whether we meet some spe

16、cified standards Validating WSDL definitions Validating SOAP request/response messages,Testing web service APIs,Backward Compatibility Testing,As businesses evolve, changes may required in the Web Services, but some consumers may want to continue the old services. The challenge is to make sure that

17、old service consumers are still supported.,SOA Testing Challenges,SOA Testing Challenges,Major Challenges: No user interface for the Web Services Difficult to create Real time applications Test Data should be close to the end user environment Infinite consumers possible,SOA Testing Challenges,Test A

18、utomation Client Simulators (Message simulation) Service Simulators Automatic test data creation Choosing the right test automation tool Maintaining pool of testing resources with SOA domain knowledge,SOA Test Automation Approach,Traditional Testing Tools,GUI Testing Approach,In House Test Tools,Web

19、 Service Testing Tools,SOA Test Automation Approach,Traditional Testing Tools Web Services SOAP requests needs to be generated manually or using a supported third party vendor testing tool Integrating traditional functionality testing tool and other such third party tool is not feasible due to its n

20、ature and limitations A mix of manual and automated process is an additional overhead Its a time consuming and expensive effort,SOA Test Automation Approach,GUI Testing Approach Web Service is UI less application. GUI application should be developed Web service interface changes demands often GUI ch

21、anges Web Services security testing that requires encrypted String result1 = Iph.findCountry(“53”); If (result1.equals(“India”) System.out.println(“Test1 Passed”); Else System.out.println(“Test1 Failed”);,Example Strategy 2,Store the data in a xml file 53 India 3ffe:1900:4545

22、:3:200:f8ff:fe21:67cf US 2.77.88 Invalid Input ,Example Strategy 2,Read the xml file as test data input. Parse the xml file into an Object(xmlObject) IPHelper iph = new IPHelper(); For (int I =0; IxmlObject.length; I+) String result1 = Iph.findCountry(xmlObject.input); If (result1.equals(x

23、mlObject.expectedresult) System.out.println(“Test” + I + “Passed”); Else System.out.println(“Test” + I + “Failed”); ,Exercise,Web Service API Gives the current temparature of the city in required units Float getTemparature(String City, Char Unit) Unit can be F(Farenheit) or C(Celsius) Write a test p

24、lan Better come up with unique test cases.,Exercise,Some Unique Test Cases Case Sensitivity bangalore, f, c, F, C,Exercise,Some Unique Test Cases Multiple names for a same city Mumbai, Bombay,Exercise,Some Unique Test Cases City name contains space New Delhi,Exercise,Some Unique Test Cases Same city

25、 name in many countries Hyderabad(Ind), Hyderabad(Pakistan),Exercise,Some Unique Test Cases City Name contains Single Quote Gizzards Cove,Exercise,Some Unique Test Cases City Name contains Same string repeated Zu Zu,Exercise,Some Unique Test Cases The City is in North/South Pole should return negati

26、ve value for the expected result,Exercise,Some Unique Test Cases City Name is very Long string - Guangzhou in southern China, Name of the city LLANFAIRWLLGWYNGLLGOGERYYCHWYRNDROBWILLLLANTYSILIOGOGOGOCH In New Zealand, Name of the city - Taumatawhakatangihangakouuauotamateaturipukakapikimaungahoronukupokaiwhenuakitanatahu,Testing web service Applications,Functional Testing Services specifically designed to function as independent entities may work perfectly well in isolation, but might not function as expected when integrated into applications due to underlying