SmartBear SoapUI 5.1 Test Automation Study Study Version: 1.0 Stand of: 2/6/2015 2:13:00 PM Status: Internal Author: Elisabeth Bauernhofer Document-ID: Classification: Internal Software Quality Lab. Alle Rechte vorbehalten. Druckdatum: 06.02.2015
Table of Content Document information... II General... II Document-History... II Document-Quality assurance... II Purpose and contents of this document... II 1. GENERAL... 1 1.1. About the Company... 1 1.2. Product Portfolio... 1 1.3. Product History... 1 1.4. Program Parts... 1 1.5. Support... 2 2. SPECIFICATION... 4 2.1. Functional testing... 5 2.1.1. Test Design... 5 2.1.2. Assertion... 6 2.1.3. Test Execution... 8 2.1.4. Test Reporting... 10 2.2. Load & Performance Testing... 10 2.2.1. Test Design... 10 2.2.2. LoadTest Execution... 11 2.2.3. Validating Performance... 12 2.2.4. Test Reporting... 12 2.3. Service Mocking Overview... 13 2.4. Security Scans Overview... 16 2.5. Rest Testing Overview... 18 3. ADMINISTRATION... 20 3.1. Installation... 20 3.2. System Requirements... 20 3.3. PlugIn s... 20 3.4. Integration... 21 4. CONCLUSION... 23 APPENDIX... 24 Picture list... 24 Version: 1.0 vom 24.01..2014 Author: Elisabeth Bauernhofer Status: Internal I / II
Document information General Connections to other documents: This analysis is part of Software Quality Lab`s Test Automation Study Receivers: - Document-History Version Status Date Responsible person Reason for changes/ Comments 1.0 released 24.10.2014 First Version Document-Quality assurance Rolle Name Availability (Place+Tel.+e-mail) Action Date Signature Author Elisabeth Bauernhofer Elisabeth.Bauernhofer@softwarequality-lab.com created 24.10.2014 Reviewer Nataliia Flaisinger, Alexsander Ofner Reviewed Releaser Released Purpose and contents of this document This document contains an objective analysis of a test automation tool and it should be available as a decision base for the people interested in the selection of a new tool. Version: 1.0 vom 24.01..2014 Author: Elisabeth Bauernhofer Status: Internal II / II
1. General SoapUI is a web service testing application for service-oriented architectures (SOA) and representational state transfers (REST). Its functionality covers web service inspection, invoking, development, simulation and mocking, functional testing, load and compliance testing. 1.1. About the Company SoapUI is a cross-platform functional testing solution. In a single test environment it provides SOAP- and REST-based Web services, to JMS enterprise messaging layers, databases, Rich Internet Applications, and much more. It is built entirely on the Java platform and uses Swing for the user interface. It also supports IDEA, Eclipse and NetBeans. SoapUI is licensed under the EUPL. It is an open-source tool but there is also a commercial version, SoapUI Pro, which mainly focuses on features designed to enhance productivity. The manufacturer of this tool, SmartBear Software, is a software company which provides tools for software developers, quality assurance engineers and IT professionals. SmartBear Software is the unification of AutomatedQA, Eviware, the original Smart Bear Software and Pragmatic Software. 1.2. Product Portfolio SoapUI is just one of many products in SmartBear Foundation s portfolio. They provides code review, automated testing, performance/load testing, API testing, performance profiling and development management tools. 1.3. Product History The first release of SoapUI (v1.0) was in October 2005. Ever since, a number of versions have been released with various new features and enhancements and the newest version of SoapUI is 5.1. The originator of SoapUI, Ole Lensmer was managing the project releases through a company called Eviware for the past few years. In July 2011, Eviware was acquired by SmartBear Software. 1.4. Program Parts Complete coverage of functional aspects of web services and web applications SoapUI supports most of the standards used in web applications, such as message transmission through HTTP, HTTPS transport as well as JMS. It also supports testing SOAP and RESTful web services. Version: 1.0 Author: Elisabeth Bauernhofer Status: Internal 1 / 24
Service mocking SoapUI mocks services simulate the web services before they are actually implemented. This gives the user the ability to test the web service consumer applications without waiting until the web service providers are implemented. Scripting Either using Groovy or JavaScript, SoapUI allows to do various pre- or post-processing test configurations such as dynamic mock responses, initialize or cleanup tests, dynamic mock operations dispatching and so on. Functional testing With SoapUI it is possible to do functional verifications against web services, web applications, and JDBC data sources. Using various in-built and custom assertions allows to validate responses of your tests. It also allows to add conditional test steps to control the test execution flow. Performance testing Performance and load tests can be quickly generated. Performance Tests in SoapUI generally is created from existing Functional Tests. The Web Service performance can be validate under different load scenarios. Test automation SoapUI can be integrated into automated test frameworks such as JUnit, and the tests can also be launched through Apache Maven and Apache Ant build frameworks. It can also be integrated into continuous integration tools such as Hudson Jenkins or Bamboo for example. In addition to the preceding features, the proprietary version of SoapUI, SoapUIPro, provides users also with data-driven testing capabilities, HTTP recording, and test reporting facilities. 1.5. Support The documentation is freely available online. For SoapUI Pro customers the support is given via the SoapUI Pro support forum, or via the support web form. SmartBear offers for SoapUI also the possibility of training and certification. There are different models for both. Version: 1.0 Author: Elisabeth Bauernhofer Status: Internal 2 / 24
Certification The SoapUI certification allows both SoapUI Open Source and Pro users to measure their proficiency with SoapUI by taking an online exam. Trainings There are two different types of Training. The On Demand Training, this is an extensive, selfpaced training. This sets the foundation for combining precisely targeted unit tests into multifaceted functional, security, and load tests. WiseClouds offers a two-day, hands-on, instructor lead training class dedicated to SoapUI Pro. It s composed of 20% lecture, 80% exercises and labs. It shows you how to use SoapUI Pro to test SOA, Web, REST, and JMS services for scalability, performance, and reliability. Version: 1.0 Author: Elisabeth Bauernhofer Status: Internal 3 / 24
2. Specification The SoapUI project is the central point in all SoapUI testing. Once the project is created, it is possible to create and run Functional Tests, Load Tests, create Mock Services or much more. The project can be created in two different ways: 1. Create a SOAP project SoapUI 1: Create a SOAP project 2. Add a WSDL SoapUI 2: Add WSDL Version: 1.0 Author: Elisabeth Bauernhofer Status: Internal 4 / 24
When adding a WSDL or creating a project with an initial WSDL, SoapUI scans through all SOAP bindings which appear in the WSDL and finds out the operations exposed by the service. Then it generates the requests corresponding to those operations according to the XML schema of the service. 2.1. Functional testing 2.1.1. Test Design SoapUI Test Suites are one of the key building blocks in a project which allow to structure and execute functional tests. SoapUI structures functional tests into three levels; TestSuites, TestCases and TestSteps. TestSuite: A TestSuite is a collection of TestCases that can be used for grouping functional tests into logical units. Any number of TestSuites can be created inside a SoapUI project to support massive testing scenarios. TestCase: In a SoapUI project, a TestCase is a collection of TestSteps that are assembled to test some specific aspect of the service(s). Any number of TestCases can be add to a containing TestSuite and they can even modularize to call each other for complex testing scenarios. TestStep: are the "building blocks" of functional tests in SoapUI. They are added to a TestCase and used to control the flow of execution and validate the functionality of the service(s) to be tested. TestSteps are directly associated with a TestCase. The structure of these elements in a SoapUI project can be represented as follow: SoapUI 3: SoapUI structure Version: 1.0 Author: Elisabeth Bauernhofer Status: Internal 5 / 24
This Page Intentionally Left Blank. This is a paradox.
Thank you very much for downloading a public preview of one of our well known and highly appreciated Tool Studies. If you re interested in reading the whole document just apply here http://www.software-quality-lab.com/en/service-areas/toolevaluation-center/tool-study/tool-study-request/ and request the ones you want from our comprehensive set of studies already available. For further information on our Tool Studies visit our web site at http://www.software-quality-lab.com/en/service-areas/toolevaluation-center/tool-study/ Or, you can always use the following form to request the studies you want to read (German only).
Bestellformular für Tool-Studien An Software Quality Lab GmbH Gewerbepark Urfahr 30 BG4 4041 Linz AUSTRIA Bitte per FAX an +43 732 890072-411 oder per E-Mail an info@software-quality-lab.com Name: Adresse: Organisation / Firma: E-Mail: Funktion / Telefon: / Datum / Unterschrift: / [bitte füllen Sie die Daten vollständig und korrekt aus] Bestellliste [bitte kreuzen Sie die gewünschten Tools an] Anforderungsmanagement IBM Rational Requirements Composer 4.0 Jama Contour 3.61 NEU! Testdatengenerator GFB QUp 1.1 Embedded Systems LDRA 8.0 Razorcat Tessy 2.6 Micro Focus Borland Caliber Microsoft Team Foundation Server 2012 Polarion ALM 2012 HP ALM 11 Testmanagement Imbus TestBench 1.6 Micro Focus SilkCentral 2008 Microsoft VSTS 2010 Mozilla Testopia 2.1 Orcanos QPack 5 Polarion ALM 20121 NEU! Siemens SiTEMPPO 5.8 TestLink 1.8 Seapine TestTrack 2012 GUI Testautomatisierung Bredex GUIdancer 4.2 HP QuickTest Professional 10 IBM Functional Tester 8.1 Microsoft VSTS 2010 QF-Test 3.5.1 NEU! Ranorex 3.3 SAP ecatt Selenium 1.0 SmartBear TestComplete 9.2 Last- und Performanztest Apache JMeter 2.3 Grinder 3.4 HP LoadRunner 9.5 Neotys Neoload 3 Unit Test Google Test 1.5 JUnit 4.8 NUnit 2.5 Weitere Informationen auf unserer Homepage www.software-quality-lab.com. Die Tool-Namen und eingetragenen Warenzeichen sind Eigentum der jeweiligen Tool-Hersteller. Die Studien sind grundsätzlich kostenlos; Software Quality Lab behält sich jedoch vor, die Kosten von EUR 100,00 für die erste Studie sowie EUR 70,00 für jede weitere Studie für gewisse Branchen und Privatpersonen in Rechnung zu stellen (z.b. Beratungsfirmen, Tool-Hersteller usw.) Studenten erhalten 50% Rabatt.
Tool Evaluation Center Efficient, goal-oriented and professional tool evaluation Unique in Europe What is TEC? The Tool Evaluation Center (TEC) is a neutral environment for evaluating software tools related to software development, through which you will receive a detailed, vendorindependent overview of the suitability of different tools for your software projects. Your Partner for software quality and testing Consulting Implementation Training Automation Evaluation Software Quality Lab is your competent partner in software quality and testing and one of the leading independent consulting companies in Austria. We specialize ourselves in the improvement of efficiency, quality and security in the fields of software development and system processes. All tools in TEC are up to date, installed and configured, furnished with examples and ready for demonstration. Practical work and getting to know the tools in a handson manner is also possible. Your Benefit EETime-saving: Tool selection in a few days. No time-consuming research and product requests, no installation and testing. EEPreparation of information for different target groups from technicians to the managing board. EESupport provided by specialists, ranging from requirements through to a proof of concept or a pilot project. Our services around the tool selection Tool categories in the TEC EEApplication Life Cycle Management EERequirements Management EETest Management EEGUI Test Automation EETest Data Management EEComprehensible decision criteria: Using special techniques we evaluate the tools together with you, basing on your requirements as a foundation for your investment decision. EELarge selection and direct comparison of products ranging from market leaders through newcomers to open source software and freeware. Linz / Vienna / Graz / Lustenau / Munich Requirements elicitation, Creating a list of criteria Tool review, Pre-selection of tools, Practical getting to know the tools in the TEC Workshop with 3-5 suitable tools, Proof of Concept, Planning and implementing the pilot project Integration with other tools Tools in TEC www.software-quality-lab.com Our TEC includes more then 40 installed tools from reputable manufacturer (e.g. IBM, HP, Micro Focus, Microsoft, Polarion, Siemens) as well as interesting newcomer products and alternatives from the open source area (e.g. JMeter, Selenium). Further details can be found at www.tool-evaluation.com. V. 2011-12 Software Quality Lab GmbH info@software-quality-lab.com www.software-quality-lab.com