SmartBear SoapUI 5.1 Test Automation Study Study Version: 1.0 Stand vom: 4/14/2015 5:37:00 PM Status: Internal Author: Elisabeth Bauernhofer Document-ID: Classification: Internal Software Quality Lab. Alle Rechte vorbehalten. Druckdatum: 14.04.2015
Table of Content Document information... II General... II Document-History... II Document-Quality assurance... II Purpose and contents of this document... II 1. GENERAL... 1 1.1. About the Company... 1 1.2. Product Portfolio... 1 1.3. Product History... 1 1.4. Program Parts... 1 1.5. Support... 2 1.6. PlugIn s... 4 2. SPECIFICATION... 5 2.1. Functional testing... 6 2.1.1. Test Design... 6 2.1.2. Assertion... 7 2.1.3. Test Execution... 9 2.1.4. Test Reporting... 11 2.2. Load & Performance Testing... 11 2.2.1. Test Design... 11 2.2.2. LoadTest Execution... 12 2.2.3. Validating Performance... 13 2.2.4. Test Reporting... 13 2.3. Service Mocking Overview... 13 2.4. Security Scans Overview... 16 2.5. Rest Testing Overview... 18 3. ADMINISTRATION... 20 3.1. Installation... 20 3.2. System Requirements... 20 4. CONCLUSION... 21 APPENDIX... 22 Picture list... 22 Version: 1.0 vom 24.01..2014 Author: Elisabeth Bauernhofer Status: Internal I / II
Document information General Connections to other documents: This analysis is part of Software Quality Lab`s Test Automation Study Receivers: - Document-History Version Status Date Responsible person Reason for changes/ Comments 1.0 released 24.10.2014 First Version Document-Quality assurance Rolle Name Availability (Place+Tel.+e-mail) Action Date Signature Author Elisabeth Bauernhofer Elisabeth.Bauernhofer@softwarequality-lab.com created 24.10.2014 Reviewer Nataliia Flaisinger, Alexsander Ofner Reviewed Releaser Released Purpose and contents of this document This document contains an objective analysis of a test automation tool and it should be available as a decision base for the people interested in the selection of a new tool. Version: 1.0 vom 24.01..2014 Author: Elisabeth Bauernhofer Status: Internal II / II
1. General SoapUI is a web service testing application for service-oriented architectures (SOA) and representational state transfers (REST). Its functionality covers web service inspection, invoking, development, simulation and mocking, functional testing, load and compliance testing. 1.1. About the Company SoapUI is a cross-platform functional testing solution. In a single test environment it provides SOAP- and REST-based Web services, to JMS enterprise messaging layers, databases, Rich Internet Applications, and much more. It is built entirely on the Java platform and uses Swing for the user interface. It also supports IDEA, Eclipse and NetBeans. SoapUI is licensed under the EUPL. It is an open-source tool but there is also a commercial version, SoapUI Pro, which mainly focuses on features designed to enhance productivity. The manufacturer of this tool, SmartBear Software, is a software company which provides tools for software developers, quality assurance engineers and IT professionals. SmartBear Software is the unification of AutomatedQA, Eviware, the original Smart Bear Software and Pragmatic Software. 1.2. Product Portfolio SoapUI is just one of many products in SmartBear Foundation s portfolio. They provides code review, automated testing, performance/load testing, API testing, performance profiling and development management tools. 1.3. Product History The first release of SoapUI (v1.0) was in October 2005. Ever since, a number of versions have been released with various new features and enhancements and the newest version of SoapUI is 5.1. The originator of SoapUI, Ole Lensmer was managing the project releases through a company called Eviware for the past few years. In July 2011, Eviware was acquired by SmartBear Software. 1.4. Program Parts Complete coverage of functional aspects of web services and web applications SoapUI supports most of the standards used in web applications, such as message transmission through HTTP, HTTPS transport as well as JMS. It also supports testing SOAP and RESTful web services. Version: 1.0 vom 01.12.2010 Author: Elisabeth Bauernhofer Status: Internal 1 / 22
Service mocking SoapUI mocks services simulate the web services before they are actually implemented. This gives the user the ability to test the web service consumer applications without waiting until the web service providers are implemented. Scripting Either using Groovy or JavaScript, SoapUI allows to do various pre- or post-processing test configurations such as dynamic mock responses, initialize or cleanup tests, dynamic mock operations dispatching and so on. Functional testing With SoapUI it is possible to do functional verifications against web services, web applications, and JDBC data sources. Using various in-built and custom assertions allows to validate responses of your tests. It also allows to add conditional test steps to control the test execution flow. Performance testing Performance and load tests can be quickly generated. Test automation SoapUI can be integrated into automated test frameworks such as JUnit, and the tests can also be launched through Apache Maven and Apache Ant build frameworks. It can also be integrated into continuous integration tools such as Hudson Jenkins or Bamboo for example. In addition to the preceding features, the proprietary version of SoapUI, SoapUIPro, provides users also with data-driven testing capabilities, HTTP recording, and test reporting facilities. 1.5. Support The documentation is freely available online. For SoapUI Pro customers the support is given via the SoapUI Pro support forum, or via the support web form. SmartBear offers for SoapUI also the possibility of training and certification. There are different models for both. Version: 1.0 vom 01.12.2010 Author: Elisabeth Bauernhofer Status: Internal 2 / 22
Certification The SoapUI certification allows both SoapUI Open Source and Pro users to measure their proficiency with SoapUI by taking an online exam. SoapUI 1: Certification Price Trainings There are two different types of Training. The On Demand Training, this is an extensive, selfpaced training. This sets the foundation for combining precisely targeted unit tests into multifaceted functional, security, and load tests. SoapUI 2: Trainings Price WiseClouds offers a two-day, hands-on, instructor lead training class dedicated to SoapUI Pro. It s composed of 20% lecture, 80% exercises and labs. It shows you how to use SoapUI Pro to test SOA, Web, REST, and JMS services for scalability, performance, and reliability. SoapUI 3: Lead training Class Version: 1.0 vom 01.12.2010 Author: Elisabeth Bauernhofer Status: Internal 3 / 22
1.6. PlugIn s The way SoapUI is designed to allow anyone to develop their own set of SoapUI features as SoapUI Plugins. Some of the these developments initiatives are: Dragonfly: It is a plugin for integrating SoapUI with HP Quality Center. It allows to export SoapUI test results inside HP Quality Center with simple configurations. ProgrammableWeb plugin makes it possible to browse and import APIs from the ProgrammableWeb API directory. The SoapUI eclipse plugin provides full SoapUI functionality from within eclipse. The Groovy Console plugin adds an interactive Groovy console for arbitrary scripting tasks. Version: 1.0 vom 01.12.2010 Author: Elisabeth Bauernhofer Status: Internal 4 / 22
2. Specification The SoapUI project is the central point in all SoapUI testing. Once the project is created, it is possible to create and run Functional Tests, Load Tests, create Mock Services or much more. The project can be created in two different ways: 1. Create a SOAP project SoapUI 4: Create a SOAP project 2. Add a WSDL SoapUI 5: Add WSDL Version: 1.0 vom 01.12.2010 Author: Elisabeth Bauernhofer Status: Internal 5 / 22
Thank you very much for downloading a public preview of our well known and highly appreciated tool studies. If you re interested in reading the whole document just apply here and request the document you want to read from our comprehensive set of studies already available. For further information on our tool studies visit our web site. Or, you can always use the following form to request the studies you want to read. Seite 1 von 2
Bestellformular für Tool-Studien/Order form for tool studies An/to Software Quality Lab GmbH Gewerbepark Urfahr 6 4040 Linz AUSTRIA Bitte ausgefüllt per Email an/ Please fill out and send to info@software-quality-lab.com Name/full name: Adresse/address: Firma/company: Email/email: Funktion/role: Telefon/phone: / [bitte füllen Sie die Daten vollständig und korrekt aus/please supply correct and complete data] Bestellliste/Order list [bitte kreuzen Sie die gewünschten Tools an/please select the tool studies] ALM, RM IBM Rational Requirements Composer 4.0.2 Jama Contour 3.61 NEU! Micro Focus Borland Caliber Microsoft Team Foundation Server 2013 Polarion ALM 2014 HP ALM 11 VersioneOne 13.0 Visure Solutions IRQA 4 Test Management Imbus TestBench 1.6.1 Micro Focus SilkCentral 2008 Microsoft VSTS 2010 Mozilla Testopia 2.1 Orcanos QPack 5 Polarion ALM 20121 NEU! Siemens SiTEMPPO 5.8 TestLink 1.9.12 Seapine TestTrack 2012 Static Code Analysis SonarQube 4.5 GUI Test Automation Appium 1.2.2 Bredex GUIdancer 4.2 HP UFT Professional 10 IBM Functional Tester 8.1.0.3 Microsoft VSTS 2010 QF-Test 3.5.1 NEU! Ranorex 3.3 SAP ecatt Selenium 2.0 SmartBear TestComplete 9.3 SmartBear SoapUI 5.1 Weitere Informationen auf unserer Website www.software-quality-lab.com. Embedded Systems LDRA 8.0 Razorcat Tessy 2.6 Load/Performance Apache JMeter 2.8 Grinder 3.4 HP LoadRunner 9.5 Neotys Neoload 3.0.3 SmartBear LoadUI 2.8.0 Unit Tests Google Test 1.5 JUnit 4.11 NUnit 2.5.7 Die Toolnamen und eingetragenen Warenzeichen sind Eigentum der jeweiligen Toolhersteller/Tool names are property of tool vendors. Die Studien sind grundsätzlich auf Anfrage frei erhältlich. Software Quality Lab behält sich jedoch vor, die Aufwände für gewisse Branchen und Privatpersonen in Rechnung zu stellen (z.b. Beratungsfirmen, Toolhersteller usw.) Studenten erhalten die Studie zum halben Preis/All studies are basically free, except for certain branches of industry or private persons, for whom we invoice at cost. Students get a discount of 50%. Seite 2 von 2
Tool Evaluation Center Efficient, goal-oriented and professional tool evaluation Unique in Europe What is TEC? The Tool Evaluation Center (TEC) is a neutral environment for evaluating software tools related to software development, through which you will receive a detailed, vendorindependent overview of the suitability of different tools for your software projects. Your Partner for software quality and testing Consulting Implementation Training Automation Evaluation Software Quality Lab is your competent partner in software quality and testing and one of the leading independent consulting companies in Austria. We specialize ourselves in the improvement of efficiency, quality and security in the fields of software development and system processes. All tools in TEC are up to date, installed and configured, furnished with examples and ready for demonstration. Practical work and getting to know the tools in a handson manner is also possible. Your Benefit EETime-saving: Tool selection in a few days. No time-consuming research and product requests, no installation and testing. EEPreparation of information for different target groups from technicians to the managing board. EESupport provided by specialists, ranging from requirements through to a proof of concept or a pilot project. Our services around the tool selection Tool categories in the TEC EEApplication Life Cycle Management EERequirements Management EETest Management EEGUI Test Automation EETest Data Management EEComprehensible decision criteria: Using special techniques we evaluate the tools together with you, basing on your requirements as a foundation for your investment decision. EELarge selection and direct comparison of products ranging from market leaders through newcomers to open source software and freeware. Linz / Vienna / Graz / Lustenau / Munich Requirements elicitation, Creating a list of criteria Tool review, Pre-selection of tools, Practical getting to know the tools in the TEC Workshop with 3-5 suitable tools, Proof of Concept, Planning and implementing the pilot project Integration with other tools Tools in TEC www.software-quality-lab.com Our TEC includes more then 40 installed tools from reputable manufacturer (e.g. IBM, HP, Micro Focus, Microsoft, Polarion, Siemens) as well as interesting newcomer products and alternatives from the open source area (e.g. JMeter, Selenium). Further details can be found at www.tool-evaluation.com. V. 2011-12 Software Quality Lab GmbH info@software-quality-lab.com www.software-quality-lab.com