TestLink 1.8. Test Management Tool Study. Analysis. Version: 1.0 Status of: :42:00 Status: Released Autor: Jaroslav Klimes

Transcription

1 TestLink 1.8 Test Management Tool Study Analysis Version: 1.0 Status of: :42:00 Status: Released Autor: Jaroslav Klimes Dokument-ID: Klassifikation: Internal Software Quality Lab. Alle Rechte vorbehalten. Druckdatum:

2 Document information General Contents DOCUMENT INFORMATION... 2 General... 2 Document history... 2 Document quality assurance... 2 Purpose and contets of this document GENERAL About the developer Product portfolio Program parts Integrations TEST ACTIVITIES Planning and controlling Analysis and design Implementation Execution Evaluation and reporting ADMINISTRATION User management Version management CONCLUSION ATTACHEMENT Picture list / 19

3 Document information General Document information General Relation to other documents: This analysis is a part of the Test Management Study by Software Quality Lab. Receivers: Document history Version Status Date Responsible Person Reason for change / Notes 0.9 Draft Jaroslav Klimes 1.0 First Release Jaroslav Klimes Document quality assurance Role Name Availability (Org.+Tel.+ ) Action Date Signature Author Jaroslav Klimes created Reviewer Reviewer Release Johannes Hochrainer Bernhard Groiss Johannes Hochrainer reviewed reviewed released Purpose and contets of this document This analysis is a part of the Test management study by Software Quality Labs. 2 / 19

4 1. General 1.1 About the developer 1. General 1.1 About the developer TestLink is an open-source test management system released under the GPL license. The project is mantained by an Open Community of Testers, and it can be used for free even in commercial environments. We include TestLink because of expected suitable combination of quality and price by this product. Open-source products can make an excellent choice in the field software quality, as choosing these may save a significant amount of money. However, each company should consider carefully if the lower product purchase costs compensate the downsides of the concrete open-source solution. A common flaw of open-source can be for example a harderto-get technical support. 1.2 Product portfolio TestLink is the only product of the Open Community of Testers. Its capabilities include creating and managing test cases as well as organizing them into test plans. These test plans allow team members to execute test cases and track test results dynamically, generate reports, trace software requirements, prioritize and assign tasks. Analyzed Tool TestLink Name Version Functions Requirement management, Test management, Version 1.8 RC1 management 1.3 Program parts TestLink is built on a client-server architecture. The server is based on PHP interpreter cooperating with a database system in the background, whereas its interface makes use of a web server (see TestLink 1). These components are not included in the installation however. TestLink gives the user freedom of choice of these components, as its scripts are compliant with the SQL standards. That means the server can run on either Windows or Linux platform, eventually also on other platform able to run the PHP interpreter, database server and web server 3 / 19

5 1. General 1.4 Integrations TestLink 1: The system architecture (source: TestLink installation manual) The installation of the server part is not difficult in case all the prerequisite server components are already cofigured and running. In such case the installation consists just of two steps: In the first step the program files (PHP scripts) are copied to a folder recognized by the PHP interpreter and the web server, the second step is running of an installation script. The client side is also platform-indpendent, it is represented by a web browser. TestLink developers mention the support of Firefox 1.0 and higher and Internet Explorer 6 (IE7 does not comply to all standards). Other browsers should also work well if they don t have problems with JavaScript, XHTML and CSS support. TestLink is designed as a single application that houses all of the supported features, no modules are used. As for the documentation, the developers provide installation and user manuals that offer a sufficient level of detail for all actions. The web pages of TestLink offer the user and developer forum as well, which is probably the only way of getting some developer support. In the application itself no help is provided except the links on the documentation files. Although the documentation is available just in the english language, the interface of the application itself is available in many language versions including german one. 1.4 Integrations TestLink is able to collaborate with a number of bug-tracking tools: Mantis, Bugzilla, JIRA, TestPlus, Eventum and Track. There is also a possibility to integrate with the source code management tools. Finally, an open API is also provided together with the product. 4 / 19

6 1. General 1.4 Integrations TestLink features a document import and export function as well: XML and CSV formats are supported. A feature worth of interest is the possibility of direct import of CSV files exported from Telelogic DOORS, which is currently the leading requirements management tool. 5 / 19

7 2. Test activities 1.4 Integrations 2. Test activities TestLink is a tool covering the essential testing activities: The requirement management, Test Case management, test execution (manual), test evaluation and metrics, version control plus defect reporting and management that can be added by integrating with other open-source tools (see the schema TestLink 2) The typical workflow in TestLink looks as follows: At the first place, the administrator must create a test project, while assigning users to this project and setting their rights as well. The test project is a base stone of TestLink. Its function is to cover other TestLink objects in order to make clear which of them belong together. Among the objects that can be subordinated to test project are requirement document with requirements, and test suites with test cases. After the test project is created, it is possible to create a requirement specification document. Under it the actual requirements can be added. Then the tests can be specified, firstly creating the test suites and secondly assigning the test cases to these. The test suites or test cases can also have a keyword attached, which fulfills the role of additional identifier. Once the test cases are created and some requirements are available, it is possible to connect these together. The next step to be done is to create a test plan. The test plan is an object that specifies the execution of tests. In contrast to other systems, the object that aggregates the test cases for excution is the test plan, not the test suite as it is usual. The purpose of test suites is just in improved organisation of test cases. The Test plan also covers several further types of objects: Builds, milestones and test results, whereas it can also have specific users and user rights assigned. During the actual test execution the test cases are assigned to builds and executed, and reports can be derived from the results. However, as it will be decribed later in detail, for defect reporting and management capabilities it is necessary to use the integration with some defect reporting tool. 6 / 19

8 2. Test activities 2.1 Planning and controlling TestLink 2: Functions overview (source: TestLink user manual) 2.1 Planning and controlling After logging in into TestLink the first page that appears is the home page (see TestLink 3). This is the control center of the system, most of the features can be accessed right from this page. The interface is similar to the usual web page design: Two menu columns on the left and on the right side of the screen, and one more menu in form of a stripe above the middle of the screen. Aside of the menu the top of the screen also shows the information concerning the user and test project which is currently active. The top menu is the main menu, where the most important actions can be quickly performed. However, many of these actions can also be accessed through the options in the left or right menu. As for these, the left menu shows the actions related to the test project and its subordinate objects, while the right menu offers the options related to the test plan and its subordinates. 7 / 19

9 Thank you very much for downloading a public preview of our well known and highly appreciated tool studies. If you re interested in reading the whole document just apply here and request the document you want to read from our comprehensive set of studies already available. For further information on our tool studies visit our web site. Or, you can always use the following form to request the studies you want to read. Seite 1 von 2

10 Bestellformular für Tool-Studien/Order form for tool studies An/to Software Quality Lab GmbH Gewerbepark Urfahr Linz AUSTRIA Bitte ausgefüllt per an/ Please fill out and send to info@software-quality-lab.com Name/full name: Adresse/address: Firma/company: / Funktion/role: Telefon/phone: / [bitte füllen Sie die Daten vollständig und korrekt aus/please supply correct and complete data] Bestellliste/Order list [bitte kreuzen Sie die gewünschten Tools an/please select the tool studies] ALM, RM IBM Rational Requirements Composer Jama Contour 3.61 NEU! Micro Focus Borland Caliber Microsoft Team Foundation Server 2013 Polarion ALM 2014 HP ALM 11 VersioneOne 13.0 Visure Solutions IRQA 4 Test Management Imbus TestBench Micro Focus SilkCentral 2008 Microsoft VSTS 2010 Mozilla Testopia 2.1 Orcanos QPack 5 Polarion ALM NEU! Siemens SiTEMPPO 5.8 TestLink Seapine TestTrack 2012 Static Code Analysis SonarQube 4.5 GUI Test Automation Appium Bredex GUIdancer 4.2 HP UFT Professional 10 IBM Functional Tester Microsoft VSTS 2010 QF-Test NEU! Ranorex 3.3 SAP ecatt Selenium 2.0 SmartBear TestComplete 9.3 SmartBear SoapUI 5.1 Weitere Informationen auf unserer Website Embedded Systems LDRA 8.0 Razorcat Tessy 2.6 Load/Performance Apache JMeter 2.8 Grinder 3.4 HP LoadRunner 9.5 Neotys Neoload SmartBear LoadUI Unit Tests Google Test 1.5 JUnit 4.11 NUnit Die Toolnamen und eingetragenen Warenzeichen sind Eigentum der jeweiligen Toolhersteller/Tool names are property of tool vendors. Die Studien sind grundsätzlich auf Anfrage frei erhältlich. Software Quality Lab behält sich jedoch vor, die Aufwände für gewisse Branchen und Privatpersonen in Rechnung zu stellen (z.b. Beratungsfirmen, Toolhersteller usw.) Studenten erhalten die Studie zum halben Preis/All studies are basically free, except for certain branches of industry or private persons, for whom we invoice at cost. Students get a discount of 50%. Seite 2 von 2

11 Tool Evaluation Center Efficient, goal-oriented and professional tool evaluation Unique in Europe What is TEC? The Tool Evaluation Center (TEC) is a neutral environment for evaluating software tools related to software development, through which you will receive a detailed, vendorindependent overview of the suitability of different tools for your software projects. Your Partner for software quality and testing Consulting Implementation Training Automation Evaluation Software Quality Lab is your competent partner in software quality and testing and one of the leading independent consulting companies in Austria. We specialize ourselves in the improvement of efficiency, quality and security in the fields of software development and system processes. All tools in TEC are up to date, installed and configured, furnished with examples and ready for demonstration. Practical work and getting to know the tools in a handson manner is also possible. Your Benefit EETime-saving: Tool selection in a few days. No time-consuming research and product requests, no installation and testing. EEPreparation of information for different target groups from technicians to the managing board. EESupport provided by specialists, ranging from requirements through to a proof of concept or a pilot project. Our services around the tool selection Tool categories in the TEC EEApplication Life Cycle Management EERequirements Management EETest Management EEGUI Test Automation EETest Data Management EEComprehensible decision criteria: Using special techniques we evaluate the tools together with you, basing on your requirements as a foundation for your investment decision. EELarge selection and direct comparison of products ranging from market leaders through newcomers to open source software and freeware. Linz / Vienna / Graz / Lustenau / Munich Requirements elicitation, Creating a list of criteria Tool review, Pre-selection of tools, Practical getting to know the tools in the TEC Workshop with 3-5 suitable tools, Proof of Concept, Planning and implementing the pilot project Integration with other tools Tools in TEC Our TEC includes more then 40 installed tools from reputable manufacturer (e.g. IBM, HP, Micro Focus, Microsoft, Polarion, Siemens) as well as interesting newcomer products and alternatives from the open source area (e.g. JMeter, Selenium). Further details can be found at V Software Quality Lab GmbH info@software-quality-lab.com