Rational Quality Manager Quick Start Tutorial 1
Contents 1. Introduction... 2 2. Terminology... 3 3. Project Area Preparation... 4 3.1 Adding Users and specifying Roles... 4 3.2 Managing Tool Associations... 5 4. Test Planning... 6 4.1 Creating the Test Plan... 7 4.2 Defining Entry Criteria, Exit Criteria and Quality Objectives.... 9 5. Creating Tests for Requirements... 10 5.1 Creating the test environments... 10 5.2 Adding Requirements... 14 5.3 Adding Test Cases... 14 5.4 Running Test Cases... 17 1. Introduction Rational Quality Manager empowers teams to manage the quality lifecycle of a project by defining test cases, sharing information and reporting project metrics. This tutorial is based on version 4.0.0.1 of RQM. This tutorial explains the basic features and helps getting started with Rational Quality Manager. More information can be found in the online library of Jazz.net: https://jazz.net/library If you have comments or questions regarding this document, Jazz or Rational Quality Manager, please contact catedra.ibm.fiupm@gmail.com 2
2. Terminology Test Plan: A document detailing a systematic approach to testing a system. Test Case: a set of conditions or variables under which a tester will determine whether an application or software system is working correctly or not. Test Script: a set of instructions that will be performed on the system under test to test that the system functions as expected. Test Environment: a setup of software and hardware on which the testing team is going to perform the testing of the software product. Defect: is a condition in a software product which does not meet a software requirement or enduser expectations. 3
3. Project Area Preparation Before starting the project it is advisable to configure the team and project area. All of the following tasks require the user to go to the Application Administration page, which can be done as follows: 1. Click on the Administration icon and then click Manage This Project Area 3.1 Adding Users and specifying Roles When you create a project area you are the administrator and you can add members and specify the roles of each of these members. 1. On the Application Administration page of the web client, click the Overview tab. 2. Add the members that will be related to your project. To add members do the following: a. In the Members pane, click Add. b. In the Contributor Selection window, enter the name of a user to search for, or click Show All. Remember to use the name or last name of the user instead of the user id. c. In the Matching users pane, select a user. d. Click Add. 4
3. Specify the roles of each member. To specify a role do the following: a. Find the user in the Members pane; click the Process Roles icon on the Actions column. b. In the Edit Process Roles window, select the desired role(s) in the Available Roles list, click Add -->. c. Click OK. 4. Click Save. 3.2 Managing Tool Associations Rational Products can be interconnected and other tools, such as Rational Requirement Composer and Rational Team Concert can provide services to Rational Quality Manager. This tutorial will show some of these connections. 1. On the Application Administration page of the web client click the Overview tab. 2. Go to the Associations section. Check that the following associations are added: Defects -> Change and Configuration Management (Rational Team Concert) Quality Management Tasks -> Change and Configuration Management (Rational Team Concert) Requirements -> Requirements Management (Rational Requirements Composer) 5
3. If they are not added click Add. 4. On the Add Association view choose the Application, choose the right Association (from the ones listed on step 2) and choose your project from the list of artifact containers. Click OK. Repeat for all the missing associations. 5. Click Save. 4. Test Planning 6
You can create test plans in order to guide the quality managing work. A test plan in RQM has numerous options; in this tutorial we take an overview of the most commonly used aspects of the test plan. 4.1 Creating the Test Plan 1. In the Project Dashboard view, expand the Planning Menu, click Create Test Plan. 2. In the Test Plan view, you will see the following: An overview section where you can change the attributes of name, action, owner, priority and description of the test plan. Choose your desired values for these attributes. Also you can change the template, leave it as Default Test Plan. A table of contents on the left column where you can see all the sections of the test plan. By clicking Manage Sections you can add, remove, create and edit sections in order to tailor the test plan to your own needs. A section detail section where you will see the working area of each section that you click open from the table of contents. 7
3. In each section you can create and link tasks in order to keep track of what you have to do. a. Click on Quality Task: Create b. On the Create Quality Task view fill the attributes (some are already filled with default values), set a due date and click OK. Now you can see the link to the newly created quality task next to the Quality Task label of the section. This quality task is a work item on another Rational tool called Rational Team Concert. 4. Click Save in order to save your project plan and your task associations. 8
4.2 Defining Entry Criteria, Exit Criteria and Quality Objectives. On the Test Plan you can define Entry Criteria that lists the objectives that have to be meet in the project before starting with the current test plan. The Exit Criteria that lists the objectives that have to be meet in order to finish the Test Plan successfully. Finally the Quality Objectives list the metrics that the product should reach in order to be considered a quality product. 1. In the Test Plan view click Entry Criteria. 2. Click the Manage Quality Objectives button. 3. On the Manage Quality Objectives view you will see a list of predefined objectives; you can also Add or Remove new objectives by clicking the corresponding buttons to add and to remove. Add the objectives you want for the entry criteria of your current plan. Click Save and close the Manage Quality Objectives view. 4. Click the Add Objectives button. 5. On the Select Quality Objectives window click the objective you want to add and click OK. The objective will be added to the Entry Criteria objectives list. Repeat for all the objectives you want to add to your Entry Criteria. 6. Click Save. 7. Then the objectives can be evaluated by changing its Actual Value and Status. 9
8. Repeat Steps 1 to 7 on the Exit Criteria Section and the Quality Objectives Section with the proper objectives for each section. 5. Testing for Requirements Rational Quality Manager can be linked to various tools such as Rational Requirements Composer in order to import or create Requirements that need to be tested. These requirements can be linked to test cases and each test case can have a number of test scripts. 5.1 Creating the test environments On the Test Environments Section you can add the different environments under which the application will be tested. This includes various platforms such as browsers, databases, operating systems and other items. 1. In the Test Plan view click Test Environments. 10
2. First add all the platforms that will be covered on the test plan. Combinations of these platforms will then be used to generate test environments. a. On the Platform Coverage Tab click the Edit button. b. You will see a list of all the environment options you can add. By changing the value on the Environment Type dropdown menu you can see change between browsers, operating systems, databases, etc. Choose the platforms you want to support and add them by clicking the Add button. 11
c. Click OK. On the Platform Coverage tab you will see a summary of the platforms you choose. d. Click Save. 3. Now create the test environments by combining the selected platforms. a. On the Test Environment Tab click the Generate new tests environments button. b. In Step 1 of the Generate Test Environments view choose the platforms you want to use for your test environments and the coverage, which is how the combination of these platforms will take place. Then click Next. 12
c. In Step 2 of the Generate Test Environment view, you can remove some undesired test environment configurations. In order to do this, select the test environments you want to remove and click the Remove button. d. Click Finish. On the Test Environment tab you will see the list of your test environments; here you can further edit them by adding descriptions to each test environments. You can also add more test environments or remove any test environment you don t want to use. e. Click Save. 13
5.2 Adding Requirements 1. Expand the Requirements Menu, click Create Requirement. 2. On the Create Requirement View fill the attributes and click Finish. This will create a new Requirement on another Rational Tool called Rational Requirements Composer. You can test all the Requirements you have in your Rational Requirements Composer project. 3. Repeat steps 1 and 2 in order to add all the requirements you want to test. 4. If you expand the Requirements Menu and click View Requirements you will be redirected to your project in the Rational Requirements Composer, where you can further edit, add and remove Requirements. 5.3 Adding Test Cases 1. Go back to your Test Plan. 2. Click Test Cases. 3. Click the Create Test Case button. 14
4. On the create Test Case view add a Name and a Description for the Test case. Add a Weight. This weight defines a scale under which the test completion will be assessed, a value of 100 a scale of 0 to 100. Choose the template (for now Default Test Case Template) and click OK. 5. Click Save. 6. Click the ID or the Name of your test case to open the Test Case View. In the Test Case View you will see the following: An overview section where you can change the attributes of name, action, owner, priority, owner and description of the test case. A table of contents on the left column where you can see all the sections of the test case. By clicking Manage Sections you can add, remove, create and edit sections in order to tailor the test plan to your own needs. A section detail section where you will see the working area of each section that you click open from the table of contents. 15
7. First, you should link your Test Case to one or more Requirements: a. Click Requirement Links. b. Click the Add new Links Button. c. On the Requirements Links View find the Requirement(s) you want to test using these Test Case and click OK. 8. Now you can add test scripts for the different scenarios of your test case. On Rational Quality Manager you can create both manual test scripts and automated scripts. Since 16
project is not linked to an automatic testing tool we will focus on manual test scripts. In order to ask a test script perform the following steps: a. Click Test Scripts. b. Click the Create New Test Script button. c. Add a Name and Descrption for your test script and click OK. d. Click Save. e. Click the ID or the Name of your test script to open the Test Script View. On the Test Script View you will see an Overview Section where you can change the Action, Owner, Test Data and Description of the Test Script. A Summary Section where you can change the Function and Test Phase attributes. A Formal Review Section where you can add reviewers and comments. And finally you can see the Manual Steps Section. f. Click Click to Add Step. For each step on the script the main attributes you can add are a Description and the Expected Results. Each of the sections is a Rich Text editor view, so you can add more information such as attachments, images, comments, etc. Add all the steps of your current test script. g. Click Save. h. Repeat steps b to g in order to add all the desired test scripts. 5.4 Running Test Cases 1. Go back to your Test Plan. 2. Click Test Cases. 17
3. Click the checkbox of the test case you want to run. 4. Click the Run Test Case button. 5. On the Run Test Case View you can change some attributes of the test case execution. Choose a test script (from the ones created in step 5.3) and a test environment (from the ones created on step 5.1). Click OK. 6. You will be prompted to the Test Execution View. There you will see a Summary of the Test Script, the Preconditions, and the Script Steps along with the controls to run them. Follow each step by logging the actual results, and clicking the control button that shows the status of each step: if the step is passed, if the step is failed or if the step is inconclusive. Run all the steps and for this example mark at least one as failed. 18
9. Click Show Result. You will be redirected to the Test Execution Result view. The first section you will see is the Overview and the Results Detail section, where you will see the summary of the execution, the actual result of the execution, the run time, among other attributes. 10. Click Weight Distribution. In this section you will see the distribution of the percentage of the results, this is used to show that the test case is not completely passed or completely failed (in this case). It is calculated automatically by the tool using the percentage of steps passed, failed and inconclusive, but it can be changed, for example if one step is more important than others its weight on the final result can be incremented. 11. Click Defects. In this section you can link the test case execution to one or more defects. Since this test case was failed, add a defect by clicking the Create New Defect button. 12. On the Create New Defect view fill the attributes (some are already filled with default values), choose your project on the Filed Against attribute, choose a severity and a priority, extend the defect description and click OK. Now you can see the link to the newly created defect on the list of the Defects section. This defect is a work item on another Rational tool called Rational Team Concert which then can be assigned to a developer who will fix the defect. 19
13. Click Save. 5.5 Viewing Test Case Execution Records 1. Go back to your Test Plan. 2. Click Test Case Execution Records. You will see the list of executions of test cases. 20
3. Click the ID or the Name of the test execution record you want to open. You will see a summary of the execution of the test case. 21