Dirk Meyerhoff, Begona Laibarra, Rob van der Pouw Kraan, Alan Wallet (Eds.) Software Quality and Software Testing in Internet Times With Contributions of Stale Amland, Walter Bischofberger, Arnim Buch, Astrid Dehnel, Tessa Doring, Stefan Engelkamp, Thomas Fehlmann, Elmar Fichtl, Stephan Friedrich, Ulrich Hasenkamp, Dirk Huberty, Paul Keese, Dirk Kirstein, Andreas Kramp, Jens Lehmbach, Claus Lewerentz, Martin Lippert, Christoph Mecke, Michael Meyer, Trevor Price, Werner Schmitz-Thrun, Katrin Severid, Frank Simon, David Singleton, Jarle Vaga, Erik van Veenendaal, Michael Vetter, Steve Willis, Jan-Gerold Winter, Heinz Ziillighoven Springer
Table of Contents Jens Lehtnbach, Ulrich Hasenkamp Systems Development in Internet Times - Overview and Perspectives 1 Part I: Managing for Optimal Time to Market Jarle Vdga, Stale Amland Managing High-Speed Web Testing 1 Project Background 2 "High-Speed" Methods and Preparation 23 24 2.1 Exploratory Testing 24 2.2 Pair Testing 25 3 "High-Speed" Test Planning 25 4 "High-Speed" Test Execution 5 The Web Testing Experience 27 28 6 Warning! 7 Acknowledgements 30 30 Steve Willis Using QA for Risk Management in Web Projects 1 Increased Visibility of Application Failure 31 2 Risk and Management Thereof 32 2.1 Identify the Risks 2.2 Problem Perfect 33 33 2.3 Quantify the Risks 34 2.4 Manage the Risks 35 2.5 Communicate the Risks 2.6 Monitor the Risks 35 35 2.7 Examples of Risks 35 2.8 Additional Factors that Impact upon Risk 36 3 QA as a Risk Management Technique 37 3.1 Simple Prioritisation of QA and Testing against Risk 37 3.2 The Role of the QA and Test Strategy 40 3.3 QA and Test Planning Against the Identified Risks 42 4 Summary 48 Andreas Kramp, Tessa Doring, Stephan Friedrich Establishing Quality Procedures for Incremental Software Development 1 Introduction 49 2 Establishing a QM Procedure 50
VIII Table of Contents 2.1 Defining the Phases of the Development Procedure 51 2.2 Definition of Quality Management Integrated in the Process Flow 2.3 Co-operation with Other Project-Integrated Tasks 51 53 3 Experience with Integrated Quality Management 4 Acceptance Procedure 54 55 4.1 Objective and Content of the Acceptance Process 55 4.2 Integration in the Software Development Production Process 4.3 Sequence of the Acceptance Process 56 58 4.4 Inspection Criteria for Result Types 58 5 Experience Gained in Establishing the Acceptance Process 61 6 Summary 62 Part II: Processes Michael Meyer, Astrid Dehnel, Elmar Fichtl Designing Processes for User-oriented Quality Engineering 1 Introduction 65 2 Role, Significance and Design of Processes 2.1 Starting Basis 66 66 2.2 Roles 68 2.3 Flexible Application of the Processes in Practice 70 3 User-centred Quality Engineering: A Customer-Oriented Approach Including Acceptability, Usability and Quality-of-Service Analysis 71 3.1 Motivation 71 3.2 Usability, Acceptability and Quality Assessment 72 3.3 Integrated Process-Accompanying Approach 73 4 Integration of User-Centred Quality Engineering and Quality Criteria for Processes 74 4.1 Analysis 75 4.2 Integration in the Processes 77 4.3 Experiences 83 5 Summary 84 Martin Lippert, Heinz Zullighoven Using Extreme Programming to Manage High-Risk Projects Successfully 1 Flexible Processes for High-Risk Projects 85 1.1 Risk. 86 1.2 Extreme Programming 2 Steering XP Projects 87 88 2.1 The Planning Game 2.2 Small and Frequent Releases 89 90 2.3 Project Planning...91 3 Experience: Facts and Numbers 3.1 Small Releases 94 95 3.2 Internal Daily Planning 97 3.3 Estimates and Forecasts 99 3.4 Lessons Learned 100 4 Summary and Perspective 100
Table of Contents IX Dirk Huberty Adapting the Test Process for Web Applications - Strategies from Practice 1 Introduction 101 2 Internet Architecture and Infrastructure 102 3 Quality Objectives for Internet Applications 105 4 Classical Test Levels 107 5 Testing Internet Applications 108 5.1 Differences in Documentation and Developer Testing 109 5.2 Differences in Functional Testing 109 5.3 Differences in Overall Integration Testing 110 5.4 Differences in Non-Functional Testing 5.5 Publishing Ill 6 Test Tools and Test Automation 7 Differences in Test Organisation 8 Summary 113 Part III: Testing from the User's Perspective Thomas Fehlmann Business-Oriented Testing in E-Commerce 1 Software Testing and E-Commerce 1.1 Testing in E-Commerce 117 117 1.2 A Model for an E-Commerce System 118 2 Interaction Scenarios & Testing Techniques 2.1 Scenario Overview 121 121 2.2 User-Centred Testing 2.3 Business Process Testing 123 124 2.4 Web Integration Testing 125 3 Dynamic Testing According to Business Needs 126 3.1 Combinatory Metrics 127 3.2 Business Metrics 129 3.3 Test Coverage Combinators 3.4 Example: Hotel Reservation System 131 131 4 Conclusions 136 Paul Keese Strategic Testing: Focus on the Business 1 Introduction 138 2 Business Processes and Integration Testing 139 2.1 Testing Business Processes 139 2.2 The Business Process "New Bank Account" 140 3 Structuring the Test 142 3.1 Organisation of Integration Testing 142 3.2 Description of Software to be Tested 3.3 Test Item Definition 142 4 From Business Process to Test Case Sequence 4.1 Level of Testing Intensity 4.2 Building a Test Case Sequence 144
XII Table of Contents 5 A Typical Software Quality Assessment... 241 5.1 The System Assessment 5.2 The Architecture Assessment 242 244 5.3 The Design Assessment 245 5.4 The Code Assessment 6 Summary/Outlook 246 247 Katrin Severid, Jan-Gerold Winter "The Back-End Side of Web Testing": Integration of Legacy Systems 1 Introduction 250 2 The Settlement System db trader MVS 251 3 Test Environment of db trader MVS 252 4 Development of NetTrader 5 Challenges for the Development of New Front-Ends 253 254 6 Use of a Code Generator 254 7 Regression Testing 255 8 Configuration Management 9 Conclusion 256 256 Part V: Test Automation Techniques and Tools Christoph Mecke Automated Testing of mysap Business Processes 1 Introduction 261 2 Methodology 262 2.1 Motivation for Testing in an SAP Environment 262 2.2 Advantages of Automatic Testing 263 2.3 Test Strategy 264 2.4 The Modular Concept 2.5 Robustness and Adaptations 265 267 3 Tools 3.1 The SAP Test Workbench 268 268 3.2 Outlook 276 4 Summary 279 Part VI: Appendix References 283 List of Contributors 289 Copyrights 295