Open Source Software Test Tools. Norbert Jansen Capgemini

Transcription

1 Open Source Software Test Tools Norbert Jansen Capgemini

2 TE3 Open Source Test Tools Norbert Jansen

3 Introduction Managing consultant at Capgemini Netherlands. Active in IT and testing for 14 years. Experience as a tester, test manager and test consultant. [email protected] Open Source Test Tools, Norbert Jansen / 3

4 Content Open Source Software. Test tools. Open Source Maturity Model (OSMM). Maturity survey of Open Source test tools. Three examples of Open Source test tools. Conclusions Open Source Test Tools, Norbert Jansen / 4

5 Open Source Software Open Source Software? Open Source Test Tools, Norbert Jansen / 5

6 Open Source has grown up Linux has become a reliable alternative operating system among IT professionals. Businesses can save millions (Gartner June 2004) In 2004 Forrester surveyed 140 large companies in North America to find out their open source plans. The 60% majority are adopting open source and half of them use it for mission-critical applications. How can Open Source Software aid testing? Open Source Test Tools, Norbert Jansen / 6

7 What is Open Source? Free availability of software source code. Adjusting code is not the exclusive right of the software supplier. Licence is about intellectual ownership and reuse. No licence fee, but not free. Open source development method: virtual community on Internet Open Source Test Tools, Norbert Jansen / 7

8 Test tools Test tools Fault Detection Support Static Dynamic Management Utilities Static analysis Test design Verification Open Source Test Tools, Norbert Jansen / 8 Performance Resource allocation Traffic monitor Coverage Dynamic analysis Link checker Test drivers Unit testing Compare Capture & Playback Usability Security Defect management Test database Control of test ware Test generator Test planning Source: Maurice Siteur in Automate your testing!

9 Using test tools Usage of test tools starts with selecting the proper tool. How to select an Open Source Software test tool? Open Source Test Tools, Norbert Jansen / 9

10 Open Source Maturity Model (OSMM) Aim: to objectively value open source software. Maturity predicts the risk that support and product development ceases to exist. OSMM is a method for determining long list & short list in the open source software selection process Open Source Test Tools, Norbert Jansen / 10

11 The Open Source Maturity Model Two pillars: Product indicators Measured purely on the product. Emphasizing on process quality. Criteria are described clearly. Set the minimum level. Applicability indicators Determine applicability of a product for a user. Weigh the product indicators for the application Open Source Test Tools, Norbert Jansen / 11

12 The Open Source Maturity Model Product indicators Product age, selling points, developer community, human hierarchies, licensing Integration collaboration, modularity standards Use support, ease of deployment, Acceptance user commodity, market penetration Applicability indicators Usability Interfacing Performance Reliability Security Proven Technology Vendor Independence Platform Independence Support Reporting Etc Open Source Test Tools, Norbert Jansen / 12

13 Survey of Open Source test tools Capgemini investigated 100 test tools in Q Majority of tools examined were dynamic testing tools. Second largest group was test management tools. Indicators examined: Age, License, Human Hierarchies, Developer community, Support, Ease of Deployment, and User community Open Source Test Tools, Norbert Jansen / 13

14 Number of tools Survey result Maturity of Test Tools Maturity Open Source Test Tools, Norbert Jansen / 14

15 JUnit Java Unit test tool. Foundation for many advanced unit test frameworks such as NUnit, XMLUnit, JUnitEE, Cactus and more. Used in daily build & test at Capgemini s Accelerated Development Centers. Unit and unit integration test. Collaborates with Open Source coverage tools. Interfaces with COTS Open Source Test Tools, Norbert Jansen / 15

16 The Grinder The Grinder is a pure Java load-testing framework. Can be used for load testing any J2EE application server. The Grinder makes it easy to orchestrate the activities of a test script in many processes across many machines, using a graphical console application. J2EE application server J2EE Performance Testing with BEA WebLogic Server by Peter Zadrozny, Phil Aston and Ted Osborne, published by Expert Press Open Source Test Tools, Norbert Jansen / 16

17 Bugzilla Part of the Mozilla foundation (the Open Source community behind Firefox). Defect tracking system Open Source Test Tools, Norbert Jansen / 17

18 Conclusions OS test tools certainly effective at point solutions. OS test tools frontrunners in functionality. Apart from very mature and powerful tools, there s a lot of garbage. OSMM is a big help in the selection process. Saving license cost alone not a good reason for OS test tools. Portal to OS test tools: Also look at or Open Source Test Tools, Norbert Jansen / 18

19 Any questions? Open Source Test Tools, Norbert Jansen / 19