Test automation Delta Lloyd, successful IT business alignment. Eric de Graaf

Transcription

1 Test automation Delta Lloyd, successful IT business alignment Eric de Graaf June

2 Your presenter for today Eric de Graaf Team lead test automation Delta Lloyd Leven Test tool specialist/consultant EclipseIT HP trainer for test tooling (UFT/ALM/LoadRunner/PC) 2

3 Key points in this presentation Align business and IT testing Start small and agile; prove your worth! Consolidation of knowledge / central de-central approach 3

4 ART team ART = Automated Regression Test ART team since 2007 at Delta Lloyd Life Now 4 test navigators over various divisions, more to come Applications Back-office application JAVA / Oracle forms / Oracle database, Webservice, Web front-end (HTML), Modern web front-end (AJAX) Other features About 300 automated test cases Release oriented: every 2 months Regression, smoke and intake tests Methodology: Data Driven Business Process Testing 4

5 Why test automation? Drivers for change Business drivers Mergers & Acquisitions Reorganization New business model / processes New products / prices Compliance drives Legislation SOX, SEC, FDA, Basel2 Governance CSR, Risk mgmt., Industry norms & standards Technology drivers Upgrades Migrations Patches New functionality 5

6 Points of attention for test DL Manual functional testing vs. automated testing lacks knowledge transfer (two different worlds: Business vs. IT); Operational testing (AD-HOC) no time for improvement steps (automation); Test tooling fragmented over Delta Lloyd landscape (various tools, various expertise levels, who knows what? consolidate efforts); 6

7 ART team has fulfilled these attention points by: Manual functional testing vs. automated testing lacks knowledge transfer (two different worlds: Business vs. IT); A) Defined a process for test automation and testing artifacts for business driven automated testing. Operational testing (AD-HOC) no time for improvement steps (automation); B) Regression testing proved that it could reduce manual test execution time. Test tooling fragmented over Delta Lloyd landscape (various tools, various expertise levels, who knows what? consolidate efforts); C) Advised HP as a strategic partner for automated testing; D) ART team consolidates testing tool knowledge. 7

8 A) Align business / IT testing - process Process consist of a flow (how to start automation) and a defined set of roles. Flow (hi-level picture): Automate a representative flow; will TI PoC Ops the investment prove that automation works for the application. It can be automated? Can be Do made? it!? Is the organization ready for test automation? 8 Start small and agile Dedicated Test environment Test Navigator Involved? Controlled Releases?

9 A) Align business / IT testing Business knowledge Knows processes Most likely companies own staff Test automation knowledge (preferably) Scripting / programming knowledge Experience with ALM tooling BPT methodology (Business Process Testing) 9

10 A) Align business / IT testing Process and artifacts created to align test automation with business testing Data Table Defined clear roles Template as outtake of PoC Load as ALM Data Table Develop BPT components and Test Plans System under test Automated HP ALM Testing Test Report Test Report; Analysis done by TA/UAT 10

11 A) Align business / IT testing roles blueprint Define test scenarios and test cases Create/define reusable test data for test cases Fill in automation spreadsheet Maintain automation spreadsheet Analysis of test results Raise and chase defects Build new / maintain exisiting UFT BPT components Load in the automation sheet in HP ALM Execute test cases (HP ALM) Deliver test run report 11

12 A) Align business / IT testing testing artifact Datasource Test case names Components Labels for application controls Values on controls Components Components 12

13 A) Align business / IT testing testing artifact Datasource Business components 13

14 A) Align business / IT testing testing artifact Datasource Business components UFT code 14

15 Creating Test Cases - proces intern Systeem Under Test Test Navigator Objects Components Inloggen Navigeer Offerte Uitloggen Test Cases Test Analist 15

16 Waaruit bestaat een Test Case intern Components are placed in the right sequence (Test Analist) The right data for that flow is filled in the automation spreadsheet (Test Analist) 1 to n Test Cases Are created based on these components 16

17 Maken van Test Cases - proces intern Systeem Onder Test Test Navigator objecten Componenten Inloggen Navigeer Offerte Uitloggen Test Cases Test Analist 17

18 intern Maintenance on Test Cases SUT changed Systeem Onder Test Test Navigator objecten Componenten Inloggen Navigeer Offerte Uitloggen Test Cases Test Analist 18

19 Maintenance required intern Systeem Onder Test Test Navigator Maintain Componenten Test Cases Inloggen a Navigeer a a Offerte Uitloggen a Test Analist Maintain a 19

20 B) Prove test automation added value As seen at Delta Lloyd: Test automation decreased test execution time by 80% No incorrect inputs during execution (machine never tired) Schedule during night time Decrease workload on business testers Gain focus on more important work (new features) 20

21 C) Advised HP as a strategic partner for automated testing PROCESS/ APPLICATION Business process TEST TYPE User acceptance test Functional acc. test Sys. Integration test System test JAVA, C#, C++ Unit test 21

22 D) ART team consolidates testing tool knowledge Setup new ALM projects for other domains; provide jump start, align way of working. HP UFT tool support HP LoadRunner since march 2014 Provide internal HP training Selenium WebDriver (for cross browser testing) Future plans HP Service Virtualization (integrate in test automation) HP Business Availability Center (application chain monitoring) Version- and configuration management (custom HP/VBA solution) 22

23 Future plans IT System Leven chain 23

24 Future plans Customer facing (b2c) IT System Leven chain 24

25 Future plans Customer facing (b2c) IT System Leven chain Customer calls service desk Service management will need to investigate where issue lies Involved supporting party must resolve Divisions only manage their own scope 25

26 Future plans Chains 26

27 Questions? 27

28 Volgende slides zijn reserve slides 28

29 First implementation 29

30 Further Test automation in our organization 30

31 A small seed 31

32 Continuity 32

33 The next step 33

34 New steps Service virtualization Agile manager Education HP ALM New target systems Chains

35 Commitment op prioritering en roadmap MT sturing Hamerslag operationele launch Businesscase Operationele fase Eerste inschatting door IT/Test manager Support door ART team Fine tunen BC op basis van PoC bevindingen Economische haalbaarheid Verkenningsfase PoC (proef) fase 1. Welke applicaties komen in aanmerking 2. Welke Divisies willen graag aan de slag met test automatisering 3. Opstellen prioritering (roadmap met daarin TI, PoC en Operationele fase ingepland per divisie 4. MT besluit ter consolidatie 5. Inplannen TI sessies PoC rapport Technische haalbaarheid Test Analyst Test Navigator In divsie Organisatorische haalbaarheid Support Test Navigator ART team Test Navigator ART team Test Analyst Test Navigator ART team