Test Automation in Agile & Migration 2 Selenium

Transcription

1 Test Automation in Agile & Migration 2 Selenium

2 Agenda» The Evolution of Testing» Importance of Test Automation in Agile» Rise of Open-Source and Low-cost tools» Growing Popularity of Selenium» Challenges in Migration and the Options» Migrate2Selenium» Q & A Unsolicited distribution is restricted. Copyright 2016, Gallop 2

3 The Evolution of Testing

4 Traditional Manual Testing Stand alone Applications Simple web Applications Testing with Defined Process Testing with Enhanced Maturity Multi-tier integrated Applications Test 80% CIT SIT UAT Matured Process Uncover Defects Phased with SDLC Evolution of Testing Early Days Test Automation In-house Testing Team In-house Test Centres It was all done by developers Unsolicited distribution is restricted. Copyright 2016, Gallop 4

5 Next Level of Automation with Diversified Tools Cross Technology integrated Complex Applications Agile Driven Test Engineering Diversified Complex Applications Mobility, Digital QE Transformation with Continuous Delivery Automation UI Performance Testing & Tuning CI & CD DevOps Performance Security Service/ API Application Security QE, Agile Transformation Era Specialized Centres of Excellence Federated CoEs Testing Managed Centres Unsolicited distribution is restricted. Copyright 2016, Gallop 5

6 Hybrid Model Trend Forecast Tomorrow's World Technology Focus Testing Focus Envisioned Test Roles Go Digital Internet of Things Virtualization Enterprise Mobility & Cloud Aggressive Functional Engineering Unsolicited distribution is restricted. Copyright 2016, Gallop 6 Building SMART Automation Platforms AI Enablement Hybrid Security Enabled Performance Engineering Digital Assurance Specialist Chief Quality Officer Creative Test Engineers Analytics Specialists Test Scientists Data Security Performance

7 The Importance of Test Automation in Agile

8 Why Agile? Early Revenue High Flexibility Speed to Market Client Involvement Better Quality Cost Control More Visibility Right Product Risk Management More Enjoyable! Unsolicited distribution is restricted. Copyright 2016, Gallop 8

9 Importance of Test Automation in Agile Early Defect Detection Rapid test coverage Faster release of new features to business users Reduction in cost of Defects Continuous Integration and Continuous Deployment Reusability of Test Cases Faster Time to Market Test in pieces rather than the whole product Unsolicited distribution is restricted. Copyright 2016, Gallop 9

10 Supporting the team Test Automation - Agile Test Quadrants Business Facing Q2 Q3 Automated & Manual Q1 Functional Testing Story Tests Prototypes Simulations Exploratory Testing Scenario Based Testing Usability Testing User Acceptance Testing Alpha/Beta Manual Q4 Critique Product Automated Unit tests API tests Web Services testing Component Tests Performance & Load Testing Security Testing *ility testing Tools Automated Source: Lisa Crispin, Brian Marick Technology Facing Unsolicited distribution is restricted. Copyright 2016, Gallop 10

11 Agile Automation Process Workflow User Story Define Acceptance Test Criteria Prototype Rinse & Refine Integrate Testing Design/Update proto types for the Business Components at UI and API level Application Code Development Develop/Update the code, User Interface controls and Unit test cases Iterative design Unit testing, integration testing and do bug fixes Execute API level automation scripts on continuous integration environment till Acceptance criteria is met Write Acceptance Test Cases Decision to Automate Test No Yes Design Pseudo codes/classes for API Level Automation Coordinate each other for developing Automation suite API Level Automation Testing Build API Level automation scripts with negative and positive scenarios UI Level Automation Testing Execute API level automation scripts on every component of developed code Execute end-to-end automation scripts on developed UI Adopt Hybrid Risk Based Testing for Test optimization Perform Manual Testing Design Keywords for UI Level automation Build automation scripts using Keywords for UI Level automation Capture UI Objects properties and integrate with UI automation scripts Perform goal based Exploratory testing Unsolicited distribution is restricted. Copyright 2016, Gallop 11

12 Test Automation Trends API / Mid Tier / Non GUI Automation Service/ Server Virtualization Automation in Agile Environment Automation in DevOPS Automation in Cross Platform/ Technology Agile Practices and Internet of Things are influencing the shift from GUI to API Testing Virtualization and automation testing will be managed by policies at a businessservice level, requiring all the groups in an organization to work in harmony Organizations gradually embrace Agile practices with CI/ CD framework to reduce time to market and gain the competitive edge Allows developers, quality assurance and operations to meet customer needs through Automation With the rise of IoT, the year 2016 will have more focus to validate cross-device/platform and crosstechnology functionalities Micro Services Selenium + Open Source tools Automation in BDD/ TDD Test Automation using Cloud Platform Mobile Automation Small, extremely focused services will can be individually tested through automation and integrated to form a robust application More and more organizations are embracing open-source test automation tools that are widely used across the globe Will lead to closer collaboration between developers & testers enabling shift left of testing Automate Application across a variety of browsers/devices/os in the cloud to reduce time-tomarket, increase release velocity without sacrificing quality Almost 35% of mobile app engagements last less than a minute, hence require more focus on Mobile test Automation for better consistency and user experience Unsolicited distribution is restricted. Copyright 2016, Gallop 12

13 Rise of Open-Source and Low-cost tools Journey of Test Automation Tools Mercury WinRunner Mercury WinRunner Mercury WinRunner HP QTP HP WinRunner HP QTP HP WinRunner HP QTP SQA Robot Rational Robot IBM Rational Robot IBM Rational Robot IBM Rational Robot Segue QAPartner Segue QAPartner Compuware QARun Borland Segue QAPartner Compuware QARun Microsoft Visual Studio Borland Segue QAPartner Compuware QARun Microsoft Visual Studio Microfocus Borland Compuware QARun Microsoft Visual Studio TRENDS Automated Unit Testing GUI Testing API Driven Testing Continuous Testing Evolution of Frameworks Unit Testing Frameworks: Nunit XUnit PyUnit Junit TestNG API Testing Frameworks: Frisby Chakram Django Hybrid BPT TDD New Age Tools Web Testing: Selenium Watir Ranorex Soap UI Sahi GUI Testing: Ranorex Test Complete eggplant Test Studio API Testing: HPUFT Parasoft vrest Postman Cloud Services Testing Gridlastic CloudBees Mailosaur Sauce Labs TestingBot Unsolicited distribution is restricted. Copyright 2016, Gallop 13

14 Growing Popularity of Selenium

15 Selenium vs Top Commercial Tools Jobs and Interest Source: Indeed Job Trends Source: Google Trends Selenium clearly has far higher adoption and interest than any other Commercial Test Tool Unsolicited distribution is restricted. Copyright 2016, Gallop 15

16 Why Selenium?» Capability to operate on almost every Operating System (OS)» Supports multiple languages such as Python, Perl, Ruby, PHP,.NET, and Java» Supports multiple browsers Opera, Safari, Chrome, IE 6, 7, 8 and Mozilla Firefox» Cost effective, being an open source tool» Has an active developer community for support» Supports parallel test execution on various browsers across various devices» Easy to use development interface» Provides scalability and sustainability in the long term Unsolicited distribution is restricted. Copyright 2016, Gallop 16

17 Challenges in Migration and the Options

18 Challenges in Migration What do I do with my existing test scripts, libraries & reusable functions? How do I handle the additional efforts to rewrite the scripts? How do I manage the additional cost to develop everything from the scratch? How do I make sure that all the test assets are migrated without any errors? What about my tool investment cost? Does the new automation tool integrate with the life cycle tools that I already have? Unsolicited distribution is restricted. Copyright 2016, Gallop 18

19 What are my Options? Continue with the existing test automation tool and use Selenium for all the future automation activities Manually migrate all the existing test scripts, libraries and reusable functions to Selenium Use an automated tool which migrates all the test assets to Selenium with minimum manual intervention Unsolicited distribution is restricted. Copyright 2016, Gallop 19

20 Migration Approach Automated Migration with Tool» The entire migration process is accelerated, creating standardized test assets» Reduced Time, Cost and Efforts Manual Migration Manual migration to Selenium could be quite costly and time consuming.» Needs minimal knowledge transition and less management oversight» Business remains as usual even while migration Some of the major challenges are:» Impact on business due to downtime issues» Lack of training and knowledge for performing the migration» Huge time involved in migration» Migration Cost Intricacies» Retaining the automation coverage Supports migration from any platform to Selenium 15 times faster and 10 times cost effective compared to manual migration Unsolicited distribution is restricted. Copyright 2016, Gallop 20

21 Migrate2Selenium

22 Migrate 2 Selenium - World s First Selenium Migration tool Language Support Design Patterns Supports multiple language translation Application Support 1 Functional decomposition Supports diverse automation frameworks Keyword driven Data driven Supports multiple Web browsers and versions World s First Selenium Migration tool Accelerated Selenium Migration Object Repository Style Test Management Integration Migrate 2 Selenium by Gallop Solutions Migrates all types of object repository models Data Sources Migrates entire test suites that reside in Quality Center/ALM converts scripts to Per Action Shared Object Descriptive Programming Selenium (Designed Supports heterogeneous data sources (Excel & DB) for Agile & DevOps) Unsolicited distribution is restricted. Copyright 2016, Gallop 22

23 Script Migration Framework Source Automation Suite Scripts (Actions) Rules Source Map Files Target Map Files XML Import/Export Automation Suite Solution Environment Variables Scripts (Class Files) Object Repositories Assertions (Class Flies) Checkpoints Profiler Parser Translator Assembler Validator Logger Environment Variables Data Tables/Excel Object Repository Application Library Data Provider Built-in Functions Utility Libraries Detailed Log File Application Functions (Class Files) Utility Library (Class Files) Launch Translator Load OR Set Parent/Child Hierarchy Load Script Files Convert Script Files Assemble Files Validate Project Unsolicited distribution is restricted. Copyright 2016, Gallop 23

24 Sample Screenshots

25 Migrate 2 Selenium Application Navigation a) Launch Screen b) Home Screen Unsolicited distribution is restricted. Copyright 2016, Gallop 25

26 Migrate 2 Selenium Application Navigation c) Select the Java Files d) Select UFT Files Unsolicited distribution is restricted. Copyright 2016, Gallop 26

27 Migrate 2 Selenium Application Navigation e) Select Target folder f) Select Target Language & Framework Unsolicited distribution is restricted. Copyright 2016, Gallop 27

28 Migrate 2 Selenium Application Navigation g) Selection Summary h) Analysis Report Unsolicited distribution is restricted. Copyright 2016, Gallop 28

29 Test Tools Mind Map TDD Cloud Solutions Unit Testing UI Automation Continuous Integration Service Virtualization Mobile Code Coverage Team Management Tools Unsolicited distribution is restricted. Copyright 2016, Gallop 29

30 To Speak to the Agile Testing Architects at Gallop, please

31 Thank You

32 Contact Information Balentine Drive, Suite 200 Newark, CA Freedom Business Center 3 rd Floor King of Prussia, PA "The V" Ascendas, Orion Block 1st Floor Hyderabad- TG contact@gallop.net Website : Unsolicited distribution is restricted. Copyright 2016, Gallop 32