Total Quality in Mobile Apps -Continuous Integration & Performance Testing

Size: px
Start display at page:

Download "Total Quality in Mobile Apps -Continuous Integration & Performance Testing"

Transcription

1 Infosys & Experitest Co-webinar: Total Quality in Mobile Apps -Continuous Integration & Performance Testing Nov 2014

2 Part I How To Use Continuous Integration for Mobile Speaker: Guy Arieli, Experitest CTO

3 Agenda Continuous Integration is especially important for mobile 1 Why is it important? 2 How is it different from regular Continuous Integration? 3 What is the recommended flow for Continuous Integration in mobile? 4 Case study: major bank 5 Demo: mobile continuous integration Jenkins

4 What Is Continuous Integration? Developers Source Code Repository CI Server YOUR APP Software development practice where members of a team integrate their work frequently Each person integrates at least daily leading to multiple integrations per day Significantly reduces integration problems and allows a team to develop cohesive software rapidly CI significantly reduces integration problems and allows a team to develop cohesive software rapidly

5 Why is CI especially important for mobile apps? Fast app release Mobile app development is faster End-user expectation for fast response time Frequent external environment changes New OS versions Huge device matrix Higher ROI because of mega matrix Many (hundreds) devices to be tested Several mobile OS to be tested New devices High adoption of Agile methodology in R&D

6 How is mobile CI different? Complex management of Continuous Integration Smart device allocation Dual application mode (instrumented, non-instrumented) Parallel execution

7 Continuous Integration For Mobile Developers x Test Results Source Code Repository Execute Test On Devices CI Server Executer Agent YOUR APP

8 Recommended process for mobile Continuous Integration View and analyze reports Prepare the application for automation Reserve the devices to be used Deploy application and device preparation Tests Execution Build the application

9 Build the Application YOUR APP Build the Application Source Code Repository CI Server New Build of Your App For example: If it s an Android build, you will get a URL for downloading this APK file Trigger the entire execution

10 Recommended process for mobile Continuous Integration View and analyze reports Prepare the application for automation Reserve the devices to be used Deploy application and device preparation Tests Execution Build the application

11 Prepare the Application (optional step) Application under test may have two modes: YOUR APP YOUR APP Instrumented more control and more capabilities over the application Tips for Implementation Test automation tool should enable: 1 Unattended, on-the-fly instrumentation 2 Perform the instrumentation on the same machine that is being used for automation New Build of Your App YOUR APP Non- instrumented 3 Windows machine to perform all instrumentation (inc. on-the-fly) (also in the case of an ios app)

12 Dynamic, smart reservation of the Devices to be used Execute your regression of tests on as many devices as you can Cloud of Devices Smart Device Reservation Dynamic, smart android > 4.2 htc

13 Recommended process for mobile Continuous Integration View and analyze reports Prepare the application for automation Reserve the devices to be used Deploy application and device preparation Tests Execution Build the application

14 Deploy Application and Device Preparation Have full control of the device and of the application installation Working with the Settings Uninstallation of applications Device reboot Installation of applications Application clear data Launch of applications **These operations should be available and should be able to run entirely unattended.

15 Recommended process for mobile Continuous Integration View and analyze reports Prepare the application for automation Reserve the devices to be used Deploy application and device preparation Tests Execution Build the application

16 Tests Execution Actions for making Test execution efficient: Capability to run the tests in parallel on different devices Decupling between the CI server and the execution machine Queue of tests that are waiting for devices the be available T1 T2 T2 Execute the Devices T2 Tn CI Server Executer Agent Remote Mobile device Lab

17 Recommended process for mobile Continuous Integration View and analyze reports Prepare the application for automation Reserve the devices to be used Deploy application and device preparation Tests Execution Build the application

18 Recommended process for mobile Continuous Integration

19 Demo How to use Jenkins for mobile Continuous integration

20 Case Study

21 Customer Profile: Multinational banking and financial services company Major global financial services provider engaged in personal banking, credit cards, corporate and investment banking and wealth and investment management. Headquartered in APAC Spans over 50 countries across Europe, America, Africa & Asia ~200,000 employees Mobile applications in tens of languages Ranked in top 10 largest banks worldwide Revenue more than $30 Bn.

22 The Need Testing end users' apps The bank s Personal and Business accounts management apps Wallet apps Trading apps Mortgages apps BankCard Many more Testing the Internal bank Employees Apps Applications used by The bank employees providing services to customers such as: Loan qualification form Mortgage requirements form Etc.

23 The Requirements On-premise devices, all within the bank VPN Cross-platform testing on all OS: Android, ios, WindowsPhone8 & BlackBerry </> No need for access to application source code for testing (on-the-fly instrumentation) Support for multi-field form filling including scrolling in lists, invisible objects, etc. Ability to test on devices located in one of the bank facility by testers located in other locations

24 Implementation Years working with the tool: 3 Over 100 SeeTestAutomation stations Number of Automation engineers working on the project: geographical locations around the world (US, Europe, Africa and China) Number of tests before: 0 Number of tests today: ~20,000 Number of executed tests: ~200,000 (each test can run on more than one device) Onsite deployment with integration into the existing test environments QTP, Junit, Eclipse QC and Jenkins Parallel execution of tests

25 Coverage Total coverage: ~90%. Number of executions of the full cycle: Once a day Number of apps tested: +20, (different application in different regions) Coverage of both customer s apps and internal systems apps Full app test coverage for all OS-Cross platform testing of Android ios WindowsPhone8 BlackBerry Full end-to-end coverage of test scenario Support for multiple languages (including English, Spanish, French)

26 ROI What if we did it manually? A single QA engineer: 56 man years to finish the cycle (lifetime). For one day we would need 20,000 trained manual QA engineers. Another Advantage The R&D engineers can work faster and take more risks According to the bank R&D managers the development speed is 3-4 times faster!

27

28 The Tools Used SeeTestAutomation Automation tool Same test runs on different devices Plugs into all testing & CI environments: UFT/Selenium/ Microsoft Visual Studio/ RFT/Java/C#/TestComplete//Perl/Python/Ruby QC/TFS/Jenkins/TeamCity/RQM Manual to Automation Script Convertor SeeTestManual Free Tool! Manual testing tool Mini-recorder for automating short, repetitive, manual scenarios Report with screenshots of each step SeeTestCloud Device Lab located onsite (in the customer VPN) Devices can be reserved and accessed by any remote user Used in conjunction with SeeTestAutomation/Manual for testing of remote devices

29 Thank you

30 Infosys Point of View (POV) on Mobile Application Performance Testing 17 December, 2014

31 Performance is key, for a Mobile user Frequent crashes and glitches Slow loading times High battery drain Unreliability Inefficient start and exits Analysis reveal that majority of 1-star reviews are related to performance issues, proving that Quality is key for an end-user. Other Poor App Store ratings are often linked with poor app performance % of Critical, 1-Star Reviews For Top ios Apps 48% 52% Performance Related CRITICAL, 1-STAR REVIEWS 0 Lagging, Performance, Hot, Battery Drain Slow, Long Load, Load Fails Crash, Bug 9% 15% 76% PERFORMANCE RELATED, CRITICAL, 1-STAR REVIEWS Source: appurify Forrester: Mobile apps live and die by their ratings in an App Store When the rating suffers, customer adoption suffers. IMS, Goldsmiths: "Users experience a lot of negative emotions and frustrations when trying to complete some digital tasks and apps are slow to load and respond" Apigee: 44% of users delete a mobile app immediately if it didn t perform as expected; Performance is reported to be especially important for banking (74%) apps realbusiness: Consumers are unforgiving towards slow and poor performing apps.

32 If left unaddressed, the impacts are significant Lost transactions not only result in lost revenue for banks, but have a detrimental impact on customer loyalty and brand reputation it's a lose-lose situation. 38 percent try another app when faced with a problem, 34 percent stop using the app, and 19 percent complain to friends and family Majority users delete or uninstall mobile app because of performance problems. About 18% delete the app immediately if it froze for just 5 sec. 38% delete the app if it freezes for longer than 30 seconds 30% of users would spend more money with an organization that had a good mobile app 29 percent would pay more for a product or service if the organization s app performed better than its competitors Nearly one third of smartphone and tablet owners would change banks if a mobile app wasn t up to par

33 Addressing Customer Reviews on Mobile apps.. 33 One in six customers who switch banks indicate a poor mobile banking experience prompted the switch Between 51% and 76% of mobile users use their mobile apps to check balances, transfer money, pay bills, and look up branch locations and hours. Hence reduced performance leads to greater & immediate customer dissatisfaction Problem Cause Solution Application is buggy (doesn t open, crashes, freezes often). Sloppy code, varying internet connection, poor memory management. Thorough testing of the app under multiple conditions and variables to ensure that an app is devoid of issues Infosys Performance Testing Solution Client Application Performance Server Side Performance Network Impact on Performance

34 Device Impact Testing / Client Application Performance 34 Key Measurement Parameters: Battery Consumption Device CPU and Memory constraints Device I/O Assess speed for read and write to devices Tools: - Xcode Instruments (memory allocation, leaks, CPU usage ) - Android ADB (battery consumption, CPU usage / processing speed) - Android DDMS ( memory usage, device I/O, track running thread info..) - Quadrant (only for Android) - Neoload

35 Server Side Performance / Load Testing 35 Key Measurement Parameters: Response Time Error Rate Throughput Server CPU utilization Server Memory utilization Tools: - LoadRunner - Neoload - CloudTest Mobile Performance Tool Recommendation: Ability to support multiple devices Ability to support native applications as well as browser-based applications Ability to record through the device using agents, or through emulators, as well as directly from a browser to reduce complexity Ease of use and fast turnaround time

36 Network Impact Testing 36 Network Emulation Options: Network Coverage - Occasional disconnection of the network. Packet Loss & Duplication Packet loss & duplication for an application session by dropping packets based on preset values Delay and Jitter - Delay of data originating from app. Multi-Network testing (Roaming) Switching from one type of network to another type of network e.g. (3G, 4G, LTE) Key Measurement Parameters: Response Time Exception Handling UI Issues Consistency Tools: - Infosys Network Impact Testing Solution (inits) - Shunra - Neoload Mobile Performance Tool Recommendation: Ability to dynamically emulate various network conditions Ability to generate and or emulate load from various locations, leveraging the cloud Ability to test regardless of the protocol the application uses

37 Some of the Performance Testing Best Practices for Mobile Apps 37 Test early: Do quick check on mobile web application performance, using page analysis tools like PageSpeed Insights, Yslow etc. For native apps, developers can perform regular checks with Instruments / DDMS tools Verify & validate the performance on a real device Perform both modular and system performance tests Correlate server-side metrics with client-side response times. It helps nailing down the root cause May look at reusing the functional scripts for load Testing (e.g. SeeTestLoad -LoadRunner) Look for consistency in test results, during multiple test iterations Ensure complete performance test coverage, executing Load, Endurance, Stress and Single-user test cycles

38 Thank You 2013 Infosys Limited, Bangalore, India. All Rights Reserved. Infosys believes the information in this document is accurate as of its publication date; such information is subject to change withoutnotice. Infosys acknowledges theproprietary rightsofother companies to thetrademarks, productnames and such other intellectual property rights mentioned in this document. Except asexpresslypermitted, neitherthisdocumentation noranypartofitmaybe reproduced, stored in aretrieval system, ortransmitted in anyformorbyany means, electronic, mechanical, printing, photocopying,recording orotherwise, withouttheprior permission ofinfosyslimitedand/oranynamed intellectualpropertyrightsholdersunderthisdocument.

Performance Testing- Is Your Mobile Application Ready for Scale?

Performance Testing- Is Your Mobile Application Ready for Scale? Hexaware & Experitest Co-webinar: Performance Testing- Is Your Mobile Application Ready for Scale? April 2015 Speakers Guy Arieli CTO Experitest Vinayak Gaur Head of Mobile Application Testing Hexaware

More information

Continuous Integration (CI) for Mobile Applications

Continuous Integration (CI) for Mobile Applications Continuous Integration (CI) for Mobile Applications Author: Guy Arieli, CTO, Experitest Table of Contents: What Continuous Integration Adds to the Mobile Development Process 2 What is Continuous Integration?

More information

Perfect Your Mobile App with Load Testing and Test Automation

Perfect Your Mobile App with Load Testing and Test Automation Wipro & Experitest Co-webinar: Perfect Your Mobile App with Load Testing and Test Automation June 2015 Speakers Guy Arieli CTO Experitest Sudheer Mohan Director - Mobility Certification & Automation Wipro

More information

Mobile Performance Testing Approaches and Challenges

Mobile Performance Testing Approaches and Challenges NOUS INFOSYSTEMS LEVERAGING INTELLECT Mobile Performance Testing Approaches and Challenges ABSTRACT Mobile devices are playing a key role in daily business functions as mobile devices are adopted by most

More information

Testing & Assuring Mobile End User Experience Before Production. Neotys

Testing & Assuring Mobile End User Experience Before Production. Neotys Testing & Assuring Mobile End User Experience Before Production Neotys Agenda Introduction The challenges Best practices NeoLoad mobile capabilities Mobile devices are used more and more At Home In 2014,

More information

Overview Company & Product Portfolio

Overview Company & Product Portfolio Overview Company & Product Portfolio Experitest EXPERITEST Testing & Monitoring tools for smartphones AUTOMATION tools for 24*7 testing & monitoring Productivity tools for MANUAL mobile testing Customers

More information

Mobile Application Testing

Mobile Application Testing Mobile Application Testing Whitepaper Author: Scott Aziz Date: June 1, 2012 This whitepaper outlines the critical areas of testing needed to certify mobile enterprise applications Best practices from UST

More information

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Mobile Performance Testing

STeP-IN SUMMIT 2014. June 2014 at Bangalore, Hyderabad, Pune - INDIA. Mobile Performance Testing STeP-IN SUMMIT 2014 11 th International Conference on Software Testing June 2014 at Bangalore, Hyderabad, Pune - INDIA Mobile Performance Testing by Sahadevaiah Kola, Senior Test Lead and Sachin Goyal

More information

STeP-IN SUMMIT 2013. June 18 21, 2013 at Bangalore, INDIA. Enhancing Performance Test Strategy for Mobile Applications

STeP-IN SUMMIT 2013. June 18 21, 2013 at Bangalore, INDIA. Enhancing Performance Test Strategy for Mobile Applications STeP-IN SUMMIT 2013 10 th International Conference on Software Testing June 18 21, 2013 at Bangalore, INDIA Enhancing Performance Test Strategy for Mobile Applications by Nikita Kakaraddi, Technical Lead,

More information

Whitepaper Performance Testing and Monitoring of Mobile Applications

Whitepaper Performance Testing and Monitoring of Mobile Applications M eux Test Whitepaper Performance Testing and Monitoring of Mobile Applications Abstract The testing of a mobile application does not stop when the application passes all functional tests. Testing the

More information

Image Area. White Paper. Best Practices in Mobile Application Testing. - Mohan Kumar, Manish Chauhan. www.infosys.com

Image Area. White Paper. Best Practices in Mobile Application Testing. - Mohan Kumar, Manish Chauhan. www.infosys.com Image Area White Paper Best Practices in Mobile Application Testing - Mohan Kumar, Manish Chauhan www.infosys.com Contents Introduction 3 QA Challenges in Mobile Application Testing 3 Device Variation

More information

Ensuring Mobile Application Quality Across Your Application Lifecycle

Ensuring Mobile Application Quality Across Your Application Lifecycle Test on Real Devices with Melillo s Managed Cloud Platform (MCP ) Powered by HP Mobile Center, MCP supplies a flexible foundation that includes all common infrastructure needed to enable organizations

More information

Automated testing for Mobility New age applications require New age Mobility solutions

Automated testing for Mobility New age applications require New age Mobility solutions Automated testing for Mobility New age applications require New age Mobility solutions Executive Summary Today, mobile phone has transformed from its former role as a mere medium of communication to that

More information

101-301 Guide to Mobile Testing

101-301 Guide to Mobile Testing 101-301 Guide to Mobile Testing Perfecto Mobile & Toronto Association of System and Software Eran Kinsbruner & Joe Larizza 2014 What To Do? Great News Your first Mobile Project has arrived! You have been

More information

Launch High-Performing Mobile Apps with Appurify. Manish Lachwani CTO and Co-founder Jay Srinivasan CEO and Co-founder

Launch High-Performing Mobile Apps with Appurify. Manish Lachwani CTO and Co-founder Jay Srinivasan CEO and Co-founder Launch High-Performing Mobile Apps with Appurify Manish Lachwani CTO and Co-founder Jay Srinivasan CEO and Co-founder About Appurify Mission to create comprehensive mobile application lifecycle management

More information

Best Practices for Performance Testing Mobile Apps

Best Practices for Performance Testing Mobile Apps Best Practices for Performance Testing Mobile Apps Lee Barnes, CTO Utopia Solutions Apology I don t believe in best practices I do believe in guidelines and better approaches for a given situation Key

More information

Viewpoint. Choosing the right automation tool and framework is critical to project success. - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys

Viewpoint. Choosing the right automation tool and framework is critical to project success. - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys Viewpoint Choosing the right automation tool and framework is critical to project success - Harsh Bajaj, Technical Test Lead ECSIVS, Infosys Introduction Organizations have become cognizant of the crucial

More information

What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing

What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing What s new in the HP Functional Testing 11.5 suite Ronit Soen, product marketing John Jeremiah, product marketing Today s agenda A new world order for applications impact on QA HP s response announcement

More information

Mobile Performance Management Tools Prasanna Gawade, Infosys April 2014

Mobile Performance Management Tools Prasanna Gawade, Infosys April 2014 Mobile Performance Management Tools Prasanna Gawade, Infosys April 2014 Computer Measurement Group, India 1 Contents Introduction Mobile Performance Optimization Developer Tools Purpose and Overview Mobile

More information

WHITEPAPER BEST PRACTICES IN MOBILE APPLICATION TESTING

WHITEPAPER BEST PRACTICES IN MOBILE APPLICATION TESTING WHITEPAPER BEST PRACTICES IN MOBILE APPLICATION TESTING 1 The basic frame of software testers mind-set is attuned to check documentation, functionality, stability, API and performance and make sure that

More information

Cognizant Mobility Testing Lab A state of the art Integrated platform for Mobility QA

Cognizant Mobility Testing Lab A state of the art Integrated platform for Mobility QA Solutions Overview Cognizant Mobility Testing Lab A state of the art Integrated platform for Mobility QA Mobile App QA Reinvented: With the astounding proliferation of mobile devices, smartphones and tablets

More information

Mobile Testing for Banking Applications

Mobile Testing for Banking Applications Mobile Testing for Banking Applications Author: Guy Arieli, CTO, Experitest Table of Contents: Introduction 2 Mobile banking industry: trends 3-4 Mobile banking industry: application type 5 Specific Challenges

More information

Mobile App Testing Guide. Basics of Mobile App Testing

Mobile App Testing Guide. Basics of Mobile App Testing 2015 Mobile App Testing Guide Basics of Mobile App Testing Introduction Technology is on peek, where each and every day we set a new benchmark. Those days are gone when computers were just a machine and

More information

Mobile Performance Testing

Mobile Performance Testing Businesses are increasingly realizing the need for wide-ranging functional testing of mobile apps, as well as per formance, load and user experience testing, although most enterprises do not test a l l

More information

White Paper Bridging the Essential Gap between Continuous Quality and Crowd Based Testing

White Paper Bridging the Essential Gap between Continuous Quality and Crowd Based Testing White Paper Bridging the Essential Gap between Continuous Quality and Crowd Based Testing 1 Contents Introduction... 3 Testing Lifecycle... 4 Testing typologies... 4 Functional Testing... 4 Manual vs.

More information

Mobile Test Strategy. Shankar Garg. Senior Consultant - Testing

Mobile Test Strategy. Shankar Garg. Senior Consultant - Testing Mobile Test Strategy Shankar Garg Senior Consultant - Testing Scope of Mobile Testing Why Quality is important Challenges in Mobile Testing Best Practices for Mobile Test Strategy Mobile Testing Tools

More information

Open source Test Automation Tools for Mobile Applications A Primer

Open source Test Automation Tools for Mobile Applications A Primer W H I T E PA P E R Open source Test Automation Tools for Mobile Applications A Primer Authors: Anil Sannareddy: Senior Test Automation Architect, Aspire Systems Murali Murugan: Lead Test Automation Consultant,

More information

Workshop: Mobile Performance Testing Series I May 10, 2016. Copyright 2016 Vivit Worldwide

Workshop: Mobile Performance Testing Series I May 10, 2016. Copyright 2016 Vivit Worldwide Workshop: Mobile Performance Testing Series I May 10, 2016 Copyright 2016 Vivit Worldwide Brought to you by Copyright 2016 Vivit Worldwide Hosted By Chris Trimper Western New York Chapter Leader Performance

More information

Microsoft Modern ALM. Gilad Levy Baruch Frei

Microsoft Modern ALM. Gilad Levy Baruch Frei Microsoft Modern ALM Gilad Levy Baruch Frei Every app Every developer Any platform Achieve more Team agility The Open Cloud Open, broad, and flexible cloud across the stack Web App Gallery Dozens of.net

More information

BEST PRACTICES IN MOBILE APPLICATION TESTING

BEST PRACTICES IN MOBILE APPLICATION TESTING Innovate, Integrate, Transform BEST PRACTICES IN MOBILE APPLICATION TESTING www.altencalsoftlabs.com The basic frame of software testers mind-set is attuned to check documentation, functionality, stability,

More information

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development

From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development From Traditional Functional Testing to Enabling Continuous Quality in Mobile App Development Introduction Today s developers are under constant pressure to launch killer apps and release enhancements as

More information

White Paper. Bridging the essential gap between Mobile Cloud and crowd based testing. 1. Introduction. 2. Testing Lifecycle

White Paper. Bridging the essential gap between Mobile Cloud and crowd based testing. 1. Introduction. 2. Testing Lifecycle White Paper Bridging the essential gap between Mobile Cloud and crowd based testing 1. Introduction 2. Testing Lifecycle a. Testing typologies (Functional, Usability) b. Functional Testing: Manual

More information

Sample Exam Foundation Level Syllabus. Mobile Tester

Sample Exam Foundation Level Syllabus. Mobile Tester Sample Exam Foundation Level Syllabus Mobile Tester September 2015 American Software Testing Qualifications Board Sample Exam Foundation Level Syllabus Mobile Tester 1. What types of testing are particularly

More information

How Performance Testing Impacts Customer s Business?

How Performance Testing Impacts Customer s Business? WHITEPAPER How Performance Testing Impacts Customer s Business? Performance testing is an extremely important element before any software product is launched in the market. A well-tested software product

More information

HP ALM Masters 2014 Performance testing Modern Applications

HP ALM Masters 2014 Performance testing Modern Applications HP ALM Masters 2014 Performance testing Modern Applications HP Apps 12 Application Delivery Management in the new style of IT We enable you to deliver high performance applications with unprecedented velocity

More information

Quality Testing. Assured.

Quality Testing. Assured. Quality Testing. Assured. Applications can make or break your business Quality an imperative for success Reliability in quality assurance and control, challenges in adapting to changing benchmarks in delivery

More information

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh),

Copyrighted www.eh1infotech.com +919780265007, 0172-5098107 Address :- EH1-Infotech, SCF 69, Top Floor, Phase 3B-2, Sector 60, Mohali (Chandigarh), Content of 6 Months Software Testing Training at EH1-Infotech Module 1: Introduction to Software Testing Basics of S/W testing Module 2: SQA Basics Testing introduction and terminology Verification and

More information

5 Ways to Improve the Quality and Efficiency of your Mobile Testing

5 Ways to Improve the Quality and Efficiency of your Mobile Testing 5 Ways to Improve the Quality and Efficiency of your Mobile Testing Dennis Schultz, IBM Solution Architect Rational Emerging Technologies Team dennis.schultz@us.ibm.com dennisschultz.wordpress.com 20 February

More information

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes

TRACE PERFORMANCE TESTING APPROACH. Overview. Approach. Flow. Attributes TRACE PERFORMANCE TESTING APPROACH Overview Approach Flow Attributes INTRODUCTION Software Testing Testing is not just finding out the defects. Testing is not just seeing the requirements are satisfied.

More information

BCS Bristol Autumn School Testing your App. Jim Thomas Director of Software Testing

BCS Bristol Autumn School Testing your App. Jim Thomas Director of Software Testing BCS Bristol Autumn School Testing your App Jim Thomas Director of Software Testing TVS background TVS UK (2008) TVS Germany (2011) TVS France (2012) T&VS India (2011) Delivering tailored solutions for

More information

LoadRunner and Performance Center v11.52 Technical Awareness Webinar Training

LoadRunner and Performance Center v11.52 Technical Awareness Webinar Training LoadRunner and Performance Center v11.52 Technical Awareness Webinar Training Tony Wong 1 Copyright Copyright 2012 2012 Hewlett-Packard Development Development Company, Company, L.P. The L.P. information

More information

Mobile Testing, Agile Methodologies & You!

Mobile Testing, Agile Methodologies & You! & Mobile Testing, Agile Methodologies & You! Before We Begin... It's Quiet in Here Q&A at End of Webinar Contact Details Available Let s Go! Today s Presenters Alan Trefzger XBOSoft William Anderson Go2Group

More information

Business white paper. Performance testing for mobile applications. Will your mobile application fail your users?

Business white paper. Performance testing for mobile applications. Will your mobile application fail your users? Business white paper Performance testing for mobile applications Will your mobile application fail your users? Table of contents 3 Introduction 3 The mobile application wave 4 A new set of challenges 5

More information

Cognizant Mobility Testing Lab. The faster, easier, more cost-effective way to test enterprise mobile apps.

Cognizant Mobility Testing Lab. The faster, easier, more cost-effective way to test enterprise mobile apps. Cognizant Mobility Testing Lab The faster, easier, more cost-effective way to test enterprise mobile apps. Be Cognizant 2 MOBILE APP TESTING REINVENTED With Cognizant Mobility Testing Lab You Will Save

More information

INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING. Copyright 2015 CloudGen, LLC

INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING. Copyright 2015 CloudGen, LLC INCREASE YOUR WEBMETHODS ROI WITH AUTOMATED TESTING Your Ultimate Partner for integration everywhere, ieverywhere TM CloudGen is an esteemed provider of information technology, business consulting, enterprise

More information

Building a Customized Test Automation Framework Using Open Source Tools

Building a Customized Test Automation Framework Using Open Source Tools Building a Customized Test Automation Framework Using Open Source Tools August, 2016 Contents Executive Summary...03 Need for Test Automation...04 Overcoming Limitations of Open Source Tools...04 Test

More information

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton

Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Session 5: Federal Secure Cloud Testing as a Service - TaaS Center of Excellence (CoE) Robert L. Linton Agenda HP ALM Solution Review HP Cloud Potential Cloud Portal HP ALM Solutions in a virtual environment

More information

Fast Feedback: Jenkins + Functional and Non-Functional Mobile App Testing Without Pulling Your Hair

Fast Feedback: Jenkins + Functional and Non-Functional Mobile App Testing Without Pulling Your Hair Fast Feedback: Jenkins + Functional and Non-Functional Mobile App Testing Without Pulling Your Hair Uzi Elion, Tecnology Director Carlo Cadet, Director, Technical Evangelists Tuning the Process for Mobile

More information

Here s how to choose the right mobile app for you.

Here s how to choose the right mobile app for you. Here s how to choose the right mobile app for you. There is no arguing with statistics. The future of the web is mobile. Tablet shipments are increasing exponentially and within two years consumer broadband

More information

Sample Exam Foundation Level Syllabus. Mobile Tester

Sample Exam Foundation Level Syllabus. Mobile Tester Sample Exam Foundation Level Syllabus Mobile Tester September 2015 American Software Testing Qualifications Board Sample Exam Foundation Level Syllabus Mobile Tester MOB-1.2.1 (K2) Explain the expectations

More information

Pipeline Orchestration for Test Automation using Extended Buildbot Architecture

Pipeline Orchestration for Test Automation using Extended Buildbot Architecture Pipeline Orchestration for Test Automation using Extended Buildbot Architecture Sushant G.Gaikwad Department of Computer Science and engineering, Walchand College of Engineering, Sangli, India. M.A.Shah

More information

What is new for HP LoadRunner and Performance Center 11.52

What is new for HP LoadRunner and Performance Center 11.52 What is new for HP LoadRunner and Performance Center 11.52 Version 11.52 Silvia Siqueira and Shane Evans How long do you wait for your mobile app to respond? Application performance is essential for business

More information

a new generation software test automation framework - CIVIM

a new generation software test automation framework - CIVIM a new generation software test automation framework - CIVIM Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the

More information

It s Not Called Continuous Integration for Nothing!

It s Not Called Continuous Integration for Nothing! It s Not Called Continuous Integration for Nothing! Dan Boutin Vice President of Digital Strategy dboutin@soasta.com Mobile (404) 304-9529 @DanBoutinSOASTA In This Discussion Today Agenda: SOASTA Introduction

More information

Mobile Application Testing Challenges & Best Practices

Mobile Application Testing Challenges & Best Practices Mobile Application Testing Challenges & Best Practices SSQA Silicon Valley; Sept 11, 2012 1 Agenda Key Challenges in Mobile Application Testing Best Practices Test Automation Test Sourcing Q & A 2 Mobile

More information

Mobilizing Your CRM. Whitepaper. August 2011. Exploring the Benefits and Considerations. Copyright 2009-2011 CWR Mobility B.V.

Mobilizing Your CRM. Whitepaper. August 2011. Exploring the Benefits and Considerations. Copyright 2009-2011 CWR Mobility B.V. Customer Support Program Page 1 of 16 Version 1.3 August 2011 Mobilizing Your CRM Exploring the Benefits and Considerations Whitepaper Copyright 2009-2011 B.V. Mobilizing Your CRM: Exploring the Benefits

More information

101 Guide Mobile QA Road Map

101 Guide Mobile QA Road Map 101 Guide Mobile QA Road Map TASSQ Joe Larizza September 2013 What To Do? Great News Your first Mobile Project has arrived! You have been aware that your marketing team was evaluating a mobile offering.

More information

Mobile Automation: Best Practices

Mobile Automation: Best Practices contents A U T H O R : M a n i s h B h a g a t Mobile Automation: Best Practices Abstract... 2 Executive Summary... 3 QA Challenges of Mobile Application Testing... 4 Mobile Application Automation Challenges...

More information

Mobile Testing That s Just a Smaller Screen, Right?

Mobile Testing That s Just a Smaller Screen, Right? Mobile Testing That s Just a Smaller Screen, Right? Stephen Janaway Senior Software Test Manager Nokia Mobile Phones Who am I? Stephen Janaway 12 years experience in mobile software testing. Software testing

More information

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info

MANUAL TESTING. (Complete Package) We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info MANUAL TESTING (Complete Package) WEB APP TESTING DB TESTING MOBILE APP TESTING We are ready to serve Latest Testing Trends, Are you ready to learn.?? New Batches Info START DATE : TIMINGS : DURATION :

More information

MANAGEMENT SUMMARY INTRODUCTION KEY MESSAGES. Written by: Michael Azoff. Published June 2015, Ovum

MANAGEMENT SUMMARY INTRODUCTION KEY MESSAGES. Written by: Michael Azoff. Published June 2015, Ovum App user analytics and performance monitoring for the business, development, and operations teams CA Mobile App Analytics for endto-end visibility CA Mobile App Analytics WWW.OVUM.COM Written by: Michael

More information

12 October 2012 White paper. Best Practices in Mobile Application Testing

12 October 2012 White paper. Best Practices in Mobile Application Testing 12 October 2012 White paper Best Practices in Mobile Application Testing The basic frame of software testers mindset is attuned to check documentation, functionality, stability, API and performance and

More information

Mobile Application Performance Testing

Mobile Application Performance Testing StarBase Insight Mobile Application Performance Testing Introduction Purpose This discussion paper aims to educate the reader about mobile applications and demystify their performance testing needs by

More information

Automation and Virtualization, the pillars of Continuous Testing

Automation and Virtualization, the pillars of Continuous Testing HP Software: Apps meet Ops 2015 Automation and Virtualization, the pillars of Continuous Testing Jerry Saelemakers/ April 2 nd, 2015 Today s business initiatives demand a balance between velocity and quality

More information

automated acceptance testing of mobile apps

automated acceptance testing of mobile apps automated acceptance testing of mobile apps Karl Krukow, CTO, LessPainful Goto Aarhus, 2012 karl@lesspainful.com, @karlkrukow 1 Agenda Automated testing for mobile desirable properties for an acceptance

More information

Increase Your Mobile Test Automation ROI

Increase Your Mobile Test Automation ROI Increase Your Mobile Test Automation ROI Make your Mobile Test Automation more mature and dependable. Take your framework to an all new level of robustness by executing your tests on real devices and at

More information

Beauty or the Beast: The tale of your mobile app. Rob Kwok, Crittercism

Beauty or the Beast: The tale of your mobile app. Rob Kwok, Crittercism Beauty or the Beast: The tale of your mobile app Rob Kwok, Crittercism Introduction & Agenda Why mobile performance matters Why delivering a great mobile experience is hard to do What metrics should you

More information

Testing Mobile Application using Device Cloud

Testing Mobile Application using Device Cloud Testing Mobile Application using Device Cloud Device Cloud and Benefits CSC has partnerships with mobile device cloud services such as DeviceAnywhere Device cloud platform provides an end-to-end solution

More information

Load and Performance Load Testing. RadView Software October 2015 www.radview.com

Load and Performance Load Testing. RadView Software October 2015 www.radview.com Load and Performance Load Testing RadView Software October 2015 www.radview.com Contents Introduction... 3 Key Components and Architecture... 4 Creating Load Tests... 5 Mobile Load Testing... 9 Test Execution...

More information

Localizing Your Mobile App is Good for Business

Localizing Your Mobile App is Good for Business Global Insight Localizing Your Mobile App is Good for Business Simply put, the more people who can find and use your mobile application in their native language, the larger your potential market. But launching

More information

Performance Testing: Roles, Activities, and QA Inclusion

Performance Testing: Roles, Activities, and QA Inclusion : Roles, Activities, and QA Inclusion Michael Lawler NueVista Group 1 Today s Agenda Outline the components of a performance test and considerations Discuss various roles, tasks, and activities Review

More information

The Importance of Continuous Integration for Quality Assurance Teams

The Importance of Continuous Integration for Quality Assurance Teams The Importance of Continuous Integration for Quality Assurance Teams Without proper implementation, a continuous integration system will go from a competitive advantage for a software quality assurance

More information

Addressing Mobile Load Testing Challenges. A Neotys White Paper

Addressing Mobile Load Testing Challenges. A Neotys White Paper Addressing Mobile Load Testing Challenges A Neotys White Paper Contents Introduction... 3 Mobile load testing basics... 3 Recording mobile load testing scenarios... 4 Recording tests for native apps...

More information

www.wipro.com Mobile Testing Preparing for a fast-changing mobile world. Sudheer M, Practice Head - Mobility Testing and Automation

www.wipro.com Mobile Testing Preparing for a fast-changing mobile world. Sudheer M, Practice Head - Mobility Testing and Automation www.wipro.com Mobile Testing Preparing for a fast-changing mobile world. Sudheer M, Practice Head - Mobility Testing and Automation Table of Contents 03----------------------------------------------------Introduction

More information

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW

RUN THE RIGHT RACE. Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW RUN THE RIGHT RACE Keep pace with quickening release cycles. Discover automation with the human touch. CHOOSE A TEST TO RUN BELOW 26032015 FUNCTIONAL TESTING With Borland everyone from business analysts

More information

Mobile App Development: The CD Recipe Jenkins + Functional and Non-functional Testing + Real Devices. Carlo Cadet, Director, Technical Evangelists

Mobile App Development: The CD Recipe Jenkins + Functional and Non-functional Testing + Real Devices. Carlo Cadet, Director, Technical Evangelists Mobile App Development: The CD Recipe Jenkins + Functional and Non-functional Testing + Real Devices Carlo Cadet, Director, Technical Evangelists Introducing Perfecto Mobile Enabling manual and automated

More information

Mobile App Testing Process INFLECTICA TECHNOLOGIES (P) LTD

Mobile App Testing Process INFLECTICA TECHNOLOGIES (P) LTD Mobile App Testing Process Mobile Application Testing Strategy EMULATOR QA team can perform most of the testing in a well-equipped test environment using device emulators with various options like ability

More information

Five Strategies for Performance Testing Mobile Applications

Five Strategies for Performance Testing Mobile Applications Five Strategies for Performance Testing Mobile Applications Mobile applications are now mainstream business. Businesses ranging from healthcare providers to retailers and airlines are creating applications

More information

Mobile Application Test Automation Best Practices for Best Results. A white paper from Mobile Labs, Inc.

Mobile Application Test Automation Best Practices for Best Results. A white paper from Mobile Labs, Inc. Mobile Application Test Automation Best Practices for Best Results A white paper from Mobile Labs and Mobile Labs Trust are trademarks of HP Quality Center and HP QuickTest Professional are registered

More information

Mobile Testing: Actual Results from Nationwide Insurance How we could have tested the same application with the latest tools available

Mobile Testing: Actual Results from Nationwide Insurance How we could have tested the same application with the latest tools available Contents Introductions Petar Puskarich Todd DeCapua Mobile Testing: Introduction / How To Testing our latest mobile application with limited tools and procedures Mobile Testing: Actual Results from Nationwide

More information

How Simple Is It To Develop a Mobile App? Uma Sudhan OpenEdge Developer 7 th Oct 2013

How Simple Is It To Develop a Mobile App? Uma Sudhan OpenEdge Developer 7 th Oct 2013 How Simple Is It To Develop a Mobile App? Uma Sudhan OpenEdge Developer 7 th Oct 2013 Agenda What a mobile app is, and why is it so important? Challenges in mobile app development Progress Developer Studio

More information

Web UI & Functional Test Automation for Continuous Agile Deliveries

Web UI & Functional Test Automation for Continuous Agile Deliveries Web UI & Functional Test Automation for Continuous Agile Deliveries Web Mobile API Database Date: 19 th Jan, 2016 Webinar Presentation by, Premal Dave, TestingWhiz About TestingWhiz TestingWhiz offers

More information

Performance Test Process

Performance Test Process A white Success The performance testing helped the client identify and resolve performance bottlenecks which otherwise crippled the business. The ability to support 500 concurrent users was a performance

More information

Automation can dramatically increase product quality, leading to lower field service, product support and

Automation can dramatically increase product quality, leading to lower field service, product support and QA Automation for Testing Medical Device Software Benefits, Myths and Requirements Automation can dramatically increase product quality, leading to lower field service, product support and liability cost.

More information

Augmented Search for Software Testing

Augmented Search for Software Testing Augmented Search for Software Testing For Testers, Developers, and QA Managers New frontier in big log data analysis and application intelligence Business white paper May 2015 During software testing cycles,

More information

Following statistics will show you the importance of mobile applications in this smart era,

Following statistics will show you the importance of mobile applications in this smart era, www.agileload.com There is no second thought about the exponential increase in importance and usage of mobile applications. Simultaneously better user experience will remain most important factor to attract

More information

Syllabus Version 1.2.8.

Syllabus Version 1.2.8. Syllabus Version 1.2.8. 0. Introduction to This Syllabus... 4 0.1 Purpose of this Document... 4 0.2 Cognitive Level of Knowledge... 4 0.3 The Examination... 5 0.4 Business Outcome... 5 0.5 Specialization...

More information

Simple Mobile Application & Browser Testing

Simple Mobile Application & Browser Testing Simple Mobile Application & Browser Testing Simple Mobile Application & Browser Testing Mobile browsers already account for 10% of global browser usage and Mobile Apps have already crossed the 1 Billion

More information

On the Edge of Mobility Building a Bridge to Quality October 22, 2013

On the Edge of Mobility Building a Bridge to Quality October 22, 2013 Copyright 2013 Vivit Worldwide On the Edge of Mobility Building a Bridge to Quality October 22, 2013 Brought to you by Copyright 2013 Vivit Worldwide Hosted by Stephanie Konkoy Americas Chapter/SIG Liaison

More information

Mobile Test Automation: Lessons Learned in the Trenches

Mobile Test Automation: Lessons Learned in the Trenches T4 Track 10/4/2012 9:45:00 AM Mobile Test Automation: Lessons Learned in the Trenches Presented by: Manish Mathuria, InfoStretch Sha Mohammed, Sabre Airline Solutions Brought to you by: 340 Corporate Way,

More information

Top Ten Reasons to Transition Your IT Sandbox Environments to the Cloud

Top Ten Reasons to Transition Your IT Sandbox Environments to the Cloud Top Ten Reasons to Transition Your IT Sandbox Environments to the Cloud WHITE PAPER BROUGHT TO YOU BY SKYTAP 2 Top Ten Reasons to Transition Your IT Sandbox Environments to the Cloud Contents Executive

More information

Syllabus Version 2.5_R (04.04.2016)

Syllabus Version 2.5_R (04.04.2016) Syllabus Version 2.5_R (04.04.2016) CMAP-F-Syllabus V2.5_EN, 04.04.2016 Page 1 of 15 0. Introduction to This Syllabus... 4 0.1 Purpose of this document... 4 0.2 Cognitive Levels of Knowledge... 4 0.3 The

More information

Top ten reasons to transition your IT lab environments to the cloud

Top ten reasons to transition your IT lab environments to the cloud Top ten reasons to transition your IT lab environments to the cloud WHITE PAPER BROUGHT TO YOU BY SKYTAP 2 Top ten reasons to transition your IT lab environments to the cloud Contents The Promise of Cloud

More information

Published on: November 2011 Author: Vinayak Gaur \ Vijayaraghavan Ragunathan \ Vishnu Prakash

Published on: November 2011 Author: Vinayak Gaur \ Vijayaraghavan Ragunathan \ Vishnu Prakash Mobile Test Automation Solutions Published on: November 2011 Author: Vinayak Gaur \ Vijayaraghavan Ragunathan \ Vishnu Prakash Hexaware Technologies. All rights reserved. Table of Contents 1. Introduction

More information

Cross Platform Mobile. -Vinod Doshi

Cross Platform Mobile. -Vinod Doshi Cross Platform Mobile Application Testing -Vinod Doshi Objective Mobile Application Testing Needs. Challenges Current platform specific tools Cloud Testing Testing Strategies and Recommendations Generic

More information

Learning More About Load Testing

Learning More About Load Testing Welcome to this introduction to application performance testing and the LoadRunner load testing solution. This document provides a short overview of LoadRunner s features, and includes the following sections:

More information

International Journal of Advanced Engineering Research and Science (IJAERS) Vol-2, Issue-11, Nov- 2015] ISSN: 2349-6495

International Journal of Advanced Engineering Research and Science (IJAERS) Vol-2, Issue-11, Nov- 2015] ISSN: 2349-6495 International Journal of Advanced Engineering Research and Science (IJAERS) Vol-2, Issue-11, Nov- 2015] Survey on Automation Testing Tools for Mobile Applications Dr.S.Gunasekaran 1, V. Bargavi 2 1 Department

More information

ENTERPRISE MOBILITY GIVE YOUR BUSINESS THE BIG ADVANTAGE

ENTERPRISE MOBILITY GIVE YOUR BUSINESS THE BIG ADVANTAGE Business Solutions through Software ENTERPRISE MOBILITY GIVE YOUR BUSINESS THE BIG ADVANTAGE 1 Executive Summary: Today, mobility is considered to be one of the most disruptive technology innovation faced

More information

Testing Mobile Applications

Testing Mobile Applications Testing Mobile Applications Published by 360logica software testing Services (www.360logica.com ) [ Testing Mobile applications ] Copyright 2011@ 360logica software testing services Testing Mobile Applications

More information

Load Testing Essentials

Load Testing Essentials Load Testing Essentials The main purpose of this workshop is to give you full understanding of load testing discipline and graft all the required skills for managing it independently. In addition to mastering

More information