1 Mobinius Testing Services OPTIMIZE YOUR PERFORMANCE AND ENSURE A SUPERIOR USER EXPERIENCE
2 MOBINIUS TESTING SERVICES Optimize your performance and ensure a superior user experience By the time you finish reading, the mobile app landscape will change. New OS versions will be released. A bunch of new devices will hit the market. Cool new apps will go viral, gaining millions of users and setting new standards in user expectations. And mobile app testing will become much more complex and challenging. Discouraged? Don t be. The world of mobile is filled with excitement and opportunity and anyone can have the next hit app! But to make a splash, your app needs to stand up to use by thousands if not millions of users around the world with different devices, operating systems, networks, connections and more. To keep those users your users delighted, your app needs to be high quality and thoroughly tested. Despite the ever-changing mobile landscape, there are some constants in the realm of mobile app quality that organizations of any size from small startups to major global enterprises can study, understand and take advantage of. In the following pages, we ll discuss the mobile landscape, dispel some common myths and outline proven strategies to help you deal with the exhaustive mobile matrix. Ready to learn more? Let s get started...
3 31% IN 2012, 31% OF COMPANIES REPORTED ACTIVELY TESTING MOBILE APPS. 55% IN 2013, THAT NUMBER ROSE TO 55%. THE INCREASE COULD BE SEEN ACROSS INDUSTRIES. (WORLD QUALITY REPORT)
4 KEY TAKEAWAY The Mobile Economy Will Continue to Explode! This means Need for global testing coverage Need for cross-platform testing capabilities Need for ongoing support and user experience management 3/4 Billion 10+ Billion Three quarters of a billion ios and Android devices across 220 countries generated over 380K + 435K 27% The ios app store is going to have 435,000 new apps in 2013 In 2012, the market for paid application downloads reached $8 billion in the top five app platforms, up 27% from % Google Play s revenue were up 311% overall in 2012 ~54 Billion Mobile application market size is going
5 CHALLENGES Today s enterprise mobile and web applications are growing in complexity. Adding to this challenge is the rising volume of users, and the different devices proliferating the marketspace that can put applications under massive stress. Therefore, you need a solution that helps capture the complete end-user experience across multiple platforms and makes the system more scalable. MOBILE TESTING CHALLENGES AT A GLANCE INDUSTRY CHALLENGES BYOD Mobile Device Management Enterprise Level Security Testing on the Cloud Consumer and Enterprise Mobility Native vs. Hybrid vs. mweb vs. HTML5 Mobile Test Automation, Security Tools DEVICE DIVERSITY Device Makers, Models Smart Phones, Phablets, Tablets Device Density (Idpi, mdpi, hdpi, xhdpi) Device Screen Sizes (Small, Normal, Larger, Extra Large Screens) Device Orientation Challenges Device Browsers, Rendering Differencess NETWORK SERVICE PROVIDER ios (3, 3GS, 4, 4GS, 5.x, 6.x) Android (2.x, 3.x, 4.x) Blackberry (4.x, 5.x, 6.x, 7.x) Windows Phone (2003, 5.x, 6.x, 7.x) Symbian, Brew, J2ME, DADA, others NETWORK SERVICE PROVIDER Network Delay and Jitter Network Disruption Testing Network Performance Testing Network Congestion Testing Multi Network/Trace Testing Enterprise Carrier Network Switching DEVICE DATA INPUT METHODS Touch Screen Kypad Non Touch, Soft/Physical Keypad Track Balls. Qwerty Keypad Voice (SIRI, Skyvi) Split Keypad Copy and Paste Blink of an eye DEVICE CAPABILITY & APP FUNCTIONALITY Bandwidth Connectivity Camera Phone/SMS/MMS Contact List NETWORK CONNECTIVITY AND VARIYING SPEED 2G, 2.73G (GPRS, EDGE), 3G, 4G WiFi (Secured, Unsecured) WiMax VPN, Hotsport, Tethering Cellular Internet, Telcom Carriers Data loss over network Bandwidth, Signal Loss DEVICE HARDWARE Limited Processing Capability/Power Locations and Languages Limited Memory size Availability of external memory SD card Device Comm Protocols (WAP, HTTP) Device Configuration OTHERS Rapid Rollouts. Deployment Velocity Mobile Context, Usability, Performance Monitoring for energy consumptions Testing with Emulators/Simulators Device Interruption Scenarios Field Testing, Test Execution Challenges
6 MOBILE TESTING METHODOLOGY Having a right mobile testing methodology is critical for your business and you need a prtner who understands intricate details and brings rquired knowledge as well as infrastructure TESTING STRATEGY PLANNING DESIGN ANALYSIS REPORTING ENVIRONMENT EXECUTION TECHNIQUES METHODS
7 TESTING TYPES 1 FUNCTIONAL Validation of Functionality Smoke / Regressions Testing Off line access testing Negative Testing 4 APP PERFORMANCE TESTING CPU Usage testing Network Usage Page Render time or activity Render time 2 NON FUNCTIONAL Network Strength/Outage/Recovery Different NW Types Peripheral Testing 5 USABILITY TESTING User Experience Competitive Analysis Expert Review 3 INTERRUPT Voice / SMS interrupts Notifications Battery /Cable Removal 6 INSTALLATION TESTING New App Install Uninstall and Reinstall Upgrade testing
8 7 MEMORY LEAK Memory Usage Memory Leaks Garbage Collection 10 SECURITY TESTING Security Auditing Vulnerability Scanning Security Scanning Penetrating Testing 8 VULNERABILITY TESTING OWASP Vulnerabilities Dynamic Testing Static Code Analysis 11 MEMORY TESTING Review of cache Data storage mechanism Data Encryption LANGUAGE TESTING 9 Validation for Locales Images and Text Currencies, time zones etc. Context
9 Mobinius s Test Lab is an on-demand test infrastructure that offers end-to-end mobile testing services which ensure that the desired user experience and planned business value are delivered by the appropriate mobile solution. With it, you can test mobile apps in any real-world end-user condition throughout all stages of the SDLC. Access thousands of real devices Test load, speed, geography and more Automate, monitor and collaborate Connect to your existing workflow Mobile initiatives in various enterprises are still done on Line of Business basis where each LOB has its own priorities and schedules and often ends up duplicating software and hardware resources. A third Party Mobility Certification Partner can help organizations move quicker in their mobile journey with optimum cost. Lab environments are places of perfect connectivity, limited devices and up-to-date operating systems. Sadly, that's not the world your app is going to encounter outside the walls of your test lab.
10 In-the-wild testing ensures your app works well in real world situations, such as: On a Range of Devices: The number of mobile devices grows every day, bringing with it a range of screen sizes, resolutions, processing power, etc. You'd need a warehouse to store all these devices. On Real Devices: Emulators and simulators simply don't cut it. Fingers on touchscreens are much different than mouse clicks and real devices aren't clean, well-maintained systems. But to house all the devices you would need for testing, you'd need unlimited space and an astronomical budget. On-Location: Connectivity changes with network and location, but you can't mimic those fluctuating conditions in a lab. Outdated Software: Not everyone regularly updates their operating system. Some Android users might not even have access to the newest version. How does your app behave on older OS versions?
11 HOW MOBINIUS HELPS Mobinius has set up a ready-to-use mobility testing lab, which includes popular devices, leading automation solutions, dedicated network connectivity which you can use on a pay per use model. We maintain and upgrade the devices and OS version based on market need. It is equipped with all prominent smart devices and popular testing solutions to cater to varying customer demands. Our Lab provides a holistic Mobile Application Testing approach and helps reduce cycle time, costs and effort. We also have resident Mobility Quality Engineering Professionals in the test center to provide Complete Mobility Testing Services. Mobinius brings High Velocity enterprise class mobile testing services to power your mobile business. Now you can control your testing costs, increase your test coverage securely and monetize by taking your application to market quickly and efficiently. With Mobinius s High Velocity Mobile Testing Solutions you can: Provision any device you want from our virtual private cloud quickly Acquire 100% cross-platform testing support on ios, Android, Windows, Symbian, Blackberry and more Leverage our test and automation experts located across the globe Tap into our library of more than ready-made test cases Automate relevant test cases with ease
12 MOBINIUS SOLUTION Mobinius Performance Testing services focus on end-user performance, system stress and load testing of application, and capacity planning for related infrastructure. Our performance testing experts help you manage and mitigate the risk of deploying mission-critical applications by identifying: What to expect once your application is in production? Potential bottlenecks before production install How to tune application parameters to maximize performance? Capacity planning for application infrastructure
13 MOBINIUS S PERFORMANCE TESTING SERVICES Mobinius s Performance Testing Services include: Comprehensive end-user performance requirements based on service level agreements Complete understanding of infrastructure associated with application Test planning and resource requirement analysis, use case analysis and performance scenario definition Test data creation and test environment setup with consideration of network performance Automation of performance test scenarios using tools Test monitor setup, test execution and results analysis Assistance in tuning the performance parameters for webservers, appservers, OS and database servers
14 ACTIVITIES & DELIVERABLES Mobinius Performance Testing is based on our customizable process and our unique Maturity Model for Quality, Process, and Automation. Our proven methodology has helped our clients realize their quality vision, reduce operation costs, accelerate time to market and deploy with confidence. ACTIVITIES DELIVERABLES DEFINE AND DESIGN Define performance requirements Select performance testing tool(s) Procure test environment Define test data Identify usage scenarios Identify potential risks Performance test plan Risk mitigation plan DEVELOP AND BASELINE Install and test performance test environment Populate test data Design test scripts Record, develop and test the test scripts Execute scripts for debugging and base-lining Performance test scripts and base line report TEST AND TUNE Execute test scripts Add virtual users to identify bottlenecks Tune the application server, web server and databas Tune the infrastructure and network Performance test execution test CERTIFY AND DEPLOY Extraplation analysis based on performance data Capacity planning at web server, app server and database levels Certify application for concurrent users Deply risk kitigation plan Capacity plan Monitoring parameters
15 HIGH VELOCITY TESTING SERVICES Powered by MOBILE CLOUD INFRASTRUCTURE 150+ MOBILE DEVICES MULTI-INDUSTRY TESTING EXPERIENCE 350+ APPS TESTED & COUNTING DEEP DOMAIN EXPERTISE 600+ READY-MADE TEST CASES
16 Mobinius is a leading provider of Mobile and Enterprise QA Services and Solutions; Mobile Application Development, Testing and Automation, and Certification and Sustenance ,