Mobile Device Automated Testing and Certification: Profit or Peril, Pain vs. Gain Frans Couperus Director Global Sales, Marketing, Business Development w2bi, Inc
Who is w2bi, Inc? Wireless To Business Integration Supplier of software solutions to the Emerging Mature Wireless Markets Recognized Market Leader of Automated Device Testing Solutions Solutions deployed in USA, Canada, Korea, Taiwan, and India Owned by employees and management Organically Funded from Direct Operations Cash Flow Positive since Year 1 Consistent growth history throughout 10 years of operation Headquarters and R&D in NJ, USA Development and Support Center in Chennai, India Comprehensive Test Lab in NJ, USA Local Agents serving Korea (UniOne), Taiwan (GCOM), India
Who is w2bi, Inc?
Products and Experience Mobile Applications Q-POWER mvantage Q-GENERIC QUIKPROBE Q-DAAT QUIKDRIVE Device & Application Testing Device Mgmt & Content Delivery Framework Is Your Mobile Device Testing Platform Multi-Sweet?
Market Situation Wireless subscriptions growth projected at 4B in 2010 Wireless device growth projected at over 3B in 2010 Number of device vendors expected to expand to meet the above demand and supply increased market diversification of devices. Market pressure on Operator and OEM resources devices becoming more complex reduced time to market intervals shortened non-overlapping market life-cycles. Subscriber Contracts & Roaming Agreements Cannot Operationalize Services Low-Cost Devices infuse additional services challenges
Mobile Device Testing Lab Network Emulated Live - Field Interop Device Safe for Network RF Parametric Minimum Performance Signal Conformance CDG2 CDG3 Launch Feature System Determination System Determination OTASP / OTAPA / OTADM MIP / DMU SMS / EMS / MMS ERI / E911 Data Thruput (1X/Rev 0/Rev A) Testing OPEX Increases
Benefits of Automated Device Testing X
Addtl Benefits of Automated Testing OPEX Savings Lab Network Emulated Operator Specific Feature Test Plans Automated Run Time (Minutes) Manual Run Time (Minutes) Derivable Benefits of Automation System Determination 150-180 300-480 42% EvDO Hybrid Mode SD 180-240 480-600 39% Data Throughput 1X / EvDO 45-60 120-150 39% OTASP 150-180 300-360 50% OTAPA 90-120 180-240 50% ERI - Roaming Verification 45-60 120-150 39% E911 (call processing) 150-180 240-300 61% MIP/DMU 180-660 240-960 70%
Fully Automated & Unattended Testing Environment Tests are automatically executed, full control of both the handset and emulation hardware No Need for User Intervention No Inconsistencies between test engineers Automation based on Qualcomm s ICD specification Test pairs are automatically generated. If a PRL does not generate an appropriate test pair for a given test, the test is automatically skipped Auto Run Time - 122 hrs (5 days) Man Run Time - 290 hrs (12 days) - Does test consistently, cost-effectively, repeatedly - Does not take vacation, get sick, or change jobs
CCF & w2bi Collaboration Why Test System Acquisition? One of the most fundamental yet complex mobile device functions Provides insight into how a device will interact with the Live network The ability of a device to acquire the correct CDMA system when in either a home or roaming area is key to delivering a quality subscriber experience using cost effective wireless services Prevents unnecessary loss of revenue or revenue turnover to competing roaming partners Live Testing Challenges Live Networks are dynamic and can impact testing reproducibility Device behavior can be impacted by non technical factors Finding the right live network conditions can require extensive travel Live network testing provides limited insight into device performance Device design variances spawn inconsistent troubles in Live Networks
System Determination Test Groups 1x 1X SYSTEM DETERMINATION TEST CASES - 683A Test ID Test Case Description Test Cases 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 2.10 2.11 2.12 2.13 2.14 2.15 2.18 ACQUISITION AVAILABLE SYSTEM NEGATIVE SYSTEM RESCAN SILENT REDIAL PRL Capacity TEST SERVICE REDIRECTION SYSTEM LOST DURING IDLE STATE SYSTEM LOST DURING TRAFFIC STATE DEEP SLEEP WILDCARD SYSTEM ID RESCAN TO A DIFFERENT GEO EMERGENCY CALL ON NEGATIVE SYSTEM OTASP DIALING MRU ACQUISITION MATCH ONLY 17 8 3 48 44 8 26 20 18 3 3 1 10 25 17 7
System Determination Test Groups 1x-EvDO 1XEV-DO SYSTEM DETERMINATION TEST CASES - 683C Test ID 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 3.10 3.11 3.12 3.13 3.14 3.15 3.16 3.17 3.20 Test Case Description ACQUISITION AVAILABLE SYSTEM NEGATIVE SYSTEM RESCAN SILENT REDIAL VOICE CALL DURING A DATA SESSION SYSTEM ACQUISITION DURING TRAFFIC STATE PRL UPLOAD TEST SERVICE REDIRECTION SYSTEM LOST DURING IDLE STATE SYSTEM LOST DURING TRAFFIC STATE DEEP SLEEP WILDCARD SYSTEM RESCAN TO A DIFFERENT GEO EMERGENCY CALL ON NEGATIVE SYSTEM OTASP DIALING MRU ACQUISITION MATCH ONLY Test Cases 42 16 12 449 92 5 4 5 43 133 133 9 5 1 9 25 19 51
Key Capabilities Dynamically generates the needed RF conditions from the PRL using w2bi patent pending technology Does not use any predefined presets to set RF conditions on the emulation hardware Supports any operators production or test PRL loaded onto either the test device or system Supports IS-683A and IS-683C formatted PRL files
Test Environment Automation Controller PC GPIB RF
Traditional Solution Strategy GUI / CONTROLLER GUI / CONTROLLER GUI / CONTROLLER GUI / CONTROLLER VENDOR A VENDOR B VENDOR C VENDOR D Increases Vendor Specific Training (times x) Lack of Vendor Consistency and Standards for UI / Test Reports Decrease of reusable assets, both human capital and equipment capital Increases testing duration and test transition Decreases flexibility. Increases cost and expense
Market Aligned Solution Strategy W2bi GUI / AUTOMATION VENDOR A VENDOR B VENDOR C VENDOR D Reduces Vendor Specific Training (times x) Harmonizes testing experience Standardized UI / Test Reporting Commonality with OEM Lab Test & Certification Enables Vendor Choices... preserving human knowledge base & vendor automation Cross platform training of users a thing of the past Capital Investment Protection Vendor Neutrality enables choice and is chosen most often
Interruption Testing OTADM in progress OTADM interrupted x Home Phone in roaming mode Roam
Comprehensive Results Rendering Text verification (OCR) Image verification
Consistent & Comprehensive Log Reports Easily sharable results in two formats HTML logs EXCEL logs Detailed information regarding the steps taken to execute each test and the corresponding results identify the exact point of failure
Celebrating 10 years of your trust in us Thank you Frans Couperus Dir. Global Sales, Marketing, Business Dev w2bi, Inc 2401 Morris Avenue Union, NJ 07083 fcouperus@w2bi.com +1.908.688.1700 x14 +1.732.259.0923 (m)