UMTS Radio Access - Operator Acceptance and Performance Testing

Transcription

1 spirent 8100 MOBILE DEVICE TEST SYSTEM UMTS Radio Access - Operator Acceptance and Performance Testing Delivers automated solutions for repeatable data throughput, call reliability and mobility performance analysis of HSPA, WCDMA and GSM/GPRS/EDGE devices. APPLICATIONS Manufacturers: Research & Development Design verification Performance analysis Benchmarking Regression test Operators: Pre-launch evaluation Acceptance test Mobile applications test Software regression test End user and network KPI analysis Spirent 8100 UMTS Radio Access - Performance solutions decrease the time and cost required to verify fundamental and critical capabilities of mobile devices which are not fully addressed by today s conformance/certification test standards: data throughput, call reliability and mobility. Real-world device performance in these areas is a major contributor to an optimal end-user experience, which in turn helps to assure network operator and device manufacturer success. Data Throughput Test Packs automate performance testing of handsets, data cards and embedded modules from physical to application layer, including Rx diversity support. Call Reliability and Mobility Test Packs provide automated testing of a device s ability to reliably make and maintain voice and data calls across 2G and 3G networks. Testing is carried out under realistic conditions using flexible multi-cell, multi-rat network emulation, including radio channel conditions and interfering cells. Powerful data analysis and reporting tools deliver comprehensive KPIs for evaluating performance of a single device or for benchmarking of multiple devices. UMTS Radio Access - Performance test capability is part of the Spirent 8100 Mobile Device Test System - an open, scalable multipurpose test system that is expandable beyond initial testing needs. The system meets a range of high-value mobile device testing requirements using highly capable components including an SR3420 Network Emulator with network-grade protocol stacks to enable delivery of high-quality devices to end users. Benefits Reduce time to market run more tests on a single, automated platform Reduce device returns and customer churn through improved device quality identify 2G/3G data performance and call reliability/mobility issues under real-world conditions in the lab Address the entire lifecycle of testing needs with a single solution R&D, DVT, Benchmarking/Evaluation, Acceptance, Applications, Regression Purchase only the capability you need, when you need it offered with turnkey and user-customizable test modules and scenarios; upgradeable to A-GNSS location performance and conformance testing

2 KEY FEATURES Call Reliability and Mobility Multi-cell option (3 WCDMA, 1 GSM) to create interference and neighbor cells Mobile Terminated and Mobile Originated call support PS, CS, and Multi-RAB scenarios UE Measurement Accuracy tests Call Setup & Call Maintainability tests Data Call Reconfiguration SHO & HHO Call Maintainability (PS and CS support) GSM, WCDMA, HSPA and HSPA+ support 2G-3G Inter-RAT Handover and Reselection testing Service Recovery and Service Availability Downlink Power Usage tests Measurement & reporting of key End User KPIs including: Call Drop Rate, Call Setup Failure Rate Measurement & reporting of key Parametric KPIs including: Handover and Reselection Success Rate and Connection Establishment Time Complete device automation through either: Data Throughput Multi RAB - simultaneous PS & CS call HSPA Physical & Application Layer Data Rate Tests Multi-cell option (3 WCDMA, 1 GSM) to create interference and neighbor cells Programmable CQI vs. TBS table to evaluate CQI performance/ sensitivity Integrated RX Diversity Integrated Sweep Looping Functions Dynamic control and monitoring Fixed or Normal CQI tests FTP, HTTP, & UDP Protocol Static and Dynamic Fading Conditions Programmable Uplink (U/L) and Downlink (D/L) Rates Up to Full-rate ~21 Mbps UDP Protocol Bi-Directional and Multi-hour Stress test Round Trip Latency tests (Short Ping and Long Ping) 2.5G GPRS/EDGE Option Configurable AT commands Pre-defined API interface Powerful reporting tools enable device throughput performance benchmarking.

3 ADVANCED AUTOMATION AND CONFIGURABLE TEST CASES Spirent s industry-leading Test Manager provides the highest level of test automation and visibility into the performance of the device under test. Test Manager enables development of custom, automated tests for regression, pre-compliance, or network operator acceptance test requirements without the need to write complex scripts or code. Customizable parameters such as network reselection, handover, and MAC-hs criteria allow device performance to be fully characterized under a wide range of realworld network settings. WIDE RANGE OF PERFORMANCE TEST PACKS UMTS Radio Access - Performance test coverage is grouped into Test Packs, enabling test coverage to be matched to testing and budgetary requirements. Test Packs address 2G and 3G packet and circuit switched environments, as well as full multi-cell mobility scenarios. Data Throughput Test Packs address data throughput performance testing of GPRS/EDGE and WCDMA/ HSPA/HSPA+ devices. In additional to single-cell 2G and 3G call reliability, the Call Reliability and Mobility Test Packs address advanced scenarios such as Inter-RAT Handover, Inter-RAT Reselection and Out of Service Recovery to provide modeling of real-world issues not effectively covered by current standardsbased conformance/certification testing. Test Suites tune parameters in a group of core test cases from one or more Test Packs to align with a particular test plan or test standard. Test Suites are maintained by Spirent to ensure they evolve with the test plan or standard. UMTS Radio Access - Performance Test Packs offer a wide range of flexible test coverage options. OPERATOR ACCEPTANCE TESTING Spirent 8100 Radio Access Performance solution offers a broad range of automated, preconfigured and validated test cases based on operators test plans. The turnkey Data Performance, Call Reliability, Mobility, Voice Quality, and Adversarial Data tests allow operators and their vendors to greatly improve their device development and evaluation cycle meaning faster time to market. In addition to pre-configured tests, the solution also offers operators the flexibility to develop a broader range of performance tests, quickly and easily creating custom, automated test suites for existing or new test plans. Test Manager enables test parameters to be easily customized. The ability to make run-time changes to test case parameters greatly simplifies device debugging. Pending test case parameters can be changed after a test session has begun to adjust the focus of an investigation while working through test scenarios to isolate issues. RESEARCH AND DEVELOPMENT TESTING For developers and evaluators looking for the ultimate flexibility in test case creation, a Development Library option offers a powerful set of tools focused on Application, Protocol, and Physical Layer testing of devices. A UI-based script engine allows for rapid creation and editing of custom test cases in a multi-cell/multi-rat environment with optional fading and noise. Development library is ideally suited to software/hardware development, including integration, interop., regression and application testing. An integrated RF playback engine helps re-create an RF environment in the lab by allowing modeling and variation of features and parameters for cell power, fading, noise, Doppler frequency, phase shift, AWGN SNR and multi-path.

4 IN DEPTH DATA ANALYSIS, AND POWERFUL REPORTING TOOLS Data Throughput and CQI Histogram charts greatly simplify the analysis of handset and data card throughput performance while running tests and during post-test analysis. The CQI histogram provides insight into how well the receiver is performing under dynamic real-world fading and noise conditions, as well as allowing benchmarking of CQI performance between devices or across firmware versions % 80.00% 60.00% 40.00% 20.00% Call Maintenance - Single Cell (Failure Rate) Same device, different firmware 0.00% % 80.00% 3G CS Call Maintain - Single Cell, PB3, RSCP = -95 dbm, CPICH_Ec/No = -20 db Same vendor, different device 60.00% 40.00% 20.00% 0.00% 3G CS Call Maintain - Single Cell, VA120, RSCP = -95 dbm, CPICH_Ec/No = -20 db Ideal for regression testing and benchmarking of call reliability performance. Powerful reporting and charting simplifies performance analysis. Event charts and logging greatly simplify the reporting of device call reliability and mobility performance, in real time and during post-test analysis. A Procedure Chart provides insight into performance of the device relative to network defined conditions during testing, which enables benchmarking of key performance metrics between devices or across firmware versions. Root cause failure analysis is aided by integrated network logging and reporting. CONFIGURABLE REAL NETWORK AND RF CHANNEL EMULATION Quantifying the data throughput or call setup/drop rate performance of devices on live networks can be extremely challenging given their highly-variable nature. Operating parameters such as traffic variation and number of connected users can change at any time, impacting the collection of consistent field test data. The Spirent SR3420 Network Emulator provides the ability to simulate realistic multi-cell 2G and 3G network conditions in the lab. The SR3420 is highly configurable, with a real-time state machine that delivers an experience much closer to the real network than other network emulators. It is designed to address the needs of high-speed data throughput testing by delivering up to 21 Mbps in the downlink at the application layer. The SR3420 s range of configurable network, RNC, and Node B parameter options, from SIBs to Physical Channels enable real network settings to be reproduced. SIB Parameters such as Cell Quality Level Qqualmin and Handover Reporting Range can be all configured to test call performance under a wide range of network scenarios. In addition to providing full Inter-RAT capability, the SR3420 also supports testing of GSM, GPRS, EDGE and WCDMA using co-channel and adjacent channel interference rather than noise, since true interfering cells present a much more realistic scenario.

5 Spirent s industry-leading SR5500 Wireless Channel Emulator generates realistic fading conditions that accurately and repeatably model the time-varying degradation of the RF signals received by the device due to multi-path, shadowing and propagation losses. The SR5500 allows the flexibility to choose from a suite of pre-programmed 3GPP-recommended models or to develop custom fading profiles that reflect other real-world fading scenarios. PROVIDES ANSWERS TO KEY PERFORMANCE QUESTIONS How well does Physical Layer throughput perform? How well does Rx Diversity perform? How does fading impact performance? How well does Application Layer throughput perform? How sensitive is throughput to code power or C/N? What is the impact of key MAC-hs parameters on throughput? How well does the device set up a call? How well does a device maintain a call? How reliable are calls during mobility scenarios? How much downlink power does a device require? Which device performs better in terms of call reliability and why? Creation of custom fading profiles is easy with the SR5500. Leading network operators and mobile device developers make use of these configurable network parameters and RF fading conditions to model a particular type of network for effective testing of device performance under specific real-world network conditions. How well does a device maintain service during Inter-RAT handover? How well does a device recover from extended loss of service? Address real-world device performance issues including handovers and cell reselection.

6 TECHNICAL SPECIFICATIONS WCDMA, HSDPA, HSUPA, HSDPA+ (64QAM) Number of Cells Up to 3 WCDMA/HSPA Cells; Up to 3 Interfering Cells Bands 1, 2, 3, 4, 5, 6, 8, 9, 11 Uplink Power Control Algorithms 1 and 2 Downlink Power Control Mode 0; 1 to 6 db DPCH Gain -25 to -1 db P-CPICH, SCH, PCCPCH, S-CCPCH -40 to -1 db HS-PDSCH and HS-SCCH Channel Gain -40 to -1 db AGCH, RGCH, HICH -40 to -1 db Voice Calls AMR 12.2, AMR 5.9 Packet Calls UL: 64, 128, 384 kbps; DL: 64, 128, 384 kbps Voice + Packet Calls Voice + Packet (R99); Voice + Packet (HSPA) HSDPA/HSDPA+ UE Categories 1-14; Fixed or Normal CQI modes HSUPA UE Categories 1-5 (10 ms TTI); CAT 4 (2 ms TTI), CAT 6 (2 ms TTI) Handover Capability Cell Selection/Re-selection Soft Handover Intra/Inter-Frequency Hard Handover HSDPA Serving Cell Change Ciphering Release 99, HSPA (UEA1) OCNS Release 99 (12 codes); Release 5 and 6 (5 codes) GSM for Inter-RAT Number of Cells 2 GSM Cell; Up to 2 Interfering Cells GSM Bands 850, 900, 1800, 1900 Voice call Supports AMR 12.2 Ciphering A5/1, A5/3 WCDMA to GSM Voice handover Blind, Synchronous Channel / Propagation Conditions Standard 3GPP Fade Models WCDMA: Case 1, Case 2, Case 3. Case 6, PA3, PB3, VA30, VA120 GSM: RA130, RA250, TU1.5, TU3, TU50, HT100 Custom Channel/RF Models (user defined) Definable parameters with 10ms granularity: - Cell Power (Ior) - Multi-path - Fade Model/Profile - Doppler Frequency - Phase Shift - AWGN SNR RF Specifications Number of Uplink RF Channels 2 Number of Downlink RF Channels** 2 Channels on A50*, A100, A300, A600 4 Channels on A304 RF Output Resolution 0.1 db RF Output Accuracy +/- 1 db AWGN SNR Ratio -30 db to 32 db * Fading/Noise optional on 8100-A50 configuration. ** Upto 4 channels supported 2 channels per SR5500 Wireless Channel Emulator.

7 ORDERING INFORMATION Data Throughput testing is supported on the A50, A100, A200, A300 and A600 configurations of the Spirent 8100 Mobile Device Test System. Call Reliability and Mobility testing is supported on the A200 (single cell test cases only), A300 and A600 configurations of the Spirent 8100 Mobile Device Test System. PERFORMANCE TESTS Test Pack Part Number TM-DATA-HSDPA TM-DATA-EGPRS TM-UCR-3GCR TM-UCR-R99-MOBILITY TM-UCR-HS-DL-MOBILITY TM-UCR-2GCR TM-UCR-2G3GRES TP-UCR-2G3GHCS TM-UCR-2G3GICR PRE-CONFORMANCE TESTS Test Pack Name & Performance Test Coverage WCDMA/HSPA/HSPA+ Data Throughput Physical Layer (FRC or RMC) and end-to-end Application Layer performance covering FTP, UDP, HTTP and Round Trip Latency for WCDMA (R99) and HSPA/HSPA+ devices. GPRS/EDGE Data Throughput End-to-end Application Layer performance covering FTP, UDP, HTTP and Round Trip Latency for GPRS and EDGE devices. 3G Call Reliability Ability to make or maintain voice and/or data calls with one primary 3G radio link. 3G R99 Mobility Ability to maintain voice and/or data calls while moving from one cell to another and/or performing radio link modification. 3G HSDPA DL Mobility Ability to maintain HSDPA data transfers while moving from one cell to another and/or performing radio link modifications. 2G Call Reliability Ability to make or maintain voice and/or data calls with one primary 2G radio link. 3G-2G Reselection Idle Mode reselection performance. 3G-2G Hierarchical Cell Selection 3G to 3G inter-frequency and intra-frequency HCS selection and reselection performance (with a roadmap to 3G to 2G). Inter-RAT Call Reliability Ability to maintain voice calls while moving between 3G and 2G cells. Test Suite Part Number Test Suite Name & Contents 1 TS-DATA-PRECONF GPP Section Pre-Conformance Non-validated test cases covering 3GPP TS Sections A to G. TS-HCS-PRECONF GPP Section Pre-Conformance HCS Non-validated HCS test cases from 3GPP TS Sections , , and a. OPERATOR VALIDATION & UE ACCEPTANCE TESTS Test Suite Part Number Test Suite Name & Contents 1 TS-DATA-EGPRS-ATT AT&T GPRS and EDGE Data Throughput 2 TS-DATA-HSPA-ATT AT&T WCDMA and HSPA Data Throughput 2 TS-UCR-CS-ATT AT&T Call Reliability & Data Mobility 2 TS-UDL-DRIVE-TEST-ATT AT&T Simulated Drive Test 2 TS-DATA-HSPA-REL7-ATT AT&T HSPA+ Data Throughput Test 2 TS-UDL-DAM-ATT AT&T Device Aggressiveness Test 2 TS-UDL-3G-PESQ-ATT AT&T 3G Voice Quality PESQ with Rate Matching 2 1 Test Suites require one or more Test Packs. 2 Available to AT&T and its authorized suppliers only. For detailed Test Pack and Test Suite descriptions, see the Radio Access Performance Test Packs data sheet. Please contact your regional Spirent sales representative for detailed ordering information.

8 SPIRENT GLOBAL SERVICES Spirent Global Services provides a variety of professional services, support services and education services all focused on helping customers meet their complex testing and service assurance requirements. For more information, visit the Global Services website at or contact your Spirent sales representative. Americas SPIRENT sales@spirent.com Europe and the Middle East +44 (0) emeainfo@spirent.com Asia and the Pacific salesasia@spirent.com 2010 Spirent Communications, Inc. All of the company names and/or brand names and/or product names referred to in this document, in particular the name Spirent and its logo device, are either registered trademarks or trademarks pending registration in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice. Rev. B 07/10