Doc. No. PS R2.0 Technical Description. Qosmotec. Software Solutions GmbH. Technical Overview. Test Automation System LTS-F.

Transcription

1 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F Qsmtec Sftware Slutins GmbH Technical Overview Test Autmatin System LTS-F Page 1

2 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F TABLE OF CONTENTS 0 DOCUMENT CONTROL SYSTEM OVERVIEW SYSTEM SETUP SYSTEM SOFTWARE TEST FEATURES Page 2

3 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F 0 Dcument Cntrl 0.1 Imprint Qsmtec Sftware Slutins GmbH All rights reserved. Qsmtec Sftware Slutins GmbH Schlss Rahe Str Aachen Germany Telefn: Fax: Internet: Dcument Descriptin This dcument gives a quick verview abut the Qsmtec LTS Field Test variant t execute wireless netwrk tests in the live netwrk. It is intended t give ptential custmers a first technical insight int the architecture and the prduct s capabilities. Page 3

4 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F 1 System Overview The Qsmtec LTS-F is a distributed end-t-end test system fr verificatin f wireless netwrk perfrmance as well as fr internatinal raming testing. The gal is t spread test UEs in varius places in the netwrk r even in freign cuntries, but have them reachable fr testing frm ne central lcatin where the tests are rganized and planned and run the tests autmatically and unattended. Thus, it is ideally suited fr netwrk peratrs, service and cntent prviders, MVNEs and MVNOs t test the netwrk and the netwrk services in varius lcatins in the field. Figure 1 shws the setup f a LTS-F system: Figure 1: LTS applicatin scheme Test prbes cntaining real UEs as well as smartphnes can be placed in any lcatin, given that they are reachable via ethernet cnnectin. Tests are scheduled n them frm a central lcatin. T gain higher flexibility, the system even allws t place the test UEs in the netwrk withut a SIM card inside. This can be mapped via sftware frm the central lcatin t each individual test UE. Page 4

5 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F 2 System Setup The LTS field variant setup is based n a cmpact UE chassis, that cnsists f an internal CPU and up t 8 industrial terminals fr 3G, 3.5G and 4G f the GenPr series, based n Sierra Wireless chipsets. UE chassis variants with V pwer supply as well as with 12 V pwer supply fr usage in vehicles are available. The SIM card slts f the industrial mdules are frnt side reachable. On the rear side are antenna cnnectrs (SMA type) fr each UE. Additinally, the terminals are equipped with SIM card adapters t receive SIM card infrmatin via sftware (see belw). The UE chassis has a cmpact size (45 cm x 25 cm x 10 cm) making it easily transprtable. Additinally, rack munting brackets can be attached t insert the UE chassis int a standard industrial 19 rack. Figure 2: UE chassis fr up t 8 industrial terminals The tests are executed n the UE chassis, cntrlling the cntained test UEs. The tests executed n a single UE cntain f a sequence f test steps, which can be circuit switched r packet switched functins. Tests can be executed n a single UE (e.g. data tests), between UEs within a UE chassis r even between UEs f different chassis (see Figure 1). Fr tests including PSTN lines, a separate PSTN server can be included int the test system. Data tests are typically executed against a dedicated test hst as part f the system, but can alternatively als be executed against any data surce (e.g. dwnlad f an arbitrary web site). A cmplete list f supprted test features is listed in chapter 3. With these cmpact UE chassis, the LTS field variant can be setup as a distributed test system with a central applicatin unit and remte test prbes fr testing in dedicated prblem areas, in freign netwrks r n the mve. On the central applicatin server, test scenaris are assembled and parameterized. The UEs as well as SIM cards fr testing are selected fr a specific test run. Test scenaris can either be executed immediately r scheduled fr executin at a dedicated pint f time. This allws t run tests autmatically and unattended in perids f special interest (e.g. peak hurs) r ut f ffice time withut manual interactin. Page 5

6 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F T perate LTS fr testing, it must be guaranteed that an IP cnnectin between the central applicatin system and the varius UE chassis is available. This can be established via WAN, LAN r via a wireless netwrk cnnectin. The pssible number f UE chassis cntrlled frm ne central LTS applicatin system is unlimited, s that a test system might cnsist f a high number f UEs, all executing tests in varius pints f the netwrk and cllecting data fr benchmarking purpses simulatanusly. An ptinal extensin f the LTS system is the SIM Server Array. This allws t assign SIM cards t the test UEs frm remte via sftware. The SIM card is physically nt inserted int the UE s SIM slt, but in an array f SIM card hlders. Frm there, any SIM card can be selected t be mapped t a specific UE fr a test. The nly requirement is an uninterrupted IP cnnectin (via WAN r LAN) between the SIM array and the CPU inside the UE chassis. The SIM server array is available in 3 different sizes: - as a small rackmuntable unit (1U) with space fr 1 SIM Bard (32 SIM cards), - as rackmuntable unit (6 U) with space fr up t 7 SIM Bards (224 SIM cards), - as rackmuntable unit (6 U) with space fr up t 13 SIM Bards (416 SIM cards). Figure 3: SIM Server Array and SIM Bard fr 32 SIM cards Typically, the SIM server array is lcated tgether with the LTS applicatin server, while the varius UE chassis are spread in the netwrk t perfrm the tests lcally and reachable via an internet r wireless cnnectin. The cmbinatin f LTS with a SIM server array prvides pwerful testing capabilities fr service prviders perating in varius regins r cuntries, like virtual netwrk enablers. Hw the system fits int the LTS architecture is visualized in Figure 1. Page 6

7 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F 3 System Sftware The LTS applicatin sftware is installed n a Windws PC (2000, XP and 7 supprted). The graphical cmpnents can be used n the applicatin server itself r be installed n any user PC cnnecting t the applicatin server. This allws t use LTS in multi-user mde. The Test Scenari Editr allws t create test scenaris frm predefined test scripts, each f them describing a set f functins executed n ne r several mbiles in rder t fulfill a certain test purpse (e.g. a vice call between tw mbiles r dwnlad f a web-site with an active PS sessin). In the Test Scenari Editr, the user has the pssibility t assign test resurces (test UEs and SIM cards) t the varius instances, t determine their executin parameters and t schedule them arbitrarily fr parallel and sequential executin. By simple drag and drp actins large scenaris cnsisting f hundreds f test cases can be created within secnds. Alarms can be cnfigured fr the test executin t be infrmed abut failures immediately. These alarms can be generated by r via SNMP t integrate LTS int mnitring systems. Figure 4: A test scenari created in LTS Page 7

8 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F The test UEs reprt results and measurements back t the LTS applicatin server. The Test Result View shws the test executins n test scenari basis. A detailed executin lg displays each test step in millisecnds accuracy. It has varius data views fr visualizatin f the cllected data, especially fr packet switched tests. All result and data windws are synchrnized with each ther, s that a selectin in ne windw autmatically highlights the respective time frame in all ther windws. Fr reprting needs beynd the capacities f the LTS system, all data can easily be exprted int in CSV frmat fr pst prcessing purpses. Figure 5: Varius Test Result Views tp: Traffic Thrughput frm end-user perspective vs. netwrk perspective bttm: IP dumps stred fr the test executin can be pened with Wireshark Page 8

9 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F In additin t this, the LTS system cnsists f a Test Case Editr, that allws t cmpse test scripts easily frm atmic test steps via drag & drp actins. The test cases cmpsed here appear in the test scenari editr and can be used fr test scenari creatin. Figure 6: Creating a test case (mbile riginated call) with the test case editr Page 9

10 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F 4 Test Features The system is capable f the fllwing test features (sme listed features are dependant n the used test UE): Vice Calls (Mbile Originated and Mbile Terminated) PSTN Calls (Landline Originated and Landline Terminated) VIP Calls (Outging and Incming) Vice Quality analysis based n PESQ standard Circuit Switched Data Calls (Mbile Originated and Mbile Terminated) SMS (Sending, Receptin and Cntent Evaluatin) USSD messages DTMF (e.g. VAS and Vice Mailbx cntrl) Supplementary Services Call Frwarding Call Waiting Call Cnferencing Call Barring Calling Line Identity Presentatin / Restrictin Definitin f PDP Cntext Definitin f Quality f Service Prfiles (2.5G and 3G) and setting f cnnected parameters: Precendence class, Delay Class, Reliability Class, Mean Thrughput Class, Peak Thrughput Class Traffic Class, Maximum & Guaranteed Bitrate (UL / DL), SDU delivery parameters (in-sequence rder, errr rati, delay, traffic handling pririty) Activatin / Deactivatin f PDP Cntext Page 10

11 Dc. N. PS R2.0 Technical Descriptin Test Autmatin System LTS-F Packet Switched Data Transmissin: Ping FTP (UL and DL) HTTP WAP (SMTP and POP3) UDP Streaming MultiRAB (CS Vice + PS Data) Data Thrughput Measurements and Statistics (Uplink and Dwnlink) Sftware cntrlled assignment f remte SIM Cards t mbile phnes Netwrk registratin and deregistratin Autmatic and manual peratr selectin Radi access technlgy selectin (2G, 3G, 4G) emlpp Pririty subscriptin and registratin Vice Grup Call Services Vice Bradcast Services Page 11