Competitive Mobile Broadband Performance Research Access Network Department Vip mobile d.o.o.
The measurement of the service quality of mobile operators In the Republic of Serbia, in the period from 16 September to 14 October 2011, a measurement of the service quality of mobile operators was undertaken. The aim of this paper is to inform the public about the results of those measurements. The measurements were carried out by a team of Vip Mobile Network Optimization and Quality Engineers based on an autonomous drive test system, TEMS Automatic, developed by ASCOM. The equipment consisted of three identical, independent Radio Test Units ( RTU ), each of which was used to measure the quality of one mobile operator, MTS, Telenor or Vip. Each RTU had two SIM cards corresponding to the measured operator. One SIM card was used to measure the quality of the voice service, and the other to measure the quality of the data services. The measurements were designed to simulate the behaviour of users as closely as possible. The work orders were defined independently for the voice and data services. In the case of the voice testing, the RTU was configured to perform mobile originated, and to receive mobile terminated, calls to and from a landline number connected to the stationary part of the TEMS automatic system. The call duration was a hundred seconds, which statistically corresponded to an average call length in Serbia. For measuring the quality of the data service, the system was configured to perform five pings (ICMP test). Subsequently, one FTP download of 3MB file size, corresponding to a download average of an mp3 file from the Internet, was conducted. As the final step, an FTP upload of 1MB file size, corresponding to sending an average picture size, was carried out. The measurement campaign was performed in the 17 largest cities in Serbia (Belgrade, Novi Sad, Nis, Kragujevac, Subotica, Zrenjanin, Pancevo, Cacak, Leskovac, Smederevo, Valjevo, Kraljevo, Krusevac, Sabac, Vranje, Novi Sad, Sombor). According to the 2002 census, the population in the 17 measured cities was 33.1% of the total population of Serbia, reflecting a large sample, resulting in reliable results regarding the quality of the mobile services. In addition to the above-mentioned cities, the measurements were conducted to include all highways, important regional roads and some additional access roads to those sites. The measurements were carried out on a stationary (the nomadic use of Mobile Broadband) and drive tests bases. The drive test applied only to the roads. The routes in the cities were carefully selected in order to have measurements equally distributed in all parts of the cities, which enabled a representation of the quality of service as closely as possible to the user.
Measured routes
Measurement results voice service Vip Tln mt:s Average PESQ Block Call [%] Drop Call [%] Call Setup Time [sec] Handover Success Rate [%] Serbia 3.90 1.23 0.44 3.69 99.51 Nis 3.93 0.00 0.00 3.51 100.00 Novi Sad 3.90 1.52 0.00 3.67 100.00 Belgrade 3.94 1.19 0.48 3.65 100.00 Kragujevac 3.89 0.00 0.00 4.09 98.11 Other cities + roads 3.88 1.33 0.55 3.69 99.45 Serbia 3.90 1.60 0.49 3.31 97.52 Nis 3.81 1.69 0.00 3.53 100.00 Novi Sad 3.92 2.14 0.55 3.14 98.59 Belgrade 3.89 0.73 1.23 3.14 99.43 Kragujevac 3.90 6.78 0.00 3.39 96.97 Other cities + roads 3.91 1.55 0.27 3.38 96.65 Serbia 3.85 2.03 0.65 4.01 98.93 Nis 3.81 0.00 1.72 4.13 100.00 Novi Sad 3.84 4.71 2.75 4.06 97.25 Belgrade 3.89 0.72 0.24 4.01 99.54 Kragujevac 3.81 0.00 0.00 4.20 100.00 Other cities + roads 3.85 2.25 0.43 3.99 99.37
3.90 Average PESQ 3.90 3.85 1.23 Block Call [%] 1.60 2.03 Drop Call [%] Handover Success Rate [%] 0.44 0.49 0.65 99.51 98.93 97.52
Call Setup Time [sec] 3.69 3.31 4.01 Measurement results data services FTP DL Mean Throughput [Mbps] FTP UL Mean Throughput [Mbps] Average Round Trip Time [msec] PS Data Transfer Cutoff Ratio [%] PS Service Access Time [sec] PS Session Time [sec] Vip Serbia 5,983 2,053 100 4.23 2.45 11.67 Nis 5,738 2,163 55 1.33 3.27 5.46 Novi Sad 5,402 1,921 94 2.30 2.93 5.56 Belgrade 6,610 2,257 67 1.19 2.44 4.59 Kragujevac 6,350 2,048 184 2.70 2.42 5.00 Other cities + roads 5,802 1,978 115 6.32 2.31 17.04 Tln Serbia 4,507 1,389 145 5.15 2.04 14.03 Nis 2,407 283 153 2.70 1.83 21.16 Novi Sad 4,662 1,798 161 3.11 2.29 8.29 Belgrade 5,966 2,122 62 1.99 2.22 4.99 Kragujevac 2,640 282 204 3.08 1.74 22.77 Other cities + roads 4,019 1,092 176 7.22 1.94 18.44 mt:s Serbia 1,642 452 355 5.50 1.55 22.27 Nis 1,753 684 164 1.35.71 15.43 Novi Sad 1,697 428 457 7.61 3.00 21.38 Belgrade 1,680 330 379 9.20 2.29 26.16 Kragujevac 1,443 418 274 3.70.94 24.48 Other cities + roads 1,624 480 346 4.36 1.18 21.52
FTP DL Mean Throughput [Mbps] 6 5 FTP UL Mean Throughput [Mbps] 2.05 1.39 2 0.45 Average Round Trip Time [msec] 354.84 PS Data Transfer Cutoff Ratio [%] 4.23 5.15 5.50 100.25 144.75
PS Service Access Time [sec] 2.45 2.04 1.55 PS Session Time [sec] 22.27 14.03 11.67