STANDPOINT FOR QUALITY-OF-SERVICE MEASUREMENT 1. TIMING ACCURACY The accurate multi-point measurements require accurate synchronization of clocks of the measurement devices. If for example time stamps are used in packets, careful clock synchronization is needed between end devices in order to calculate delay to both directions. This clock synchronization now acts as the shared knowledge of the separate measurement points. The timing accuracy is not a trivial problem, since computer real-time clocks are very inaccurate they might drift several seconds in a day. This is definitely not enough, since (at least) millisecond-order accuracy is usually needed in network delay measurement. Network time protocol (NTP) is cost effective way for reaching synchronization. Maximum accuracy for time synchronization using NTP is about one millisecond. To reach maximum accuracy, the NTP server must remain in the same LAN as the NTP client in order to minimize delay and jitter between the server and the client. NTP is quite slow to obtain accurate synchronization; stabilization time of about hour is sometimes needed. Reference: Easy Wireless, WP2: D2.3 Monitoring, testing and controlling of QoS. 2. NETWORK ADDRESS TRANSLATION Network address translation (NAT) is the process of modifying network address information in datagram packet headers while in transit across a traffic routing device for the purpose of remapping a given address space into another. NAT effects to measurements in IP networks because it intends to masquerade source IP addresses, it makes some two point measurements relying on finding same IP addresses very hard or event impossible to perform. Most often today, NAT is used in conjunction with network masquerading (or IP masquerading) which is a technique that hides an entire address space, usually consisting of private network addresses (RFC 1918), behind a single IP address in another, often public address space. This mechanism is implemented in a routing device that uses stateful translation tables to map the "hidden" addresses into a single address and then rewrites the
outgoing Internet Protocol (IP) packets on exit so that they appear to originate from the router. In the reverse communications path, responses are mapped back to the originating IP address using the rules ("state") stored in the translation tables. The translation table rules established in this fashion are flushed after a short period without new traffic refreshing their state. As described, the method only allows transit traffic through the router when it is originating in the masqueraded network, since this establishes the translation tables. However, most NAT devices today allow the network administrator to configure translation table entries for permanent use. This feature is often referred to as "static NAT" or port forwarding and allows traffic originating in the 'outside' network to reach designated hosts in the masqueraded network. Illustration 1: NAT address remapping Reference: Wikipedia 3. QUALITY-OF-SERVICE METRICS Probably the most essential and general performance Quality-of-Service (QoS) metrics are: > Delay > Jitter > Throughput > Packet loss Another somewhat different, yet important, metric is data transmission efficiency, i.e., how much control information is needed in order to get the actual data through. This Page 2 of 8
metric it is not usually taken into consideration even though in power limited wireless devices it is quite essential for power consumption minimization. Jitter is also related to delay, since it is understood as the variation of the delay. Jitter has several definitions, e.g., the maximum variation of the delay, but the most common one is probably the standard deviation of the delay. Jitter can be calculated from the exact delay measurements, but not from the average values. Jitter is easier to calculate than absolute delay, since it only needs the delay difference between sequential packets, but not absolute clock synchronization of the measurement points. Jitter can be controlled with buffers, but this is done at the expense of delay. Packet loss is more or less independent metric as compared to the other metrics even though some approximation of it can be drawn from raw throughput, if offered traffic load is known. Lost packets are usually detected via sequence numbers and ARQ-methods (automate repeat request). Packet loss has its effect to the other metrics. Consider e.g., an application layer jitter measurement, where jitter is measured directly from sequentially arriving packets. If lower layers fail to deliver some packets correctly, jitter is increased because of the gaps of missing packets. It might also be the case that the application layer packets are all delivered correctly, but jitter is still increased because of the erroneous lower layer packets and retransmissions provided by ARQ-methods. In this case the delay is also increased. 3.1. One way delay One way delay (OWD) is the elapsed time for traversal of a packet between measurement points. OWD can be used for example to locate network bottlenecks, i.e. to locate which part of the network causes the most of the overall delay. OWD measurement is useful to ensure that network operates in congestion situations when QoS methods like differentiated services (DiffServ) are used in the network to ensure good QoS for critical applications. 3.2. Jitter Jitter characterizes the variation in network delay [Reference: Easy Wireless, WP2: D2.3 Monitoring, testing and controlling of QoS]; it is generally computed as the variation of the one-way delay for two consecutive packets (see Figure 1). It manifests through distortion of voice or video due to consecutive packets arriving at irregular intervals. Severe jitter causes jittery or shaky voice quality, reducing intelligibility: > Propagation delay can vary as network topology changes when a link fails, for example, or when a lower-layer network s topology changes which causes a Page 3 of 8
sudden peak in jitter. Current IP backbone research suggests that these occurrences are more common than generally believed > Switching delay can vary because some packets might require more processing than others. This effect is becoming less of a consideration, though, because packet switching is increasingly implemented via hardware pipelines whose switching delay characteristics are deterministic > Scheduling delay variation occurs as scheduling queues oscillate between empty and full. Jitter buffers (also known as play-out buffers) remove delay variation by turning variable network delays into constant delays at destination end systems Figure 1. Effect of the Jitter for the Applications. Jitter buffers add to end-to-end delay, so networks engineered to support low-delay services (such as VoIP) should also be engineered for low jitter. Adaptive jitter buffers aim to reduce additional delay to a minimum by dynamically tuning jitter buffer size to the lowest acceptable value. The algorithms that adaptive jitter buffers use, however, can place constraints on the maximum rate of change in jitter between consecutive packets. Jitter is of the following types: > Constant jitter: In this, the variation in delay is more or less constant > Transient jitter: An unnatural incremental delay, sometimes only by single packets > Short term delay variation: It occurs due to changing routes and exhibits increasing delay for some packets as well as an increase in packet to packet delay Examples of delay: > System packet scheduling delay: It is a transient jitter. VoIP with soft phones often experiences jitter as more than one program may be running on the CPU, thereby slowing it and transmission time jitter is introduced > Congestion in the Local Area Network: It is a transient jitter and occurs for short durations. It is governed by the maximum back-off time and the delay between packets. If the LAN cannot be contacted by the VoIP endpoint and the back-off Page 4 of 8
time limit is reached or if another packet is ready for transmission, then the previous packet may be dropped. A 10 Mbit Ethernet has a high back-off time as compared to the VoIP packet spacing and hence the jitter limits are governed more by the packet spacing and are usually in the range of 10-30 milliseconds > Firewall routers: It can lead to a transient delay as well as short term variations. Firewall routers such as double socket routers reestablish an IP flow on the inner side of the firewalls after they have terminated it on the outer side. This helps in regulating the payload that gets forwarded to the inner networks. However, this leads to variable delay > Access Links: These lead to short term variations and are often responsible for jitter as they constitute a bottleneck in the network. As ISDN and cable modems have bandwidth problems, the jitter introduced due to access links can be severe, sometimes up to 30 milliseconds of delay for each packet > Load Sharing: Load sharing between IP service providers can lead to a constant jitter. Sometimes, multiple access links are routed through one IP service provider and this can lead to jitter if the delays across the links differ > Load sharing by an IP service: It can lead to a constant jitter. When IP service providers route traffic over more than one internal route in order to even out the load on the network, the difference in delay on each route can lead to delay > Load sharing within routers: It results in a constant jitter. When routers process packet in multiple queues in order to boost router capacity, it can lead to low levels of jitter. In order to support high capacity some routers employ a multiprocessing approach in which packets are processed by multiple parallel queues. This can introduce low levels of jitter due to short term differences in queue size > Routing table updates: These can lead to transient jitters. Routers perform periodic updates in order to ascertain packet priority and dispatch the high-priority packet first. This can lead to a delay in the transmission of some packets and sometimes some packets can experience very high delays > Route Flapping: This causes transient jitters and can be traced to varying levels of congestion and link breakdowns. Route flapping occurs when a routing table is updated and is characterized by a low frequency oscillation > Timing Drifts: It causes transient jitters and can result in "jitter buffer events", in which the buffer can either be overfilled or it has excess capacity. The timing can be reset if an NTP server is used 3.3. Bandwidth and Throughput Each IP telephony call requires a minimum quantity of bandwidth. If the network throughput does not meet the minimum requirements, the call cannot be established and any ongoing calls will be discontinued. IP services are commonly sold with defined bandwidth that reflects the services access-link capacity. Defined bandwidth isn t always the same as achieved throughput, however. Throughput characterizes the available user bandwidth between defined network ingress and egress points. The requirement for this Service Page 5 of 8
Level Agreement (SLA) parameter is obvious for point-to-point services such as virtual wires, as defined by the Pseudo Wire Emulation Edge to Edge working group within the IETF. For multipoint-to-multipoint services, such as IP virtual private networks, the SLA definition must exclude cases in which throughput loss is due to customer-based aggregation. Achieved throughput for TCP/IP traffic largely depends on packet-loss probability and Round-Trip delay Time. Consequently, achieved throughput might not relate to contracted access bandwidth. Reference: Easy Wireless, WP2: D2.3 Monitoring, testing and controlling of QoS 3.4. Packet loss Loss characterizes the packet drops that occur between defined network ingress and egress points. Network congestion results in the loss of voice and data packets across the network, disrupting speech and creating signaling problems. For VoIP codecs commonly support concealment algorithms, which can hide the effects of losing 30 ms of voice samples. The loss of two or more consecutive 20 ms voice samples thus results in a noticeable degradation of voice quality. 4. QOS MEASUREMENT METHODS 4.1. Passive multi point measurement The passive method works as follows: QoS agents are connected non-intrusively (parallel) to network path under test. Packets by passing measurement points are captured and analyzed by QoS agents. Capture and analysis results like network flows, packet IDs and packet time stamps are transmitted to other measurement points/qos agents via separate measurement connection. To calculate delay, flows are matched using IP addresses, protocols and ports. Packets are matched using packet IDs; delay is calculated from packet time stamps. Method is called passive, because the actual streams are not modified; hence it is not fully passive because measurement data needs to be transported between measurement points. There is big drawback in passive method - it does not work in real networks. Network flows can not be matched in case there is a NAT between measurement points. In order to use passive multi point measurement, there could not be a NAT between measurement points or NATs must be by passed using some kind of tunneling like mobile IP. Page 6 of 8
4.2. Active multi point measurement In the active measurement method, measurement points are connected to network path under test so that traffic traverses through measurement device. Delay is calculated from probe packets sent between QoS agents. Probe packets contain transmit time stamp from which delay can be calculated. Throughput tests etc. are also possible, because QoS agents are connected serially to the network path. Measurement connection is established between measurement devices, so measurement can be performed also in NATed environment. Illustration 2: Passive QoS measurement Single-point measurements provide end-to-end performance information, which can be used to determine QoS. This setup enables the possibility to measure round trip time (RTT), i.e., the time from the initiation of the service request to the reception of the service reply. This information is valuable QoS metric and gives direct insight of the total performance of the system. From RTT(t RTT ) it is easy to calculate the average throughput of the system S ete = N d /t RTT Page 7 of 8
if the amount of transferred data (Nd) is known. In this way delay and throughput are related, but the relation is not necessarily strict. Consider e.g., a single-point passive measurement, where passing traffic is measured at some point of a network. In this, throughput can be easily measured, but one way delay can be not [Reference: Easy Wireless, WP2: D2.3 Monitoring, testing and controlling of QoS]. Network flow accounting can be used to monitor QoS from a single network point. NetFlow is technology developed for flow accounting. In netflow based accounting, network flows are captured and collected from a single network point. The collection data is further stored to flow database for post processing. NetFlow technology efficiently provides the metering base for a key set of applications including network traffic accounting, usage-based network billing, network planning, as well as Denial Services monitoring capabilities, network monitoring, outbound marketing, and data mining capabilities [Reference: Netflow introduction, downloaded from cisco.com 2.6.2009]. Page 8 of 8