PRESTA 10G Platform for High-accuracy 10-Gb/s Network Monitoring NTT Network Innovation Laboratories Katsuhiro Sebayashi, Kenji Shimizu, Seiki Kuwabara, Tetsuo Kawano, Mitsuru Maruyama 1 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Outline Background Features of PRESTA 10G Platform Applications Open-source monitoring tools Pre-service network tester In service QoS Monitoring Past experiments and demonstrations of Distributed In-service QoS Monitor System Conclusion 2 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Background High-speed streaming application Production quality Uncompressed HD video stream (i-visto) Over one gigabit per second per stream Network monitoring Guarantee QoS for video stream Required micro-second order accuracy and resolution i-visto gateway (XG-1) PRESTA 10G Network Interface Card and Network Monitoring Platform i-visto exmedia server i-visto gateway (XG-2) 6-Gb/s Uncompressed 4K video stream Optical IP Networks 1.5-Gb/s Uncompressed HD video stream 3 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Features of PRESTA 10G Network Interface Card 10-Gb/s network interface card with highly accurate traffic measurement capabilities Supports 3 protocols for 10-Gb/s Ethernet LAN-PHY/WAN-PHY and OC-192c POS 10-Gb/s wire-rate packet capturing and generating capabilities 100-ns time-stamping for sending and receiving packets using external timing source Hardware-assisted inter-packet gap control function for packet generating Flexible traffic shaping function Timing source input (10 MHz, 1PPS) PCI-X/DMA Packet processing engine 4 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Features of PRESTA 10G Platform Consists of general purpose PC and PRESTA 10G network interface card Can be applied for passive monitoring, active measurement and traffic generator Easy development of 10-Gb/s network monitoring software Easy migration of existing/open-source network monitoring tools into 10-Gb/s networks using libpcap-compatible API library High-end, advanced traffic monitoring tools In-service QoS monitoring Pre-service network testing Open-source monitoring tools Existing monitoring software Non-sampling packet capturing, NetFlow probe, traffic, statistics reporting PRESTA API library provides raw software interface Libpcap-compatible API library PRESTA NIC device driver PRESTA 10G Platform includes PRESTA network interface card 5 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010 Linux Kernel
Application 1/3: Open-source monitoring tools Greatly improves performance of open-source monitoring tools and existing monitoring software by making wire-rate packet capturing function Packet analysis Traffic monitoring DDoS, Intrusion detection Wireshark Flow Generator Packet storage snort ntop tcpdump softflowd NetFlow Flow Collector 6 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Application 2/3: Pre-service network testing Accurate traffic playback tool Recording real streaming packets Storing all received packets and their precise arrival times (capture mode) streaming server Testing networks using the recording packets (playback mode) streaming client Observing of network behaviors such as jitters, delays, and packet droppings (playback mode) Networks Reproducing recorded packets as network test traffic 7 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010 In-service QoS Monitor
Application 3/3: In-service QoS monitoring Distributed In-service QoS Monitor System The characteristics of a stream, such as interpacket gap, one-way delay, jitter and bit-rate, are measured using accurate time stamp information contained in the packets. Time-stamps of all PRESTA 10G Platforms and i-visto gateways can be synchronized by GPS time signal. Sender (i-visto gateway) Probe (PRESTA10G) Inter-packet gap distribution (100-ns resolution) One-way delay distribution (100-ns resolution) Bit-rate characteristics (calculated every 100-us) Receiver Data IP/UDP time-stamping of sending packets 10Gbps network time-stamping of received packets 8 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Past experiments and demonstrations of Distributed In-service QoS Monitor System SC08 Measuring traffic characteristics of uncompress HDTV video stream (1.5Gb/s) from Osaka, Japan to Austin. OSAKA Knowledge Capital Trial Measuring traffic characteristics of 4K uncompress HDTV video stream (6.0Gb/s) between Osaka and Tokyo at 4 measurement point. 2009 Internet2 Spring Member Meeting Demonstrating 500 micro-second resolution bit-rate measurement. SC09 Measuring traffic characteristics of uncompress HDTV video stream (1.5Gb/s) from Osaka and Tokyo, Japan to Portland. 9 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Demonstrations at SC09 Distributed In-service QoS Monitor System 1.Showing necessity of high-resolution measurement 2.Measuring influence of route change GPS for time synchronization between PRESTA TG monitors PRESTA 10G Inter-packet gap distribution (100-ns resolution) One-way delay distribution (100-ns resolution) Bit-rate characteristics (calculated every 100-us) Tokyo 1.5Gbps Seattle Demo. 1 i-visto GW Traffic generator Demo. 2 Traffic emulator Jitter Portland Osaka 1.5Gbps Los Angeles i-visto packet with time-stamp TS Data IP/UDP * This work is supported by the National Institute of Information and Communications Technology. 10 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
bit-rate (Mbps) bit-rate (Mbps) Demonstration 1: Showing necessity of high-resolution measurement In 10-Gb/s networks, the time resolution at microseconds is necessary especially for measuring the video stream of 1-Gb/s and higher. Measurement result of bit-rate calculated every 100 milliseconds 100 seconds 1.6-Gb/s Time Measurement result of bit-rate calculated every 500 microseconds 500 mill seconds 9.0-Gb/s Disorder of image by packet drop (uncompressed HDTV transmitted by i-visto) Time 11 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Demonstration 2: Measuring influence of route change Two steams are transmitted in different routes. Difference of delay distribution of two streams is observed. Delay of stream #2 is distributed by crowding the traffic. When congestion occurs, route of stream #2 is changed. Delay of two streams becomes the same. Other traffic stream #2 stream #2 Sender stream #1 Receiver Sender stream #1 Receiver Delay distribution Delay distribution stream #1 stream #2 1.1 ms 0.3 ms 12 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Conclusion PRESTA 10G Platform can be applied for variety of network monitoring and measurement purposes for 10-Gb/s network Distributed In-service QoS Monitor System for video sharing networks Accurate traffic playback tool for network performance evaluation Performance-improved open-source monitoring tools for easy network monitoring Planning to develop advanced network monitoring systems in the future Systemizing of accurate traffic playback tool Hardware-assisted available bandwidth estimation Sharing of high-resolution measurement data using perfsonar Automated network configuration based on measurement results NTT Advanced Technology schedules sales of engineering samples 13 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010