Development of perfsonar-measurement Archive (MA) Capability based on PRESTA 10G NTT Network Innovation Labs. Kenji Shimizu, Katsuhiro Sebayashi 1 1 This work was partially supported by the National Institute of Information and Communications Technology.
Background High-speed streaming application Production quality Uncompressed HD video stream (i-visto) Over one gigabit per second per stream Network monitoring Guarantee QoS for video stream Required micro-second order accuracy and resolution i Visto gateway (XG 1) i Visto gateway (XG 2) 6 Gb/s Uncompressed 4K video stream PRESTA 10G Network Interface Card and Network Monitoring Platform Optical IP Networks i Visto exmediaserver 1.5 Gb/s Uncompressed HD video stream 2
Features of PRESTA 10G Network Interface Card 10-Gb/s network interface card with highly accurate traffic measurement capabilities Supports 3 protocols for 10-Gb/s Ethernet LAN-PHY/WAN-PHY and OC-192c POS 10-Gb/s wire-rate packet capturing and generating capabilities 100-ns time-stamping for sending and receiving packets using external timing source Hardware-assisted inter-packet gap control function for packet generating Flexible traffic shaping function Timing source input (10 MHz, 1PPS) PCI X/DMA Packet processing engine 3 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010
Features of PRESTA 10G Platform Consists of general purpose PC and PRESTA 10G network interface card Can be applied for passive monitoring, active measurement and traffic generator Easy development of 10-Gb/s network monitoring software Easy migration of existing/open-source network monitoring tools into 10-Gb/s networks using libpcap-compatible API library High end, advanced traffic monitoring tools In service QoS monitoring Pre service network testing Open source monitoring tools Existing monitoring software Non sampling packet capturing, NetFlow probe, traffic, statistics reporting PRESTA API library provides raw software interface Libpcap compatible API library PRESTA NIC device driver PRESTA 10G Platform includes PRESTA network interface card Linux Kernel 4
TARGET perfsonar as a sharing infrastructure of our precise and high-resolution measurement data taken from PRESTA 10G. Currently, PRESTA 10G provides following measurement capability. I. One-way delay: micro-second accuracy. Using probe packets or application s packets. II. Jitter: micro-second accuracy. III. Inter-packet gap: 100-nano-second resolution. IV. Available bandwidth estimation: by using packet train generation well-controlled by a hardware-assisted function. V. Flow records: using NetFlow/PSAMP protocols VI. Traffic bit-rate: 100-micro second resolution.... etc. 5
FIRST STEP: IMPLEMENTATION OF MA perfsonar-ma on PRESTA 10G to show everymicro-second traffic bit-rate. cf.) Existing perfsonar-snmp MA, ABW based on RRD archives provides every-second/minute bit-rate We needs higher-resolution (up-to micro-second) measurement extensions to existing perfsonar. Long-tern Short-tern 6 Exinsting RRD-based perfsonar-ma high-resolution perfsonar-ma on PRESTA 10G
POINTS: MODIFICATION INTO PERFSONAR-PS_HRAMA To take advantage of PRESTA 10G, we need to modify perfsonar-ps to support 1. high-resolution timestamps (100-nanosecond resolution.) 2. accelerating to calculate a large amount of data from 10-Gbps highspeed networks. HRA (High Resolution Archive) file formats Meta-data to accelerate the calculation of bit-rate. Fixed-length index. Timestamps formats sub-second expression: ISO-8601, UNIX timestamps. Resolution definition in XML messages. Unit of millisecond ( m ) and microsecond ( u ) Compatibility with SNMP MA RRDtools and backend HRA processor. The requests switches based on the resolution. 7
OVERVIEWS HRA Viewer Existing perfsonar- UI High-resolution archive (HRA) patches A daemon captures and stores in the HRA formats by using PRESTA 10G. A processor reads the stored data and calculate traffic bit-rate in requested resolution. perfsonar requests are switches based on the resolution. What we made. Existing codes. HRA daemon Res. <= 1s Res. <= 1s request. Existing perfsonar-ps SNMP MA(ver. 3.1.8) + HRA patch Switch based on requested resolution HRA IF HRA processor Res. > 1s request. SNMP IF RRDtools Res. > 1s PRESTA-enabled libpcap PRESTA 10G provides: 10-Gbps wire-rate capturing. Accurate and high-resolution timestamps. HRA archive or pcap archive RRD archive 8
DEMONSTRATION HRA viewer Apache TCPmon (*) Host-only virtual network Virtual Machine (CentOS 5.4 x86_64) HRA-enabled perfsonar MA local IF (lo) HRA archives (captured with PRESTA 10G) 9 (*) http://ws.apache.org/commons/tcpmon/
HRA Viewer It can make the bit rate visible by a high resolution as if the loupe. 160Mbps 140Mbps 150Mbps 350Mbps 250Mbps 125Mbps 0bps bit-rate calculated every 100 microseconds bit-rate calculated every 10 milliseconds 10 bit-rate calculated every 1 seconds
POINTS in SetupDataRequest. sub-second timestamp expression is supported by ISO-8601, UNIX timestamps. microsecond unit ( u ) is new definition. 11
CONCLUSION We introduced PRESTA 10G platform for high-accuracy 10-Gb/s network monitoring. We showed our motivation and implementation of perfsonar measurement archive (MA) capability of PRESTA 10G. Our perfsonar-ps HRAMA takes advantage of our PRESTA 10G s high-resolution accurate timestamps and 10-Gbps wire-rate traffic capturing capability. We needs comments on Any pointers to high-resolution perfsonar (ABW)? GUI? (Should I merge to other UI?) Next steps (perfsonar-ps BUOY?), we are planning to share the results of hardware-assisted available bandwidth estimation. 12