SCAMPI Programmable hardware for network monitoring. Masaryk University



Similar documents
The SCAMPI Scaleable Monitoring Platform for the Internet. Baiba Kaskina TERENA

Design of an Application Programming Interface for IP Network Monitoring

How To Monitor Network Traffic On A Network With A Network Monitor

Autonomous NetFlow Probe

Hardware Acceleration for High-density Datacenter Monitoring

The new frontier of the DATA acquisition using 1 and 10 Gb/s Ethernet links. Filippo Costa on behalf of the ALICE DAQ group

Experiences Deploying and Operating a Large-Scale Monitoring Infrastructure

HANIC 100G: Hardware accelerator for 100 Gbps network traffic monitoring

Open Flow Controller and Switch Datasheet

SCAMPI - A Scaleable Monitoring Platform for the Internet

Insiders View: Network Security Devices

Wire-speed Packet Capture and Transmission

Infrastructure for active and passive measurements at 10Gbps and beyond

Optimising the resource utilisation in high-speed network intrusion detection systems.

Why 25GE is the Best Choice for Data Centers

ABW - Short-timescale passive bandwidth monitoring

Networking Virtualization Using FPGAs

ABW - Short-timescale passive bandwidth monitoring

ABW Short-timescale passive bandwidth monitoring

Introduction to Network Traffic Monitoring. Evangelos Markatos. FORTH-ICS

C-GEP 100 Monitoring application user manual

Ixia Director TM. Powerful, All-in-One Smart Filtering with Ultra-High Port Density. Efficient Monitoring Access DATA SHEET

Wireshark in a Multi-Core Environment Using Hardware Acceleration Presenter: Pete Sanders, Napatech Inc. Sharkfest 2009 Stanford University

PCIe Over Cable Provides Greater Performance for Less Cost for High Performance Computing (HPC) Clusters. from One Stop Systems (OSS)

Enabling Open-Source High Speed Network Monitoring on NetFPGA

Extreme Load Test of Hardware-accelerated Adapter against DDoS Attacks

PCI Express Impact on Storage Architectures and Future Data Centers. Ron Emerick, Oracle Corporation

Potential Thesis Topics in Networking

How To Design An Image Processing System On A Chip

Open Source VoIP Traffic Monitoring

High Performance Network Security

Network Performance Channel

UNITE: Uniform hardware-based Network Intrusion detection Engine

XMC Modules. XMC-6260-CC 10-Gigabit Ethernet Interface Module with Dual XAUI Ports. Description. Key Features & Benefits

Adding a PIB to the MIB Configuration and integration of advanced monitoring

Mellanox Academy Online Training (E-learning)

ATC808. Low Cost 26 Port ATCA Switch KEY FEATURES THE POWER OF VISION

Bivio 7000 Series Network Appliance Platforms

D3.3: Deployment - second phase

APRIL 2010 HIGH PERFORMANCE NETWORK SECURITY APPLIANCES

AMC13 T1 Rev 2 Preliminary Design Review. E. Hazen Boston University E. Hazen - AMC13 T1 V2 1

APRIL 2010 HIGH PERFORMANCE INTRUSION PREVENTION SYSTEMS

A Low Latency Library in FPGA Hardware for High Frequency Trading (HFT)

ncap: Wire-speed Packet Capture and Transmission

Computer Organization & Architecture Lecture #19

PCI Express* Ethernet Networking

Campus Network Design Science DMZ

Embedded Development Tools

基 於 SDN 與 可 程 式 化 硬 體 架 構 之 雲 端 網 路 系 統 交 換 器

PCI Express and Storage. Ron Emerick, Sun Microsystems

Network Master Gigabit Ethernet Tester. Network Master Gigabit Ethernet Tester. Introduction. By Ole Sørensen Product manager.

PCI Express Impact on Storage Architectures. Ron Emerick, Sun Microsystems

OpenFlow with Intel Voravit Tanyingyong, Markus Hidell, Peter Sjödin

NetFlow probe on NetFPGA

Sockets vs. RDMA Interface over 10-Gigabit Networks: An In-depth Analysis of the Memory Traffic Bottleneck

Deliverable D4.2a: First LOBSTER Workshop Proceedings and Summary

Exploiting Stateful Inspection of Network Security in Reconfigurable Hardware

High Speed I/O Server Computing with InfiniBand

Designing a Card for 100 Gb/s Network Monitoring

DiMAPI: An Application Programming Interface for Distributed Network Monitoring

White Paper Solarflare High-Performance Computing (HPC) Applications

Custom design services

Fraunhofer Institute for Telecommunications

Bro at 10 Gps: Current Testing and Plans

The search engine you can see. Connects people to information and services

MOST PCI Tool Kit. Overview. Ordering Information. Experience the Versatile MOST PC Interfaces.

PCI Express Impact on Storage Architectures and Future Data Centers. Ron Emerick, Oracle Corporation

Compiling PCRE to FPGA for Accelerating SNORT IDS

The On-Demand Application Delivery Controller

Cisco Integrated Services Routers Performance Overview

A Reconfigurable and Programmable Gigabit Ethernet Network Interface Card

Chapter 02: Computer Organization. Lesson 04: Functional units and components in a computer organization Part 3 Bus Structures

PE10G2T Dual Port Fiber 10 Gigabit Ethernet TOE PCI Express Server Adapter Broadcom based

FlowMon. Complete solution for network monitoring and security. INVEA-TECH

10 Gbps Line Speed Programmable Hardware for Open Source Network Applications*

PCI Express Overview. And, by the way, they need to do it in less time.

Secure Cloud Storage and Computing Using Reconfigurable Hardware

IMPLEMENTATION OF FPGA CARD IN CONTENT FILTERING SOLUTIONS FOR SECURING COMPUTER NETWORKS. Received May 2010; accepted July 2010

EDUCATION. PCI Express, InfiniBand and Storage Ron Emerick, Sun Microsystems Paul Millard, Xyratex Corporation

Passively Monitoring Networks at Gigabit Speeds Using Commodity Hardware and Open Source Software. Luca Deri January 2003

DD670, DD860, and DD890 Hardware Overview

Achieving Low-Latency Security

D1.3 First-Tier Encryption Definition

Solid State Storage in Massive Data Environments Erik Eyberg

LogiCORE IP AXI Performance Monitor v2.00.a

Development of perfsonar-measurement Archive (MA) Capability based on PRESTA 10G

Evaluation and Characterization of NFV Infrastructure Solutions on HP Server Platforms

Codesign: The World Of Practice

WHITE PAPER. Extending Network Monitoring Tool Performance

FlexPath Network Processor

Versalar Switch Router Market Opportunity and Product Overview

Modeling a GPS Receiver Using SystemC

How Router Technology Shapes Inter-Cloud Computing Service Architecture for The Future Internet

Agenda. Michele Taliercio, Il circuito Integrato, Novembre 2001

Optimizing Data Center Networks for Cloud Computing

DPtech ADX Application Delivery Platform Series

High-Density Network Flow Monitoring

Appliance Comparison Chart

Security perimeter. Internet. - Access control, monitoring and management. Differentiate between insiders and outsiders - Different types of outsiders

VME Data Acquisition System: Fundamentals and Beyond. Abhinav Kumar Bhabha Atomic Research Centre, Mumbai March 2011

Transcription:

SCAMPI Programmable hardware for network monitoring Jiří Novotný <novotny@ics.muni.cz> Masaryk University Arne Øslebø <arneos@uninett.no> Uninett Jun 8, 2004 Rhodos

SCAMPI overview 2.5 year 5 th Framework project Started April 2002 9 partners: CESNET FORTH FORTHNET IMEC Leiden University Masaryk University NETIKOS TERENA UNINETT Main goals: Development of a high-performance intelligent monitoring adapter for 10 Gbps Development of an open and extensible architecture for network monitoring Development of monitoring and measurement tools Investigate strategies and methodologies for monitoring systems operating at 100 Gbps and beyond

Applications Intrusion detection uses Snort signatures DOS attack detection based on anomaly detection QoS application packet loss jitter One way delay Flowrep generic report generator with a web frontend for Netflow/IPFIX records

MAPI Monitoring Application Programming Interface Design goals: Make it quick and easy to implement new monitoring applications Low overhead Support for multiple concurrent users and applications Global optimization Optimize processing of packets based on all applications from all users Transparent support for different hardware adapters Easy to extend New drivers function libraries Support for: SCAMPI adapter, DAG cards, NIC

MAPI (2) Network flow mapi_create_flow Initially all packets seen on the network Apply functions to a flow mapi_apply_functions BPF filter, string search, packet counter, byte counter, Netflow, jitter etc. Read results mapi_read_result mapi_get_next_pkt MAPId Daemon that communicates with hardware devices and processes packets in software

Why Programmable Hardware Today s computers are not able to process traffic monitoring at wire speeds PCI bus throughput interrupt latency slow disk access... hardware acceleration ASICs are not flexible enough do not follow changing conditions of the Internet... programmable hardware acceleration SCAMPI adapters are based on COMBO family developed by CESNET and Masaryk University

COMBO6

COMBO6 Combination of programmable hardware and standard integrated circuits XILINX FPGA (VIRTEX II 3000-6000) CAM, 3xSRAM, DDRAM, EEPROM PLX, power supply Exchangeable interface cards Test/extension connector Status fully operational

COMBO6X New design of COMBO6 2xXILINX II PRO, 3xPower PC processors inside FPGA can bring new ideas in network monitoring Using of FPGA and PCI core instead of PLX chip speed of PCI bus goes up at least to 4Gb/s. With PCI-X core could go up 8Gb/s 3xSRAM, 1xCAM,1xDRAM The COMBO6X with FPGA and PCI core will be ready for redesign to Express PCI in end of 2004 Status in design phase

COMBO-4MTX

COMBO-4MTX Interface card with 4x1Gb/s copper ports 2xXILINX FPGA (VIRTEX II 1000-3000) 2xSRAM, EEPROM 4x1Gb ports Status fully operational

COMBO-4SFP

COMBO-4SFP Interface card with 4x1Gb/s optical ports 2xXILINX FPGA (VIRTEX II 1000-3000) 2xSRAM, 3xEEPROM 4x1Gb ports in SFP cages (hot swap) hw supports four speeds 1GbE, Infiniband, Fiber channel, OC48 Status fully operational

COMBO-2XFP

COMBO-2XFP Interface card with 2x10Gb/s optical ports 1xXILINX FPGA (VIRTEX II PRO XC2VP20), Power PC inside 1xSRAM, 1xCAM, 3xEEPROM 2x10Gb ports in XFP cages (hot swap) Status in activation phase

COMBO-PTM

COMBO-PTM Precise Time Module XILINX FPGA (Spartan 3) 90nm technology MCU Texas Instruments MSP430FI49IPM Precise crystal Connector for GPS (PPM, data) Connector to COMBO6 Status in activation phase

SCAMPI Adapters SCAMPI-4MTX COMBO6, COMBO-4MTX, COMBO-PTM SCAMPI-4SFP COMBO6, COMBO-4SFP, COMBO-PTM, 4xSFP transceiver SCAMPI-2XFP COMBO6X, COMBO-2XFP, COMBO-PTM, 2xXFP transceiver Any combination of COMBO6, COMBO6X with, COMBO-4MTX, COMBO-4SFP, COMBO-2XFP is available

SCAMPI FIRMWARE Modular design VHDL-standard development approach with simulation Nanoprocessors instead of FSMs Prototyping firmware blocks in SW Hardware/software co-design

SCAMPI SOFTWARE Linux driver Mapi for COMBO6 Software simulator of COMBO6 on top of commodity card Comfort development environment for nanoprograms (nsim) Comboctl loader and comfort debugging

More information http://www.ist-scampi.org http://www.liberouter.org/hardware.html