ANI Network Testbed Update

Transcription

1 ANI Network Testbed Update Brian Tierney, ESnet, Joint Techs, Columbus OH, July, 2010

2 ANI: Advanced Network Initiative Project Start Date: September, 2009 Funded by ARRA for 3 years Designed, built, and operated by ESnet staff 1 of 3 ARRA Advanced Network Initiative (ANI) projects in the DOE ANI 100G Prototype ANI Network Testbeds 4 ANI research projects 2

3 DOE s Advanced Networking Initiative ANI Project scope ($66.8M): Build end-to-end 100 Gbps prototype network between DOE supercomputers and MANLAN Build a network testbed facility for researchers and industry Includes $5M in network research that will use the testbed facility Magellan: Separate DOE-funded ($32.8M) nationwide scientific mid-range distributed computing and data analysis testbed to explore whether cloud computing can help meet the overwhelming demand for scientific computing NERSC / LBNL & ALCF / ANL configured with multiple 10 s of teraflops and multiple petabytes of storage, as well as appropriate cloud software 7/12/10 Joint Techs, Summer

4 ANI Project Goals Prototype network: Accelerate the deployment of 100 Gbps technologies Build a persistent infrastructure that will transition to the production network ~ Key step toward DOE s vision of a 1-Terabit network linking DOE supercomputing centers and experimental facilities Not for production traffic Testbed: Build an experimental network research environment at sufficient scale to usefully test experimental approaches to next generation networks - Funded for 3 years, then roll into the ESnet program - Breakable, reserveable, configurable, resettable - Enable R&D at speeds up to 100 Gbps 7/12/10 Joint Techs, Summer

5 Testbed Overview Progression Start out as a tabletop testbed Move to Long Island MAN when dark fiber is available Extend to WAN when 100 Gbps available Capabilities Ability to support end-to-end networking, middleware and application experiments, including interoperability testing of multi-vendor 100 Gbps network components Researchers get root access to all devices Use Virtual Machine technology to support custom environments Detailed monitoring so researchers will have access to all possible monitoring data 7/12/10 Joint Techs, Summer

6 The Testbed Provides A rapidly reconfigurable high-performance network research environment that will enable researchers to accelerate the development and deployment of 100G networking through prototyping, testing, and validation of advanced networking concepts. An experimental network environment for vendors, ISPs, and carriers to carry out interoperability tests necessary to implement end-to-end heterogeneous networking components (currently at layer-2/3 only). Support for prototyping middleware and software stacks to enable the development and testing of 100G science applications. A network test environment where reproducible tests can be run. An experimental network environment that eliminates the need for network researchers to obtain funding to build their own network. 7/12/10 Joint Techs, Summer

7 Sample Projects Examples of the types of projects the current testbed will support include the following: Path computation algorithms that incorporate information about hybrid layer 1, 2 and 3 paths, and support 'cut-through' routing New transport protocols for high speed networks Protection and recovery algorithms Automatic classification of large bulk data flows New routing protocols New network management techniques Novel packet processing algorithms High-throughput middleware and applications research 7/12/10 Joint Techs, Summer

8 Network Testbed Components Table Network Testbed consists of: 6 DWDM devices (Layer 0-1) 4 Layer 2 switches supporting Openflow 2 Layer 3 Routers Test and measurement hosts - Virtual Machine based test environment - 4x10G test hosts initially Eventually 40G and 100G from Acadia 100G NIC project This configuration will evolve over time 8

9 Monitoring Host App Host NEC openflow-1 Tabletop Testbed Configuration NEC openflow-2 IO Tester Host Inventory: 2 application hosts 2 monitoring hosts 4 IO test hosts 2 file server/ webdav hosts 1 ssh gateway host IO Tester north-rt1 north-wdm1 north-wdm2 Prod. east-wdm1 To all devices Mgmt Switch gateway-1 2x 10GE NEC openflow-4 To other File Server File Server south-wdm1 Comments: - App Host : can be used for any researcher application, control plane Monitoring control software, etc. Can support up to 8 Host simultaneous VMs - File Server : Disk space for storing VMs, monitoring data, etc. NFS mounted everywhere, webdav to Internet - IO Tester Lawrence is capable Berkeley of 15 G disk-todisk or 35G National Laboratory App Host memory-to-memory south-wdm2 NEC openflow-3 south-rt1 east-wdm2 File Server Gateway router IO Tester 3x 10GE WDM Link 10GE Link IO Tester U.S. Department of Energy Office 1GE of Link Science To Internet

10 Sample Configuration: Multi-Domain Multi-Layer Protection Testing North Domain East Domain Openflow Switch IO Tester north-wdm1 north-wdm2 east-wdm1 IOTester Prod. South Domain IO tester Test inter-domain optical protection schemes south-wdm1 Openflow Switch south-wdm2 east-wdm2 Test inter-domain higher layer (> 1) protection schemes IOTester

11 Phase 2: move to Long Island MAN

12 100G Prototype Network Prod. LIMAN ANI Testbed Configuration (40G aggregate) Mon host App Host MX80 Router ssh gateway AofA File Server Testbed To Internet IO Tester Mon host MX80 Router App Host File Server Testbed Prod. Testbed IO Tester IO Tester IO Tester Testbed Prod. NEWY Prod. WDM Link 2 x 10 G Infinera 10 GE Link 1 GE Link BNL

13 Testbed will connect to the Nationwide 100G Prototype Network Chicago Magellan NERSC NYC ALCF / ANL Magellan Sunnyvale Nashville OLCF / ORNL 100 G 13

14 Testbed Status Tabletop Testbed available for researchers to log in as late June. Experiments just starting researchers are logging in, configuring VMs, etc Basic documentation mostly written Can reserve testbed components using Google calendar. A few remaining tasks (e.g.: router configuration save/restore) For Phase 2: RFP for the Long Island dark fiber ring has been signed and construction has started. 7/12/10 Joint Techs, Summer

15 Current Projects Using the Testbed Project Summary Expected Results Archstone PI: Tom Lehman, ISI To dynamically create slices of resources across multiple network layers in a vertically integrated manner, so as to generate virtual network topologies. This requires a highly-advanced path computation element which extends the concept of simple path computation to multi-layer, multidimensional topologies. This project will utilize the ANI Testbed to determine design requirements, test alternatives, and evaluate performance of the developed technologies. FlowBench PI: Prasad Calyam, Ohio Supercomputer Center To set up different physical topologies in testbed using resources such as NEC Openflow switches, App Hosts, and Monitoring hosts. On these topologies, we will experiment with Openflow and benchmark performance of GridFTP file transfers with enhanced TCP/UDP variants. The Testbed will be used confirm that our developed technologies will operate as desired with production network equipment, topologies, and configurations. HNTES PI: Malathi Veeraraghavan, University of Virginia Hybrid Network Traffic Engineering Software: The purpose of HNTES is to leverage both an IP datagram network and a high-speed optical dynamic circuit network to best serve users' data communication needs. Experiments on the testbed will be conducted to determine whether flows can be redirected on-the-fly to newly established optical circuits without impacting TCP behavior, and user-perceived performance. 7/12/10 Joint Techs, Summer

16 Testbed Access Proposal process to gain access described at: Currently there are 3 DOE-funded projects that have access to the testbed 4-5 more are waiting for 40G capability Testbed will be available to anyone: DOE researchers Other government agencies Industry Must submit a short proposal to the testbed review committee Committee will be made up of members from the R&E community and industry Our initial goal is to accept at least five proposals every review cycle 16

17 Acceptance Criteria The criteria for selecting the proposals will be based on: Quality of proposed research which includes: Clear, focused research topic Creative and original concept Test plan Qualifications of the team Potential impact of the research on field of networking and DOE SC mission Readiness: is the project ready to run experiments right away? Value of ANI testbed resources to the research Level of support required by ESnet staff 7/12/10 Joint Techs, Summer

18 Testbed Proposal Timeline October 1, 2010: 1st Round of Proposals due January 10, 2011: Testbed awards announced February 1, 2011: Testbed available for use April 1, 2011: 2nd round of proposals due July 1, 2011: 2nd round awards announced October 1, 2011: 3rd round of proposals due January 10, 2012: 3rd round awards announced April 1, 2012: 4th round of proposals due July 1, 2012: 4th round awards announced 7/12/10 Joint Techs, Summer

19 (not related to Testbed!) New ESnet performance Testing Service

20 New ESnet Diagnostic Tool: 10 Gbps IO Tester 16 disk raid array: capable of > 10 Gbps host to host, disk to disk Runs anonymous read-only GridFTP Accessible to anyone on any R&E network worldwide 1 deployed on now (west coast, USA) 2 more (midwest and east coast) by end of summer Already used to debug many problems Will soon be registered in perfsonar gls See:

21 More Information Let us know what we could add/change to make the testbed more useful to you!

22 Extra Slides