Perspec'ves on SDN. Roadmap to SDN Workshop, LBL

Transcription

1 Perspec'ves on SDN Roadmap to SDN Workshop, LBL Philip Papadopoulos San Diego Supercomputer Center California Ins8tute for Telecommunica8ons and Informa8on Technology University of California, San Diego 14 July 2015

2 What mo'vates SDN SDSC/ Calit2? Can SDN/Openflow simplify and/or improve network management tasks within/to the data center? External Layer 2 connec8vity depends on which research network is being u8lized Dynes (ESNet) and Internet2 AL2S (+ Coordina8on with CENIC, California s educa8on network) Must already deal with three different mechanisms Internal networking to the center is mul8- vendor (Juniper, Arista, Cisco, Mellanox) Produc8on, high- performance, NSF- funded systems will be hos8ng high- performance virtual clusters. Isola8on via VLANs and Single Root I/O virtualiza8on (SRIOV) Being u8lized for experiments by par8cular research ac8vi8es Overall: evalua8on of technology, use for research. Not yet pervasive to be considered a solu8on

3 A subset of Ac'vi'es Related to SDN

4 A Specific Research Ac'vity: Community of Prac'ce Scien'fic Expedi'ons and Infrastructure Experiments for Pacific Rim Ins'tu'ons and Researchers PRAGMA Members and Affiliates Established in 2002

5 PRAGMA Experimental Network Testbed (ENT) Ac'vi'es ENT Backbone TWAREN connected through Pacific Wave OpenFlow Network Slicing AutoVFlow deployed and tested (demo)

6 ENT Ac'vi'es Interna'onal Openflow Tes'ng: Control Plane Distributed implementa8on via AutoVFlow Support for mul8ple experiments See Kohei Ichikawa at this Workshop for more details

7 - scale DMZ. Openflow on some edge devices, but not enabled at core switch Climate Modeling Ocean Observing 3D Electron Microscopy Chemistry LHC Physics Proteomics Computer Science High Performance Compu8ng High Performance data Augment Network (10GbE Backbone) Phil Papadopoulos, SDSC, Calit2, PI

8 Prism in Rela'on to Other Networks 100 GbE N x 10 GbE Border e Network (80,000+) 20 GbE 80 GbE 100 GbE Data Oasis 20 GbE 80GbE 10/20 GbE Redundant Ring See Tom HuKon at this Workshop Prism Prism Cherub

9 Prism in Rela'on to Other Networks Connec8on to LHCONE wiring to LHCONE crosses mul8ple administra8ve domains. Doable, but not scalable LHC Tier 2 Site Wuerthwein Lab Physics 100 GbE N x 10 GbE Border 80 GbE 100 GbE Data Oasis This is not the only usage: Connec8ons to StarLight, New ac8vi88es with SDX (Joe Mambreg, PI), Pacific Research plahorm (PRP), 10/20 GbE Redundant Ring 80 GbE See Tom HuKon at this Workshop Prism 80GbE Prism Cherub

10 HPC for the 99% R. L. Moore, C. Baru, D. Baxter, G. Fox (Indiana U), A Majumdar, P Papadopoulos, W Pfeiffer, R. S. Sinkovits, S. Strande (NCAR), M. Ta8neni, R. P. Wagner, N. Wilkins- Diehr, M. L. Norman UCSD/SDSC (except as noted)

11 Comet Architecture (1944 Compute ) - Local Storage 320 GB 72 HSWL 18 N racks FDR FDR 36p FDR 72 IB Core (2x) Internet GB 72 HSWL N GPU 4 Large- Memory FDR 36p 18 Mid- 8er FDR 40GbE 72 Bridge (4x) 72 Arista 40GbE (2x) R&E Network Access Data Movers Juniper 100 Gbps Arista 40GbE (2x) Data Mover (4x) GbE 10GbE 72 HSWL 18 7x 36- port FDR in each rack wired as full fat- tree. 4:1 over subscrip8on between racks. Performance Storage 7 PB, 200 GB/s Durable Storage 6 PB, 100 GB/s AddiNonal Support Components (not shown for clarity) NFS Servers, Virtual Image Repository, Gateway/Portal Hos8ng s, Login s, Ethernet Management Network, Rocks Management s Notable: Bridging IB Fabric to Ethernet. All nodes are poten8al 40GbE Sources

12 Virtual Clusters Overlay Physical Cluster with User- Owned High Performance Clusters Virtual Cluster 1 Isola8on of Virtual Clusters SRIOV (Single Root I/O Virtualiza8on) for Independent Infiniband Subnets Standard VLANs to isolate private Ethernet broadcast domain Virtual cluster nodes can PXE- boot from their virtual frontends Virtual Cluster 2 Ethernet switches are openflow enabled: re8cent about using this for first revision of produc8on.

13 Takeways Ac8vi8es range from computer science experimenta8on (ac8vely using openflow) to isola8on of virtual clusters (using VLANs, evalua8ng Openflow) A variety of ac8vi8es u8lize Layer2 connec8vity op8ons provided by ESNET/Internet2 Is there any unifica8on of mechanism on the horizon? New Ac8vi8es (not detailed in this talk) push on high- performance data at distance Openflow is really s8ll in the experimental networking bin Not in exis8ng network equipment, new purchases are ooen capable Core equipment lasts 5+ years, it will take a while to be pervasive. Personal view: terrific poten8al, need to be careful to not reinvent capabili8es already exis8ng (Rou8ng is a good thing)