ExoGENI: A Mul-- Domain IaaS Testbed

Transcription

1 D u k e S y s t e m s NSF Workshop on Designing Tools and Curricula for Undergraduate Courses in Distributed Systems, Boston, July 8, 2012 ExoGENI: A Mul-- Domain IaaS Testbed Jeff Chase Duke University / RENCI Ilia Baldine Yufeng Xin Anirban Mandal Paul Ruth Aydan Yumerefendi Chris Heerman

2 Federated substrate with end-to-end virtualized slices Sensor Network Slices Cloud Site Mobile Wireless Network

3 Ilia Baldine

4 14 GENI-funded Racks IBM x3650 M3/M4 servers 2 local drives, 48G RAM Dual-socket 8-core CPU w/ Sandy Bridge 10G dual-port Chelseo adapter BNT G/40G OpenFlow switch DS3512 6TB sliverable storage iscsi interface for head node image storage as well as experimenter slivering Each rack is a small networked cloud Interconnected by combination of dynamic and static L2 circuits: regionals + national fabrics OpenFlow-enabled Also accommodates volunteer sites 4

5 GENI resource model Researcher software running on researcherspecified network topology Virtual topology node pipe Slice dataplane Slice Virtual resource control Aggregate Slivers (e.g., VMs) Physical Substrate node pipe

6 EC2: The Canonical Cloud

7 IaaS: infrastructure services Consumers of Infrastructure-as-a-Service have access to virtual computers, network-accessible storage, network infrastructure components, and other fundamental computing resources... Example: virtual server 1. Host offers instances of a machine abstraction. 2. Guest (slice) requests and programs virtual resource instances. 3. Host contract defines performance and isolation properties. App/Exp Platform OS VMM (optional) Physical Deployment of IaaS clouds is growing rapidly w/ open cloud software.

8 IaaS: clouds and network virtualization Virtual Compute and Storage Infrastructure Virtual Network Infrastructure Cloud APIs (Amazon EC2..) Dynamic circuit APIs (NLR Sherpa, DOE OSCARS, I2 ION, OGF NSI ) Breakable Experimental Network Cloud Providers Transport Network Providers

9 Open Resource Control Architecture ORCA is a wrapper for off-the-shelf cloud and circuit nets etc., enabling federated orchestration: + Resource brokering + VM image distribution + Topology embedding + Stitching + Authorization GENI, DOE, NSF SDCI+TC SM controller coordinator B AM aggregate

10 ExoGENI Every Infrastructure as a Service, All Connected. Substrate may be volunteered or rented. E.g., public or private clouds and transport providers ExoGENI Principles: Open substrate Off-the-shelf back-ends Provider autonomy Federated coordination Dynamic contracts Resource visibility Breakable Experimental Network

11 ExoGENI software structure

12 OpenStack, the Cloud Operating System Management Layer That Adds Automation & Control [Anthony

13 An ExoGENI cloud rack site option 1: tunnels Static VLAN tunnels provisioned to the backbone Direct L2 Peering w/ the backbone 4x1Gbps management and iscsi storage links (bonded) Management switch Worker node Worker node Worker node Worker node Worker node Worker node Worker node Worker node Worker node Worker node Management node To campus Layer 3 network 2x10Gbps dataplane links Sliverable Storage option 2: fiber uplink Dataplane to dynamic circuit backbone (10/40/100Gbps) OpenFlow-enabled L2 switch (optional) Dataplane to campus network for stitchable VLANs

14 Strong isolation is the goal Compute instances are KVM based and get a dedicated number of cores VLANs are the basis of connectivity Register OpenFlow controllers for your VLANs 14

15 Building network topologies slice Slice owner may deploy an IP network into a slice (OSPF). OpenFlow-enabled L2 topology Cloud hosts with network control Computed embedding Virtual network exchange Virtual colo campus net to circuit fabric

16 Flukes GUI

17 3 racks deployed RENCI, GPO and NICTA 2 existing racks Duke and UNC 2 more racks coming FIU and UH Connected via BEN ( LEARN and NLR FrameNet, I2 17

18 From ORCA to ExoGENI ExoGENI is a facility deployment based on the ORCA framework/toolkit. ExoGENI instantiates ORCA actors with specific configurations and relationships. One AM is configured for each aggregate/provider. SMs proxy the GENI API, check identity/access. GENI users may access site racks as independent aggregates. per-rack SM sees only resources within the rack Testbed-wide SMs (ExoSMs) perform topology embedding across all of ExoGENI, acting as a single GENI aggregate. Testbed-wide broker assists ExoSMs.

19 Deployment structure A SM Other GENI Resources GENI Experimenter Tools (e.g., omni) ExoSM GENI API Other GENI Resources B SM A AM LEARN AM BEN AM I2 AM NLR AM SL AM ANI AM B AM I2/ION ESnet LEARN StarLight Rack A OpenFlow BEN NLR GENI AM-API ORCA AM API Native IaaS API OpenFlow Rack B

20 Getting GENI credentials Cloud-Based Credential Store Issue user credentials Issue project x credentials Issue slice s credentials IdP PA SA 1 Register user Create project Create slice in x 5 Create sliver in s Delegate

21 Summary ExoGENI is a network of standard OpenStack cloud sites deployed (deploying) at campuses. Initial sites centrally managed from RENCI, other providers may join and advertise portions of their resources. Layered orchestration software (ORCA) manages multi-cloud slices and integrates with GENI. Proxies GENI APIs, checks identity/authorization. Circuit backplane for L2 network connectivity. By agreement with circuit providers... Configurable/flexible L3 connectivity. Easy button to configure IP network within slice. Host campuses may offer L3 connectivity to slices.