Cloud and Network facilities federation in BonFIRE David García Pérez, AtoS

Transcription

1 Building service testbeds on FIRE Cloud and Network facilities federation in BonFIRE David García Pérez, AtoS FedICI Aachen, Germany, 26/08/2013

2 BonFIRE BonFIRE is a multi-cloud facility for testing and experimentation of cloud applications 2 Cloud and Network facilities federation in BonFIRE BonFIRE 2

3 BonFIRE is Unique 3 Cloud and Network facilities federation in BonFIRE BonFIRE 3

4 BonFIRE scencarios and sites EPCC (Edinburgh) Scenario 1 (normal internet) HP (Bristol) Scenario 3 GEANT AutoBAHN and Federica PSNC (Poznan) Scenario 2 Emulab (Virtual Wall) iminds (Ghent) INRIA (Rennes) Wellness (Sevilla) HLRS (Stuttgart) Permanent (>450cores / 45TB) & On-Request (+1,500 cores) infrastructures 4 Cloud and Network facilities federation in BonFIRE BonFIRE 4

5 Open Cloud Computing Interface Resource level operations through OCCI OCCI extended to add resources of the type: Site-links Routers experiments <experiment href="/experiments/43706" xmlns=" project.eu/ doc/schemas/occi"> <id>43706</id> <description>fedici Experiment</description> <name>fedici Experiment</name> <walltime>7200</walltime> <user_id>dperez</user_id> <groups>dperez</groups> <status>ready</status> <routing_key>fa84aed377254b5f4098</routing_key> <aggregator_password>qu73px</aggregator_password> 5 Cloud and Network facilities federation in BonFIRE BonFIRE 5

6 BonFIRE Architecture Exposes a REST BonFIRE OCCI interface Has an EndPoint for different kinds of Testbeds Centralized Different authentication queues - to authorization coordinate module services such as Both for central Accounting. services and testbeds Experimenters queue. Lowest layer an user can interact with BonFIRE Exposes a REST BonFIRE OCCI interface 6 Cloud and Network facilities federation in BonFIRE BonFIRE 6

7 Cloud Testbeds OpenNebula The OCCI server was extended to add aditional BonFIRE functionality HP Cells OCCI server implemented to interact with Cells. Virtual Wall Not a typical Cloud testbed. OCCI server implemented to interat with Virtual Wall VMWare vcloud OCCI server implemented to interat with Virtual Wall Amazon EC2 BonFIRE Enactor makes translation from OCCI to propietary Amazon EC2 API. 7 Cloud and Network facilities federation in BonFIRE BonFIRE 7

8 Network Testbeds Virtual Wall Default Networks: best-effort variant of network. Managed Networks: Controllable QoS (bandwidth, packet loss rate, and delay). Active Networks: on top of Managed Networks adds: control of background traffic (UDP and TCP connections with dynamic packter size and throughput) FEDERICA Isolated network slices by the means of virtualizing routers. BonFIRE Enactor implements an OCCI-to-SFA adaptor AutoBAHN Beta functionality of GÈANT. New resource site-link, that it is able to create a dedicated network between EPCC and PSNC with guaranteed bandwith, reduced jitter, and service reliability. BonFIRE Enactor implements an OCCI-to-AutoBAHN BoD adaptor 8 Cloud and Network facilities federation in BonFIRE BonFIRE 8

9 Gluing it together Canonical BonFIRE images based on Debian. Support Xen, KVM, and ESX hypervisors Contextualization works the same way for all federated Cloud Managers. Working right now into providing an RPM based distribution. BonFIRE WAN VPN net that connects all Clouds infrastructures over public internet. User Management LDAP database that stores user credentials and group membership. Authorization service, group based, that checks to which kind of resources and locations an user can access. SSH gateways to access VMs in the BonFIRE WAN network. BonFIRE Monitoring Zabbix based Access to infrastructure, Cloud Manager, VM and application monitoring. 9 Cloud and Network facilities federation in BonFIRE BonFIRE 9

10 Practical Experimentation Tools REST API based on OCCI Graphical Interface BonFIRE Portal BonFIRE Experiment Descriptor (JSON or OVF) RESTfully (Ruby API) Command Line Tools { "name": "My Experiment", "description": "Experiment description", ruby p249 "duration": > pp root.locations 120, #<Collection:0x813dd534 $ curl - kn "resources": project.eu/experiments uri= project.eu/locations [ RELATIONSHIPS HTTP/ { OK "compute": { parent, self "name": "Server", ITEMS <?xml (0..5)/5 version="1.0" "description": encoding="utf- 8"?> "A description of the server.", #<Resource:0x813c6b04 <collection xmlns=" project.eu/doc/schemas/occi" "instancetype": uri= project.eu/locations/be- ibbt> "small", href="/ bfexperiment #<Resource:0x813b5868 experiments"> create <name> "locations": uri= project.eu/locations/de- hlrs> [- D <description>] ["uk- epcc"], [- W <walltime>] [- G <group>...] #<Resource:0x813a45cc <items offset="0" "resources": total="0"> uri= project.eu/locations/fr- inria> [ #<Resource:0x </items> uri= project.eu/locations/uk- epcc> {"storage": "@BonFIRE Debian Squeeze v3"}, #<Resource:0x <link href="/" rel="parent" uri= project.eu/locations/uk- hplabs>> { "network": type="application/vnd.bonfire+xml"/> "@BonFIRE WAN"} ] } => nil </collection> }, { "compute": { "name": "Client", 10 Cloud and Network facilities federation in BonFIRE BonFIRE 10

11 Validation of the Platform Core partners experimentation of BonFIRE From Cloud Benchmarking to study of malicious paterns in applications. Two Open Calls First OpenCall already finished. Experiments ranging from service composition, virtual clusters, security or multimedia Second Open Call experiments still being executed in the platform. Experiments ranging from Cloud elasticity, QoS in federated Clouds, testing of commercial home security and management solutions, multimedia interfaces, or orchestration between users and cloud resources. Open Access We invite users to come and use for free the platform. 11 Cloud and Network facilities federation in BonFIRE BonFIRE 11

12 Free access to BonFIRE Get free access to the BonFIRE resources Three simple steps: 1. Visit 2. Spend 15 minutes to specify your needs 3. Apply to the BonFIRE Open Access What you get: Cloud resources Up to 50 virtual cores Up to 250 Gb storage Advanced emulated network functionality BonFIRE s unique monitoring and control features 12 Cloud and Network facilities federation in BonFIRE BonFIRE 12

13 Building service testbeds on FIRE Thank you for your attention QUESTIONS??? project.eu project.eu