CAlcul Réparti sur Réseau Internet Optique à CApacité Surmultipliée* On-Demand Infrastructure Services rovisioning Workshop TERENA «Carrier Grade Virtualized Services delivery from Agile Network Infrastructures» based on CARRIOCAS project results Dominique Verchere (Alcatel-Lucent Bell Labs) & ascale Vicat-Blanc rimet (INRIA) TERENA Office, Amsterdam Netherlands December 8, 2009 * Distributed/Cloud Computing services delivered by Internet Optical Networks with Ultra-high transmission Capacities Vx/N&N/E/09/0040 1 Contents 1. Business models towards Cloud Computing Services delivery 2. Virtualized Infrastructures for Generalized Service roviders 3. Scheduling, Reconfiguration & Virtualization (SRV) service function 4. SRV management functions and service activation interfaces 5. CARRIOCAS ilot Network 6. SRV Scheduler Experimentations 7. Challenges to beyond connectivity services 2 1
Business models towards «Cloud Computing Services delivery» Enterprises want to lower their IT infrastructure costs and focus on their business projects IT resources externalization/outsourcing ~ 40 % annual growth of Internet traffic generated by datacenters. Visualization and image/video post-production High-erformance Computing access for R&D Industrial Applications: e.g. simulated design, pharmacy Data storage management: streaming, back-up Remote access to Datacenters services delivery imposes strong requirements on the network infrastructures to deliver guaranteed QoS end-to-end connectivity services: Mainly bandwidth, latency, jitter, availability and security/confidentiality. 3 Enterprise users of remote IT infrastructures Interests of accessing IT services from the Cloud Catalyst for Virtualized IT Services from Telecom Service providers is: Maximize usages of IT infrastructures for the Business Users IT infrastructure fixed costs (TCO) can be significantly reduced Virtual Organization practices and service on-demand Virtual Labs / Virtual Enterprises based on the «pay-as-you-use» The infrastructure is scaled dynamically according to organization needs Collaboration under short time constraints for Research/Business roject developments IT infrastructure operations and maintenances burdensome becomes invisible Efficient roject Execution and results delivery Access to shared High-erformance Computing" services Based on Service oriented Architecture: e.g. OGSA/OGF, SCA/OASIS. Response to new regulations: Network management/control solutions supporting IT Service requests are needed for emerging virtualized infrastructure as services market. 4 2
Requirements on Network Infrastructures for «Cloud Computing Services delivery» Automated infrastructure management and operations supporting external network service interface to provision connectivity services Services are specified from SLA (QoS, SEC) Connectivity requests are derived Network Services are automatically selected Lx-VNs (x = 1,2,3) Service and Network management interactions with Explicit Resource Selection Network Services can be provisioned with Instant or Scheduled resource reservation SRV = Scheduling and Reconfiguration of connectivity for Virtualized services delivery 5 Towards Virtualized Infrastructures and «Generalized Service roviders» High Energy hysic ers Bio-informatics Scientists Client SLA Service Cliquez pour resentation Integration & modifier le style du titre Service Storefront Generalized Service rovider (GS) Software Application Services Services I.T. Specific Software (Application Resources) Computational Resources Storage Resources Car Designers Manufacturers Customers (Enterprises) User-Network Interface E rovider Edge Node Service Management System (S.R.V.) Network Management System Agent Connectivity Services Connection ath Computing Element () rovider Node () (G)MLS s Telecom Infrastructure Operator rovider SLA Edge Node rovider Edge Node (E) E Instruments/Sensors (Acquisition Resources) MLS-T UNI Customer Edge Node () Visualization resources IT Infrastructures Datacenter Operators6 3
Computing Services delivered by Networks Joint IT and Network service activations Orders and Connectivity Services are managed by SRV Connections are allocated by Network Resource Scheduler & s Application workflow QoS Orders Generalized Service rovider Company A NRScheduler - Super Company B Scheduled Tasks + Connectivity Scheduled Services Optimization S.RV. Management Function Connectivity service requests NRS + Super- + Control lane Capacity transmission: 10 Gbps per λ Datacenter A Datacenter B Capacity transmission:10 Gbps per λ High-Capacity transmission: 40 Gbps per λ S i : (30Gb; T i : 23; duration: 10) Connection provisioning built w. lacement methods () Company C Traffic Engineering, Multipoint, Control theory - perf. evaluation High-Capacity transmission: 40 Gbps per λ Company D S 2 : (10Gb; T 2 : 27; duration: 50) Datacenter D Datacenter C Datacenter + Network Resource Management & Control rotocol Formal Specifications and Validation () LIST 7 SRV exposes Connectivity Services Connectivity Services delivered from Network Infrastructures rovisioned Connections: SRV commands Network Management System Signaled Connections: SRV triggers connection through GMLS based controller Grid Application User (Grid Services) Grid Application User Grid Application User Grid Application User (e.g. Company A) (Grid Services) constraints constraints (Grid Services) constraints constraints (Grid Services) Management & Control Service Layer Buisness Layer Layers SLA rovider (Connectivity Services) Connection control (e.g. UNI signaling ) MLS lanning Tool Network Domain 1 ublication/negotiation Agreement/Notification SRV Network Management System SLA rovider (Connectivity Services) Connection Service requests (e.g. MTOSI) NRScheduler TE-DB (e.g. Computing + Storage) SLA rovider (Connectivity Services) Connection Service Query/Response ublication/negotiation Agreement/Notification SRV Network Domain 2 SLA rovider (Connectivity Services) lanning Tool NRScheduler Connection control Network Management System (e.g. UNI signaling) TE-DB GMLS 8 4
SRV exposes Virtualized IT + Network Services Virtualized Services delivered from Network Infrastructures SRV interface with Virtual IT+Network Management functions: CMS+NMS=VMS SRV composes with several Infrastructures as Services Grid Application User (Grid Services) Grid Application User Grid Application User Grid Application User (e.g. Company A) (Grid Services) constraints (Grid Services) constraints constraints (Grid Services) constraints Grid + Network Layer Service Layer Business Layer SLA rovider (Virtualized Services) IT resource configuration IT Resources request/accept Cloud Management System RE-DB MLS Negotiation/Agreement/Notification lanning Tool EMS SRV Network Domain 1 SLA rovider (Virtualized Services) Connection configuration Network Resources request/accept Network Management System NRScheduler EMS TE-DB (e.g. Computing + Storage) SLA rovider (Virtualized Services) GMLS Negotiation/Agreement/Notification lanning Tool SRV Connection configuration Network Resources request/accept NRScheduler Network Management System Network Domain 2 SLA rovider (Virtualized Services) TE-DB Cloud Management System IT resource config. IT Resources request/accept RE-DB 9 SRV position in Telecom Service roviders Scheduling, Reconfiguration & Virtualisation Virtualized Services (v2) Connectivity Services (v1) Service Service Service Negotiation Service ublication ublication Negotiation / / Notification Notification SRV rocesses Shared Shared Information Information / / Data Data Model Model Resource Resource abstraction abstraction / / Virtualization Virtualization Cin/out=20Gbps Service rovider s Carrier Network C S.R.V. Cliquez atterns Ain/out=20Gbps olicies olicies atterns (WSLA) Bin/out=40Gbps pour modifier Contracts (WSLA) Contracts Service Service Selection Selection Composition le style B du titre Scheduling Scheduling rocesses rocesses Composition A Commercial Filters (policies) Business view Scheduled Management Components of Network Resources Network Management Function Layer Network Control Layer Requests / Reponses Cds Network Management : Res. Scheduler Read / Write Timed TED Scheduled NetConf. lanning tools Consultation NMS Resource inventory A E IG-TE D Service rovider s Carrier Network Cin/out=20Gbps A C Ain/out=20Gbps B in/out=40gbps B Service rovider s Carrier Network Cin/out=20Gbps C A 3 Ain/out=20Gbps 2 Bin/out=40Gbps B Synchronization/ Connection Alimentation inventory TED Transport Networks Service view Network view Service rovider s Carrier Network Cin/out=20Gbps C A Ain/out=20Gbps Bin/out=40Gbps B Element view B C 10 5
Service Activation Interface: GS-SRV SRV manages 2 views of connectivity services based on T.M.Forum From Service orders expressed at the Business layer (after negotiation phase) Connectivity services: Customer view Connection services: Resource view SRV-DB: connectivity services inventory design FeasibiltyChecked design reserve provision Designed Reserved rovisioned unreserve unprovision remove checkfeasibility remove remove remove Service Activation Interface Service Component Activation Interface Service Order Handler Connectivity Instance Manager (Customer based Service Factory) Connection Instance Manager (Network based Service Factory) Service Requests/Notification/ublication S.R.V. Service Inventory Manager SRV -DB Shared Shared Information Information // Data Data Model Model Resource Resource Management Management abstraction abstraction // Virtualization Virtualization activate deactivate terminate Active terminate terminate remove Terminated Figure 1: Connectivity service State Machine : computing Company A E UNI-N Client Network Transport Network UNI-N rovider Edge Node rovider Node Edge Nodes (G)MLS controlled Network rovider Edge Node E Resource Center: High-erf. Visu. (DC) Carrier Grade Ethernet MLS-T (L2-VN) 11 Service Component Activation Interface: SRV-NRS Connection Service Component Activation: Resource Facing NRS is attached to a Network Management Domain SRV NRS: Timed based EVLI, EVLAN, E-TREE provisioning/activation TE management Connection rovisioned Monitoring NRS SRV-DB Background and periodic process (from Network States) Downward information: SRV NRS Connectivity topology is an Ethernet Service graph Service Access points: location, Bandwidth, Latency on the links Commands for new connectivity services Feasibility, Reservation, rovision, Activation Upward information: NRS SRV Connection status Reserved / Available rovisioned / Unprovisioned Activated (i.e. used) / De-activated Shared Info/Data Model based on MTOSI 2.0 / TMF SCAI: Resource facing Interfaces (Connection data model) 12 6
CARRIOCAS experimental network 13 Transport Ethernet Services over WDM Network architecture referencing R-OADM based WDM transmission: (with 40 Gbps transmission) Carrier Grade Ethernet based Networks: 1850TSS-320 Network rovisioning based on Management: 1350-OMS service functions Large Scale Distributed Applications (Grid/Cloud Applications): Computing and Storage Service on Demand (Ter@tec): LUSTRE CFS Application Instruments: Industrial (Remote Visualization): EDF icture Walls Connectivity Service orders References on CARRIOCAS ilot Network Requests Delivery Scheduling Reconfiguration & Virtualization (SRV) (SRV) service service Application Client Visual. Server Negotiation protocol (e.g. WS-agreement based) Connection Services Advertisement protocol (e.g. WS-notification based) North Bound Interface Network Network Management Systems (1353NM 1354BM-Ethernet) South Bound Interface Grid Application Client / Server Ethernet Switch (Customer Equipment) EDF Clamart (o 1) 1850 TSS-320 (rovider Edge) Network High-Capacity transmission λ: nx10 Gb/s link 1 Network A-Saclay (o 3) E Ethernet Switch (Customer Equipment) link 2 A1850 TSS-320 (E) HC + Storage Servers link 3 Univ. Orsay (o 2) link 4 Transmissions: λ: 4x10 Gb/s 40 Gb/s Network E A Ter@tec (o 4) Application Client Storage Server 10Gb/s Interfaces (Ethernet frame aggregation over λ) 14 7
Ethernet Switch (Customer Equipment) EDF Clamart (o 1) 1850 TSS-320 (rovider Edge) A-Saclay (o 3) 1850 TSS-320 (rovider Edge) E Ethernet Switch (Customer Equipment) Ethernet Switch (Customer Equipment) link 2 A1850 TSS-320 (E) link 3 Univ. Orsay (o 2) E A Ter@tec (o 4) (1) Data Stage-in: service n 12 (4) Data Stage-out: service n 16 Area_2 (10.0.0.1) Cliquez 10.70.50.1 Area_1 pour modifier 10.70.50.2 le style du titre LSR_5 LSR_7 10.71.50.3 CARRIOCAS Connectivity Service Scenario latform: oint-to-oint Ethernet Virtual Connectivity Services (2) Simulation execution: No connectivity: (3) Visualization: service n 14 (5) Data Storage back-up: service n 9 (10.0.0.0) LSR_6 LSR_8 10.71.50.4 service 9 Data-Storage access2 (Orsay) HCcomputing access (Ter@tec) Area_4 (10.0.0.3) (2) LSR_2 LSR_1 10.71.50.1 10.71.50.2 LSR_3 LSR_4 10.73.50.1 10.73.50.2 service 14 service 16 LSR_9 10.72.50.1 icture Wall access (Clamart) LSR_10 10.72.50.2 Area_3 (10.0.0.4) LSR_12 10.72.50.4 LSR_11 10.72.50.3 service 12 Network High-Capacity transmission: 4 λ s (10 Gb/s each) 1 λ (40 Gb/s) link 1 Network Network link 4 Transmissions: 1 λ (40 Gb/s) Network 4 λ s (10 Gb/s each) Data-Storage access1 (Saclay) 15 CARRIOCAS Optical Network topology (4E 12 ) SRV User Interface: Connectivity Service order Interface to order Guaranteed Ethernet Connectivity Services Several scheduled requests at 1 Gbps on Connectivity Service n 14 CS n 14: Computing Center: LSR3 Visualization Center: LSR2 16 8
SRV Admin Interface: Bandwidth Usage Display Scheduled Connectivity Services: Ter@tec (LSR_3) Clamart (LSR_2) 1 Gbps during 2 hours starting September 17th at 4:12 pm 17 Admin. Interface of NRS & Node s Signalization of Label Switched Ethernet connections supported with GMLS controllers: LSR_3 LSR_2 - ERO: 3 11 9 10 2 Ethernet Switching MinBandWidth: 1Gbps MaxBandWidth: 1Gbps MaxLSSize: 1Gbps 18 9
Many Thanks to CARRIOCAS Colleagues for their valuable contributions French Ministry of Industry, Essonnes, Haut-de-Seines and aris General Council for their supports on CARRIOCAS project http://www.carriocas.org LIST Many thanks to other projects such as HOSHORUS and G-Lambda for their stimulating and valuable interactions Financial artners 19 «Telecom Service rovider» beyond Connectivity Services delivery Telecom Networks and National Research networks have different SLA requirements and consequently connectivity services delivery is different Application Network Interactions Cloud Computing Interfaces vs. Network Service Interfaces Which interaction level? Service operations? Infra. management? Control? Associate and compose services with heterogeneous QoS parameters Which sort of business alliance can be defined between AS and Telecom Service roviders New/extended Data / Information models Uniform service discovery, request, selection and composition olicy based Service Management for automated functions Network abstraction for Cloud computing specifications Networks as Services need to be standardized with security constraints Virtualized IT Service access require extensions on standard specifications Network as services: T. M. Forum, IETF, ITU-T Application as services: OGF (NSI, OCCI), OASIS (SCA) Virtualized Management Infrastructure with ower saving capabilities 20 10