Chair for Next Generation Networks (AV) TU Berlin FanTaaStic One Stop Shop of federated Testbeds and Testing Services Florian Schreiner EIT ICT Labs FanTaaStic CI-FIE Industry Workshop 27.06.2014 Fraunhofer Institute for Open Communication Systems - FOKUS Kaiserin-Augusta-Allee 31 D-10589 Berlin Germany Email: florian.schreiner@fokus.fraunhofer.de Competence Center: Next Generation Network Infrastructures WWW: http://www.fokus.fraunhofer.de/go/ngni/
Chair for Next Generation Networks (AV) TU Berlin Evolution of Testbed Federation Mechanisms in FI Projects Teagle SFA OML + FCP SFA + OMF FITeagle SFAWrap MySlice OML + FCP
Chair for Next Generation Networks (AV) TU Berlin Federation Tools covering the Experimentation Lifecycle Discovery equirements eservation Provisioning Monitoring Experiment Termination E.g. OWL-based ontologies. E.g. OMF OEDL scripts. E.g. NITOS Scheduler. E.g. SFA. E.g. OML streams. E.g. via FCP. E.g. TopHat. esource Information Model Experiment esource Description esource Scheduling Model Direct or Orchestrated Instantiation esource or Experiment Measurement Automated / Manual esource Usage Data Storage and esource elease Authentication (e.g. X.509 certif cates) Authorization (e.g. SAML-based ABAC PDP) SLA (e.g. WS-Agreement)
Chair for Next Generation Networks (AV) TU Berlin Testbed Functions 1) esource discovery 8) Authentication 2) Experiment definition esources Predefined interactions 9) Authorization 10) Accounting 3) esource reservation 11) Security 4) esource provisioning Direct (API) Orchestrated 12) SLA management 13) Interconnection 5) Experiment control, during execution 14) User interfaces 6) Monitoring esources Experiment 7) Permanent storage (data, experiment descriptor)
FanTaaStIC Actors Users esearchers Students SMEs Testbeds as a Service FanTaaStIC Testbed Federation and Brokering Facility Testbed esources Testbed A Testbed B Testbed C Testbed Providers
Operational Model Analysis of available tools & frameworks from past and current FIE / federation projects for realizing sustainable EIT ICT testbed operations. Analysis and inquiry of a first set of candidate testbeds from FIE and the EIT ICT for integration. Output: Operational Model with Gap Analysis for educational, research and commercial (SME) usage Discovery equirements eservation Provisioning Monitoring Experiment Termination DF ontology? SFA Slices? SFA? FCP? NITOS OML? SFA Specs? OMF OEDL? FCP? NEPI EC? Scheduler? Zabbix? Teagle DEN-ng? Teagle VCT? Teagle? Teagle FCI? esource Experiment esource Direct or esource or Automated / Data Storage Information esource Scheduling Orchestrated Experiment Manual esource Usage elease and esource Model Description Model Instantiation Measurement Authentication (OpenID?) Authorization (SAML-based ABAC?) SLA (WS-Agreement?) + FanTaaStIC Operational Model Gap Analysis
Why using the etom Framework?
etom mapped to - FanTaaStIC etom - Operations Operations Support and eadiness Fulfillment Assurance Billing Customer elationship Experimenters, Product Testing Enterprises Service & Operations Chapter 3.1 Chapter 3.2 Services for Testing and Experimentation esource and Operations Testbed esources Supplier/Partner elationship Testbed Providers Chapter 3.3 Chapter 3.4
etom - Operations Competence Center NGNI Operations Support and eadiness Fulfillment Assurance Billing Customer elationship Customer Interface CM Support & eadiness Marketing Fulfillment esponse Selling Order Handling Problem Handling Customer QoS/ SLA Manage Billing Events Bill Invoice Bill Inquiry Handling Charging Bill Payments & eceivables Chapter 3.1 Enable etention & Loyality Service & Operations SM& O Support & eadiness Service Configuration & Activation Service Problem Service Quality Service & Specific Instance ating Chapter 3.2 esource and Operations M&O Support & eadiness Workforce esource Provisioning esource Trouble esource Performance esource Data Collection and Distribution esource Data Collection & Processing Chapter 3.3 Supplier/Partner elationship S/PM Support & eadiness S/P equisition S/P Problem eporting & S/P Performance S/P Settlements & Payments Chapter 3.4 S/P Interface
Gap Analysis
OSS/BSS Processes to be realized based on Business Model Federator all oles: Matchmaker One-stop-Shop Advisor Integrator Invisible Coordinator (Coordinated action) equired Process / Service / Component Class eq. No. Process description (linked etom processes) Service processes (for main federation service type) B-SM 1. Design & transition of new or changed services ( ) B-SM 2. Service Level management (SLAs, OLAs) (1.1.1.7) B-SM 3. Service reporting (1.1.2.4, 1.1.2.5) B-SM 4. Service continuity & availability management (1.1.2.1, 1.1.2.4) B-SM 5. Financial management (budgeting, accounting, charging) for services (1.1.4.5) B-SM 6. Capacity management (1.1.2.4) B-SM 7. Information security management ( ) B-SM 8. Incident & service request management (1.1.2.3) B-SM 9. Problem management (1.1.2.3) B-SM 10. Configuration management (1.1.2.2) B-SM 11. Change management (1.1.2.2, 1.1.3.2) B-SM 12. elease & deployment management (1.1.2.2, 1.1.3.2) B-SM 13. Continual service improvement (1.1.2.4) Consumer-facing services/components B-CF 1. Provision of main technical service (1.1.1.5) B-CF 2. Advice ( 1.1.1.6 ) B-CF 3. Assignment of resources (1.1.1.5) B-CF 4. Legal contracts ( ) B-CF 5. Billing and payments (1.1.1.10 to 1.1.1.15) B-CF 6. Platform for using service (1.1.1.2) Federation-member facing services/components B-FM 1. Collective bargaining ( ) B-FM 2. Internal mediation (1.1.2.5) B-FM 3. Promotion (1.1.1.3) B-FM 4. Validation (1.1.4.4) B-FM 5. Facilitate technical interoperation (1.1.4.2) Supporting service components (technical) B-SC 1. Comparison platform ( ) Federation members (Uncoordinated action)
FanTaaStIC Architecture Blueprint Federation Operator (FO) administer Section 3.2 (etom 1.1.2) FO Interface (FOI) TO Interface (TOI) Portal Portal Section 3.4 (etom 1.1.4) Monitoring epository Policy epository Service Catalog esource Catalog CM OSS & BSS Ticket System / Fault (TS) Billing System (BS) SLA (SM) Provisioning System (PS) FanTaaStIC Operation Center (FOC) FanTaaStIC TaaS Services (FanS) Catalog esource eservation esource Provision esource Monitoring esource elease epository esource Brokering esource Negotiation esource Discovery Experiment Control Section 3.1 (etom 1.1.1) FU Interface (FUI) administer Portal administer Testbed Owner (TO) Section 3.3 (etom 1.1.3) QoS/SLA Monitoring System (MS) eservation System (S) Billing System (BS) esource System esource (MS) System (MS) Provisioning, Control, Fault experiment Federation User (FU) Interconnection System (IS) esource egistry Testbed
FanTaaStIC s services Ultimate goal of FanTaaStIC: Integrator, which through it s testbed federation and brokering facility offers aas and TBaaS services, AND: One-stop-shop (Billing, Payment, Legal Contracts) services Matchmaker (Discovery and Assignment of esources) services Advisor (Expert advice on Testbed/resource usage / Experimentation & Testing) services + Consultation on Business Model, Feasibility, etc.!
Why Testbed should be offered more flexible and demand driven Past Testbed per project - short lived Present Testbed federations Upfront project-based participation Future On-demand - short-term booking Capacity forecasting / scheduling
Concrete prices do matter! For comparison of offerings To foster competition For increased transparency
FanTaaStIC Products vs. Consumer Matrix Example of Network Service Provider Market Segment Market Value Chain component Provider Industrial (IND) esearch and Development (&D) Education (EDU) Certificati SME BE Agencies Organisat on (CE) ions Standardi sation (STA) Auditing (AUD)... TOTAL NA EC public private public private Total Market 0 0 0 0 0 0 0 0 0 0 0 0 0 Network Service Provider (NSP) Total NSP 0 0 0 0 0 0 0 0 0 0 0 0 0 Sum 0 0 0 0 0 0 0 0 0 0 0 0 0 Enablers (Enabler / Awareness Plane) 0 Mobile OSS / BSS (Business Plane) 0 Configuration & Monitoring ( Plane) 0 Services (Service Plane) 20 20 Equipment Control (Control Plane) 0 Equipment (Data Plane) 0 Sum 0 0 0 0 0 0 0 0 0 0 0 0 0 Enablers (Enabler / Awareness Plane) 0 Fixed OSS / BSS (Business Plane) 0 Configuration & Monitoring ( Plane) 10 10 Services (Service Plane) 0 Equipment Control (Control Plane) 0 Equipment (Data Plane) 30 30 Sum 0 0 0 0 0 0 0 0 0 0 0 0 0 Enablers (Enabler / Awareness Plane) 0 Satellite OSS / BSS (Business Plane) 0 Configuration & Monitoring ( Plane) 0 Services (Service Plane) 0 Equipment Control (Control Plane) 0
For SMEs testbeds alone are useless!! SMEs typically need support in many different product development phases Product Development Decisions System Under Test Especially testing support is important Typically SMEs lack the know-how to set up multi-tech testbeds Decision taking Analysis & Evaluation Evaluation eports Experimentation-Driven Innovation Cycle Experiment eports Experiment Data eporting Experimentation SMEs should be enabled to primarily focus on their product
FanTaaStic s Expert Services Product Development Test Strategy Definition Our experts will help analyzing the required testing procedures and test setups and define a test strategy suitable for testing your product taking into account the specific related technologies and the conditions under which testing should be conducted Feasibility Check Our experts will help analyzing the technical feasibility of your ideas to implement, deploy and roll-out
FanTaaStic s Expert Services Testing Test Environment (Test Setup Support) Our experts will support you in selecting and setting up the test environments required for testing your product and support you in executing the tests Functional Testing Our experts will support you in testing specific functions of your products, using one or several federated testing facilities of Fantaastic Performance Testing Our experts will support you in conducting various performance tests, tailored to the needs of your product Usability and Accessibility testing Our experts will provide you with expert advice on usability and accessibility of your product Test Automation Our experts will provide support in automating various testing procedures for analyzing your product s performance, usability and behavior in multiple conditions Test Data Our experts will support you in managing various amounts of testing data IT Infrastructure Testing Our experts will provide various means for testing your IT infrastructure, e.g. security related testing, reliability / QoS related testing, etc.
FanTaaStic s Expert Services eporting Statistics on esource Usage Our experts will help you in analyzing various statistics related to your product as well as related to the systems and components involved
FanTaaStic s Expert Services Analysis and Evaluation Feasibility Analysis Our experts will help analyzing the feasibility of your product to be deployed and tested on Fantaastic s testing facilites Test Process Consulting Our experts will help analyzing and evaluating the processes involved in executing your product based on the tests conducted on Fantaastic s testing facilities Test Automation Consulting Our experts will help analyzing and evaluating where automation of your product s processes might provide improvements based on the tests conducted on Fantaastic s testing facilities Performance Test Consulting Our experts will help analyzing and evaluating the performance of your product based on the tests conducted on Fantaastic s testing facilities Transition to Managed Services Our experts will help analyzing and evaluating the performance of your product based on the tests conducted on Fantaastic s testing facilities Structural Code Evaluation Our experts will help analyzing the structure of your code and provide you with expert advice on how to improve your product
The Answer Federation and Dynamic brokerage of: Multiple testbeds / technologies Multiple experts Multiple support services Customized testbed/testing packages, according to needs of users / phase of development lifecycle testbeds.eu
شكرا على ح سن إصغائكم 谢 谢 Muchas Gracias Merci Beaucoup Vielen Dank 有 難 う Thank You Terima Kasih Hartelijk Dank Muito obrigado Any Questions? Dipl. Ing. Florian Schreiner Group Leader Tel + 49 30 3463 7174 Fax + 49 30 3463 8000 Email Florian.Schreiner@fokus.fraunhofer.de Place Kaiserin-Augusta-Allee 31, 10589 Berlin, Germany Internet www.fokus.fraunhofer.de/go/ngni