Ready for cloud service delivery?

Transcription

1 Ready for cloud service delivery? Status and next steps TF-MSP Berlin, 11 January GN4-1, SA7 Andres Steijaert

2 NREN collaboration on service delivery Agenda & topics Which services are - available - incoming Progress on specific components Delivery approach Network peerings Tender Progress in specific service areas How will NRENs deliver these services (adoption)? 2

3 INTRODUCTION approach and overall status 3

4 Organisational, technical and financial structures in Research and Education institutions often don't map on the way cloud providers offer their services GET IN Assure data is handled safely and meets European and national regulations Acquire and use services through the institutions structures: Affordable and predictable cost and purchasing models (prevent bill shock) Limit network traffic costs and provide network integration Log in with institutional account GET OUT Be able to move data (to another provider) 4

5 Meeting user needs Cloud collaboration areas COLLABORATION SUITES REALTIME COMMUNICATION FILE STORAGE AND SYNC INFRASTRUCTURE AS A SERVICE 5

6 NRENs and clouds GÉANT compendium 2015 data (draft) from NRENs in and outside of Europe Most popular service types Number of NRENs working in these areas 39 Infrastructure as a Service File storage and backup Software as a Service, collaboration services and video conferencing Most popular providers as mentioned by NRENs - Amazon Web Services - BOX - Google Apps - Microsoft Azure and Office 365 Suppliers - OwnCLoud Several suppliers are explicitly mentioned by NRENs; that they either have an agreement with this provider or are interested in establishing an agreement. The vast majority is the latter, NRENs seeking a 6

7 Service delivery IN-HOUSE CLOUDS OUTSOURCED CLOUDS The NRENs and GÉANT connect demand and supply Providers with right capabilities - Bring choice to the research and education community MAKE & BUY, COMMUNITY CLOUD & PUBLIC CLOUD (commercial) OFFERINGS Added value from NRENs: TRUSTED ADVISORS, BROKERS, PROVIDERS = RIGHT CONDITIONS FOR COMMUNITY 7

8 NRENs and clouds GÉANT compendium 2015 data (draft) from NRENs in and outside of Europe NREN cloud involvement Not involved with clouds 31% Involved with clouds 69% Hybrid approach 13 NRENs have adopted a hybrid cloud strategy and are both building and brokering clouds. 8

9 NRENs cloud approach, clusters of compatible data GÉANT compendium 2015 data (draft) build NRENs which (have plans to) offer cloud services not obtained through a vendor, are marked orange broker NRENs which (have plans to) broker agreements with cloud service providers, are labeled blue build and brokernrens which (plan to) do both, a hybrid approach are presented in purple 9

10 Our collaborative approach NRENs deliver to institutions. NRENs are the visible brands in their respective countries. GÉANT supports the NRENs to be successful, with an underlying delivery framework (building blocks for the NRENs to use). 10

11 Our collaborative approach Joint NREN efforts, to enable and facilitate the European Research and Education community to use online services on a large scale, with the right conditions 1. NRENs use one voice, GÉANT, towards providers (both commercial and from communtity) resulting in agreements and connections to our infrastructure 2. for NRENs to adopt and deliver locally, 3. to institutions, for consumption INSTITUTE Y GÉANT INSTITUTE Z PAN-EUROPEAN LEVEL NATIONAL LEVEL 11

12 Cloud services status Framework agreements Results of a pan-european tender / tender compliant Educational discount / preferential pricing For use below tender thresholds IaaS tender, over 30 providers interested. Ready in July 2016 OwnCloud available Cloud Suppliers in the Catalogue Discussions with file sync & share providers Listed in Cloud Catalogue Stating capabilities 16 providers listed CODE

13 USER NEEDS TERMS & CONDITIONS BROKERAGE & PROCUREMENT CLOUD MANAGEMENT & BILLING ADOPTION FEDERATED IDENTITY MANAGEMENT & SINGLE SIGN-ON NETWORK PEERINGS

14 NETWORK cloud peerings 14

15 Network peerings with cloud providers By establishing network peerings with cloud service providers, GÉANT and the NRENs: deliver a high quality service in terms of performance, security and end-to-end service assurance. make it possible to minimize or remove the data transport related costs, which cloud providers currently charge our community. These data ingress and egress charges are a barrier to the adoption of cloud services by institutions. By directly peering, no commercial network routes need to be used, removing the need for providers to charge transport costs. The GÉANT Board approved the launch of the GÉANT cloud service peering opt in trial. 15

16 Already existing cloud network peerings Providers that are part of Helix Nebula (CloudSigma, ATOS, Interoute, T-systems). IaaS providers are connected in response to CERN s recent IaaS tender. Upcoming new peering Peer with Microsoft for Azure and Office 365. It is expected there will be more requests for peerings Amazon Web Services (AWS). Outcomes of SA7 IaaS tender. Providers listed in the GÉANT Cloud catalogue are all candidates for future connections to GÉANT: The HNiSCiCloud project, led by CERN with a number of research laboratories participating, will launch in 2016 and will require connectivity to even more cloud providers. It is expected that the EC s Open Science Cloud initiative will require connections to cloud service providers. 16

17 Peering models A - NREN scenario Cloud service provider connects to the NREN in the country or countries it is located in. The NREN(s) will take responsibility to give other NRENs access to this provider, via GÉANT, via: IP transit to GÉANT. A L2/p2p circuit connection to a GÉANT PoP or GÉANT Open exchange. A L2 circuit to an open exchange where an IP peering with GÉANT can be established. NREN recovers from the cloud service provider, the costs involved in providing connectivity to GÉANT. B - GÉANT PoP scenario Cloud service providers connect directly to a GÉANT PoP or GÉANT Open exchange in the following cases: When the ToR of the NREN does not allow transit to GÉANT, or when the NREN has no means of recovering costs from the provider, the NREN can agree to this scenario. At least 3 NRENs who will be using the cloud service provider, explicitly request a direct connection to GÉANT. The cloud service provider is responsible for the connectivity to the most suitable GÉANT PoP. C - Open Exchanges Cloud service providers connect at an Open Exchange Transit between cloud service providers via GÉANT for their sole benefit will not be allowed. 17

18 Establishing the connection: contract GÉANT Contractual Agreement For cloud network peering

19 Establishing the connection: technical implementation Institutes GÉANT Institutes Institutes Technical implementation

20 Using the connection: Microsoft ExpressRoutes Secure, dedicated private connections: Layer 2 or managed Layer 3. Microsoft Azure or Office 365 NREN Institute NRENs use ExpressRoute Management Interface to set-up the connections

21 IaaS tender & community cloud 21

22 IaaS tender Legal basis for joint NREN procurement activity EC Procurement Directive (2014/24/EU) New Directive sets out key provisions; key to the success of the planned GEANT IaaS tender and Frameworks: Framework Agreement use Cross-border procurements Centralised Purchasing Bodies Member State Procurement Legislation To be implemented by Member States no later than 18 th April 16 22

23 IaaS tender Timeline Market engagement Tender issued Final Bids Contracts awarded Oct 15 Nov 15 Dec 15 Jan 16 Feb 16 Mar 16 Apr 16 May 16 Jun

24 PAN-EUROPEAN LEVEL GÉANT runs the tender and establishes framework agreements with suitable IaaS providers. The tender does not have a winner takes all approach, but instead, involves framework agreements with all IaaS providers who qualify as a result of this tender. This will allow NRENs and their connected institutions the flexibility to choose the services that best fit NRENs needs and the needs of their users. NATIONAL LEVEL NRENs adopt the frameworks and act in one of the following roles: Commission / cost recovery fee for the NRENs Referrer Reseller Underwriter An NREN will act as Expanding the Referrer intermediary by making role, an NREN is also the Framework involved in the contracting Agreements available in its and billing of (some of) its respective country and Institutions service orders. facilitating connected institutions to buy from Providers. (Direct delivery model) An NREN makes purchases from Providers (on behalf of its connected institutions) and distributes the acquired resources across its community (institutions and endusers). Institutions consume the service facilitated by their NREN, without the need to run a tender themselves. Depending on the role of their NREN (referrer, reseller, underwriter) an institution can, at its discretion: Directly procure and use the IaaS services from the Providers Procure and use the IaaS services through its NREN. Run a mini competition amongst all capable providers granted a framework agreement, in accordance with the instructions Use the IaaS services made available through its NREN

25 Other tender opportunities One NREN conducts tender Other NRENs are listed (if they want to) and can benefit; adopt the outcomes. First cases Jisc, software for secure document management for board meetings SURFnet, cloud management portal 25

26 ~okeanos Computing and Storage IaaS Developed by GRNET, 100% Open Source Compatible with OpenStack Aim: Simplicity and Getting Things Done In production for several years Also adopted outside GRNET in Europe, US, Asia, Integrated with edugain Making ~okeanos available to GN4 project

27 OpenStack Most popular Open Source cloud software and API Several NRENs are interested in offering cloud services using OpenStack A group has been set up to share knowledge and experience OSO: OpenStack Operators Mailing list and bi-weekly chats 27

28 FILE STORAGE terms & conditions, OwnCloud 28

29 owncloud Open Source file sync and share provider Popular choice for on-premises online file storage TERENA negotiated favoured pricing for members Several NRENs incorporate owncloud into the services offered to their members and users OpenCloudMesh: allow file sharing between different owncloud installations; to-date 14 organisations have signed up to participate Federated cloud sharing aims at an interconnected mesh of research clouds

30 File storage (sync & share) SA7 is discussing educational pricing and conditions with four file storage providers: BOX Code42 (CrashPlan, SharePlan) Dropbox Zettabox CODE42 All of these providers are listed in the GÉANT Cloud Catalogue. BOX, use in GN4 project? 30

31 WEB CONFERENCING RENDEZ-VOUS 31

32 rendez-vous Multi-party video conferencing developed by RENATER Powered by jitsi.org Simple to use No plugins or downloads (uses WebRTC) Open Source Very resource efficient (thousands of conferences on single server) Deploy videobridges on the GEANT network Orchestrate updates Deploy monitoring and discovery services 32

33 CLOUD MANAGEMENT portals 33

34 Cloud management (portals) Many NRENs have adopted a hybrid cloud strategy, offering a mix of community cloud (built and operated within R&E) and commercial (public cloud) offerings. These services have different interfaces, pricing models, reporting and billing mechanisms. A new layer is required to abstract the underlying complexity and to manage these different systems and resources. SA7 facilitates joint efforts by the NRENs in this area, including engagement with providers that can deliver these cloud management portal capabilities. Opportunity: SURFnet procurement offer to list other NRENs 34

35 Cloud Management - Institution Requirements Single University Scenario 30,000 students, significant cloud adaption hundreds of end users of cloud accounts IT admin, Researchers, Lecturers, Students with many different use cases Tens of departments / budget holders Tens of IAAS cloud accounts Multiple IAAS services IT Department (service owner) Requirements : How can I ensure users access to services is appropriate and report on usage compliance /governance How do I allocate IaaS service usage to budgets? How do I manage invoices e.g. consolidated billing 35

36 Cloud Management Institution Requirements Billing / Management Cloud account management creating, allocating to budget holders User management enabling, controlling, reporting access to cloud accounts Allocating users to cloud accounts i.e. enabling access Allocating cloud accounts to budget holders Consolidate billing - managing & tracking POs & invoices Cost management quotas Export / integration potential to external billing systems? Functionality 36

37 Cloud Management Requirements for Different Levels INSTITUTION interested in cloud accounts, budgets, users, usage, costs NREN Large number of institutions per country Institution s usage Reporting/feedback to measure cloud adaption - usage Multicloud Portal service GÉANT /Management Reporting Reporting/usage, costs per country & vendor 37

38 CLOUD ADOPTION opportunities for the NRENs 38

39 Communication, Reaching out to the NRENs What are we already doing? SA7 meetings Cloud showcases, webconferencing sessions Survey; NRENs ask institutional input What is planned? Session at GN4 Symposium Sessions at TNC 2016 NREN cloud conference for institutions (autumn 2016) What is needed? NRENs: prepare internally, reach out to institutions SA7 NREN: one-on-one sessions, secondment and workshops? 39

40 Obstacles for use? What are current roadblocks for delivering and consuming? For NRENs to deliver cloud services to their communities? For Institutions to consume cloud services (through their NREN)? 40

41 How can we, NRENs, activate ourselves and our institutions? NREN Commitment Organisational aspects Institutions Commitment (quality) Concrete demand (quantity) forecast of spending What would an institution want their NREN to do for them? 41

42 Communication Discuss delivery opportunities Commitment for the IaaS tender: each NREN either in or out. to be completed before April

43 Thank you GEANT Limited on behalf of the GN4 Phase 1 project (GN4-1). The research leading to these results has received funding from the European Union s Horizon 2020 research and innovation programme under Grant Agreement No (GN4-1). 43