SWITCH Cloud Services

Transcription

1 SWITCH Cloud Services Future and current Activities of Platforms and Services Andreas Dudler SATW Workshop A2, Rüschlikon, 30. Januar

2 Agenda Cloud : challenges and needs (SWITCH community) One example : SWITCHdrive Recent Cloud activities of SWITCH CUS P-2 Information scientifique, accès, traitement, sauvegarde Ongoing and future Cloud activities 2 2

3 Challenges for Swiss universities Cloud topic is a (new) challenge for IT service departments! Traditional IT service models are questioned Consumerization of IT Higher requirements of users for IT services Building up know-how is required for all aspect of the topic Integration of clouds in own architecture Legal aspects (data protection, data privacy, data location) Cloud services open outsourcing potential 3 Ausgangslage bei den Universitäten und Hochschulen Das Thema Cloud ist eine Herausforderung für Informatikdienste der Hochschulen Rechtliche Aspekte Consumerization der IT Höhere Ansprüche der Nutzer an IT-Dienstleistungen Cloud Dienste bieten Outsourcing-Potential Traditionelle Dienstleistungen werden in Frage gestellt Know-How Aufbau ist nötig für alle Aspekte des Themas 3

4 Needs in the SWITCH community IT services and researchers want to use clouds Scaling, capex -> opex, ease of use, concentrate on own added value Data location based in Switzerland High performance access to Cloud services Financing models tailored to academic world Legal advice and security for the use of Cloud services and these contracts keep control Specific use cases have been gathered within the CUS P- 2 project Information scientifique: accès, traitement et sauvegarde. 4 4

5 One example : SWITCHdrive Input form FID AAI-enabled Dropbox Evaluation December 2012: 1 st Workshop: institution s expectations and user needs April June 2013: test phase with end users August 2013: decision -> build Output SWITCHdrive service: starting April Wichtiges Element in der Evaluation: Beteiligung der Community (IT Services und Benutzer) Wir haben auch Filesender getestet 5

6 Recent Cloud activities of SWITCH: Relevant Communities SATW Swiss Academy of Technical Sciences Participated in creating Cloud Computing white paper Cloud Computing in Bildung und Forschung workshop in Jan 2014 GN3+ : new activity on Support to Clouds Helix Nebula project: following their activities, SWITCH is connectivity provider Swiss Academic Compute Cloud (SwissACC) Own hands-on project: Building Cloud Competence (BCC) Swiss OpenStack User Group CUS P-2 Cloud Strategy 6 Bisherige Aktivitäten von SWITCH im Bereich Cloud : 6

7 European Projects: GN3+/HelixNebula GN3+: Current stage of GÉANT collaboration for pan- European R&E networking 41 partners (38 NRENs) Service Activity 7 (new in GN3+) on Cloud Computing Focused on general strategy, brokerage, and (network) integration Growing interest among community in operating own services Helix Nebula: Big Science users CERN, ESA, EMBL and (not so big) commercial Cloud providers (CloudSigma, Interoute etc.) look at brokerage and unifying interfaces SWITCH facilitates this work by extending its existing interconnection with CloudSigma to the European-wide research community 7 7

8 Swiss Academic Compute Cloud CUS P-2 bridge project May 2013 April 2014 Led by University of Zurich, GC3 Co-lead by SWITCH 14 partners from Swiss academic institutions Goal Collaborative project to support large scale data-analysis Support researchers in solving scientific problems on IT infrastructure 8 "Consolidate infrastructure and user support effort to enable a Swiss-wide platform for large-scale data analysis" Swiss Academic Compute Cloud (SwissACC) is an short project, serving as a funding bridge between the AAA/SWITCH program and the Information scientifique, accès, traitement et sauvegarde program of CRUS. The project provides a range of services and know-how from over 10 AAA/SWITCH projects. The 14 SwissACC partners work on two main objectives: sustaining and preserving the research communities of the former AAA/SWITCH grid projects, and increasing user and usage numbers. The project focuses on consolidating the services and simplifying the procedures that have been created to support Swiss communities. Its main goal is to free researchers from complex computational aspects of their research so they can focus on their core work. 8

9 The BCC Experience: Building It BCC = Building Cloud Competence 10 COTS servers (Superµ/Quanta) Dual 10GE each, consumer SATA disks Ceph distributed storage system OpenStack/KVM virtualization 9 9

10 The BCC Experience: Users Various researchers running VMs CAIDA/Georgia Tech/TAMU work studying network traffic Analyzed 200 GB of aggregated Netflow data over a few months USI performance tests Virtualized 10GE can outperform bare-metal GigE Digital Humanities (Medievalist) Currently rent server in Germany, would like moving to Swiss service A4Mesh Data: analysis, storage and publication ETH-SEG Scientific experiments Dogfooding internal e.g. Security Cloud Shared Storage aka Academic DropBox tests 500 users testing for six weeks 10 10

11 OpenStack: Gaining Traction OpenStack is used in many industries over the world Vibrant community with many commercial sponsors Use in academic community CERN ICCLab ZHAW University of Zurich Use by large public Cloud service providers HP Rackspace 11 11

12 CUS P-2 Cloud Strategy Action Items suggested by partial strategy (paraphrased): Call for national compute/storage cloud services (resources) Call for cooperative integration projects to lay groundwork Call for national e-science team Call for cooperative adoption projects on specific e-science use cases Fund participation in other relevant national and international projects 12 Leading role of SWITCH together with SWING. in substrategies for Identity management, Cloud, e- learning, participation in working environment, national organization. 12

13 CUS P-2 Cloud Strategy, Whitepaper Action Items suggested by partial strategy (paraphrased): Call for national compute/storage cloud services (resources) Call for cooperative integration projects to lay groundwork Call for national e-science team Call for cooperative adoption projects on specific e-science use cases Fund participation in other relevant national and international projects. Training modules for the use of cloud resources

14 CUS P-2 Cloud Strategy, Whitepaper, SWITCH Focus Action Items suggested by partial strategy (paraphrased): Call for national compute/storage cloud services (resources) Call for cooperative integration projects to lay groundwork Call for national e-science team Call for cooperative adoption projects on specific e-science use cases Fund participation in other relevant national and international projects. Training modules for the use of cloud resources

15 CUS P-2 Strategy, Identity Management Swiss edu-id Long-term electronic ID for the Swiss education system Based on Authentication and Authorization Infrastructure (SWITCHaai) of the Swiss Universities SWITCH starts a project to build up the Swiss edu-id AAI Accounts 50 IdPs 770 SPs Langlebige elektronische Identität für das Bildungssystem Basis: Authentisierungs- und Autorisierungs Infrastruktur (SWITCHaai) der Schweizerischen Hochschulen 15

16 Motivation for Cloud activities Clear needs of the community Input in the Innovation process Clear statements of requirements by university management Data security and data protection Cloud as a field of action in SWITCH s strategy (2011) Positioning of SWITCH Governance and financing model for the academic community Close integration into the academic network (SDN) Identity management: AAI and Swiss edu-id (Integration with University IT architecture) Swiss data location, full control by users Security expertise 16 Deklarierte Bedürfnisse der Community Eingabe in Innovationsprozess Klare Forderungen aus den Management Meetings Datensicherheit und Datenschutz Cloud als Thema in der Strategie von SWITCH Positionierung einer SWITCH-clud Governance und Finanzierungsmodell Enge Integration in das akademische Netzwerk Identitätsmanagement: AAI und Swiss edu-id Schweizer Standort, vollständige Kontrolle durch die Nutzer 16

17 Ongoing and further Cloud activities Building up Know-how in Cloud in all aspects Technical Know-How Experience gathered in pilot installations with selected customers Swiss Academic Compute Cloud: Cloud usage by researchers Study of legal aspects Initiated SWITCH Cloud project Aufbau von Know-How im Thema Cloud Aufbau von technischem Know-How Pilot-Installation mit ausgewählten Kunden Swiss Academic Compute Cloud: Cloud Nutzung durch Forscher Klärung von rechtlichen Aspekten Projekt SWITCH Cloud Aufbau von Infrastruktur und Dienstleistungen: Academic Dropbox Virtuelle Maschinen, Massen-Speicher als self-service Dienstleistung Wissenschaftliche Software für akademische Benutzung 17

18 The SWITCH Cloud Project 2014 Goal of the project Create services for the community Build up scalable and cost-effective infrastructure Key figures Budget: CHF 60 man-months Infrastructure in 2 locations Lausanne and Zurich Lausanne Zürich 18 18

19 The SWITCH Cloud 2014 Software as a Service Academic Dropbox Filesender functionality Academic Software Infrastructure as a Service Virtual Machines Storage as a Service Identity Reporting Monitoring Cloud Infrastructure 19 19

20 Project Milestones 2014 Januar Februar April Juli September Oktober 20 CUS P-2 20

21 Next steps Project proposals for CUS P-2 project Swiss edu-id Cloud Building up the Cloud services with academic community (Advisory Committee) SERI (SBFI) proposal by SWITCH 21 21