Helix Nebula The Science Cloud

Transcription

1 Helix Nebula The Science Cloud, May streng vertraulich, vertraulich, intern, öffentlich 13/05/2014 1

2 Science Goes Cloud Data Deluge and Globalisation of Science Biology Next generation sequencing annual increase of kbases/day almost by factor 10 Physics ATLAS experiment at CERN generates 15 PB of data per year to be analyzed by 3,000 physicians Earth Observation ESA will launch 3 Sentinel satellites in 2014 and 2015 which will generate more than 3 PB data p.a. Climate Research The climate model intercomparison project of the IPCC generated 2.3 PB in times more than in /05/2014 2

3 Helix Nebula The Science Cloud Big science teams up with big business A European public-private partnership for cloud

4 Helix Nebula The Science Cloud A European Public-Private Partnership Strategic Plan Establish multi-tenant, multi-provider cloud To support the computing capacity needs for the ATLAS experiment Setting up a new service to simplify analysis of large genomes, for a deeper insight into evolution and biodiversity To create an Earth Observation platform, focusing on earthquake and volcano research To improve the speed and quality of research for finding surrogate biomarkers based on brain images infrastructure Identify and adopt Suppliers policies for trust, security and privacy Create governance structure Define funding schemes Adopters 12/05/2014 4

5 Helix Nebula The Science Cloud Vision and Key Objectives Vision In 2020, all scientists of all disciplines will choose the Helix Nebula Infrastructure as their first option to store, access, process & analyse data It will contain vast quantities of data, open source tools, and a literally infinite amount of computing power accessible and usable from any kind of computer, smart phone or tablet device. Science will make significant progresses by applying data sharing and interdisciplinary research using this infrastructure as the fundamental tool. This infrastructure will have such a reliability and worldwide recognition for its implemented security and privacy scheme that also commercial companies will be using this "high security area" to derive patents. Objectives A platform capable of development through PPP into a scalable science cloud A flexible governance structure capable of growing alongside the infrastructure itself Representations of functional and non functional requirements including policies for trust, security and privacy Agreements regarding inter operability with other, existing e infrastructures Three flagships based at CERN, EMBL and ESA, selected as stretch targets highlighting extreme cases of the requirements of the ERA Sustainable business models adhering to and supporting European level policies A roadmap and development plan for addressing issues on the road to /05/2014 5

6 Helix Nebula The Science Cloud Timeline Set-up Pilot phase Towards an open market for Science Common Strategy Agree on the Partnership Select flagships use cases Define governance model Deploy flagships Analysis of functionality, performance & financial model Success Stories More applications More services More users More service providers co-funded by EC under grant with 1.8M 12/05/2014 6

7 Helix Nebula Use Cases

8 Helix Nebula Use Cases EMBL: Next Generation DNA Sequencing EMBL European Molecular Biology Laboratory THE CUSTOMER EMBL is at the forefront of innovation in life sciences research, technology development and transfer, and provides outstanding training and services to the scientific community in its member states. (EMBL Website) Intergovernmental Research Organization Supported by 20 Member States 1500 staff, 70+ nationalities Five locations in Germany, UK, France and Italy 12/05/2014 8

9 Helix Nebula Use Cases EMBL: Next Generation DNA Sequencing Source: Rupert Lück, EMBL 12/05/2014 9

10 Helix Nebula Use Cases EMBL: Next Generation DNA Sequencing Source: Rupert Lück, EMBL 12/05/

11 Feb 08 May 08 Aug 08 Nov 08 Feb 09 May 09 Aug 09 Nov 09 Feb 10 May 10 Aug 10 Nov 10 Feb 11 May 11 August 11 Helix Nebula Use Cases EMBL: Next Generation DNA Sequencing Bases Sequenced / Sample / EMBL (Illumina) x Ilumina HiSeq x MySeq x Ion Torrent NGS generates 30+ TB data each week Source: Rupert Lück, EMBL 12/05/

12 Helix Nebula Use Cases Why EMBL Involves in Cloud Computing key challenges in life sciences Enabling real-time use of information embedded in DNA and molecules Supporting individual and improved medication for patients e.g. in cancer treatment Better understanding and treatment of complex diseases e.g. Alzheimer Systematic analysis and documentation of biological information to support life science research and its translation to medicine and the environment, the bio-industries and society (ELIXIR- Project). 12/05/

13 Helix Nebula Use Cases CERN: AtLAS Experiment on the LHC CERN European Organization for Nuclear Research THE CUSTOMER What is the universe made of? How did it start? Physicists at CERN are seeking answers, using some of the world's most powerful particle accelerators. (CERN Website) 20 Member States 2300 staff, 790 other paid personnal > 10,000 users in 50+ countries 1.2 billion CHF budget (2012) Experiments are producing 15 PB p.a., requiring 100,000 fast CPUs to process data 12/05/

14 Helix Nebula Use Cases CERN: AtLAS Experiment on the LHC Source: Bob Jones, CERN 12/05/

15 Helix Nebula Use Cases ESA: Geohazard Supersites ESA The European Space Agency THE CUSTOMER To provide for and promote, for exclusively peaceful purposes, cooperation among European states in space research and technology and their space applications. (ESA Convention) 20 Member States Five establishments in Europe, about 2200 staff 4 billion Euro budget (2012) Over 70 satellites designed, tested and operated in flight, thereof 17 scientific satellites in operation 12/05/

16 Helix Nebula Use Cases ESA: Geohazard Supersites SUPERSITE EXPLOITATION PLATFORM Transition to cloud in 2012 Multi-cloud On-Demand SAR processing tested and verified performance equal or better than local SAR products accessible Data Catalogue extensions being tested/planned: FedEO (US products) GÉANT (Iceland SS, CEMS, TSX GEO) Japan ERI Downstream projects starting (ECMWF, DORIS) 12/05/

17 Helix Nebula business models

18 Helix Nebula Business Models Business Model Development Example: Information as a Service 12/05/

19 Ease of Implementation Helix Nebula Business Models Business Model Evaluation 3,5 Collaboration & Communication Platform for Science & Education Application Crowd Generic Cloud Computing for European Big Science Information as a Service 3,0 Brand Management Versioned Cloud Computing for Science & Education Worldwide All-In-One Enterprise Cloud 2,5 2,5 3,0 3,5 4,0 4,5 Impact of Option 12/05/

20 Helix Nebula The Science Cloud data Security and Privacy European Data Security and Privacy International Standards All participating cloud providers have to be certified according to relevant international security standards, e.g. ISO European Law All participating cloud providers have to be compliant to European and national data protection laws and regulations. Customer Requirements Cloud providers have to fulfil special security and privacy requirements of research organisations if they want to offer cloud services to these customers e.g., regarding management of satellite or DNA data. 12/05/

21 Helix Nebula Cloud Federation and Marketplace

22 Helix Nebula The Science Cloud Federated Cloud Services for Data Intensive Science Science Blue Box Other Sectors THE CHALLENGE Large amounts of resources: >10,000 fat VMs No single cloud provider can meet the demands and manage the business risks Co-opetition with other European cloud providers Technical solution and governance model for cloud service management and brokering Limited budgets available through FP7 On-Premise Clouds Commercial Clouds The SOLUTION Multi-cloud solution with Blue Box cloud manager Federation of on-premise and commercial clouds for open source and commercial cloud stacks T-Systems with strong position in Project Management Team, contribution of several technologies and responsible for Governance of Helix Nebula 12/05/

23 HNX Helix Nebula Marketplace Commercial Marketplace for Federated Cloud Infrastructure Services (IaaS) Builds upon the work undertaken as part of the EC funding project and overall initiative Support by European cloud providers and integration with existing e-infrastructures, a hybrid cloud Computing Market Place and open for new Cloud Providers Trusted cloud services through compliance with EU regulations and legislation Simplified procurement process for multiple cloud services Offered to the global scientific community, for both publicly-funded and commercial Research and Technology Organizations, offering large-scale and HPC-type deployments from the start. A focus on transparency and impartiality of the brokerage function. Trust is important. 12/05/

24 HNX Helix Nebula Marketplace Commercial Marketplace for Federated Cloud Infrastructure Services (IaaS) Initially four commercial cloud providers integrated Amazon EC2 Bridge for compatibility with third party tools, such as StarCluster or any EC2-compatible tool Integration with the EGI FedCloud on our roadmap for /05/

25 Helix Nebula The Science Cloud Inter-Operability with exiting e-infrastructures DANTE offering free IP connectivity in GÉANT for research traffic during the pilot phase NRENs have different commercial agreements (usually they apply a fee) 12/05/

26 Helix Nebula Progress Beyond

27 Helix Nebula The Science Cloud Progress Beyond 12/05/

28 XZELCloud Cloud Advanced Services on large-scale Federated Infrastructures 12/05/

29 Helix Nebula The Science Cloud A European Public-Private Partnership Strategic Plan Establish multi-tenant, multi-provider cloud To support the computing capacity needs for the ATLAS experiment Setting up a new service to simplify analysis of large genomes, for a deeper insight into evolution and biodiversity To create an Earth Observation platform, focusing on earthquake and volcano research To improve the speed and quality of research for finding surrogate biomarkers based on brain images infrastructure Identify and adopt Suppliers policies for trust, security and privacy Create governance structure Define funding schemes Adopters 12/05/

30 THANK YOU! Dr. Bernd Schirpke T-Systems International Emerging Products & Innovation Dachauer Straße 651, München