Dutch HPC Cloud: flexible HPC for high productivity in science & business

Transcription

1 Dutch HPC Cloud: flexible HPC for high productivity in science & business Dr. Axel Berg SARA national HPC & e-science Support Center, Amsterdam, NL April 17, th PRACE Executive Industrial Seminar, Bologna, Italy

2 Good business opportunity in HPC John West, Director for DoD HPC Modernization Program, discussing The Missing Middle at the 26th Annual HPCC Conference (March , Newport, RI, USA). He postulated on how, given this unalloyed good that is HPC, how come everybody isn t using it? Council on Competitiveness: missing middle refers to: the group of HPC users between low-end, mostly workstation-bound HPC users, and the kind of high-end HPC typically performed at national labs and some universities. The problem is that transitioning from desktop HPC to server-based HPC is filled with roadblocks, especially for commercial users looking to make the leap to small clusters.

3 Large opportunity for HPC in science & business John West, Director for DoD HPC Modernization Program, discussing The Missing Middle at the 26th Annual HPCC Conference (March , Newport, RI, USA). He postulated on how, given this unalloyed good that is HPC, how come everybody isn t using it? Council on Competitiveness: missing middle refers to: the group of HPC users between low-end, mostly workstation-bound HPC users, and the kind of high-end HPC typically performed at national labs and some universities. The problem is that transitioning from desktop HPC to server-based HPC is filled with roadblocks, especially for commercial users looking to make the leap to small clusters.

4 Many hurdles for the use of HPC by the missing middle (science & business) > Increasing hardware complexity (including divergent technologies like CPUs and GPUs) > Fixed software (OS) environments > Software portability and usability > Software scaling > Software licensing > Security and trust > Cultural hurdles > Lack of expertise > Etc.

5 High potential for use of HPC by industry 1. Direct use of the HPC infrastructure (the visible part of the iceberg) 5-10 companies 1 2. Indirect use of the HPC infrastructure (under water part of iceberg) more than 85 use cases in NL where industry & SMEs used the HPC infrastructure through collaboration with academia 3. Potential users (the ocean) SMEs, design & engineering, life sciences, energy, etc. Long list (>200) of identified potential NL companies that could benefit from HPC for simulation and data mining 2 3

6 Dutch TopSector Approach Industry, SMEs Government Science

7 Infrastructure Innovation with Impact > 34 M value program called Infrastructure Innovation with Impact ( ) > 7 M funded by Ministry of Economic Affairs, Agriculture & Innovation > Objective: > Providing competitive advantage with the national ICTinfrastructure for Research. > Technology transfer from science to business in this area is crucial for knowledge economy in the Netherlands. Investments in keeping the national e- infrastructure at the competitive level Access to and support for the integrated e- infrastructure for industry and SMEs

8 Access to and support for the national e- infrastructure for industry and SMEs Development, promotion and implementation of an access and support program for industry and SME s Deployment of software for business applications on the e-infrastructure Deployment of HPC Cloud services for industry and SME s Development and deployment of advanced data services for industry Best practices and business models on use of the e- infrastructure and technology transfer

9 The sun is shining behind the clouds

10 Great opportunity for HPC Clouds in science and business

11 Major drivers for HPC Cloud Why can t I just scale up the application that runs on my workstation? It is too complicated and takes too much effort to port my application to your supercomputer, not to speak about your grid My workflow is not suited for such static environment I want to choose my own operating system My application does not run on your Linux ;-( I want to use the Cloud, it is fancy and cool!

12 Major drivers for HPC Cloud > Scaling up applications and work loads (elastic): - from work station level to HPC level - enabling the scale up of complex workflows > Flexibility of the user environment: - addressing mismatches between user s environment and fixed HPC environment - adapting the HPC environment to the application, rather than adapting the application to the HPC environment

13 Infrastructure Innovation cycle > Rapid prototyping and Proof-of-Concept in pilots with concrete use cases (small nr. of users) > Pre-production with limited number of users > Production for larger user community

14 HPC Cloud Innovation roadmap Started 2009, Q3: Proof-of-Concept phase Small testbed, 50 cores Evaluated different Open Source Cloud Toolkits and Virtualization products Chosen: OpenNebula and KVM 5 external user groups Started 2010, Q2: Pre-production Phase (Claudia) Medium sized testbed, 128 cores, 100 Tbyte storage 60 external users Since 2011, Q3: Production Phase (Calligo) 608 cores, 400 TB storage more than 30 project running from the start

15 Dutch HPC Cloud

16 Our definition of Cloud Cloud Computing: Self Service Dynamically Scalable Computing Facilities Cloud computing is not about new technology, it is about new uses of technology

17 Virtual Private (HPC) Cluster > Take hardware stack optimized for HPC usage 32 cores/256 GB memory per node Multiple fast 10GE interconnect Large and well-connected storage > Provide Secure environment and networking Each VPC its own VLAN FireWalled access Centrally provided network scans > Enable User to configure Virtual Private HPC Clusters Define cluster of Virtual Machines Self Service GUI Public IP possible (subject to security scan) Do not restrict OS types

18 Self Service GUI & Collaboration Portal Developed at SARA Open Source, available at

19 Dutch HPC Cloud service > Work loads: - enabling scale up of work loads from small specialized clusters - significantly scale up work loads from workstations - enabling and scale up complex work flows > High User Productivity > Advantages: - dynamic, flexible and elastic self-service - define your own working environment - define your own Virtual Private HPC cluster > HPC Cloud service platform at SARA - 19 nodes with 32 Intel Xeon E7 cores (608 cores total), 256GB memory (4,75TB total), 40Gbps network (4x10GE non-blocking) - 400TB Shared storage (ISCSI,NFS,CIFS,CDMI...) - Software: OpenNebula KVM > Integrated in the Dutch e-science grid BiG Grid

20 Dutch HPC Cloud service Based on an HPC platform o Infrastructure based on High Performance Compute, Storage and Networking o No over-provisioning of resources (overhead is 5% max.) o Applications with different requirements can co-exist on same physical host and in same virtual cluster o Self Service as a guiding principle o IAAS: user access to Virtual Private HPC Clusters o PAAS: various standard platform images available o SAAS: software as a service o Network, Storage and Compute under control of the user osupport, expertise and tools available o Support for installation configuration and best practices o Collaboration portal to share virtual machine images and user experiences

21 HPC cloud offering High Performance Platform Virtualized Everything Software, Services Support HPC Cloud Offering Fast CPU, High Memory, Large Storage and High Bandwidth Virtual Private Clusters and Networking Resource Deployment portal, Collaboration Portal User in control Powerful Flexible Versatile HPC Cloud

22 HPC Cloud Calligo

23 SARA HPC ecosystem

24 HPC Cloud in the HPC pyramid PRACE Tier-0 Centers Tier-1 National e- infrastructure Regional/topical resources (Tier-2 size)

25 HPC Cloud in the HPC pyramid PRACE Tier-0 Centers Tier-1 National e- infrastructure Regional/topical resources (Tier-2 size)

26 Why not using Amazon EC2? Do if you can! Full daily support Customer relation and intimacy Expert community support Community collaboration and sharing support Data-intensive computing High Performance Known service provider (trust)

27 Major concerns of cloud services?

28 Legislation

29 HPC Cloud Security & Trust Security and trust are of major importance Protect Firewall the outside from the cloud users the cloud users from the outside the cloud users from each other fine-grained access rules ( closed port policy) non-standard ports open on request only and between limited network ranges Scanning of new virtual templates Port scanning catches initial problems, but once the VM is live... catches well-known problems State-full Package Inspection random sample based

30 Transcriptomics PSEs Han Rauwerda, MAD, Swammerdam Institute for Life Sciences, University of Amsterdam, NL

31 Example NMR Protein structure validation Jurgen Doreleijers, CMBI, NBIC, NL

32 Example NMR Protein structure validation Jurgen Doreleijers, CMBI, NBIC, NL

33 Example Transcriptomics PSEs Han Rauwerda, MAD, Swammerdam Institute for Life Sciences, University of Amsterdam, NL

34 CLARIN: dynamic web services deployment Marc Kemps Snijders, Meertens Institute, Royal Academy of Sciences, NL

35 CLARIN: dynamic web services deployment Marc Kemps Snijders, Meertens Institute, Royal Academy of Sciences, NL

36 GALAXY, web-based genome analysis platform Mattias de Hollander, Netherlands Institute of Ecology, NL

37 GALAXY, web-based genome analysis platform Mattias de Hollander, Netherlands Institute of Ecology, NL

38 Urban Flood

39 Urban Flood

40 Diversity in Applications Type Examples Requirements Compute Intensive Data intensive Communication intensive Monte Carlo simulations and parameter optimizations, etc Signal/Image processing in Astronomy, Remote Sensing, Medical Imaging, DNA matching, Pattern matching, etc Particle Physics, MPI, etc CPU Cycles I/O to data (SAN File Servers) Fast interconnect network Memory intensive DNA assembly, etc Large (Shared) RAM Continuous services Databases, webservers, webservices Dynamically scalable

41 Big Data in the Cloud SARA > SARA s open source Apache Hadoop providing access to a distributed file system along with a framework for running map reduce jobs over the data. > Data is replicated to each node, running jobs in parallel on a distributed system. > As the data increases, new nodes are added at runtime. Scale out, not up > No more do-it-yourself parallelism (it's hard!), but rather linearly scalable data parallelism: Separating the what from the how Move processing to the data Process data sequentially, avoid random reads Seamless scalability

42 SARA (Timeline) 2009: Piloting Hadoop on Cloud 2010: Test cluster available for scientists 6 machines * 4 cores / 24 TB storage / 16GB RAM 2012: Production cluster available 2012: Production cluster available (March) 72 machines * 8 cores / 8 TB storage / 64GB RAM Integration with Kerberos for secure multi-tenancy

43 Big Data DevOps Programming algorithms Domain knowledge

44 What are our scientists doing? Information Retrieval Natural Language Processing Machine Learning Econometrics Bioinformatics Computational Ecology / Eco-informatics

45 Concluding remarks Great opportunity for HPC in science and business ( missing middle ), many potential users/applications could take advantage of HPC but do currently not HPC Cloud service with Virtual Private Compute Clusters offers just the selfservice flexibility combined with High Performance to adapt the computing environment to the application: overcomes many hurdles and could serve many of the missing middle. High productivity! HPC Cloud is complementary to other services like supercomputers (Tier-0 and Tier-1), standard capacity clusters and grids: HPC Cloud service is part of the of the whole HPC eco-system HPC Cloud is complementary to commercial cloud offerings like Amazon EC2 with respect to basic support, expert community support, customer intimacy, and community collaboration and sharing possibilities There is great interest and many concrete examples from science and business (simulation as well as Big Data analysis): enabler and stepping stone for larger and wider HPC usage

46 To finish with Cloud is a Promise Rain is Fulfillment! Questions and more info: Axel Berg axel.berg@sara.nl