SuperVessel: The Open Cloud Service for OpenPOWER

Size: px

Start display at page:

Download "SuperVessel: The Open Cloud Service for OpenPOWER"

Victor Willis
8 years ago
Views:

1 Superessel: The Open Cloud for OpenPOWER Yonghua Lin, Ling Shao IB

2 Why Superessel Cloud otivation: To grow the number of developers on OpenPOWER in the world Freely opened to all the students in universities, individual developers and ecosystem partners for OpenPOWER. Built on the POWER7/POWER8 resource pool Built with open technologies, such as OpenStack Support advanced technology services, e.g. service, big data service, cognitive computing service 2

3 Roadmap of Superessel Super arketplace (Online) Superessel Cloud (Online) Superessel Big Data and HPC OpenPOWER Enablement (Online) Super Class (Preparing) Super Project Team 1. and container service 2.Storage service 3.Network service 4.Accelerator as service 5.Image service 1.Big Data service: apreduce (Symphony), SPARK 2.Performance tuning service 1.X-to-P migration 2.OpenPOWER new system test service 1.On-line video courses 2.Teacher course management 3.User contribution management 1.Project management service 2.DevOps automation Superessel Cloud Infrastructure Storage IB POWER servers OpenPOWER server FPGA/GPU 3

Big Data service: apreduce (Symphony), SPARK 2.Performance tuning service 1.X-to-P migration 2.OpenPOWER new system test service 1.On-line video courses 2.

4 Architecture of Superessel Cloud OpenPOWER-Superessel Unified anagement Platform User interface Admin interface User account & authentication mgmt irtual point management Statistic and analysis Cloud Infrastructure Big Data OpenPOWER enablement service Super Class service Super Project s for cloud admin (IB Cloud anagement) Horizon Glance OpenStack controller HEAT Cinder Nova Neutron System maintenance Resource usage metering System monitoring System analysis Image management Baremetal management K K LxC/ LxC / K Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder K pool for POWER8 LE K pool for POWER8 BE Container pool for POWER8 LE GPFS Container pool for POWER8 BE K pool for x86 OpenPOWER server FPGA/GPU 4

Nova Neutron System maintenance Resource usage metering System monitoring System analysis Image management Baremetal management K K LxC/ LxC / K Nova Neutron Cinder Nova Neutron Cinder Nova

5 To expand the Superessel via collaboration with OpenPOWER partners ulti-site design : Using the multi-region in OpenStack to support multi-site management of Superessel cloud. We are designing the first multi-site for Jiangsu Development and Test cloud on POWER Shared dashboard, Shared keystone, Shared object store (in future) Enhance the cache design for performance optimization Enable the regional administration Unified anagement of Superessel Dashboard for cloud Dashboard for Big data Beijing Site Jiangsu Site Users OpenStack controller OpenStack controller Users 5

We are designing the first multi-site for Jiangsu Development and Test cloud on POWER Shared dashboard, Shared keystone, Shared object store

6 Superessel Cloud s irtual machine and services PN management Pre-installed image service ulti-site support will be provided in next step We use virtual points for resource management 6

7 Superessel Cloud s Pre-installed image service: It could very much make user easier to start development on POWER is used to provide the pre-installed environment. 7

8 Superessel Big Data s Support apreduce and SPARK services Allow user to request different size of cluster 8

9 Shared file system for Cloud and Big Data service Cloud Infrastructure Big Data HEAT template for big data cluster Select Big data computing framework (apreduce, SPARK Select cluster size Select data folder size Servers Servers GPFS FPO GPFS FPO POWER7/POWER8 KeyStone Glance User A K/ (Web app) OpenStack controller Horizon Nova Cinder anila GPFS FPO HEAT Neutron User A (Symphony (Symphony (Symphony ) ) ) Folder A User B (Symphony (Symphony (SPARK) ) ) Folder B POWER7/POWER8 HEAT will orchestrate docker instances, subnet and data folder based on user s request anila provides the NFS service using GPFS as backend, and the folder will be mounted via nova-docker (with v support) Folder created by anila could be accessed by the K/docker instances created for big data and other purpose 9

(Symphony ) ) ) Folder A User B (Symphony (Symphony (SPARK) ) ) Folder B POWER7/POWER8 HEAT will orchestrate docker instances, subnet and data folder based on user s request anila provides the NFS

10 Superessel Accelerator as Accelerator arketplace for developers to upload and compile the accelerators for Superessel POWER cloud Allow user to request different size of cluster Fig.1 Accelerator arketplace for Superessel Cloud Fig.2 Cloud users could apply accelerator when creating 10

user to request different size of cluster Fig.

11 Developer quickly grew in the past 100 days Users from 30 universities (including 3 from US) 6 university joint research projects Supported several courses from universities, e.g. The Big Data course of Beijing Institute of Technology: 100 students with 38 big data clusters The virtualization technology course from University of Delaware (US) Our target is 100,000 users and 100 universities in 2015/

The Big Data course of Beijing Institute of Technology: 100 students with 38 big data clusters The

12 Thank You!! Call for your collaboration to build this CLOUD together 12

FPGA Accelerator Virtualization in an OpenPOWER cloud. Fei Chen, Yonghua Lin IBM China Research Lab

FPGA Accelerator Virtualization in an OpenPOWER cloud Fei Chen, Yonghua Lin IBM China Research Lab Trend of Acceleration Technology Acceleration in Cloud is Taking Off Used FPGA to accelerate Bing search