Distributed Cloud Computing Platform as a Service (PaaS) Analysis and Recommendations

Transcription

1 Distributed Cloud Computing Platform as a Service (PaaS) Analysis and Recommendations OGF 34, 14 March Michael V. Behrens CTO, R2AD, LLC David Moolenaar VP West Cost, R2AD LLC Eugene Luster Cloud Researcher, R2AD, LLC

2 OGF IPR Policies Apply I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy. Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the OGF plenary session, any OGF working group or portion thereof, the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, the ADCOM, or any member thereof on behalf of the ADCOM, any OGF mailing list, including any group list, or any other list functioning under OGF auspices, the OGF Editor or the document authoring and review process Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. Excerpt from Appendix B of GFD-C.1: Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, nondiscriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification. OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process. 2

3 Background: Cloud Computing Standards Research Focus We (R2AD, LLC) are sponsored by DISA s Office of the CTO to pursue cloud computing research with emphasis on the following: 1. Open Source 2. High Security 3. Interoperability 4. Portability 5. High Performance 6. Transparency 7. Ease of Management We are currently directly involved with these standards groups: Open Grid Forum (OGF) OCCI specification (more later) Storage Network Industry Association (SNIA) CDMI specification (more later) National Institute of Standards and Technology (NIST) Document roadmap of cloud standards Others as time/energy permit 3 R2AD Android Cloud Management Client

4 Goal: Cloud Interoperability Create a specification for PaaS which outlines the key architecture components to enable interoperability Document standards (de-facto or other) to include along with open-source components Specify APIs where needed which can be used by cloud brokers or by developers Facilitate resource utilization between clouds and migration of data and VMs between clouds Cloud Computing Inter-Cloud Cloud Computing IaaS PaaS SaaS IaaS PaaS SaaS Web Data Web Data 4

5 Recommend OCCI Platform as a Service (PaaS) Specification PaaS next big wave of cloud technology It s the next generation for enterprise workloads Operating System really should not matter black cloud computing PaaS layer should be Operating System agnostic Separating allows a set of heterogeneous systems to handle the workflow. Performance/Efficiency/Cost based decisions on back-end instead of technical. Major new choices available for open on-premise private clouds OpenShift Backed by Red-Hat. Uses JBoss, Spring, etc. Cloud Foundry Backed by VMware. Uses Tomcat, Spring, etc. Jelastic Available for on-premise in near future not fully open however. Globus Open source private cloud PaaS. Globus World is next April in Chicago Others: Cumulogic, DISA s, Services, etc. 5 NIST Definition of PaaS: Platform as a Service (PaaS). The capability provided to the consumer is to deploy onto the cloud infrastructure consumer-created or acquired applications created using programming languages, libraries, services, and tools supported by the provider. The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, or storage, but has control over the deployed applications and possibly configuration settings for the application-hosting environment.

6 OCCI PaaS Standardization Recommendations Evaluate existing PaaS Products/Standards Understand the impact to overall integration and interoperability. Compare requirements/features with existing legacy or proprietary PaaS. Apply use case approach to help evaluation each offering Create a set of requirements based on this evaluation period Engage open PaaS offerings to gain support from the get go Contact OpenShift, Cloud-Foundry, others? Involve Cloud Brokers, i.e.: CompatibleOne, Open Nebula, jcloud, Deltacloud Focus on a standardized Architecture and APIs (REST Based) Mark out key architecture components and needed interaction Database Layer, Web Layer, Control/Management Layer, Load Balancer, provision/config Interactions with IaaS for scalability Incorporation of OCCI IaaS and CDMI Document key interfaces for developers and create new OCCI PaaS Specification Consider these areas: Security/Identity, Data access, CRUD, Monitoring, Tenants of distributed computing (inter-cloud scalability or bursting), Load balancer 6

7 PaaS Vision (work in progress) Replace stove pipe architectures and proprietary use of APIs with one or more standardized PaaS and Cloud APIs Common services (ReSTful APIs) for data storage and access, identity, logging/auditing, messaging, processing, monitoring, deployment, replication, SLA Use pattern based APIs/Tools in order to remain focus on application logic instead Do not keep re-inventing the platform (identity management, logging, database, management, etc) J2EE helped us through the last decade. PaaS binds scalable components together, similar to what Sun did with J2EE (EJB, JMS, JDBC, JSP, etc). PaaS supports multiple languages and web engines (Weblogic, glassfish, JBoss, Tomcat, Jetty, Nginx, node.js, etc) however ideally using same REST APIs to ensure portability in a heterogeneous cloud environment (i.e. CouchDB). Engine and Operating System should not matter.black box cloud computing Provide On-Demand scalability Automatic load balancing for web and data. Distributed data for speed and redundancy Built in replication/synchronization/caching, based on API which specifies data policy Provide automated self-service for full life cycle Use cloud based repository development, test, and field Forge.mil: GIT, SVN, Maven, DISA CM Cloud Oriented Runs on top of IaaS in production. Agnostic as to which IaaS. Use the cloud to test the cloud, monitor the cloud, etc. Supporting Mobile end-user Data and apps accessible to mobile user (location transparency) SaaS Applications, Software PaaS Application Infrastructure Web Server+Data Storage IaaS Hardware Infrastructure Servers, Raw Storage, Network End Users/Customers Developers Data Center/Integrators 7

8 Cloud Technologies Compared (work in progress) Offering Reference URL Installable On-Premise Rackspace No IaaS OpenStack Yes IaaS and DaaS CloudStack Yes IaaS (backed by Citrix) Eucalyptus Yes Yes IaaS + DaaS (mimics Amazon) 8 Open Source Cloud Style OpenShift Yes Soon PaaS (backed by RedHat) Cloud Foundry Yes Yes PaaS (backed by VMware) Stackato Yes Yes PaaS (based on cloud foundry) Cumulogic Yes No PaaS Jelastic Soon No PaaS Apprenda Yes No PaaS (primarily.net focused) Appistry Yes No PaaS Hadoop Analytics RightScale No Management Google App Engine No. IaaS and PaaS SalesForce Force.com Microsoft Azure Services Platform Amazon EC2, Amazon S3, Amazon Beanstalk No SaaS PaaS No. PaaS + DaaS + IaaS No. IaaS DaaS PaaS

9 Management & Security Generic Cloud PaaS Model Big Data & Storage Source/App/VM Repository Auto Deploy/Configure PaaS Node PaaS Node Inter-Cloud Node Data Memory Cache Algorithms REST Web Distributed & Indexed - Synchronization Messages/Queue Scalable Platform Proxy Load Balancer Perimeter Security https (RESTful) Mashups (Distributed Observed State) Consider: 2012 Open Grid Open Forum PaaS Offerings that include well known/used/documented/supported components 9 Node Data Memory Cache Algorithms REST Web Hadoop, HAProxy, Restlet, ProxyCA, Node.js, web server, etc.

10 Survey: OpenShift PaaS OpenShift is a PaaS backed by Red Hat since 2011 Languages: Java, Perl, PHP, Python, and Ruby Application Services: SQLite, Apache HTTP, JBOSS, Spring, built-in management layer Open Sourced: Not yet (planned) On-Premise: Future Offering OpenShift Express Free version, no auto-scaling. Good for developers Hosting: Amazon initially OpenShift Flex Auto-scaling, performance monitoring, app management Can autodeploy into OpenShift using tools like Web Site(s): 10

11 Survey: Cloud Foundry PaaS Cloud Foundry is a PaaS backed by VMware since 2011 Languages: Java,.NET, Ruby, Scala, Node.js, PHP, Python Application Services: RabbitMQ, vfabric PostgreSQL, MySQL, MongoDB, Redis, Spring, Chef Configuration Management Open Sourced: Yes On-Premise: Yes Cloud Foundry Open Source CloudFondry.org is the open source site. Others, like VMware, and Stackato build on it. Micro Cloud Foundry A VM which is available from VMware to run the PaaS environment on your laptop. Alternatively, VMware is hosting a free cloud for developers to experiment with. Web Site(s):

12 Jelastic Example 12

13 Globus Toolkit (Potential PaaS) Applications DRM High-level Services and Tools Grid Status Cactus MPI globusrun PUNCH Nimrod/G Condor-G Core Services GASS GridFTP Metacomputin g Directory Service Globus Security Interface Replica Catalog GRAM I/O Condor LSF MPI PBS NQE Local Services Linux TCP AIX UDP Solaris globusworld, April 10-12, 2012 at Argonne National Laboratory 13

14 Paas Data Layer - Transparency Implement Location Transparency Make data access layer virtual in order to decouple data sources from data consumers. This turns data into an enterprise information service. Secure Restful access and Scalability are important considerations. NoSQL is a common solution, implemented by: CouchBase or MongoDB synchronization of document stores Hadoop/Hbase based on Google s file distributed file system/database, used by Facebook. Suitable for real-time and data warehouse. Riak based on Amazon s Dynamo, scalable, fault-tolerant, open source key/value database server Hypertable - high performance data storage for applications requiring maximum performance, scalability, and reliability. Achieve data virtualization, don t focus on a specific tool. Consider Cloud Data Management Interface (CDMI) as the PaaS Layer to data it provides an access API to data and metadata Pick appropriate underlying storage products based on requirements 14

15 OCCI PaaS Brainstorm Replication Monitor Brainstorming session.white Board Ambient Billing Management Protocol Mediation Repository Standards Instead of Cloud Silos! Provisioning Distributed Computing NoSQL Configuration Web Platform Data Store Security Service Privacy Streaming Availability Presentation Load Balance Encryption High Availability Migration 15 Transport Logging Synchronization