OW2 Open Source Cloudware Initiative

Transcription

1 OW2 Open Source Cloudware Initiative Denis Caromel, INRIA, CNRS I3S Frédéric Dang Tran, Orange Labs Jean-Pierre Laisné, Bull, OW2 Alexandre Lefebvre, Orange Labs, OW2, Jean-Marc Menaud, Ecole des Mines de Nantes, Benoît Pelletier, Bull Franca Perrina, INRIA Cedric Thomas, OW2 Solutions Cloud Computing Paris, 5-6 Mai 2010

2 Cloud computing is a long-term business opportunity A disruptive innovation driven by two key industry trends Worldwide IT Cloud Revenue by Product/Service Type billion dollars 50,0 Servers 40,0 Storage 30,0 App Dev/Deploy Commoditized enterprise IT: hardware, software and networks and standardized enterprise usage Infrastructure SW Applications 20,0 10,0 0, Source IDC, September 2009 Five-year annual growth rate of 26 percent--over six times the rate of traditional IT offerings. New Internet-based IT usage: new economic models to absorb fluctuating or peak demands Source: 2

3 Open source software is critical for cloud computing openness While openness seems still a distant reality... Different meanings Proprietary core business Few consensus on standards...open Source Software is now critical for Cloud Computing... General consensus about costs reduction and facilitated adoption Open APIs for pragmatic reasons OSS and open standards but Cloud Computing is also a risk for OSS OSS enclosure OSS is at the heart of Cloud Virtualization technologies: Xen, KV, OpenVZ, VirtualBox, etc. Infrastructure management: OpenNebula, Eucalyptus, Libcloud, etc. Platform environment: Heroku, etc. OSS a unique proposition for Interoperability Transparency / Privacy / Security Sovereignty De facto open standards Sustainable ecosystems 3

4 An industry empowerment startegy Furthermore, most consortia managing open source development and marketing are based in the United States and funded by US IT companies. If the cloud computing research aims at realizing a sustainable European economic opportunity as envisioned in 2010, this imbalance needs to be addressed. (...) The EC should promote the European leadership position in software through commercially relevant open source approaches. Maintaining an open source approach for research results and cloud infrastructure support tools ensures uptake and simplifies adaptation to different environments. The European open source movement should thereby work strongly together with industry to support commercial cloud based service provisioning. Source, European Commission, Information Society and Media, The Future Of Cloud Computing: Opportunities for European Cloud Computing Beyond 2010, page 42 and 4 The OW2 opportunity... OW2 to foster Cloud projects to be funded within EU "Future of Internet" programmes and PPP mechanisms 4

5 Open Source Cloudware Initiative A business ecosystem at work VISION & GOALS OW2 Technology Vision Jet Stream discussion From Middleware to Cloudware Open Cloud Computing Open Source Empowerment OW2 projects 3rd party projects Collaborative projects Initiative bedrock STAKEHOLDERS Software Vendors Systems Integrators Academia Enterprises Telcos SMEs Public Entities

6 OW2 OSC Initiative: Roadmap Priorities Milestones 1. Define research and development agenda May 2010: Launch and initiative participant recruitment drive 2. Define, develop, integrate, deliver and promote all open source components aiming to deliver OW2 Open Source Cloudware Sept 2010: Workshops, seminars Dec 2010: First Research Agenda Cloudware white paper Mid 2011: First OSC implementations 3. Global lobbying for Open Source Cloudware Dec 2011: OW2 OSC Summit 6

7 Elasticity for Green Java EE PaaS Ce travail a bénéficié d'une aide de l'agence Nationale de la Recherche portant la référence ANR-08-SEGI-017

8 Cloud Computing at Orange Context: Large-scale datacenters (+40,000 x86 servers) JavaEE JOnAS middleware stack: +250 applications, +1,000 application server instances Static server consolidation (12/1) through virtualization: Utilization level increased from 20% to 75% Next step: migration to a Cloud model On-demand JavaEE server provisioning according to demand fluctuations Automation of the management of virtualized JavaEE clusters: deployment, update, auto-scaling etc. Open (source) cloud management stacks alternatives to proprietary solutions (IaaS/PaaS) 8

9 Self-sizing for Java EE PaaS Goal : improve the platform efficiency (performance, energy cost) Challenges Cluster growth/shrink capabilities according to workload Datacenter multi-tenancy with limited capacities requires arbitration policies Datacenter placement for minimizing the energy consumption 9

10 OW2 code base JOnAS ( Enterprise OSGi & Java EE 5 certified server JASMINe ( Management tools for SOA platform Monitoring module (probe, mediation, graphs) Decision module (rules engine based) Virtual Machine Management (Xen, VmWare,...) CLIF ( Load testing Selfbenchmarking Entropy (in progress) Dynamic VM placement 10

11 Architecture for self-sizing Scale up/down PaaS IaaS VM provisioning VM placement 11

12 25% Energy Savings Before Server 1 Task 1 Server 2 Task 2 Server 3 Task 3 Server 4 Task 4 After 12

13 To conclude Future Work in SelfXL DSL (shell) Control loop coordination Beyond SelfXL International contributions University of Fortaleza (Brazil) Cloud APIs in JASMINe (EC2, OpenNebula, Eucalyptus, ) Beihang University of Aeronautics & Astronautics, Peking University (China) Collaborative projects COMPATIBLE ONE (System@tic ) Cool-IT (System@tic) 4Caast (FP7) OW2 Open Source Cloudware Inititiative Open Cloud based on Open Source and Open Standards 13

14 Application acceleration and Cloud Management

15 ProActive Parallel Suite Java Parallel Toolkit Multi-Platform Job Scheduler Resource Manager Used in Production Today: 50 Cores 300 Cores early 2010 Strong Differentiation: q Java Parallel Programming + Integration + q Portability: Linux, Windows, Mac + q Versatility: Desktops, Cluster, Grid, Clouds = Perfect Flexibility

16 ProActive with Desktops, Grids, Clouds (EC2)

17 ProActive Parallel Suite q q q q q Workflows in Java Master/Workers SPMD Components 17

18 ProActive Scheduling 18

19 ProActive Scheduling ProActive Scheduler ProActive Resource Manager Multi-platform Graphical Client (RCP) File-based or LDAP authentication Static Workflow Job Scheduling, Native and Java tasks, Retry on Error, Priority Policy, Configuration Scripts, Dynamic and Static node sources, Resource Selection by script, Monitoring and Control GUI, ProActive Deployment capabilities: Desktops, Clusters, Clouds, RESOURCES

20 ProActive Resourcing 20

21 Resourcing User Interface 21

22 ProActive in Cloud Stack

23 ActiveEon: company born of INRIA q Co-developing, Support for ProActive Parallel Suite q Worldwide Customers: Fr, UK, USA Selected Partners: 23

24 For more informations Please contact Cedric Thomas (CEO) cedric ow2 org 24

25 There is more to Cloud openness than just open source software The need for openness Corporate customers and consumers alike will want to be able to shift from one cloud to another in search of the best experience and the best pricing, and they ll want the cloud services they choose to be able to interact with each other, in the background, on their behalf. All vendors will pledge 'Cloud Openness'... In the 90s, all hardware vendors were selling 'open systems' ;-) OSI-like criteria for Cloud Openness No barriers to entry No barriers to exit No discrimination Interoperability Free/Open source licenses Technologicval neutrality Transparency Sources:

26 OW2 to interact with existing open source cloud communities Cloud stacks TioLive Virtualization technologies KVM.org VirtualBox.org Xen.org Incl. Xen Cloud Platform initiative OpenVZ Infrastructure mgt technologies Open Nebula Eucalyptus LibVirt Apache Hadoop HPC on demand technologies XtreemOS Others - Non open source Enomaly (Infra Mgt) Open Cirrus (Open but not OSS) Sabalcore (HPC on demand)

27 Generally accepted service layers and main offerings positioning Software as a Service SaaS Platform as a Service PaaS Infrastructure as a Service IaaS Complete end-user-oriented applications customizable within limits. The broadest market. In this case the provider allows the customer only to use its applications. The software interacts with the user through a user interface. API to build higher-level applications. Pre-built application components A set of software and development tools hosted on the provider's servers. Developers can create applications using the provider's APIs and underlying data models and constructs. No interoperability standards (yet), so some providers may not allow customers to move applications to another platform SalesForce.com GoogleDoc Execution resources, servers, storage and network Provides virtual servers with unique IP addresses and blocks of storage on demand. Customers can pay for exactly the amount of service they use: this service is also called utility computing. Source: Google Apps Amazon Web Services (AWS) Google AppEngine Microsoft Azure RackSpace Mosso 27

28 Tentative mapping of OW2 existing projects...but do members have a mid- to long-term Cloud Computing strategy? OW2 Stack * OW2 Stack: JOnAS/JASMINe, PEtALS, exo, xwiki, Talend, JORAM, Bonita, Spago, Orbeon, SaaS platform OW2 Spagic, Talend, Xwiki, "on-demand" information System includes OW2 middleware stack + OW2 architecture (Fractal, Dream, Chameleon) Development and composition environment OW2 Acceleo, Chameleon/Cilia mediation, Talend Cloud testing and cloudified testing platform OW2 CLIF VM (appliance) building and management to be used for development, testing, pre-prod, production embedded OW2 middleware in the VM includes JOnAS/JASMINe, PEtALS, exo, xwiki, Talend, JORAM, Bonita, Spago, Orbeon, management of such VMs (versioning, deployment) OW2 JASMINe, UShareSoft partnership Autonomic Cloud Application Servers JASMINe evolutions (Context of ANR SelfXL project) SLA verification OW2 Chameleon/Cilia mediation Open Cloud (IaaS) Cloud interoperability, migration between clouds providers ProActive Personal Storage Cloud OW2 Funambol, OpenMobileIS, Ingres Mobile Cloud OW2 Funambol, OpenMobileIS Cloud Networking Outside the OW2 scope? Picture source: 28

29 JetStream: Cloud computing in our technology vision? Develop, integrate, deliver and promote the "OW2 Cloud Stack" Drive OW2 projects evolution toward cloud computing Drive OW2 alignment with relevant standards Foster OW2 OSS for cloud computing Develop a network of cloudoriented partners Promote and integrate "best of breed" Cloud Floss Generally promote OW2 and its projects and members A path from «Cloud Aware» to CloudWare 29

30 OW2 to align with most current cloud open standards Areas to follow include data and application portability, cloud interoperability management, monitoring, metering security and privacy HPC Many standard bodies DTMF Cloud incubator, includes OVF (Open Virtualization Format) Open Grid Forum (OGF) Open Cloud Computing Interface (OCCI) working group Open Cloud Consortium (OCC) Cloud Computing Interoperability Forum (CCIF) Cloud Security Alliance

31 Homework What is our definition of Cloud computing? Is Cloud computing an opportunity for OW2? What is our window of opportunity? Should OW2 develop a Cloud computing strategy and how? What can OW2 contribute to Cloud computing? What are our resources? Which OW2 members have an interest in Cloud computing? A strategy? What do we want to do? What can OW2 do? What should we expect from the TC do? From the MO?

32 Conclusion Flexibility Clutch Power q Portability: Windows, Linux, Mac q Versatility: Desktops, Grids, Clouds q Java Parallel Toolkit Multi-Platform Job Scheduler Resource Manager Free Professional Open Source Software Multi-Core: Ready for the next revolution Virtualization: Dynamic Load Balancing onto VMs Cloud: Smooth transition available (Desktop, Server, Cluster) Dynamic Workload Management with Virtualization

33 ProActive Scheduling Big Picture ProActive Scheduler ProActive Resource Manager Multi-platform Graphical Client (RCP) File-based or LDAP authentication Static Workflow Job Scheduling, Native and Java tasks, Retry on Error, Priority Policy, Configuration Scripts, Dynamic and Static node sources, Resource Selection by script, Monitoring and Control GUI, ProActive Deployment capabilities: Desktops, Clusters, Clouds, RESOURCES

34 ProActive Scheduling Big Picture ProActive Scheduler ProActive Resource Manager Multi-platform Graphical Client (RCP) File-based or LDAP authentication Static Workflow Job Scheduling, Native and Java tasks, Retry on Error, Priority Policy, Configuration Scripts, Dynamic and Static node sources, Resource Selection by script, Monitoring and Control GUI, ProActive Deployment capabilities: Desktops, Clusters, Clouds, RESOURCES