Domain 1: Self-sizing and green PaaS

Transcription

1 Domain 1: Self-sizing and green PaaS Goal: improve the platform efficiency Performance Energy cost Challenges Cluster growth/shrink capabilities according to workload Data center multi-tenancy with limited capacities requires arbitration policies Data center placement for minimizing the energy consumption Use case: Orange Infrastructure Large-scale data centers (+40,000 x86 servers) JavaEE JOnAS middleware stack: +250 applications, +1,000 application server instances Static server consolidation (12/1) through virtualization: Utilization level increased from 20% to 75% Technologies OW2: JOnAS, Jasmine, ProActive, Clif, Entropy 3rd party: Xen, K + Collaboration in progress: OpenStack, OpenNebula, Ubuntu Technology to be developed: Partners Bull, Ecole Mines Nantes, Inria, Orange, ActiveEon O-Engine, Iscas, Buaa, PKU, UCM,... Resources SHORT TERM Work in Progress Collaborative Projects: SelfXL (ANR), 4caast (FP7), Easi-Clouds (ITEA2), Compatible One (FU10), Internetware (973),... 1

2 Self-sizing and green PaaS Architecture Autonomic Manager Scaling Apply Scaling policies Decision Sensor Autonomic Manager Scaling Apache Actuator JavaEE/APP1 PaaS IaaS JASMINe Decision PSQL Sensor Scale Up / Down Data provisionning Apply Scaling policies Apache PSQL Actuator JavaEE/APP2 Apply Arbitration policies Placement Apache PSQL Apache Apache ProActive Scheduling PSQL Management of Physical / Virtual Resources Autonomic Manager Provisionning ProActive Resourcing Decision Sensor Actuator JASMINe M Provisionning Placement System Cloud managers Hypervisors PA M Infrastructure OSCi Collaboration Framework v2.0 2

3 JOnAS, Jasmine: Toolset for SaaS Deploy dynamically complex applications and services on Clouds Smart Administration: Supervision Self-management Service 2 Service 1 Java EE Appl2 Java EE Appl1 Connecteur 2 Connecteur 1 JORAM JMX Registry CAMEL CXF JavaEE OSGi JOnAS JASMINe Orchestra Tomcat EasyBeans Technologies OSGi 3

4 JASMINe Management tools for SOA platform Cross-platform (JOnAS AS prime target) Four main features: Design, Deploy, Monitoring, Self-* 4

5 JASMINe Virtual Machine Management (M) Support for multiple hypervisors: Open-source Xen and K Citrix XenServer ware virtualcenter 2.x Microsoft Hyper-V using xenapi, libvirt, VI API, wmi 5

6 "Infinite" ressources management Provisionning of new ressources in case of capacity overflow Java EE PaaS as a virtual ressource Java applications deployment and services execution (EJBs, WS, OSGi, ) Java EE PaaS performance optimization EJB3.1 and asynchronous methods support Proactive Parallel library deployed as an OSGI service 6

7 25% Energy Savings Before Server 1 Task 1 Server 2 Task 2 Server 3 Task 3 Server 4 Task 4 After 7

8 Domain 1 recent actions Interactions with OpenStack 19 October conf call Better understanding of ProActive position still needs to be consolidated with Entropy Better understanding of PaaS/IaaS API and integration still needs to be consolidated standards versus proprietary features Started construction of a follow-up to SelfXL as a French collaborative research project either FUI 11 or ANR 8

9 Domain 1 questions General focus of the domain on elasticity how to include work on deployment, development tools, IaaS integration? should we keep it in this domain for now and extend the scope of the domain? is it too early to create another domain? Which next steps to integrate work from BUAA, ISCAS, NUDT, PKU? 9

10 Cluster scaler: Principles Rules based decision module Nodes monitoring (maintain node state) Heartbeat impl tru cpu load indicator Rate aggregation Servlet indicator Scale-up / Scale-down triggering Service oriented solution IaaS interface M impl Cluster Daemon impl Loadbalancer interface Jk impl Modularization & dynamicity Add new impl at runtime 10

11 Cluster scaler Architecture (control loop) 11

12 Integration with ISCAS JOnAS enhance with ONCE Access Controller Short-term JASMINe enhance with ONCE Deployer CLIF enhance with ONCE Bench4Q Mid-term JOnAS enhance with ONCE Work Manager, Access Controller, Resource Profiler JASMINe enhance with ONCE Capacity Planner Long-term JOnAS, JASMINe enhance with ONCE autonomic mechanisms 12

13 Integration with ISCAS Short-term JOnAS enhance with ONCE Access Controller Autonomic authorization for tenants JASMINe enhance with ONCE Deployer Application deployment plan visual design tool Application migration tool (migration app from other AS to Mid-term JOnAS) Deployment constraint validation and conflicts resolution CLIF enhance with ONCE Bench4Q Long-term Open session, load fluctuation 13

14 Integration with ISCAS Short-term JOnAS enhance with ONCE Work Manager, Access Controller, Resource Profiler Mid-term Building app-level multi-tenant PaaS Platform (tenants share one JOnAS on each server node) JASMINe enhance with ONCE Capacity Planner Adaptive Performance modeling for live workloads Long-term 14

15 Integration with ISCAS Short-term Mid-term JOnAS, JASMINe enhance with ONCE autonomic mechanisms Long-term Bottleneck detection and adaptive resource provision Load balancing for dynamic heterogeneous cluster Policy self tuning 15