TECHNICAL WHITEPAPER Automation and Virtualization Increase Utilization and Efficiency of J2EE Applications
Introduction Progressive IT departments have broadly adopted application servers and the Java 2 Platform, Enterprise Edition (J2EE), to better respond to the business needs of the company. As enterprise Java has become more and more pervasive, IT has used J2EE technologies to build many of its most important business applications. Because these applications are critical to the business, IT typically overprovisions hardware and dedicates software, middleware, and even human resources to guarantee performance. The resulting server silos, however, create a static and rigid dependency between J2EE services and the underlying hardware, resulting in application services that are tightly coupled to their environments. This approach may increase IT s ability to deliver the required service level for J2EE applications, but it does so at a very high price. Enterprises spend millions of dollars on capital, plus millions more on operations, to manage server silos in the data center. By managing the data center for peak utilization, IT suffers as much as 90 percent of its resources sitting idle most of the time, waiting for infrequent load spikes. And, because of this static and rigid allocation of application resources, IT departments are unable to respond quickly to the business and improve overall server utilization. As is, today s enterprise data centers are optimized to guarantee J2EE application service levels, but IT is also challenged to be responsive to the business and keep costs manageable. Until now, this was a juggling act for IT departments with no solution in sight. Service Level Automation for Java Applications The goal of the Cassatt software is to enable IT departments to respond to business needs, provide applications at required service levels, and reduce costs. Cassatt provides the benefits of virtualization to the world of J2EE applications and web services. The Cassatt software delivers Java application virtualization and management an innovation that lets an IT department reduce costs through server consolidation while automatically maintaining the application service levels that the business requires. Cassatt is enabling IT organizations starting with those running BEA -based applications to maximize the return on IT investments. These new economics enable organizations to innovate and deliver new capabilities to support their business for a fraction of what was thought possible. Cassatt makes scaling J2EE application deployment fluid and dynamic. The Cassatt solution creates a virtual pool of Java application resources hardware, operating systems, and middleware freeing the resources to be used by all applications. Then, the Cassatt software automatically, and without human intervention, matches Java applications to appropriate computing resources to maintain user-defined service levels for each application. Specifically, managing your J2EE server farm with Cassatt: Decouples J2EE services from their servers and enhances the J2EE implementation Better utilizes software licenses by automatically allocating software on demand Improves server utilization through consolidation and on-demand capacity 2
Decreases operational costs via Cassatt s Service Level Automation Increases availability of the application server solution by automatically replacing failed hardware Enables scheduled and automated resource allocation to meet planned periods of peak utilization Enables sharing resources to meet demand Most importantly, existing J2EE applications can be integrated into the Cassatt environment as is, without any code changes. How Cassatt Can Help You: Creating a Real-Time Infrastructure for BEA Applications he Cassatt software, called, enables a real-time infrastructure that allows resources to be quickly repurposed to the most critical tasks and applications. This dynamic, responsive infrastructure is achieved by virtualizing and pooling IT resources and then providing automated management. Pooling Resources A foundation of the Cassatt-based real-time infrastructure is the shared resource pool. The Cassatt software transforms static server silos in the data center into a pool of shared resources. By virtue of sharing resources, Cassatt decouples applications and servers, which directly addresses the problem of over-provisioning yet underutilizing servers. Pooling and sharing resources drives up utilization, reduces capital expenditures, and decreases software licensing costs via consolidation. Service Level Automation Cassatt provides a single software solution that combines Goal-Driven Automation with Virtualization Control in a real-time infrastructure to deliver Service Level Automation. Goal-Driven Automation Cassatt provides the means to translate IT policies, business priorities, and service level agreements into a set of goals, which are continuously and automatically managed by the software. Based on these userdefined goals, the Cassatt software allocates and deallocates server resources and deploys and undeploys J2EE applications. Virtualization Management To affect change in the real-time infrastructure, Cassatt leverages its Virtualization Control technologies: Image matrix technology provides an abstraction layer that decouples software and hardware Service matrix technology provides an abstraction layer that decouples J2EE application services from hardware These technologies allow software and services to be hosted on the network rather than on a server s hard disk, enabling Cassatt to quickly redeploy software and services from server to server. This design also allows many physical systems to operate from the same software image or service, dramatically improving maintenance costs and middleware license utilization. 3
Applying Service Level Automation to BEA Server The Cassatt Web Automation Module (WAM) provides tight integration with BEA Server. Based on user-defined policies, the Cassatt software can: Dynamically respond to a node failure by provisioning a new node. When the new node is ready, Cassatt invokes the BEA Administration Server to automatically start server instances on the new node, providing hands-off recovery. Reallocate resources based on application use. For example, if one J2EE application runs by day and another at night, Cassatt can provision the same hardware and leverage the same software licenses to run both applications per a predefined schedule. Automatically deploy a new instance of a BEA service if the service performance falls below a predefined threshold. Automatically add computing resources as required by a BEA application. The domain is configured with the range of IP addresses required for peak capacity, so the Administration Server simply utilizes new resources as the Cassatt software makes them available. Automatically decrease computing resources in use when more are allocated than are required to meet service levels. Managing Your BEA Applications The Cassatt software manages hardware allocation and software provisioning via a tier structure. The Cassatt Web Automation Module (WAM) manages deployment of J2EE applications within the BEA domain structure. Overlapping tiers and domains (see Figure ) maximizes the utility of BEA in the environment. The Administration Servers provide centralized management over all s. Consolidating the Administration Servers into one tier: Simplifies application deployment Increases Administration Server availability Improves license utilization, as multiple versions can run on the same hardware Notice in the next figure that Cassatt can manage multiple BEA domains running multiple versions of BEA software. Also, just one node in the Admin tier can serve numerous nodes in the managed server tier. Environment BEA Domain BEA Domain Admin Tier Application Managed Server Tier Application Figure : Tiers and BEA Domains 4
In Figure 2, notice that the nodes in the tier can host the full range of BEA service packs simultaneously, and the tier can host multiple applications. Environment BEA Domain Admin Tier Application Managed Server Tier Application Figure 2: Administration Tier and Tier To further enhance J2EE applications built and managed with BEA, WAM utilizes the following technologies: deployment environment part of the environment used to manage and dynamically deploy BEA applications. Monitoring subsystem capabilities that not only monitor status of the tier hardware and software, but also monitor details about J2EE application performance and resource utilization. Optimization engine the heart of the environment, which responds to monitoring information and initiates automated corrective or responsive actions to guarantee service levels. BEA Deployment Environment Within the environment, platform software images and J2EE applications are managed and deployed via the Cassatt virtualization technologies the image matrix and service matrix, respectively. Using the image matrix, Cassatt provisions hardware in a tier with software. As shown in Figure 3, a software image is stored in the Cassatt image matrix, and specific image instances are applied on demand. In this example, the software image includes both BEA V8.. and V8..3, which provide a range of version support for deployed applications. 5
Control Node Image Matrix Software Image : Red Hat ELAS 3 Admin Tier Red Hat ELAS 3 Image instances Image instances are deployed on demand from the image matrix to nodes in tiers. Managed Server Tier Red Hat ELAS 3 Red Hat ELAS 3 Figure 3: Image Matrix at Work After provisions nodes with the platform software image, WAM initiates the service matrix to deploy BEA applications. See Figure 4. To handle application deployment, WAM leverages native capabilities to deploy application instances from the service matrix into domains. WAM also ensures that the managed server has the necessary capacity to run the application. Control Node Service Matrix Application instances are deployed on demand from the service matrix to the domain. Service instances Domain Domain Application Application Figure 4: Service Matrix at Work 6
WAM provides facilities to capture a application and specify the parameters that define the application in the service matrix. For each deployed application, a user may specify: Runtime node requirements for deployment (for example, required available memory on the server to run the service) Dependencies on other services Minimum/maximum number of services to deploy Monitored values with associated periods and frequencies Thresholds for monitored values that indicate a need for more or fewer service deployments The service matrix stores metadata and the bits that compose the application. Then, based on monitoring data, the Optimization Engine automates the deployment of EAR and WAR files to meet user-defined goals. Monitoring Subsystem The monitoring subsystem provides for two levels of monitoring: Tier and node monitoring used to verify that basic software requirements are receiving the necessary resources (for example, the minimum number of nodes) to run at a user-specified level. BEA server and domain monitoring used to monitor application deployments and to interrogate the BEA application domain and pinpoint problem areas. The infrastructure provides a JMX monitoring collector that is used for. monitors the application server and the domains that are deployed inside that server, collecting low-level detail, as illustrated in Figure 5. Domain Monitoring Data Store Admin Tier Application JMX Monitoring Collector JMX monitoring collector can gather... JVMHeapSize JVMHeapFree ExecuteThreadCount ExecuteThreadTotalCount PendingRequests PendingRequestOldestTime Figure 5: JMX Monitoring 7
Optimization Engine The Optimization Engine responds to monitoring information and initiates automated corrective or responsive actions to guarantee service levels. To accomplish this, the Optimization Engine interacts with other components and the BEA Administration Server, as illustrated in Figure 6. Components Optimization Engine Monitoring Subsystem Extensible Policy Interface Governor BEA Admin Server BEA Node Manager Checks system state 2 3 4 5 Service running below threshold Requests resource Requests application deployment Specifies deployment details Deploys application Figure 6: Application Deployment Sequence Flow By measuring system conditions, analyzing the system state, and then responding immediately, the Optimization Engine drives the automation that is so critical to the real-time IT infrastructure that Cassatt creates. With, the minimum and maximum resource levels can be set for each tier and application-specific parameters can be set for each domain deployed in BEA. The monitoring subsystem reports system state to the Optimization Engine. When defined monitoring parameters or thresholds are breached, the Optimization Engine initiates corrective action to bring the system up or down to the specified service level. Consider the following specific example: Example - corrective actions taken by the Optimization Engine If the monitoring subsystem reports that pending requests exceed 20 for more than 2 minutes... Then the Dynamic Policy Engine... Deploys a new BEA J2EE application instance on an underutilized server to bring the system up to the necessary level of service. or... Dynamically allocates an available server from the free pool or an underutilized server from another tier, provisions it, and deploys a new BEA application instance to bring the system up to the necessary level of service. Conversely, when the utilization of an application falls below a specified level, the Optimization Engine decreases the number of deployed service instances. 8
Based on user-defined policies, the Optimization Engine makes all decisions regarding the services that should be running and the physical entities on which they should run. When the system state does not match the user-defined policy, automatically determines the optimal course of action and adjusts the resources without operator intervention. To initiate system change, employs two mechanisms: Extensible policy interface provides a web services API that defines the operations available to the Optimization Engine. This WSDL interface represents the set of valid operations (for example, allocating resources, starting servers, loading software images) that can be performed on a node or tier in the environment. Governor an adjunct to the Extensible Policy Interface that specifically manages requests for BEA services. The Governor issues commands to a BEA Administration Server to deploy or undeploy J2EE applications. This request includes deployment details (that is, metadata acquired from the service matrix) such as required resources and how to access the application to be deployed. As shown in Figure 7, the Optimization Engine invokes the appropriate image or service delivery process to bring the system into conformance with the user-defined policy. Image Matrix Image Delivery Extensible Policy Interface Provision and Allocate/Deallocate Servers Optimization Engine Governor Deploy/Undeploy BEA Applications Service Delivery Service Matrix Figure 7: Optimization Engine and Image and Service Delivery Virtualization and Automation Deliver Improved Agility, Better Service Levels, and Reduced Costs for J2EE Applications Cassatt brings the benefits of virtualization to the world of J2EE applications and web services. Cassatt s Java application virtualization and management lets IT departments reduce costs through server consolidation, streamlined operations, and better agility, while automatically maintaining the application service levels that the businesses require. For more information on managing J2EE server farms, go to www.cassatt.com. 9 Cassatt Corporation 740 Technology Drive San Jose, CA 950 t: 408.437.7600 f: 408.437.364 www.cassatt.com 2006 Cassatt Corporation. All rights reserved. All trademarks are the property of their respective holders. Specifications subject to change without notice.