EMC VSPEX SOLUTION FOR INFRASTRUCTURE AS A SERVICE WITH VMWARE VCLOUD SUITE

Transcription

1 DESIGN AND IMPLEMENTATION GUIDE EMC VSPEX SOLUTION FOR INFRASTRUCTURE AS A SERVICE WITH VMWARE VCLOUD SUITE EMC VSPEX Abstract This describes how to design virtualized VMware vcloud Suite resources on EMC VSPEX Private Cloud solutions. It also illustrates how to size vcloud Suite components using VSPEX guidelines, allocate resources following best practices, and use all the benefits that VSPEX offers. January 2014

2 Copyright 2014 EMC Corporation. All rights reserved. Published in the USA. Published January 2014 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC 2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite Part Number H EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

3 Contents Contents Chapter 1 Introduction 9 Introduction Overview Essential reading Purpose of this guide Business value Scope Audience Terminology Chapter 2 Solution Overview 13 Overview Key components VMware vcloud Suite EMC VNX EMC Integration for vcloud Suite Hardware list Software list Chapter 3 Solution Design 19 Overview Solution architecture High-level solution architecture Storage design VNX storage tiering and FAST VP Storage mapping vcloud Suite design VMware vsphere vcloud Automation Center vcenter Operations Manager vcloud Networking and Security Design considerations and best practices Network design Storage design Virtualization design EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 3

4 Contents Chapter 4 Solution Implementation 33 Overview Installing and configuring vcloud Management cluster Setting up and configuring SQL Server database Deploying management and production resource cluster vcenter servers Preparing a management cluster EMC integration Deploying vcloud Networking and Security Deploying vcac Database server vcac web server vcac server Manager Service DEM worker server vcloud Suite integration (configuring endpoint) Deploying vcenter Operations Manager vcloud Suite Integration EMC Integration Chapter 5 Solution Verification 52 Overview Verifying vsphere implementation Preparing production vcenter resources VSI operations Configure datastore clusters in vsphere Verifying vcns implementation Separating tenant networks Verifying vcac implementation Cloud roles and resource administration Creating vsphere virtual resource reservation and cost profile vcac blueprints Deploy virtual machines from blueprints Reconfigure existing virtual machine Decommission a virtual machine Chargeback and metering vcenter Operations Management Monitoring vcenter objects and resources Monitoring VNX health and resources Capacity planning and optimization EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

5 Contents Chapter 6 Resource Sizing Guide 90 Overview Cloud management environment sizing Summary Appendix A: Storage Service Levels 95 Overview Storage service levels Storage levels consumable by tenants Storage service-level offerings EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 5

6 Contents Figures Figure 1. Key components of the EMC VSPEX solution for IaaS with VMware Figure 2. Logical architecture: VSPEX solution for IaaS with vcloud Suite Figure 3. EMC VNX sub-lun tiering of production LUN data across two disk types23 Figure 4. Organization mappings for storage service levels Figure 5. Storage DRS - Aligning datastore clusters with storage service levels.. 26 Figure 6. Architecture overview of vcops vapp including EMC Storage Analytics 27 Figure 7. EMC VSI installed and available under Solutions and Applications Figure 8. EMC VSI Feature Manager Figure 9. EMC VSI: VNX Array Discovery Figure 10. EMC VSI : Block storage details and properties Figure 11. EMC VSI : File storage details and properties Figure 12. Set multipathing policy Figure 13. Select NMP and PowerPath/VE multipathing policies for VNX devices. 40 Figure 14. Viewing VAAI support in the vsphere Client for VNX storage Figure 15. Start Profile Driven Storage service on vcenter server Figure 16. VM Storage Profiles in vsphere Client Figure 17. Add VNX Provider details Figure 18. New EMC VNX vendor provider added VNX Figure 19. Storage capabilities presented to vcenter by VNX Provider Figure 20. Add user-defined storage capability for VNX storage Figure 21. Assign user-defined storage capability to datastore cluster Figure 22. System and user-defined storage capabilities displayed in vsphere Figure 23. EMC Storage Analytics with VMware vcenter Operations Manager Figure 24. Launch EMC VSI storage provisioning wizard from vsphere Client Figure 25. Figure 26. Summary of vsphere tasks executed by EMC VSI when provisioning storage GB VMFS datastore EPC_Prod2_Fin_LUN11 available as a storage resource Figure 27. Path management details for newly created 200 GB LUN/datastore Figure 28. Datastore cluster fully configured in vsphere Figure 29. Endpoint configurations for vcac Figure 30. Enterprise groups created and managed by vcac cloud administrator. 60 Figure 31. Enterprise groups resource defined vcac cloud administrator Figure 32. Storage resource reservations as managed by the vcac enterprise administrator Figure 33. Assigning cost profiles Figure 34. Provisioning groups managed by vcac enterprise administrator Figure 35. Blueprint approval policy as set by provisioning group manager EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

7 Contents Figure 36. Create new VMware vsphere virtual machine blueprint Figure 37. Create new blueprint Figure 38. Select vsphere template to clone from Figure 39. Complete build information for new blueprint Figure 40. Select custom build profiles for virtual machine Figure 41. Enable virtual machine operations for cloud user Figure 42. Deploy new virtual machine blueprint from self-service portal Figure 43. Reconfigure virtual machine resources from self-service portal Figure 44. Set execution options for virtual machine reconfiguration Figure 45. Decommissioning a virtual machine Figure 46. Executive Summary Virtual for vcac virtual machines Figure 47. Manage compute resource cost and storage cost profiles Figure 48. Manage compute resource cost and storage cost profiles Figure 49. Edit vcac compute resource cost and storage cost profiles Figure 50. Chargeback by group allocated resources Figure 51. Chargeback by group by reservation Figure 52. Chargeback by owner by allocated resources Figure 53. Dashboard for reclaimed virtual machines in the enterprise private cloud Figure 54. Reclamation Savings by Owner report Figure 55. vsphere UI dashboard high level overview Figure 56. Health dashboard showing immediate issues in environment Figure 57. End to end fault analysis covering actual fault, causes, and solution details Figure 58. VMware vcops root cause analysis solution details Figure 59. EMC VNX Storage Topology dashboard Figure 60. ESA EMC Storage Metrics displaying VNX LUN metrics Figure 61. ESA VNX Overview dashboard displayed object heat maps Figure 62. Virtual Machine Capacity details for management cluster Figure 63. Specify virtual machine configuration for What-If scenario Figure 64. What-If scenario Adding ten new virtual machines Figure 65. Figure 66. Edit policy to specify thresholds for underutilization of virtual machines87 List of oversized virtual machines with suggested optimal resource configurations Figure 67. Schedule a report in vcops or run the report manually Figure 68. Successfully completed reports available for download Figure 69. Storage service-level positioning for VSPEX management and orchestration Figure 70. Storage service levels on VNX systems Figure 71. Storage service-level mapping from applications to storage array EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 7

8 Contents Tables Table 1. Terminology Table 2. Solution software Table 3. Deployment process stages and procedures Table 4. Management vcenter requirements Table 5. vcac Up to 1,000 machines (physical or virtual) Table 6. vcops hardware requirements Table 7. Production vcenter requirements Table 8. Storage service levels example EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

9 Introduction Chapter 1 Introduction This chapter presents the following topics: Introduction Purpose of this guide Business value Scope Audience Terminology EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 9

10 Introduction Introduction Overview EMC has joined forces with the industry-leading providers of IT infrastructure to create a complete virtualization solution that accelerates deployment of cloud infrastructure. Built with the best available technologies, VSPEX enables faster deployment, more simplicity, greater choice, higher efficiency, and lower risk. Validation by EMC ensures predictable performance and enables customers to select technology that uses their existing IT infrastructure while eliminating planning, sizing, and configuration burdens. VSPEX provides a proven infrastructure for customers who want to gain the simplicity that is characteristic of truly converged infrastructures and have more choice in individual solution components. This EMC VSPEX cloud management solution is designed to enable customers to implement an on-site Infrastructure as a Service (IaaS) offering for their internal users. This solution is designed and implemented on a VSPEX proven infrastructure and hence uses the same hardware and software resources as defined in the VSPEX proven infrastructure collateral. Along with the software mentioned in the EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide, this solution also uses additional cloud management software to enable delivery of IT as a service. As more organizations attempt the transformation from the traditional IT-as-a-cost-center model to a more mature model of acting as a service broker, IaaS is the area where most customers focus their initial efforts. This EMC VSPEX solution for IaaS deploys the best of EMC and VMware products and services to empower our customers to accelerate the implementation and adoption of private cloud while still enabling customer choice for the compute and networking infrastructure within the data center. In this solution, EMC is catering to those organizations that are looking for ways to further leverage their existing infrastructure investments and expand their use to cloud computing solutions. Essential reading EMC recommends reading related documents before proceeding. VSPEX Proven Infrastructure Solution Refer to this VSPEX Proven Infrastructure document: EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide. vcloud Suite Refer to the VMware vcloud Suite website for details about vcloud Suite. 10 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

11 Introduction Purpose of this guide Business value The purpose of this document is to demonstrate how to implement an IaaS environment on an existing VSPEX Private Cloud solution using management and orchestration tools from VMware. This document provides an introduction to the VMware vcloud Suite and EMC VSPEX solutions, and specifically demonstrates integrations that exist in a VSPEX Private Cloud solution. Use this document as a reference to begin the planning and design process for your management and orchestration deployment, and to set the stage for successful implementation efforts. Be aware that this particular design represents one of many possible ways to deploy an IaaS platform on a VSPEX Private Cloud environment. We chose this design because of the level of maturity of the toolsets and the ability to meet the use case requirements within a reasonable amount of time, maximizing the use of out-of-box capabilities. Focusing on IaaS, this document defines the key elements needed to create an operational service offering, explains the processes required to implement the infrastructure and software stacks, and provides step-by-step directions to fulfill the primary requirements of a private cloud. This solution document focuses on the implementation of the vcloud Suite, and defines the core infrastructure requirements that must be met, such as storage, network, compute, and vsphere configurations, before you can layer on the private cloud components. This document includes the most common use cases for implementing an IaaSfocused private cloud and provides direction and enablement content for foundational capabilities and requirements. Business applications are moving into consolidated compute, network, and storage environments. EMC VSPEX solutions reduce the complexity of configuring every component of a traditional manual model. VSPEX solutions unify administration and self-service while maintaining security and process separation. This solution guide addresses the following business needs: Automated provisioning through self-service portal Automated monitoring Multitenancy Resource elasticity Metering and chargeback Performance monitoring Storage resource management and analytics EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 11

12 Introduction Scope The guide assumes that the reader is familiar with VSPEX private cloud solutions and that a VSPEX private cloud architecture already exists in the customer environment. This guide describes the high-level steps required to deploy vcloud Suite on a VSPEX private cloud with VMware vsphere and EMC VNX, and it provides guidance for using vcloud Suite components to simplify and efficiently manage the VSPEX private cloud. Audience This document is targeted at partners, technical architects, and cloud solution engineers with a background in EMC and VMware solutions who are considering an IT-as-a-Service transformation and want to align the daily operational tasks of management and monitoring the private cloud with the skill sets required to ensure success. You should have an understanding of VMware vcloud and vsphere solutions, and be familiar with the EMC VNX storage platform solutions that you are planning to use as the enabling platforms hosting the IaaS offering. You should also have a clear understanding of the provisioning and operational processes that are implemented within your own environments and recognize your end users general requirements for an IaaS solution. These requirements should include areas such as security, compliance, monitoring, management, data protection, and disaster recovery. Having these competencies will ensure a more relevant connection between the capabilities provided by this solution and the operational requirements of your organization that will ultimately bring additional business value. Terminology Table 1 lists terminology used in this guide. Table 1. Terminology Term FAST VP PaaS VAAI VASA VSI VXLAN Definition Fully Automated Storage Tiering for Virtual Pools Platform as a Service VMware vstorage APIs for Array Integration VMware vsphere Storage APIs for Storage Awareness Virtual Storage Integrator Virtual Extensible LAN 12 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

13 Solution Overview Chapter 2 Solution Overview This chapter presents the following topics: Overview Key components EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 13

14 Solution Overview Overview This EMC VSPEX solution for IaaS built on top of a VSPEX private cloud architecture enables customers to build a scalable multitenant platform for complete management and orchestration. This private cloud solution provides on-demand access and control of applications, servers, storage, and security while maximizing asset utilization. This solution uses vcloud Suite as the cloud management software and VSPEX private clouds as the physical infrastructure. This solution runs on the VMware vsphere virtualization layer backed by highly available EMC VNX family storage components. The compute and network components, which are defined by the VSPEX partners, are designed to be redundant and are sufficiently powerful to handle the processing and data needs of the virtual machine environment. This chapter introduces the components of vcloud Suite that enable management and orchestration in a VSPEX private cloud environment. Key components This section presents the key components used in this solution to enable complete management of a VSPEX stack through vcloud Suite. This section also explains integration points for EMC and vcloud Suite components that simplify the management and orchestration tasks. VMware vcac vcenter Operations EMC Storage Analytics vcloud Networking and Security VMware vcenter VASA VAAI VMware vsphere EMC VSI EMC PowerPath VE EMC VNX Figure 1. Key components of the EMC VSPEX solution for IaaS with VMware 14 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

15 Solution Overview VMware vcloud Suite VMware vcloud Suite is an integrated solution for building and managing a complete cloud infrastructure that meets IT s most critical needs. vcloud Suite fulfills the promise of the software-defined datacenter by pooling industry-standard hardware and running each layer of the datacenter as a software-defined service. It creates pools of servers, storage, and networking with dynamically configurable security, availability, and management services that can meet the needs of all applications. The built-in self-service portal and catalog, policy-based infrastructure and application provisioning, and automated operations management help to complete the picture. VMware vsphere VMware vsphere transforms the physical resources of a computer by virtualizing the CPU, RAM, hard disk, and network controller. This transformation creates fully functional virtual machines that run isolated and encapsulated operating systems and applications like physical computers. VMware vcenter VMware vcenter is a centralized management platform for the VMware Virtual Infrastructure. This platform provides administrators with a single interface for all aspects of monitoring, managing, and maintaining the virtual infrastructure, and can be accessed from multiple devices. VMware vcenter also manages some advanced features of the VMware virtual infrastructure such as VMware vsphere High-Availability and DRS, along with vmotion and Update Manager. vcenter Orchestrator VMware vcenter Orchestrator is an IT process automation engine that helps automate your cloud and integrate the VMware vcloud Suite with the rest of your management systems. Orchestrator saves time, removes manual errors, reduces operating expenses, and simplifies IT management. Orchestrator allows administrators and architects to develop complex automation tasks within the workflow designer, then quickly access and launch workflows directly from within the vsphere Client or by using various triggering mechanisms. vcloud Automation Center vcloud Automation Center enables customized, self-service provisioning and lifecycle management of cloud services that comply with established business policies. It provides a secure portal where authorized administrators, developers, or business users can request new IT services and manage existing computer resources from predefined user-specific menus. vcenter Operations Manager VMware vcenter Operations Manager is the key component of the vcenter Operations Management Suite. It provides a new, simplified approach to the operations management of vsphere s physical and cloud infrastructure. Using patented, selflearning analytics and an open, extensible platform, vcenter Operations Manager provides you with operations dashboards to gain deep insights and visibility into the health, risk, and efficiency of your infrastructure, providing performance management and capacity optimization capabilities. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 15

16 Solution Overview vcloud Networking and Security VMware vcloud Networking and Security (vcns) is the leading software-defined networking and security solution. It enhances operational efficiency, unlocks agility, and provides the extensibility to rapidly respond to business needs. It provides a broad range of services in a single solution, including virtual firewall, VPN, load balancing and Virtual Extensible LAN (VXLAN) extended networks. EMC VNX The EMC VNX storage system is a powerful, trusted, and smart storage array platform that provides a high level of performance, availability, and intelligence in organizations within the business. VSPEX private cloud customers can leverage the advanced storage tiering features and efficiencies of the VNX storage array to deliver multiple storage service levels to their various organizations, accelerating and simplifying their as-a-service offerings in their private cloud environment. Virtual Provisioning EMC Virtual Provisioning can reduce cost, improve capacity utilization, and simplify storage management. Users can present a large amount of capacity to a host and then consume space only as needed from a shared pool, reducing initial overallocation of storage capacity. Virtual Provisioning can reduce labor costs by simplifying data layout and reducing the steps required to accommodate capacity growth. Fully Automated Storage Tiering EMC Fully Automated Storage Provisioning for Virtual Pools (FAST VP) for VNX optimizes efficiency across all drive types in the array to improve system performance while reducing cost. FAST VP dynamically allocates workloads based on the configured service level and nondisruptively moves workloads across drive types, optimizing overall system performance. FAST VP moves the most active parts of the workload to high-performance flash disks and the least frequently accessed data to lower-cost drives, leveraging the best performance and cost characteristics of the different drive types. Unisphere EMC Unisphere is an intuitive management interface that allows IT managers to dramatically reduce the time required to provision, manage, and monitor storage assets. Unisphere delivers the simplification, flexibility, and automation that accelerate the transformation to the private cloud. EMC Integration for vcloud Suite EMC provides tight integration points for vcloud suite which simplify management and provisioning of storage. vcloud Suite also provides the capability to monitor the health and performance of storage resources on the VNX array from within. EMC Virtual Storage Integrator EMC Virtual Storage Integrator (VSI) is the free vcenter plug-in provided by EMC that extends the vcenter UI to add additional EMC-specific capabilities. EMC VSI provides multiple feature sets including Storage Viewer (SV), Path Management, and Unified 16 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

17 Solution Overview Storage Management. Unified Storage Management simplifies the provisioning of VNX virtual pooled storage for the private cloud. VMware vstorage APIs for Array Integration (VAAI) EMC VNX supports VMware vstorage APIs for Array Integration (VAAI), which offloads virtual machine storage operations to the array to optimize server performance. In the VMware environments, the following VAAI components are supported: VMware vsphere Storage APIs for Storage Awareness (VASA) VASA allows VMware administrators to view and classify, from a single location VNX drive types in a more sophisticated way, using the storage vendors VASA provider to interrogate the storage and classify it in terms of its attributes and underlying technology. This can range from basic disk type to the RAID level, automated tiering capabilities, and replication status. EMC Storage Analytics EMC Storage Analytics can be used as a plug-in with VMware s vcenter Operations Manager to provide a powerful management tool for VMware and storage administrators to access real-time intelligent analytics for their VNX platform. Obtain detailed statistics via customizable dashboards, heat maps, and alerts while also accessing topology mapping in a VMware environment. Hardware list Software list This solution is built on top of a VSPEX configuration and assumes that the required hardware is installed and set up within the business according to the configuration guidelines in this VSPEX Proven Infrastructure document: EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide. Table 2 lists the software requirements for this solution. Table 2. Solution software Software Configuration Notes VMware vcloud Automation Center (vcac) VMware vcloud Automation Center VMware vsphere ESXi 5.5 Build Server hypervisor VMware vcenter Server 5.5 Build vsphere Management Server VMware vcenter Operations Manager (vcops) vcloud Networking and Security VMware vcenter Operations Management 5.1 Networking and security for vcloud site Microsoft SQL Server o 2012 Enterprise Edition Database server for vcenter, vcac Microsoft Windows Server 2008 R2 SP1, 2012 R2 Operating system for the server environment EMC VSI 5.6 EMC storage plug-in for VMware vsphere Client EMC Storage Analytics 2.0 EMC Storage Analytics Adapter EMC Unisphere Management software for EMC VNX EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 17

18 Solution Overview Software Configuration Notes EMC VNX OE for file o 8.1 Operating environment for file EMC VNX OE for block o OE Release 33 Operating environment for block EMC PowerPath Virtual Edition 5.8 Multipathing and load balancing for block access. 18 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

19 Solution Design Chapter 3 Solution Design This chapter presents the following topics: Overview Solution architecture Storage design EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 19

20 Solution Design Overview It is important to understand the roles of the various solution components that are used to enable management and orchestration of the VSPEX Private Cloud. This section explains the design and layout of this cloud management solution that was implemented on a VSPEX private cloud architecture to deliver infrastructure as a service. The functions served by the different components along with their use cases in this solution are discussed in this section. Solution architecture High-level solution architecture This section describes the environment and supporting infrastructure for this EMC VSPEX solution for IaaS. Figure 2. Logical architecture: VSPEX solution for IaaS with vcloud Suite 20 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

21 Solution Design The management infrastructure for this private cloud solution is critical to the availability of its supporting components. This solution has two management layers which separate the virtual infrastructure into two tiers of resource management: Management cluster Production resource clusters Management cluster The management cluster hosts all virtual machines used for managing the cloud infrastructure. This cluster supports the components responsible for functions such as the user portal and automated provisioning, monitoring, networking, security, and metering. All server and virtual machine components within the management cluster are managed by a separate, higher level vcenter Server instance. This instance can be located in the management cluster, but for highest possible availability, should be located on a separate set of infrastructure servers. The management cluster is supported by three VMware vsphere ESXi servers, configured in a vsphere cluster using VMware vsphere Distributed Resource Scheduler (DRS) and VMware vsphere High Availability (HA). This vsphere cluster uses server, network and storage resources of its own, separate from the production resource clusters. Fibre Channel connectivity between the management cluster and the VNX array is not a mandatory requirement; iscsi or NFS connectivity can also be used to provide storage to the management cluster if preferred. All storage is RAID protected and all ESXi servers run EMC PowerPath /VE for automatic path management and load balancing. Production resource clusters The production resource clusters host all systems used by different organizations to support the business needs of the enterprise customer. These resource clusters are managed by a second vcenter Server instance located in the management cluster, which serves as the vsphere endpoint for vcloud Automation Center (vcac). Add server, network, and storage resources to the existing cluster, and change resource reservations at the vcac layer to make the additional resources available for consumption. Extend existing storage resources automatically using EMC VSI. All storage configured to support the production resource clusters is RAID protected and all ESXi servers run EMC PowerPath /VE for automatic path management and load balancing. Sizing considerations for the production resource clusters will vary across enterprise customers. Base the sizing considerations on the expected workload for each organization. Storage design The VNX storage array provides many features that allow provisioning of IaaS. Since this solution is built on top of a VSPEX Private Cloud, it uses the same storage configuration as mentioned in the VSPEX Private Cloud proven infrastructure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 21

22 Solution Design document. As a result, this solution uses a single storage service level as the base storage configuration to support up to 1000 reference virtual machines. For more information on reference virtual machines refer to: EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide Additional storage service levels can be created within a VNX array to achieve different levels of performance and most effectively align resources with performance requirements. Refer to Appendix A for more information on creating additional storage service levels. Note: The two additional storage service level examples in Appendix A fall outside of the guidelines in the underlying Private Cloud Proven Infrastructure. If a specific number of reference virtual machines will be supported, use only the storage configuration mentioned in the VSPEX Proven Infrastructure document. If virtual machines are deployed on other storage service level examples provided in Appendix A then the number of reference virtual machines supported may be lower. VNX storage tiering and FAST VP As validated in the VSPEX Proven Infrastructure, this solution uses EMC s FAST VP technology which enables storage tiering within the storage service level. Storage tiering is the assignment of data to different types (tiers) of storage media to reduce total storage cost. FAST VP makes automatic storage tiering possible on VNX storage arrays. FAST VP operates by periodically relocating the most active data to the highest performance storage tier, while relocating less active data to the lower performing storage tiers, as appropriate, when new data is promoted. FAST VP uses intelligent algorithms to continuously analyze devices at the sub-lun level. This enables it to identify and relocate the specific parts of a LUN that are most active and would benefit from being moved to higher-performing storage such as enterprise flash drives. It also identifies the least active parts of a LUN and relocates that data to higher-capacity, more cost-effective storage. Performance measurement and user-defined policies determine data movement between tiers. FAST VP moves the data automatically and non-disruptively. The VSPEX Private Cloud uses two disk types within the storage pool with each providing a different tier of performance and capacity, as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

23 Solution Design Figure 3. EMC VNX sub-lun tiering of production LUN data across two disk types Storage mapping Figure 4 shows how the storage pool and LUNs are mapped to different enterprises within the business. Production clouds are organizational clouds for virtual machines with maximum performance requirements. Test/Development clouds are clouds are organization clouds for virtual machines with medium performance requirements. Archive/Low Cost clouds are organizational clouds for virtual machines with least performance requirements. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 23

24 Solution Design Organization Mappings for Storage Service Levels EMC VNX Production Clouds LUNs VM01 VM02 VM03 Test/Development Clouds Storage Service Level Prod-2 Flash Drives VM01 VM02 VM03 Finance-ESXi Archive/Low Cost Cloud Mfg-ESXi SAS Drives VM01 VM02 VM03 Figure 4. Organization mappings for storage service levels vcloud Suite design The combination of standardization, workflow automation, and self-service gives businesses the agility they need to offer IT as a service on virtual infrastructures at reduced cost. The Management and Orchestration Workflow Automation solution combines the converged infrastructure of VSPEX with service catalog and process automation capabilities of vcloud Suite that enable IT organizations to deliver services rapidly, efficiently, and cost-effectively. vcloud Suite components possess attributes which collectively are necessary for successful management and orchestration of a Private Cloud. These components along with EMC VNX and EMC integration software for vcloud Suite enable provisioning of Infrastructure as a service on a VSPEX Private Cloud. VMware vsphere VMware vsphere is the leading server virtualization platform in the industry. VMware vsphere provides flexibility and cost savings to end users by consolidating large inefficient server farms into nimble reliable cloud infrastructures. The core components of VMware vsphere are the vsphere Hypervisor and the vcenter Server. Use case vcenter Server This solution uses VMware vcenter for system management. Physical servers in this solution are clustered to provide high availability. This solution uses two vcenter Servers. The first vcenter server manages the management cluster. The second vcenter Server manages the production cluster which is used as an endpoint for consumable resources in vcloud automation center. 24 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

25 Solution Design This solution takes advantage of VMware Storage API for Array Integration to offload virtual machine storage operations to the storage array. It uses VMware Storage API for storage awareness which provides a single management interface to view VNX drive types. vcenter uses the EMC VSI plug-in that provides features like Storage Viewer, Path Management and Unified Storage Management. Unified Storage Management simplifies provisioning of VNX pooled storage through vcenter for various organizations within the business. EMC VSI Because VSI is modular in design, administrators can add, remove and update features independently providing a flexible customized user experience. Features available for VSI include Storage Viewer, Path Management, Symmetrix storage replication adaptor (SRA), Unified Storage Management, AppSync Management, and EMC RecoverPoint Management. The three features used in this solution are: Storage Viewer feature extends the VMware vsphere Client to facilitate the discovery and identification of VNX storage devices that have been provisioned to ESXi hosts and virtual machines. Storage Viewer presents the underlying storage details to the vsphere administrator by merging the data of several different storage mapping tools into a few seamless VMware vsphere Client views. Path Management feature for VMware Native Multipathing and EMC PowerPath/VE provides a mechanism for changing the multipath policy for groups of LUNs based on storage class and virtualization objects. Unified Storage Management feature provides array-based storage management and provisioning for VMAX, VNX, VNXe, CLARiiON, Celerra arrays. This feature also allows for virtual machine decompression, compression, cloning and extending datastore capacity. VMware vsphere Storage DRS To prevent hot spots and over- or under-utilized datastores, VMware vsphere Storage DRS provides smart virtual machine placement and load-balancing mechanisms based on I/O and space capacity. Datastore clusters form the basis of Storage DRS. As with a cluster of ESXi hosts, a datastore cluster is used to aggregate storage resources, enabling smart and rapid placement of the virtual disk files of a virtual machine and load balancing of existing workloads. This solution for the VSPEX Private Cloud aligns storage with datastore clusters. All storage devices within a datastore cluster must have consistent size and performance characteristics. Storage assigned to an organization in VMware vcac consists of devices which have been aggregated to a single unit of consumption a single datastore cluster in vsphere. Though vcac v5.2 is unaware of Storage DRS (SDRS) operations, all SDRS movements of virtual machine files are contained within a single datastore cluster, and all LUNS within each datastore cluster in this solution are available to only one tenant; therefore the scope of virtual machine file movement is contained within the tenant s resources. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 25

26 Solution Design In the example shown in Figure 5 for the Manufacturing organization, all of the storage devices are aggregated into a single datastore cluster. Depending on the choice of service level when a blueprint in vcac is provisioned, each cluster presents a single target for the provisioning of virtual machines in vcac blueprints. Figure 5. Storage DRS - Aligning datastore clusters with storage service levels vcloud Automation Center VMware vcloud Automation Center (vcac) enables you to rapidly deploy and provision business-relevant cloud services across your private cloud and physical infrastructure. Acting as a service governor, it provides a cross-cloud storefront for IaaS and platform as a service (PaaS) deployments. It empowers organizations to enforce business and IT policies throughout the service life cycle, helping them to transform virtualized environments into software-defined cloud datacenters. Use case vcac provides the ability to carve a shared infrastructure up into logical units and logical capacities that can be handed over to different business units. It does this with machine blueprints. Cloud users can choose from a self-service catalog of custom defined blueprints, each containing specific resources appropriate to different applications or business units. vcac is designed to leverage physical components such as those that comprise the VSPEX proven Infrastructure. It supports the differing requirements of an enterprise s many business units and integrates with a wide variety of existing IT systems and best practices. Through the workflow designer, vcac can easily invoke vcenter Orchestrator workflows to extend lifecycle state transitions and machine command menus, resulting in entire processes being automated without requiring any manual cycles from IT teams. A number of user roles and responsibilities are defined and used in the structure of vcac. The administration of users and compute resources in vcac is managed through the vcac console, which is the administrative portal. The relevant groups are summarized below: Cloud administrator The cloud administrator configures resource endpoints and enterprise groups, where enterprise group administrators and their respective compute resources are defined. 26 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

27 Solution Design Enterprise groups Enterprise groups contain enterprise administrators that manage their respective cloud resources, as defined by the cloud administrator. Enterprise administrators are responsible for configuring and creating provisioning groups for individual departments as well as resource reservations and customizations for network, storage, compute and cost profiles. Approval groups and policies are also defined by the enterprise administrator. Provisioning groups The users in these provisioning groups are the users and consumers of the infrastructure provided to them by their enterprise administrator. The enterprise administrator assigns compute, storage and network resources and makes them available to the provisioning group manager. vcenter Operations Manager VMware vcenter Operations Manager provides an integrated approach to performance, capacity, and configuration management. This solution uses analytics to provide the intelligence and visibility required to proactively ensure service levels in virtual and cloud environments. vcenter Operations Manager provides pre-built and configurable dashboards for realtime performance, capacity and configuration management. Figure 6. Architecture overview of vcops vapp including EMC Storage Analytics EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 27

28 Solution Design As shown in Figure 6, vcenter Operations Manager is distributed as a vapp which you can import and deploy to vsphere. This vcenter Operations Manager vapp is located in the Management Cluster of this Enterprise private cloud solution and consists of two virtual machines: UI virtual machine Analytics virtual machine UI virtual machine The UI virtual machine allows you to access the results of the analytics in the form of badges and scores using the web-based application for the vsphere UI virtual machines. vcenter Operations Manager Administration Portal The vcenter Operations Manager Administration Portal provides a user interface for vcenter Operations Manager vapp maintenance and management tasks. Analytics virtual machine The Analytics virtual machine is responsible for collecting data from vcenter Server, vcenter Configuration Manager, and third party data sources, such as metrics, topology, and change events Capacity Collector The Capacity Collector collects metrics and computes derived metrics. Use case Performance data is abstracted to health, risk, and efficiency measures that allow IT to identify potential performance problems with less effort. Capacity analytics identify over-provisioned resources so they can be right-sized for more efficient use of virtualized resources. "What If" scenarios eliminate the need for spreadsheets, scripts, and rules of thumb. Integrating vcenter Operations with the EMC Storage Analytics Suite enables full endto-end visibility of the entire infrastructure from virtual machine to LUN and every point in between. This enables IT administrators to quickly visualize the health of the EMC arrays (both block and file) using a simple Performance-at-a-glance tab. EMC Storage Analytics (ESA) links VMware vcenter Operations for storage with the EMC Adapters for VNX. The vcenter Operations Manager displays performance and capacity metrics from EMC storage systems with data that the adapter provides by: Connecting to and collecting data from block and file systems. Converting the data into a format that vcenter Operations can process. Passing the data to the vcenter Operations collector. vcloud Networking and Security vcloud Networking and Security enables the creation of VXLANs which enable creation of layer 2 logical networks without the help of VLANs. VXLANs, network services like NAT, and a DHCP-application-level firewall along with data security, help in segregating tenant traffic and providing multitenancy. 28 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

29 Use case Solution Design Through vcac, vcloud networking and security is specified as a vsphere endpoint. This enables vcac to discover network resources like load balancers, network paths, and security groups. These network paths can be added to reservations while load balancers and security groups can be added to blueprints. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 29

30 Solution Design Design considerations and best practices Follow the design considerations and best practices in this section to efficiently deliver IaaS to different organizations and to simplify management for system and cloud administrators. Network design Because this solution is built on top of the VSPEX private cloud solution for vsphere, the core network design considerations are the same as those detailed in the following Proven Infrastructure document: EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide Because a self-service-based private cloud environment has separate tiers and levels of users, certain network practices should be deployed to simplify management. This solution uses VMware vsphere Distributed Switch (VDS) to simplify virtual machine network configuration. For more information on VDS refer to the VMware website. VXLAN-based networking through vcns Create a VMware vsphere distributed switch (VDS) within the datacenter datacenter for clusters belonging to each enterprise. Add the uplink ports meant for virtual machine traffic to the VDS. Configure the clusters and VDS for VXLAN networking. Create virtual wires for each Production, Test and Development, and Archive production group. VLAN-based networking Create a VMware vsphere distributed switch (VDS) within the datacenter for clusters belonging to each enterprise. Add the uplink ports meant for virtual machine traffic to the VDS Create a separate Distributed Virtual (DV) port group for each Production, Test and Development, and Archive provisioning group deployed within the business. Each DV port group should have a dedicated VLAN. Note: If multiple NICs are available, use the fastest network adapters for Production provisioning groups and the slower adapters for Archive provisioning groups. Configure the settings for a DV port group so that it uses only specific network adapters for traffic. Storage design Because this solution is built on top of the VSPEX private cloud solution for vsphere the storage design for the production-level storage is the same as detailed in that solution. Appendix A of this document details the design for two additional storage levels the Test and Development storage level and the Archive storage level. The two additional storage levels mentioned in Appendix A are only provided as examples. VSPEX recommends using only the storage layout described in the VSPEX Private Cloud solution for vsphere. The use of additional storage tiers may impact the potential number of reference virtual machines supported by the Private Cloud Proven Infrastructure. 30 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

31 Storage layout examples Solution Design The Production, TestDev, and Archive provisioning groups of each enterprise use the storage configuration as outlined in the EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide. Since the three clouds will be supporting different performance profiles, EMC FAST VP technology would automatically tier the data within the storage pool to achieve optimal performance. To simplify storage management and to achieve separation of resources for each provisioning group, EMC recommends dedicating a particular LUN (or group of LUNs in a storage cluster) to a particular provisioning group only and not having different provisioning groups using the same LUN (or group of LUNs) for storage. Virtualization design For virtualization design considerations, refer to EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide. To simplify management and efficiently utilize resources, follow these practices: Create separate host clusters for each enterprise group (manufacturing, finance, accounting, and so on). Create separate reservations for each provisioning group within the enterprise. Note: You can create additional host groups under the parent host group if separation of Production, Test and Development, and Archive clouds is desirable. Dedicate a particular LUN to a specific provisioning group only. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 31

32 Solution Design 32 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

33 Solution Implementation Chapter 4 Solution Implementation This chapter presents the following topics: Overview Installing and configuring vcloud Management cluster Deploying vcloud Networking and Security Deploying vcac Deploying vcenter Operations Manager EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 33

34 Solution Implementation Overview This chapter introduces the steps and processes involved in deploying the solution. Table 3 lists the main stages in the solution deployment process along with links to the relevant information and procedures. Table 3. Deployment process stages and procedures Stage Description 1 Install and configure vcloud Management Cluster 2 Deploy vcac 3 Deploy vcloud Networking and Security 4 Deploy vcenter Operations Manager 5 Deploy vcenter Orchestrator Installing and configuring vcloud Management cluster Complete these tasks to install and configure a vcloud Management server: 1. Install the ESXi 5.5 hypervisor on the physical servers being deployed for the solution. Refer to the vsphere Installation and Setup Guide for more detail. 2. Configure ESXi networking including NIC trunking, VMkernel ports, and virtual machine port groups and Jumbo Frames. Refer to the vsphere Networking document for more detail. 3. Install and configure PowerPath/VE to manage multipathing for VNX LUNs (block only). Refer to PowerPath/VE for VMware vsphere Installation and Administration Guide for more detail (block storage only). 4. Connect the VMware datastores to the ESXi hosts deployed for the solution. Refer to the vsphere Storage Guide for more detail. Setting up and configuring SQL Server database Complete these tasks to set up and configure a Microsoft SQL Server database for the solution: 1. Create two virtual machines to host SQL Server for the Management and Production vcenter instances separately. Verify the virtual server meets the hardware and software requirements based on the resource sizing guide in Chapter 6. Refer to the Microsoft Developer Network webpage for more detail. Note: EMC recommends using SQL Server clusters for high availability. 2. Install Microsoft Windows Server 2008 R2 on the virtual machine created to host SQL Server. Refer to the Microsoft TechNet webpage for more detail. 3. Install SQL Server on the virtual machine designated for that purpose. Refer to the Microsoft TechNet webpage for more detail. 34 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

35 Solution Implementation 4. Create the database required for the vcenter server on the appropriate datastore. Refer to Preparing vcenter Server Databases for more detail. 5. Create the database required for Update Manager on the appropriate datastore. Refer to Preparing the Update Manager Database for more detail. Deploying management and production resource cluster vcenter servers Preparing a management cluster EMC integration Complete these tasks to deploy management and production resource cluster vcenter Servers: 1. Create two virtual machines to be used for management and production resource cluster vcenter Server. Refer to the vsphere Virtual Machine Administration Guide for details. 2. Install Windows Server 2008 R2 Standard Edition on the two vcenter host virtual machines. 3. Install VMware Tools, enable hardware acceleration, and allow remote console access on the two vcenter host virtual machines. Refer to the vsphere Virtual Machine Administration Guide for details. 4. Create the 64-bit vcenter and 32-bit vcenter Update Manager ODBC connections on the two vcenter host virtual machines. Refer to vsphere Installation and Setup and Installing and Administering VMware vsphere Update Manager for details. 5. Install vcenter Server software on the two vcenter host virtual machines. Refer to vsphere Installation and Setup for details. Complete these tasks to prepare and configure a vcenter management cluster: 1. Create a virtual datacenter for the management cluster. For details, refer to vcenter Server and Host Management. 2. Type the vsphere license keys in the vcenter licensing menu. For details, refer to vsphere Installation and Setup. 3. Connect management vcenter to management cluster ESXi hosts. For details, refer to vcenter Server and Host Management. 4. Create a management cluster and move the ESXi hosts into it. For details, refer to vsphere Resource Management. 5. Perform ESXi host discovery from the Unisphere console. For details, refer to Using EMC VNX Storage with VMware vsphere TechBook. This section provides guidance on integrating EMC VNX with VMware vsphere through VSI plug-in, VAAI and VASA. EMC VSI for VMware Refer to the VSI plug-in documentation for installing VSI. EMC VSI for VMware vsphere: Unified Storage Management Product Guide EMC VSI for VMware vsphere: Storage Viewer Product Guide EMC VSI for VMware vsphere: Path Management EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 35

36 Solution Implementation Once VSI has been installed on the client machine, find the EMC VSI icon in vsphere located under vsphere Client -> Solutions and Applications, as shown in Figure 7. Figure 7. EMC VSI installed and available under Solutions and Applications Verify that all newly installed VSI features were installed and enabled by checking feature manager. In our solution we installed Path Manager, Storage Viewer, and Unified Storage Management as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

37 Solution Implementation Figure 8. EMC VSI Feature Manager As part of the VSI installation, Solutions Enabler 7.6 is installed. Also, for VSI to obtain and present PowerPath/VE multipath details for the underlying storage, install the PowerPath Remote Tools for Windows package. VSI currently supports PowerPath Remote Tools version 5.7.b173, or later. Configure Solutions Enabler Configure Solutions Enabler by adding the hostname or IP address of the Solutions Enabler API server. Note: If you do not specify remote API server it will default to localhost. Discover VNX array To discover the VNX arrays, add the IP address of each storage processor and the login credentials and click discover new VNX system as shown in Figure 9. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 37

38 Solution Implementation Figure 9. EMC VSI: VNX Array Discovery Once the storage arrays have been discovered, the vsphere admin can get a more granular view of existing datastores. Select a host and select the EMC VSI tab, then highlight the desired datastore as shown in Figure 10 and Figure 11. Figure 10. EMC VSI : Block storage details and properties 38 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

39 Solution Implementation Figure 11. EMC VSI : File storage details and properties Unified Access Control Utility Overview EMC Unified Access Control provides a means to restrict vsphere administrators from provisioning storage on specific storage pools within a given array. By providing this control, storage administrators can build designated storage pools dedicated for vsphere administrators to provision storage as needed. Alternatively, the storage administrator can allow provisioning to all current and future pools. VSI Path Management Before using Path Management, be sure that RTOOLS is installed on the host running VSI and that the host has appropriate licenses. To manage paths through VSI: 1. Right-click the desired vsphere cluster, and select EMC > Set Multipathing Policy, as shown in Figure 12. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 39

40 Solution Implementation Figure 12. Set multipathing policy 2. Select the device type and desired policy from Select Multipathing Policy as shown in Figure 13. Figure 13. Select NMP and PowerPath/VE multipathing policies for VNX devices 40 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

41 Solution Implementation VMware vstorage APIs for Array Integration (VAAI) To verify that VAAI is working correctly, from the Configuration tab, under Hardware -> Storage, find the column in the datastores view labeled Hardware Acceleration as shown in Figure 14. This column indicates the support status for the device or datastore. There are three possible values that can populate this column: Supported, Not Supported, or Unknown. More detailed information on VMware VAAI with EMC VNX can be found in the VMware vstorage APIs for Array Integration with EMC VNX series for SAN White Paper. Figure 14. Viewing VAAI support in the vsphere Client for VNX storage VMware vsphere Storage APIs for Storage Awareness (VASA) VASA is commonly used to enable profile driven storage where a virtual machine is attached to a storage capability and is then matched and placed on a suitable datastore of the same capability profile. This solution uses VASA functionality to organize datastores of identical attributes and capabilities and place them in datastore clusters, configured for each business organization, where they can take advantage of Storage DRS to maximize capacity utilization. Configuring VASA Storage Provider on VNX The VASA provider for VNX is available by default, with no additional user configuration required. 1. Set up storage profiles on the vcenter server by starting VMware vsphere Profile Driven Storage Service in Windows Services as shown in Figure 15. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 41

42 Solution Implementation Figure 15. Start Profile Driven Storage service on vcenter server 2. Once the agent is running, move the VM Storage profiles to the vsphere Client by selecting Home -> Management -> VM Storage Providers, as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

43 Solution Implementation Figure 16. VM Storage Profiles in vsphere Client 3. Click Add, as highlighted in Figure 17, and enter the relevant details for the VNX storage array, including: Array name and administrative login details URL of the provider service on VNX, for example, EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 43

44 Solution Implementation Figure 17. Add VNX Provider details 4. Once the details are accepted and the array is successfully added, the array is displayed in the vendor provider list, as shown in Figure 18. Figure 18. New EMC VNX vendor provider added VNX EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

45 Solution Implementation 5. Specific VNX provider details and status are displayed under Vendor Provider Details, which can also be manually synchronized from this section. 6. View the complete list of storage capabilities which the VASA provider presents to the Storage Profiles service in vcenter by selecting Home-> Management->VM Storage Profiles and click Manage Storage Capabilities, as shown in Figure 19. This list is initially shows all system-defined storage capabilities which, depending on the storage type being presented, are automatically detected by VASA and displayed in vsphere as part of datastore details. Figure 19. Storage capabilities presented to vcenter by VNX Provider You can manually enter customized storage capabilities to more accurately reflect or represent a service or configuration that is not system-defined, as highlighted in the example in Figure 20. To add a user-defined storage capability, click Add within Manage Storage Capabilities, as shown in Figure 20. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 45

46 Solution Implementation Figure 20. Add user-defined storage capability for VNX storage This user-defined storage capability can be assigned to single or multiple datastores. For this solution, it is assigned to all members of a datastore cluster, as shown in Figure 21. Figure 21. Assign user-defined storage capability to datastore cluster In the vsphere Client, you can view the system-defined and user-defined storage capabilities for each member of this datastore cluster, as shown in Figure 22, where the user-defined storage capabilities have been fully expanded into view. 46 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

47 Solution Implementation Figure 22. System and user-defined storage capabilities displayed in vsphere Deploying vcloud Networking and Security In the private cloud, the VMware vcloud Networking and Security (vcns) feature can provide firewall, VPN (Virtual Private network), Load Balancer, VXLAN, NAT (Network Address Translation), HA (High Availability), Data Security, Endpoint, and vcloud Ecosystem Framework. Complete these tasks to deploy vcloud Networking and Security. More detail for performing each task is provided in the VMware vcloud Networking and Security Documentation. Note: vcns documentation and UI still use the vshield product name. 1. Install and configure vshield Manager. Deploy the OVF template downloaded from the VMware website and configure. 2. Configure the network settings of the vshield Manager. Assign the IP address, gateway, and DNS to the vshield Manager through the CLI (command line interface). 3. Log in to the vshield Manager User Console. Open a web browser and navigate to the IP address just assigned to the vshield Manager. 4. Set up vshield Manager. Specify settings for vcenter Server, DNS and NTP server, and Lookup server details. 5. Install the vshield license through vsphere Client. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 47

48 Solution Implementation Deploying vcac Complete the tasks described in this section to deploy the vcac components. Database server vcac web server vcac server Manager Service VMware recommends that you deploy a dedicated server running Microsoft SQL Server to host the vcac database. Create the database server by following these steps: 1. Prepare one vcac authorization store. Choose one type of vcac authorization store (SQL-based, Active Directory-based, or file-based) and create it. For more information, refer to the vcac 5.2 Installation Guide. 2. Install Microsoft.Net Framework 4.5 in the database server. 3. Install and run the vcac Prerequisite Checker for Database components. 4. Create the vcac database by using the vcac wizard. Install the vcac web server by following these steps: 1. Create a virtual machine to be used for the vcac web server. For more information, refer to the vsphere Virtual Machine Administration Guide. 2. Install the vcac web server guest operating system, on the vcac web server virtual machine. Refer to the vcloud Automation Center Support Matrix. 3. Update the virtual machine by installing VMware Tools, enabling hardware acceleration, and allowing remote console access. For more information, refer to the vsphere Virtual Machine Administration Guide. 4. Install Microsoft.Net Framework Install the IIS Server Role with role services as specified in Installing IIS 7 on Windows Server 2008 or Windows Server 2008 R2, 6. Install and run the vcac Prerequisite Checker for web components. For more information, refer to the vcac 5.2 Installation Guide. 7. Install vcac web components. Install and configure the administration website, reports website, and the model manager. Set up the vcac server Manager Service by following these steps: 1. Create a virtual machine to be used for the vcac server Manager Service. 2. Install Windows Server 2008 R2 SP1, which is the vcac server guest operating system, on the vcac server virtual machine. 3. Update the virtual machine by installing VMware Tools, enabling hardware acceleration, and allowing remote console access. 4. Install Microsoft.Net Framework Install the IIS Server Role with role services as specified in Installing IIS 7 on Windows Server 2008 or Windows Server 2008 R2. 6. Install and run the vcac Prerequisite Checker for Manager Service and DEM Worker and Orchestrator Service components. 48 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

49 7. Install and configure the vcac Manager Service. 8. Install the DEM Orchestrator in the same virtual machine. Solution Implementation DEM worker server vcloud Suite integration (configuring endpoint) Create a DEM worker server by following these steps: 1. Create a virtual machine to be used for the DEM Worker server. 2. Install the guest operating system on the DEM Worker server virtual machine. Refer to the vcloud Automation Center Support Matrix 3. Install VMware Tools, enable hardware acceleration, and allow remote console access. 4. Install Microsoft.Net Framework Install and run the vcac Prerequisite Checker for DEM Worker and Orchestrator Service components. 6. Install the DEM Worker in the virtual machine. 7. Create a virtual machine to be used for the vcac Proxy Agent Machine. 8. Install the guest operating system on the vcac Proxy Agent Machine virtual machine. Refer to the vcloud Automation Center Support Matrix. 9. Update the virtual machine by installing VMware Tools, enabling hardware acceleration, and allowing remote console access. 10. Install Microsoft.Net Framework Install and run the vcac Prerequisite Checker for DEM Worker and Orchestrator Service components. 12. Install the DEM Worker in the virtual machine. vcac uses vcenter as an endpoint to allocate resources to different enterprises within the business. Complete these tasks to configure the Production Resource vcenter as an endpoint in vcac: 1. Log in to the vcac web console and start configuration. Open a web browser and navigate to as the vcac administrator. Refer to the vcac 5.2 Installation Guide for more information. 2. Create one new resource vcenter Credential under vcac Administrator- Credentials. Create a username and password to connect to your resource vcenter Server. 3. Create the resource vsphere (vcenter) Endpoints under vcac Administrator- Endpoints. 4. Create a virtual machine to be used for the vcac Proxy Agent Machine. For more information, refer to the vsphere Virtual Machine Administration Guide. 5. Install Windows Server, the vcac Proxy Agent Machine guest operating system, on the vcac Proxy Agent Machine virtual machine. 6. Update the virtual machine by installing VMware Tools, enabling hardware acceleration, and allowing remote console access. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 49

50 Solution Implementation 7. Install Microsoft.Net Framework Install the vsphere Proxy Agent and provide the Endpoint name created in Step 3. Deploying vcenter Operations Manager Complete these tasks to deploy the vcenter Operations Manager: 1. Download the OVA file for vcenter Operations Manager from VMware s distribution website. This vapp installs two virtual machines: UI VM and Analytics VM. For more information refer to VMware Downloads. 2. Refer to the vcenter Operations Manager vapp requirements to understand the resources required for the vapp based on the scope of the resources that will be monitored. For more information, refer to the vcenter Operations Manager vapp Deployment and Configuration Guide. 3. Use the IP pools configuration option through vsphere Client to assign the network base address, netmask, and default gateway that will be assigned to a network used by the vapp. 4. Deploy the vcenter Operations Manager vapp from the vsphere Client. Set the ESXi host time, define the vcenter to be monitored, and assign a license to the vapp. 5. Configure the Chargeback Manager database to allow the maximum number of connections from the different components used by Chargeback Manager. 6. Verify the install through the vsphere Client and through a browser. vcloud Suite Integration vcenter Operations Manager (vcops) enables you to manage vcenter objects and resources. The Management vcenter and Production vcenter are added to vcops. To add a vcenter Server instance to vcops, refer to the vcenter Operations Manager vapp Deployment and Configuration Guide. EMC Integration Integrating vcenter Operations with the EMC Storage Analytics Suite enables full endto-end visibility of your entire infrastructure from virtual machine to LUN and every point inbetween. This enables IT administrators to quickly visualize the health of the EMC arrays (both block and file) using a simple Performance-at-a-glance tab. 50 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

51 Solution Implementation Figure 23. EMC Storage Analytics with VMware vcenter Operations Manager EMC Storage Analytics (ESA) links VMware vcenter Operations for storage with EMC Adapter for VNX. vcenter Operations Manager displays performance and capacity metrics from EMC storage systems with data that the adapter provides by: Connecting to and collecting data from block and file systems. Converting the data into a format that vcenter Operations can process. Passing the data to the vcenter Operations collector. vcenter Operations Manager presents the aggregated data through alerts, dashboards, and in predefined reports that end users can easily interpret. EMC Adapter is installed with the vcenter Operations administrative user interface. To install and configure EMC Storage Analytics with VMware vcenter Operations Manager refer to the EMC Storage Analytics for VNX Installation and User Guide. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 51

52 Solution Verification Chapter 5 Solution Verification This chapter presents the following topics: Overview Verifying vsphere implementation vcns implementation Verifying vcac implementation vcenter Operations Management EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

53 Solution Verification Overview This chapter shows how to verify that the vcloud components were implemented correctly and that the VSPEX private cloud can be managed successfully to deliver infrastructure as a service. Verifying vsphere implementation This section shows how to verify the implementation of vsphere and integration software. Preparing production vcenter resources VSI operations Perform these tasks to prepare the production resource vcenter so that it can be used as an endpoint in vcac. This section assumes that the second vcenter Server instance has already been installed according to the steps detailed in Chapter Create a virtual datacenter for the production resource cluster. For more information, refer to the vcenter Server and Host Management Guide. 2. Type the vsphere license keys in the vcenter licensing menu. For more information, refer to the vsphere Installation and Setup Guide. 3. Connect the resource vcenter to the resource cluster ESXi hosts. For more information, refer to the vcenter Server and Host Management Guide. 4. Create a different resource cluster for the tenant departments (such as finance and manufacture) and move the correct ESXi hosts into them. For more information, refer to the vsphere Resource Management Guide. 5. Perform ESXi host discovery from the Unisphere console. For more information, refer to Using EMC VNX Storage with VMware vsphere TechBook. Through the VSI plug-in LUNs can be created on storage pools on the VNX and presented to clusters within vcenter. This section assumes that a storage pool designed according to VSPEX private cloud recommendations already exists on the VNX. Create and assign LUNs with EMC VSI After the storage pool has been created, configure, mask, and format the LUNs as VMFS datastores through the EMC VSI: 1. Right-click the vsphere cluster to which the new storage will be assigned, and select EMC > Storage Manager > Provision Storage, as shown in Figure 24. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 53

54 Solution Verification Figure 24. Launch EMC VSI storage provisioning wizard from vsphere Client 2. From this point, the vsphere administrator is guided through a process which will result in a newly created VMFS datastore being mounted on all ESXi hosts in the vsphere cluster with access to the storage array. For more information on provisioning storage through the VSI plug-in refer to EMC VSI for VMware vsphere: Unified Storage Management Product Guide Version When you click Finish, the EMC VSI wizard: Configures the LUN. Masks the LUN to the vsphere cluster on the array. Rescans the ESXi server HBAs. Formats and mounts the datastore to the ESXi servers in vsphere. Figure 25 shows the tasks that are completed. 54 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

55 Solution Verification Figure 25. Summary of vsphere tasks executed by EMC VSI when provisioning storage As a result, the new VMFS datastore is mounted and immediately available for use across all ESXi members of the vsphere cluster, as shown in Figure 26. Figure GB VMFS datastore EPC_Prod2_Fin_LUN11 available as a storage resource This solution uses EMC PowerPath/VE on all ESXi servers for multipathing for all SAN storage. PowerPath/VE claims the new device once it is mounted to the ESXi server, therefore no user interaction is required. To access path management details for a storage device, right-click a datastore and select Manage Paths, as shown in Figure 27. Note: Alternatively, in the Device List under the Storage Adapters, where the device owner is displayed as PowerPath, right-click and select Manage Paths. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 55

56 Solution Verification Figure 27. Path management details for newly created 200 GB LUN/datastore All of the available paths for the device managed by PowerPath/VE show as Active. As shown in Figure 27, this device has four active paths because each of the two HBAs on this ESXi server is zoned to a single VNX array port on SPA and SPB. PowerPath/VE optimizes load balancing of I/O across these paths, nondisruptively manages any path failures, and automatically restores any failed paths when made available again. This process for storage provisioning with the EMC VSI should be repeated for each LUN required. For this solution, we created five similar-sized datastores from the Prod-2 storage service level storage pool for the Finance Organization. Configure datastore clusters in vsphere Once all five datastores have been provisioned successfully, the next step is to create a datastore cluster in vsphere and place the five datastores into it. A datastore cluster is created by using the new Datastore Cluster wizard in vcenter. When configuring the datastore cluster, enable the Storage DRS feature with the Fully Automated option. Retain the default settings in the SDRS Runtime Rules, as this solution does not use the I/O metric-based load balancing because storage is FASTenabled on the array. For instructions and guidance on configuring and creating datastore clusters in vcenter, refer to VMware vsphere 5 Documentation Center: Creating a Datastore Cluster. Once the wizard has completed, the datastore cluster is fully configured in vsphere, as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

57 Solution Verification Figure 28. Datastore cluster fully configured in vsphere Verifying vcns implementation vcns VXLAN enables technology for network virtualization, providing network abstraction, elasticity, and scale across the datacenter without any physical network reconfiguration. Separating tenant networks Multiple virtual wires or logical networks can be created using VXLAN to provide isolation for various tenants or provisioning groups within the business. Complete these tasks to create a VXLAN to separate tenant networks: 1. Prepare the network for VXLAN virtual wires. Ensure the current software and hardware environment meets the prerequisites for creating VXLAN, the prerequisites can be checked in VMware vcloud Networking and Security Documentation. 2. Associate resource clusters with distributed switches. Log in to the vsphere Client and map each resource cluster to the distributed switch. 3. Assign the segment ID pool and multicast address range. In the vsphere Client, assign the segment ID and multicast address range to vshield Manager under Inventory -> Hosts & Clusters, select a datacenter resource, and under Network Virtualization -> Preparation -> Segment ID. 4. In the vsphere Client, add a network scope under Inventory -> Hosts & Clusters -> Network Virtualization -> Network Scope. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 57

58 Solution Verification 5. In the vsphere Client, add a VXLAN virtual wire under Inventory -> Hosts & Clusters -> Network Virtualization -> Network. This step adds a separate VXLAN virtual wire for provisioning groups. After creating virtual wires or logical networks for provisioning groups, vcns license activated components such as vcns Edge gateway and vcns App can be used to provide networking services and security within the business. For more information on configuring VXLAN and edge gateway services, refer to the VMware VXLAN Deployment Guide. Verifying vcac implementation vcac provides the ability to divide a shared infrastructure into logical units and logical capacities. These can, in turn, be handed over to different business units where users can choose from a self-service catalog of customized virtual machine blueprints. The resource clusters supporting the various organizations within the enterprise are managed by a vcenter server located in the management cluster. This vcenter server operates as the vsphere end-point for VMware vcac, to which all of the underlying vsphere resources are made available. This section explains how to: Create enterprise groups and Provisioning groups within vcac to enable multitenancy by allocating and reserving resources through the vsphere endpoint configured in Chapter 4. Set up vcac blueprints and making them available to groups within the enterprise. Create and request virtual machines through blueprints. Reconfigure and decommission virtual machines through a self-service portal. Cloud roles and resource administration vcac is built to work with existing infrastructures. It supports the differing requirements of an enterprise s many business units and integrates with a wide variety of existing IT systems and best practices. A number of user roles and responsibilities are defined and used in the structure of vcac. The administration of users and compute resources in vcac is managed through the vcac console, which is the administrative portal. The relevant groups, users, and roles are summarized in the following sections: Cloud administrator Enterprise groups Provisioning groups 58 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

59 Solution Verification Cloud administrator The cloud administrator role is responsible for configuring resource endpoints and enterprise groups, where enterprise group administrators and their respective compute resources need to be defined. A primary task of the cloud administrator is to configure the endpoints which vcac then uses for provisioning compute resources and operations. In this solution, the Production vcenter was added as a vsphere endpoint called vsphere (vcenter) which is used by vcac for compute resources. The configuration of the endpoint is displayed in Figure 29. Figure 29. Endpoint configurations for vcac The cloud administrator is responsible for creating enterprise groups and assigning compute resources to them. Figure 30 highlights the compute resources of the Manufacturing cluster in vsphere being selected to support the WayneEnterpriseMfg group. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 59

60 Solution Verification For more information on creating enterprise groups and cloud administrator operations, refer to the vcloud Automation Center Operation Guide. Figure 30. Enterprise groups created and managed by vcac cloud administrator Figure 31. Enterprise groups resource defined vcac cloud administrator Enterprise groups Enterprise groups contain enterprise administrators who manage their respective cloud resources, as defined by the cloud administrator. Enterprise administrators are 60 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

61 Solution Verification responsible for configuring and creating provisioning groups for individual departments and resource reservations and customizations for network, storage, compute and cost profiles. Distributed virtual port groups created on the vsphere distributed switch are available as network paths to be selected when creating a reservation. Logical networks created through vcns are also available as network paths to be selected. Approval groups and policies are also defined by the enterprise administrator. Creating vsphere virtual resource reservation and cost profile The enterprise administrators can create a vsphere vcenter virtual reservation, which is a share of one virtualization compute resource s resources dedicated to a particular provisioning group for use in provisioning virtual machines. The reservation policies can be used to classify the reservation. Figure 32. Storage resource reservations as managed by the vcac enterprise administrator The storage administrator can create different kinds of storage pools based on different arrays, like a gold class based on a VSPEX storage pool and a silver class consisting of all SAS drives in a RAID5 configuration (refer to Appendix A). Then the enterprise administrator can tag them in different reservations, as shown in Figure 33. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 61

62 Solution Verification Figure 33. Assigning cost profiles Figure 34 displays the configured provisioning groups for the Finance and Manufacturing departments. The provisioning group WayneEntMfgProvGrp1 is highlighted, and contains provisioning group managers responsible for the Manufacturing department. Figure 34. Provisioning groups managed by vcac enterprise administrator A cloud or enterprise administrator can edit this provisioning group to define the group manager, support, and user roles for the Manufacturing department. The enterprise administrator has the responsibility of assigning compute, storage, and network resources and making them available to the provisioning group manager. In this solution the resources are carved from the cluster in vsphere allocated to this enterprise. Resources can be reserved by the enterprise 62 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

63 Solution Verification administrator for their provisioning groups using reservation policies. These policies cover reservations across memory, storage, and network resources. For more information on creating provisioning groups, reserving resources, and reservation policies, refer to the vcloud Automation Center Operation Guide. Provisioning groups The users in these provisioning groups are the users and consumers of the infrastructure provided to them by their enterprise administrator: Provisioning Group Manager (PGM) A PGM can access all virtual machines, create and publish blueprints for end users, manage approval requests, and work on behalf of other users in their group. Support user role This is a helpdesk user whose role enables them to work on behalf of other group users where required for troubleshooting and support. User role These users are the end users in the context of vcac, who can deploy from the blueprints made available to them by the PGM. Those users in the user role are the primary consumers of the vcac self-service user portal from where they can provision and manage their virtual machines. The deployment of blueprints may be subject to approval by the PGM. This approval policy is set on a per-blueprint basis by the PGM, as highlighted in Figure 35. For more information on roles within a provisioning group refer to the vcloud Automation Center Operation Guide. Figure 35. Blueprint approval policy as set by provisioning group manager This solution environment, as an example, is based around a fictional company named Wayne Enterprises, which contains two production organizations: Manufacturing and Finance. These organizations are supported by users in the IT department who are directly responsible for supporting the systems and applications of each organization. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 63

64 Solution Verification vcac blueprints A blueprint is the complete specification for a virtual machine, determining the machine s attributes, the manner in which it is provisioned, and its policy and management settings. When a user requests a machine through the self-service portal, they must select the blueprint from which it will be created. Blueprints specify the workflow used to provision a machine and define the build profiles containing additional provisioning information as needed. The blueprint also sets the policies that apply to a machine, such as any approvals required, expiration date, and owner operations. When a blueprint is created, information is specified using controls in the console and custom properties. A local blueprint is created by a PGM for a single provisioning group and is available only to that group s members. A global blueprint is created by an enterprise administrator or PGM and can be selected for inclusion among a provisioning group s local blueprints by the PGM. Blueprints can be single or multi-machine, including multi-tier enterprise applications which require multiple components (application, database, or web). A multi-machine blueprint contains multiple individual machine blueprints. Creating blueprints Enterprise administrators and PGMs (or a user who is both) can create blueprints. A user who is both an enterprise administrator and a PGM can choose whether to create a global blueprint, which is available to all provisioning groups, or a local blueprint which is confined to a single group. To create a local blueprint: 1. Log in to the vcac console as a PGM. 2. Select Provisioning Group Manager -> Blueprints in the activity pane 3. Click New Blueprint and select Virtual, as shown in Figure 36. Figure 36. Create new VMware vsphere virtual machine blueprint You can create a blueprint from the beginning or copy it from an existing master blueprint. Copying an existing master blueprint may be useful or more efficient in circumstances where the new virtual machine shares a large number of identical properties, meaning less customization is required in building the blueprint. 64 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

65 Solution Verification Blueprint creation involves completing information across four separate tabs: Blueprint Information Build Information Properties Security Each of the four tabs contains several input fields which combine to define the final product of the blueprint. Blueprint Information The new blueprint is set as a master blueprint which then allows it to be copied for subsequent blueprint creation. Other properties such as reservation policy, provisioning group and virtual machine name prefix, and machine daily cost are configured here, as well as specifying that this blueprint requires the approval of the provisioning group manager when deployed by users. The process of creating a new blueprint is shown in Figure 37. Figure 37. Create new blueprint Build Information In the next tab, Build Information, the blueprint type is set for Server and the Clone action is selected which means that a cloning workflow will take place, based on an existing template in vsphere. In this example, a number of standard Windows and Linux virtual machine templates are pre-built in vsphere. Select the desired template by clicking next to the Clone from text field, as highlighted in Figure 38. The Windows2008R2SP1 template is selected for this example. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 65

66 Solution Verification Figure 38. Select vsphere template to clone from The virtual machine resources are, at a minimum, set to how the template is configured. The blueprint can be set to allow these values to be increased at a later stage up to a maximum value. Figure 39 shows where to set the machine resources maximums and where to specify the storage service level (Storage Reservation Policy). Figure 39. Complete build information for new blueprint 66 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

67 Solution Verification For this example, the minimum machine resources are inherited from the vsphere template and the maximum values have been manually set at double the minimum values. This means that at deployment time, this virtual machine can be deployed with up to the maximum values. Later in this configuration, we provide cloud users with the ability to reconfigure the virtual machine resources after deployment. Properties The Properties tab contains a selection of build profiles. Some are specific to each operating system, while others are applicable to all virtual machines. A build profile contains a set of properties to be applied to a machine when it is provisioned. For this blueprint, we selected a build profile specific to Windows Server 2008 and Windows 2012 virtual machines. The selection process is shown in Figure 40. Figure 40. Select custom build profiles for virtual machine Security Finally, for this blueprint creation, in the Security tab we specify which users can access this blueprint, and specify machine operations and reconfiguration options, as shown in Figure 41. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 67

68 Solution Verification Figure 41. Enable virtual machine operations for cloud user For more details on creating virtual machine blueprints refer to the vcloud Automation Center Operating Guide v5.2. Deploy virtual machines from blueprints After the blueprint has been created, it is then available for cloud users to deploy from the user self-service portal, as shown in Figure 42. Figure 42. Deploy new virtual machine blueprint from self-service portal Reconfigure existing virtual machine The PGM enables a cloud user to reconfigure one of their virtual machines in the blueprint. A machine owner can make any of the following changes to a provisioned machine: Increase or decrease memory 68 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

69 Increase or decrease the number of CPUs Solution Verification Modify storage by adding, removing, or increasing the size of volumes (SCSI disks only) Modify networks by adding, removing, or updating network adapters Changes to each of these parameters are subject to the limits defined in the blueprint that was used to provision the machine originally. Figure 43 highlights an example of a virtual machine owner reconfiguring the storage resources of a virtual machine from the self-service portal. Figure 43. Reconfigure virtual machine resources from self-service portal Reconfiguration requests can also be made subject to approval, as with provisioning requests. When the request is approved, the reconfiguration is ready to be executed. This is shown in Figure 44. Figure 44. Set execution options for virtual machine reconfiguration EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 69

70 Solution Verification The three options for when to execute the reconfiguration are: Immediate The reconfiguration is automatically queued for execution after all required approvals have been given. Scheduled The machine owner specifies a date and time to execute the reconfiguration. Execution can be rescheduled if the request is not approved until after the scheduled time. Queue for Owner The reconfiguration must be triggered manually by the machine owner after all approvals have been given. Decommission a virtual machine When the machine s lease expires, or the machine is manually expired, the machine is either archived or destroyed, depending on whether its blueprint specifies an archive period. When the end of the archive period is reached, or if there is no archive period, the virtual machine is destroyed, as shown in Figure 45. Figure 45. Decommissioning a virtual machine Chargeback and metering This private cloud environment requires flexible metering and costing models that can account for the utilization of all resources within the environment. VMware vcac contains a built-in cost reporting solution for all the physical and virtual resources allocated and consumed within the private cloud. Managing the lifecycle of cloud resources by reclaiming unused, underutilized, or expired resources is also measured and captured by the vcac reporting portal, along with estimated savings associated with the reclaimed resources. Note: The scope of this reporting functionality is limited to the resources consumed within VMware vcac. The vcac reporting portal is available to the following users: Support user Provisioning group manager Enterprise administrator vcac administrator 70 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

71 Solution Verification Any of these users can access the vcac reports web site by clicking Reports in the activity pane. Report types The first available, or top-most, report is the Executive Summary report (shown in Figure 46) which provides an overview of provisioning and resources for the entire vcac site, by machine types of virtual, physical, and cloud. The scope of this solution includes virtual resources; therefore all reports in this section reflect this. Figure 46. Executive Summary Virtual for vcac virtual machines Included in this Executive Summary report, as shown in Figure 46, are graphics representing the distribution of virtual machines by blueprint, group, state, and reservation. The table provides totals for physical, reserved, allocated and used virtualization resources. More general capacity usage reports are also available in the vcac reporting portal. The capacity usage reports, as displayed in Figure 47, provide breakdowns of machine quota, memory, and storage usage by provisioning group, virtualization compute resource, machine owner, and blueprint. Only provisioning groups with reservations of the selected type are displayed. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 71

72 Solution Verification Figure 47. Manage compute resource cost and storage cost profiles Figure 47 displays the capacity usage, filtered by group, for both the Finance and Manufacturing organizations used in this solution. This report shows resources reserved, allocated, and used by all provisioning groups. The summary table is broken into three columns containing capacity usage information for virtual machine, memory, and storage. Cost profiles To enable calculation of a machine s cost for display to machine owners, requesters and administrators, and for chargeback reporting, you can associate each virtualization compute resource with a cost profile. Additionally, for finer definition of storage cost for virtual machines, you can also associate each known vcac storage path (datastore/lun) on a compute resource with a storage cost profile. A daily cost can also be specified in each blueprint. Cost profiles and daily blueprint cost are optional. Cost profiles are assigned to compute resources by enterprise administrators. Blueprint costs are specified by enterprise administrators for global blueprints and PGMs for local blueprints, as shown in Figure 48. Figure 48. Manage compute resource cost and storage cost profiles 72 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

73 Solution Verification For this solution, a storage cost profile has been created to represent each of the storage service levels presented and available within VMware vcac. Figure 49 displays all cost profiles in this solution. Enterprise administrators can assign or change a compute resource s cost profile using the Edit compute resources page. Each cost profile specifies these costs: Compute resource cost A daily cost per GB of memory capacity specified in the virtual blueprint or installed in the physical machine CPU cost A daily cost per CPU specified in the virtual blueprint or installed in the physical machine Storage cost A daily cost per GB of storage capacity as specified in the virtual blueprint Storage cost profile A storage cost profile, highlighted in red in Figure 49, contains only a daily cost per GB of storage. If you assign a storage cost profile to a datastore or LUN, this storage cost overrides the storage cost in the cost profile, highlighted in blue in Figure 49, assigned to the compute resource, if any. These daily costs are added to that specified in the blueprint, if any to be displayed and charged back to machine owners and provisioning groups. Also included in the Configuration tab for the vcac compute resources is the Storage Reservation Policy. This policy has been aligned with the storage cost profiles for the associated datastore clusters. Figure 49. Edit vcac compute resource cost and storage cost profiles Chargeback reports Taken together, the combined costs enable the generation of daily costs per machine, and chargeback reports totaling these costs for each machine and for all machines on EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 73

74 Solution Verification each reservation over a specified period. Once the appropriate cost profiles have been created and assigned to the relevant resources in vcac, then the chargeback section of the vcac reporting portal provides access to a number of chargeback reports. From the vcac reporting portal, chargeback reports can be separated and calculated by machine type, physical or virtual, and can be viewed as follows: Chargeback by Group by Allocated Resources Chargeback by Group by Reservation Chargeback by Owner by Allocated Resources The reports can be filtered by date, provisioning group, and machine type. Chargeback by Group by Allocated Resources: This report (shown in Figure 50) shows the cost for all provisioning groups or a selected provisioning group of all machines or all machines of a selected type owned by members of the group, over a specified period of time. For example, you can see the cost of virtual machines owned by a particular group during a particular week, or by all provisioning groups over a year. Costs are shown for individual machines and totaled for all machines owned by a provisioning group. Figure 50. Chargeback by group allocated resources The chargeback report displayed in Figure 50 is filtered by date for one month, by Provisioning Group (WayneEntMfgProvGrp2), and by Machine Type (Virtual). Included 74 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

75 Solution Verification in the output of this report are the daily charges, the number of days charged for each, their total cost, and the combined cost of all machines for the provisioning group. Chargeback by Owner by Allocated Resources: This report shows the cost for all machines owners or a selected owner of all machines or all machines of a selected type owned, over a specified period of time. For example, you can see the cost of machines of all types owned by a particular owner during a particular week, or by all owners over a year. Costs are shown for individual machines and totaled for all machines owned by a user. The chargeback report displayed in Figure 51 contains chargeback information for two provisioning groups: WayneEntMfgProvGrp1 and WayneEntMfgProvGrp2. This report has been run by the mfgit user who is an enterprise administrator for the Manufacturing organization; therefore this user will only see information specific to provisioning groups in their own organization. The total costs stated in this report are totals for the amount of compute resources reserved for these provisioning groups. These costs for reservations are irrespective of how much of those resources are actively being consumed. Figure 51. Chargeback by group by reservation Chargeback by Owner by Allocated Resources: This report shows the cost for all machines owners or a selected owner of all machines or all machines of a selected type owned, over a specified period of time. For example, you can see the cost of virtual machines owned by a particular owner during a particular week, or by all owners over a year. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 75

76 Solution Verification Figure 52. Chargeback by owner by allocated resources The chargeback report in Figure 52 is filtered to report on the total cost of virtual machines owned by an application orientated owner in the manufacturing organization named mfgappowner. The time period for this report is for the past month. The output of this report contains the daily charges per individual virtual machine, the number of days charged for each virtual machine, their total cost, and the combined cost of all machines for that owner. Reclamation reports Reclamation reports provide information on all machines or machines of a particular type that have been reclaimed (destroyed or decommissioned) during a particular period. This includes machines destroyed or decommissioned after lease expiration or manual expiration or machines manually destroyed or decommissioned, as well as virtual machines destroyed by a reclamation workflow initiated by an enterprise administrator. 76 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

77 Solution Verification Figure 53. Dashboard for reclaimed virtual machines in the enterprise private cloud The Reclaimed Resources Dashboard report, as displayed in Figure 54, totals reclaimed machines, or machines of a selected type, during the last 7, 30, 90, and 365 days. Further detail can be gained with regard to who the reclaimed virtual machine owners were and what the operational savings were due to the reclamation. Figure 54. Reclamation Savings by Owner report The Reclamation Savings by Owner report, as displayed in Figure 54, shows information for each owner of one or more machines reclaimed since the specified start date. The savings quoted in this report are based on the difference between the hypothetical cost of all machines owned by the provisioning group since the specified start date if no machines had been reclaimed, and the actual cost including machine reclamation. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 77

78 Solution Verification vcenter Operations Management Managing operations in cloud environments includes ensuring service levels, problem solving, troubleshooting, and preventative maintenance. Successfully meeting these requirements involves analysis of current utilization, forecasting of future needs, and the optimization of current resource consumption by reclaiming underutilized resources. The in-depth infrastructure and operations information provided by VMware vcenter Operations Management (vcops) eliminates time-consuming problem resolution processes through automated root cause analysis. Self-learning performance analytics and dynamic thresholds adapt to the environment to simplify operations management and eliminate false alerts. Integrated smart alerts for health, performance, and capacity degradation identify performance problems before they affect end users. Advanced capacity analytics allow administrators to optimize virtual machine density and identify capacity shortfalls before they affect end users. The VMware vcenter Operations Management Suite Enterprise Edition provides flexibility with advanced features that extend monitoring, analytics, and reporting capabilities and it is suitable for solutions of any size. Monitoring vcenter objects and resources This VSPEX IaaS solution uses vcops to monitor both the management layer and the compute resources used in production. VMware vcops is not integrated with, or aware of, VMware vcac v5.2, and therefore has no concept of what resources are owned by vcac. However, both the Management and Production (vcac resources) components are managed by separate vcenter servers, which means their respective resources can be managed and monitored separately in vcops. vcenter Operations Manager dashboard Once implemented and configured, the vsphere UI provides a comprehensive insight into the environment, as shown in Figure 55. The main dashboard is divided into three logical entities providing high-level information about the current overall health and issues of all managed resources, potential future issues and risks in the environment, and resource efficiency trends in the environment. Figure 55. vsphere UI dashboard high level overview 78 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

79 The three primary logical entities in vcops can be explained as follows: Solution Verification Health calculates health scores based on patented algorithms that dynamically calculate thresholds by observing the behavior trends of the cloud environment and gives visibility into the red, yellow, green status of the virtual machines, datastores, and clusters. You can see where the problems are, what the issue is, and if there is any pattern of abnormal behavior in the environment. Risk provides insight into the resource consumption to tell you not only when you will run out of capacity but also which resources will run out. Efficiency aims to be proactive in order to optimize your environment and reclaim waste. vcops badges vcenter Operations Manager uses badges to illustrate derived metrics to provide an overview of the state of the virtual environment or an individual object. These badges serve as focus points to narrow the scope of a potential problem and provide details about the cause of the problem. Major and minor badges are color coded and range from a healthy green to a potentially problematic yellow, orange, or red. Badges are organized in a simple hierarchy in which the scores of minor badges contribute to the scores of major badges. Scores might reflect a healthy state or a potential problem depending on the type of badge. For example, low scores for health, time remaining, and capacity remaining might indicate potential problems, while low scores for faults, stress, or anomalies indicate a normal state. Navigation and troubleshooting The vcops dashboards provide a wide number of different insights into infrastructure condition and enable simple and easy analysis of the root cause of problems. For example, while the overall environment condition for health is represented with a green badge value of 97, by hovering the mouse over one of red marked areas on the Health Weather Map we get brief information about a fault. In the example used in Figure 56, the red icon on the bottom row of the Health Weather Map is related to a particular VNX data store, indicated with a Health value of 0 and 100 value for Faults. Note that there is only a single fault, but the 100 value represents a percentage faulted. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 79

80 Solution Verification Figure 56. Health dashboard showing immediate issues in environment Double click this red area to display further details about the issue. vcops automatically navigates the view to the source of the issue, which in this example is VNX-based datastore, VNX-VSI-DS02. Select the Faults badge to show more comprehensive details which indicate lost storage connectivity. Event details including fault criticality, resource type, resource name as well as datastore workload, space and performance related metrics are available, as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

81 Solution Verification Figure 57. End to end fault analysis covering actual fault, causes, and solution details The level of troubleshooting supporting the monitoring differentiates vcops from standard monitoring solutions. Instead of providing large amount of alerts when certain thresholds are reached or abnormal states occur, vcops provides detailed information on the actual issue, and its potential causes and solutions, as shown in Figure 57. Selecting What does that mean? from the dashboard provides a detailed description of root cause and a step-by-step procedure with links to appropriate knowledge base articles you should follow to determine the current issues in your environment. An example of this solution detail is displayed in Figure 58. Figure 58. VMware vcops root cause analysis solution details EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 81

82 Solution Verification Monitoring VNX health and resources VMware vcops integration with EMC Storage Analytics (ESA) software combines the features and functionality of VMware vcenter Operations Manager with VNX. It delivers custom analytics and visualizations that provide deep visibility into your EMC infrastructure and enable you to troubleshoot, identify, and take quick action on storage performance and capacity management problems. Within the vcops custom portal, ESA presents three separate dashboards: two are universal and one is specific to VNX. Each dashboard is fully customizable and can be adjusted to display the required details and metrics or additional widgets. By default, ESA enables the following dashboards in the vcops custom portal which provide information about VNX storage systems: EMC Storage Topology dashboard Provides view of resources and relationships between storage and virtual infrastructure objects, as shown in Figure 59. EMC VNX Storage Metrics dashboard Displays resource and metrics for storage systems. EMC VNX Overview dashboard Represents a single view of performance and capacity of VNX resources. EMC Storage Topology dashboard The EMC Storage Topology dashboard is shown in Figure 59. It shows the VNX arrays that are configured these are referred to as adapter instances. When an array is selected from the Storage System Selector pane, the Topology and Resources panes are populated with associated underlying components. ESA pulls in all related VMware objects, making it possible to navigate end-to-end into the underlying storage array components from vsphere datastore cluster and LUN to storage pools and storage processor. The instance in Figure 59 shows that EPC_Prod2_LUN10 has datastore EPC_Prod2_LUN10 built on it. The LUN is created from the vcac pool and uses Storage Processor A. These details are presented graphically in the Storage Topology and Health pane and also presented as parent and child resources in their respective panes. 82 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

83 Solution Verification Figure 59. EMC VNX Storage Topology dashboard The second universal dashboard, shown in Figure 60, is for EMC Storage Metrics. Each EMC resource has a set of metrics associated with it and is displayed in a graph. Navigation is driven from the top down, so once the storage system and specific resource have been chosen, the user can select multiple metrics to be displayed in the Metric graph. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 83

84 Solution Verification Figure 60. ESA EMC Storage Metrics displaying VNX LUN metrics VNX arrays have their own specific dashboard, EMC Performance Overview, which presents details in the form of heat maps, as shown in Figure 61. This dashboard covers the main storage system resource types thin pools, storage groups, LUNs, storage processors (VNX), FAST Cache Performance (VNX) and provides a few metrics from each one. The heat map colors work on two different levels: there is a green-to-red legend for some which represents either usage (for example, thin pool allocation) or performance (for example, latency) and there is a blue legend for relative usage across that metric within an array (for example, total writes). For any one of the objects shown, a full historical perspective is available on the EMC Storage Metrics page. 84 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

85 Solution Verification Figure 61. ESA VNX Overview dashboard displayed object heat maps Capacity planning and optimization VMware vcops provides powerful capacity planning functionalities which help predict behavior and evaluate the potential impact of future growth on the underlying resources supporting the enterprise private cloud environment. The capacity planning component of vcops provides statistics on the current utilization, as shown in Figure 62, but can also provide a prediction for a What-If scenario where the infrastructure environment may be influenced by an increased or decreased number of ESXi hosts, storage, or virtual machines on existing or new consumption profiles. By implementing the scenario, vcops will model the predicted impact so that you know in advance what your capacity requirements will be under such circumstances. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 85

86 Solution Verification Figure 62. Virtual Machine Capacity details for management cluster As shown in Figure 62, the capacity-remaining figures are based on demand and consumption trends of the currently operating virtual machines. To plan for capacity requirements for future growth, you can create a What-If scenario which contains a virtual machine profile that can be based on an existing virtual machine or specified manually, as shown in Figure 63. Figure 63. Specify virtual machine configuration for What-If scenario As shown in Figure 63, the virtual machine profile can be tailored to specify not just the allocation of resources but also their actual usage and consumption. Once this scenario of adding ten new virtual machines has been successfully run through, the details displayed for virtual machine capacity are updated to display the current actual capacity remaining as well as with the What-If scenario implemented, as shown in Figure EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

87 Solution Verification Figure 64. What-If scenario Adding ten new virtual machines Under- or over-utilized virtual machine dashboard In situations where resources are limited, vcops is capable of identifying reclaimable, underutilized resources in idle or oversized virtual machines. The resource-optimization-related waste dashboard will compare configured and recommended CPU and memory metrics and determine oversized virtual machines according to actual resource consumption over defined period of time. The definition of under- or over-utilized virtual machines can be customized, is policy based, and can be edited to suit specific business requirements, as shown in Figure 65. Multiple policies can be created and applied as appropriate. Figure 65. Edit policy to specify thresholds for underutilization of virtual machines EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 87

88 Solution Verification The dashboard detail provides a list of oversized virtual machines and recommendations of appropriate values for CPU and RAM resources according to real consumption history, as shown in Figure 66. Figure 66. List of oversized virtual machines with suggested optimal resource configurations vcops reports The Reports tab in vcops provides a formal reporting structure around the various views and summaries available in the Planning section. Each report can have a specific schedule attached or can be executed manually, as displayed in Figure 67 for the Virtual Machine Capacity Overview Report. 88 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

89 Solution Verification Figure 67. Schedule a report in vcops or run the report manually Note: The New Report Schedule functionality is password protected and provides the ability to the completed report to multiple addresses. Once a report has successfully completed, it is available, along with previously run instances of the same report, to be downloaded in either PDF or CSV format, as shown in Figure 68. Figure 68. Successfully completed reports available for download EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 89

90 Resource Sizing Guide Chapter 6 Resource Sizing Guide This chapter presents the following topics: Overview Cloud management environment sizing Summary EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

91 Resource Sizing Guide Overview Understanding the performance requirements of a private cloud environment can be a challenge. The EMC VSPEX solution for IaaS simplifies this process significantly because the solution is based on an existing VSPEX private cloud platform with known levels of performance and scalability. This chapter provides sizing information for the additional management and orchestration components. For this sizing guide there are two distinct elements: The sizing of the management environment components that form the private cloud The supporting infrastructure components on which the virtualized workloads will run Cloud management environment sizing The other documents referenced in this section provide guidelines for configuring the characteristics of each component in a solution. Table 4 provides examples of how the solution is sized according to those guidelines. For more details, refer to EMC VSPEX Private Cloud VMware vsphere 5.5 for up to 1,000 Virtual Machines Proven Infrastructure Guide. As mentioned in the VSPEX Private Cloud document, a reference virtual machine has 1 vcpu, 2 GB RAM, and 100 GB storage space. Table 4. Management vcenter requirements Server role vcenter components Recommended hardware specifications Number of VSPEX reference virtual machines SQL Server database server (SQL-DB01) vcenter database CPU: 2.4 GHz 4-core or equivalent RAM: 8 GB 4 Disk: 40 GB Network: 1 Gb/s vcenter Server (vcenter-01) SSO vcpu 2 RAM: 10 GB 5 Inventory Disk: 100 GB vcenter Server Network: 1 Gb/s EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 91

92 Resource Sizing Guide Table 5. vcac Up to 1,000 machines (physical or virtual) Server role vcac components Recommended hardware specifications Database server vcac database CPU: 2.4 GHz 4-core or equivalent RAM: 8 GB Number of VSPEX reference virtual machines 4 Disk: 40 GB Network: 1 Gb/s vcac server/web server Manager Service DEM Orchestrator CPU: 2.4 GHz 4-core or equivalent RAM: 4 GB 4 (plus 4 for failover server) Model Manager (web and data) portal website Disk: 40 GB Reports website Network: 1 Gb/s DEM machines Distributed Execution Managers (DEM) Workers (one or more) CPU: 2.4 GHz 4-core or equivalent RAM: 4 GB 4 Disk: 40 GB Network: 1 Gb/s Agent machines vcac agents (one or more) CPU: 2.4 GHz 4-core or equivalent RAM: 4 GB 4 Disk: 40 GB Network: 1 Gb/s Note: There is one active web server, with one server for failover. In this configuration, the Manager Service can be co-hosted with the web components. Table 6. vcops hardware requirements Server role vcops components Recommended hardware specifications Management UI VM CPU: 2.4 GHz x 2 vcpu or equivalent RAM: 7 GB Number of VSPEX reference virtual machines 4 Disk: 100 GB 92 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

93 Resource Sizing Guide Server role vcops components Recommended hardware specifications Number of VSPEX reference virtual machines Network: 1 Gb/s Analytics Analytics VM CPU: 2.4 GHz x2 vcpu RAM: 9 GB 8 Disk: 800 GB Network: 1 Gb/s Table 7. Production vcenter requirements Server role vcenter components Recommended hardware specifications Number of VSPEX reference virtual machines SQL Server database server (SQL-DB02) vcenter database CPU: 2.4 GHz 4-core or equivalent RAM: 16 GB 8 Disk: 40 GB Network: 1 Gb/s vcenter Server (vcenter-02) SSO vcpu 2 RAM: 10 GB 5 Inventory Disk: 100 GB vcenter Server Network: 1 Gb/s vcloud Networking and Security vcns Manager CPU: 2.4 GHz 2-core or equivalent RAM: 8 GB Disk: 60 GB Network: 1 Gb/s 4 This would require a total resource requirement of 57 VSPEX reference virtual machines. Summary The EMC VSPEX solution for IaaS creates a robust, scalable platform infrastructure that includes the best features of the underlying EMC and VMware technologies and layers them into the complete solution. Because it is built on the VSPEX private cloud EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 93

94 Resource Sizing Guide platform, sizing the appropriate solution becomes significantly easier since EMC has provided solutions with known sizing metrics. This solution provides several recommendations and examples for enabling IaaS within the business. VSPEX partners can use these recommendations to create different types of resource pools or provisioning groups to meet specific application and performance requirements of enterprises within a customer environment. This solution uses the same design, hardware, and configuration described in the VSPEX Proven Infrastructure as a base architecture to provide IaaS within a business. It discusses two additional types of storage service levels in Appendix A on page 96 to give customers the flexibility of deploying virtual machines based on performance and capacity requirements. These additional storage levels should have their own set of disks separate from the disks required in the VSPEX Proven Infrastructure. However, EMC recommends that you use only the VSPEX storage layout to calculate and support the exact number of VSPEX reference virtual machines required. Deploying virtual machines on different storage service levels can reduce the total number of supported reference virtual machines. When building the cloud infrastructure, you should note certain recommendations, including verifying the interconnect points of IP connected devices. Where workloads and infrastructure management exist, connections with a minimum of 10 Gb with appropriately sized switching backplanes are and should be used. Failure to observe these recommendations can result in underperforming situations, such as resource scheduling problems or failure scenarios, which require the movement of workloads as quickly as possible. The VSPEX sizing tool can assist you in quickly, easily, and properly sizing your VSPEX private cloud environment, including the required management and orchestration applications. You can then determine the proper VSPEX private cloud reference architecture for your given workloads that has been tested, sized, and proven by EMC. 94 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

95 Appendix A: Storage Service Levels Appendix A: Storage Service Levels This chapter presents the following topics: Overview Storage service levels EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 95

96 Appendix A: Storage Service Levels Overview The VSPEX IaaS solution using VMware vcloud Suite is designed on top of an existing VSPEX Proven Infrastructure for vsphere. The Proven Infrastructure uses a specific configuration for storage pools on the VNX to support a required number of virtual machines. As a result, this solution uses a single storage service level. This appendix provides information on using additional storage service levels in the VSPEX Private Cloud solution. However, it should be noted that the VSPEX architecture is built for a specific number of virtual servers and using different storage levels may reduce the number of virtual servers supported. Storage service levels The VNX storage array provides many features that allow provisioning of IaaS. Creating storage pools with specific types of drives enables creation of different storage service levels based on pool composition and drive performance. Multiple storage service levels can be created within a VNX array to achieve different levels of performance and most effectively align resources with performance requirements. Storage levels consumable by tenants Storage service levels can be created across a VNX with varying availability, capacity, and performance capabilities. You can weigh each service level respective to the application and operational requirements of each line of business, with some weighted in favor of capacity and others weighted for performance. The service levels provide the highest performance where workloads demand it. The performance capabilities decrease as the service levels move toward serving less performanceintensive workloads where cost is more important. Figure 69 shows the performance versus capacity requirements for the different segments of an organization used as a reference in this solution. Figure 69. Storage service-level positioning for VSPEX management and orchestration Storage servicelevel offerings The Prod-2 storage service level built according to the VSPEX Private Cloud solution storage design is the only VSPEX recommended storage service level. This section provides two additional storage layout examples for virtual machines with different 96 EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite

97 Appendix A: Storage Service Levels performance requirements within an organization. All three storage service levels are shown in Figure 70 and described in Table 8. Figure 70. Storage service levels on VNX systems Note: Additional drives need to be present on the VNX to support the two storage service levels. Deploying virtual machines on these storage service levels may lower the number of reference virtual machines as specified in the VSPEX configuration. Note: FAST VP must be enabled for all service levels so that they can take advantage of storage tiering and load balancing when different drive types are added to the storage pool. Table 8. Service level Storage service levels example FAST VP SSD disks SAS/FC NL-SAS/SATA Prod-2 Yes 2 x 200 GB 45 x 600 GB SAS N/A TestDev No N/A 27 x 600 GB SAS N/A Archive No N/A N/A 16 x 2 TB NL-SAS The storage service levels are allocated as follows: Prod-2 is configured for production systems within organizations where performance is a criterion (similar to the VSPEX private cloud storage layout). TestDev is configured for testing and development systems. Archive is configured for archived systems or for systems where cost, but not performance, is important. EMC VSPEX Solution for Infrastructure as a Service with VMware vcloud Suite 97