Introducing VMware Validated Designs for Software-Defined Data Center

Transcription

1 Introducing VMware Validated Designs for Software-Defined Data Center VMware Validated Design for Software-Defined Data Center 2.0 This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this document, see EN

2 Introducing VMware Validated Designs for Software-Defined Data Center You can find the most up-to-date technical documentation on the VMware Web site at: The VMware Web site also provides the latest product updates. If you have comments about this documentation, submit your feedback to: Copyright 2016 VMware, Inc. All rights reserved. Copyright and trademark information. VMware, Inc Hillview Ave. Palo Alto, CA VMware, Inc.

3 Contents About Introducing VMware Validated Design for Software-Defined Data Center 5 1 Overview of VMware Validated Designs 7 2 Solution Overview and Design Objectives 9 3 Documentation Structure and Audience 11 4 VMware Software Components in the Validated Design 15 5 Overview of the SDDC Structure 17 Physical Infrastructure Layer 18 Virtual Infrastructure Layer 20 Cloud Management Layer 24 Operations Layer 25 Index 29 VMware, Inc. 3

4 Introducing VMware Validated Designs for Software-Defined Data Center 4 VMware, Inc.

5 About Introducing VMware Validated Design for Software-Defined Data Center The Introducing VMware Validated Design for Software-Defined Data Center guide provides directions on using the content of VMware Validated Design for Software-Defined Data Center. The guide also contains a high-level overview of the Software-Defined Data Center (SDDC) design supported in this VMware Validated Design version. Introducing VMware Validated Design for Software-Defined Data Center focuses on providing guidance about using the VMware Validated Design and includes the following information: Design objectives Document structure and purpose Supported VMware product versions SDDC design overview Intended Audience Introducing VMware Validated Design for Software-Defined Data Center is intended for cloud architects, infrastructure administrators, cloud administrators and cloud operators who want to get familiar with VMware Validated Design to deploy and manage an SDDC that meets the requirements for capacity, scalability, business continuity and disaster recovery. VMware Technical Publications Glossary VMware Technical Publications provides a glossary of terms that might be unfamiliar to you. For definitions of terms as they are used in VMware technical documentation, go to VMware, Inc. 5

6 Introducing VMware Validated Designs for Software-Defined Data Center 6 VMware, Inc.

7 Overview of VMware Validated 1 Designs Use VMware Validated Design to create a Software-Defined Data Center that is based on management components by VMware, and has a scalable and best-practice configuration. VMware Validated Design has the following advantages: One path to SDDC SDDC design for use in production After you satisfy the deployment requirements, follow one consistent path to deploy an SDDC. VMware Validated Design supports an SDDC that has the following features: High-availability of management components Backup-and-restore support Monitoring and alerting Opportunity to extend the deployment to support disaster recovery Validated design and deployment The prescriptive documentation of VMware Validated Design is continuously validated by VMware. Validation provides the following advantages to your organization: Validated product interoperability Validated SDDC features, such as custom workload churn, high availability of management components, operational continuity, efficient monitoring, and design with dual-region support in mind Reduced risk of deployment and operational problems Reduced test effort Fast SDDC standup Support for latest product releases Foundation for development of SDDC deployment use cases By downloading all SDDC products, and following detailed design and step-by-step instructions, you are able to implement a data center without engaging in design work and product research. Every version of VMware Validated Design accommodates new product releases. VMware Validated Design provides the foundation for use cases that satisfy the requirements of individual organizations or industry segments, such as SDDC for microsegmentation, DevOps and automated IT. VMware, Inc. 7

8 Introducing VMware Validated Designs for Software-Defined Data Center 8 VMware, Inc.

9 Solution Overview and Design 2 Objectives VMware Validated Design has a number of objectives to deliver prescriptive content about an SDDC that is fast to deploy and is suitable for use in production. Table 2 1. Objectives of VMware Validated Design VMware Validated Design Objective Main objective Scope of deployment Cloud type Description SDDC capable of automated provisioning of workloads Greenfield deployment of the SDDC management components. Private cloud Number of regions and disaster recovery support The design documentation provides guidance for an SDDC that is capable of supporting a dual-region case for failover. The deployment documentation provides guidance for an SDDC that supports a single region for both management and tenant workloads. By design, the SDDC management components can operate in an environment that supports failover in a dual-region environment with one availability zone. See Physical Infrastructure Layer, on page 18. Maximum number of virtual machines 10,000 running virtual machines Churn rate of 150 virtual machines per hour Churn rate is related to provisioning, power cycle operations, and decommissioning of one tenant virtual machine by using a blueprint in the cloud management platform. A churn rate of 100 means that 100 tenant workloads are provisioned, pass the power cycle operations, and are deleted. Number of hardware pods 3-pod setup The validated design requires the following pods for SDDC deployment: Management pod. Runs the virtual machines of the management products. Compute pod. Runs the tenant workloads. Edge pod. Connects the virtual networks in NSX for vsphere and the external networks. Data center virtualization Compute virtualization Software-defined storage in the management and edge pods Network virtualization VMware, Inc. 9

10 Introducing VMware Validated Designs for Software-Defined Data Center Table 2 1. Objectives of VMware Validated Design (Continued) VMware Validated Design Objective Description Scope of guidance Storage, compute and networking for the management pod. Number of hosts, amount of storage and configuration Deployment and initial setup of management components at the levels of infrastructure, cloud management platform, and operations. Basic tenant operations such as creating a tenant, assigning tenant capacity, configuring user access, and adding virtual machines to a service catalog from single-machine blueprints. Operations on the management components of the SDDC such as monitoring and alerting, backup and restore, and post-maintenance validation. Overall availability 99% availability Planned downtime is expected for upgrades, patching, and on-going maintenance. Authentication, authorization, and access control Use of Microsoft Active Directory as a central user repository. Use of service accounts with minimum required authentication and Access Control List configuration. Use of basic tenant accounts. Certificate signing Hardening Certificates are signed by an external certificate authority (CA). Tenant workload traffic can be separated from the management traffic. 10 VMware, Inc.

11 Documentation Structure and Audience 3 The structure of the VMware Validated Design documentation reflects the best practices in designing and deploying a data center that is capable of automated provisioning of workloads. The documentation components of the validated design are organized according to audience and deployment stage, and you use them in a specific order. Figure 3 1. VMware Validated Design Documentation Flow Start Design Phase Architecture Overview Detailed Design Reference Architecture Deployment Phase Planning and Preparation Deployment Guide for Region A Operations Phase Operational Guidance Architecture Overview The first part of VMware Validated Design is Architecture Overview and it introduces the terms and components in the design. VMware, Inc. 11

12 Introducing VMware Validated Designs for Software-Defined Data Center Table 3 1. Architecture Overview Information Section Attribute Guide Description VMware Validated Design Reference Architecture Guide Purpose Introduce the fundamentals and components in the SDDC design. Provide information about the layered structure of the SDDC. Describe the building modules and basic behavior of each management component. Audience Cloud architects and cloud administrators Detailed Design After you learn about the basic modules in the SDDC design, you proceed with detailed design of the management components and the required infrastructure. Table 3 2. Detailed Design Information Section Attribute Guide Description VMware Validated Design Reference Architecture Guide Purpose Provide complete details about the configuration of each layer and of the components that are a part of the layer. Describe available design alternatives. Provide design decisions to reflect the main design issues and the rationale behind a chosen solution path. Audience Cloud architects and cloud administrators Planning and Preparation After you understand the details of the design, you plan your environment according to the requirements of the design so that you can deploy the designed SDDC directly without additional testing and troubleshooting efforts. Table 3 3. Planning and Preparation Information Section Attribute Guide Purpose Audience Description VMware Validated Design Planning and Preparation Guide Collect all requirements that your environment must meet so that you can follow VMware Validated Design to create an SDDC. The Planning and Preparation section provides prerequisites for the following areas: Required software including VMware products, scripts and third-party software Networking configuration including VLANs, example IP addresses and DNS names Active Directory user configuration Specifications of the virtual machines that you must provide in advance Cloud architects, infrastructure administrators, cloud administrators and cloud operators 12 VMware, Inc.

13 Chapter 3 Documentation Structure and Audience Deployment Guide for Region A After you make sure that your environment has the required structure and configuration, follow the Deployment Guide for Region A to start the SDDC implementation. Table 3 4. Deployment Guide Information Section Attribute Guide Description VMware Validated Design Deployment Guide for Region A Purpose Provide step-by-step instructions for each management component of the SDDC according to the selected design path in Detailed Design. Cover the single-region setup of the SDDC. Provide details about setting up the virtual infrastructure for both management and tenant workloads. Provide procedures for integration of the products to form one functional system. Audience Cloud architects, infrastructure administrators, cloud administrators and cloud operators Operational Guidance After you deploy the SDDC, follow the Operational Guidance documentation to operate the environment and the management workloads. Table 3 5. Operational Guidance Information Section Attribute Guide Purpose Audience Description VMware Validated Design Operational Guidance that is delivered as a set of add-on packages. For each management component, provide the following information: Step-by-step instructions about backing and restoring the components of each management product. Step-by-step instructions about setting up dashboards and activating alerts for monitoring the SDDC, and lists of notifications that are most symptomatic. Step-by-step instructions about validating the operation of the SDDC after software maintenance such as restore, upgrade or failover. Cloud architects, infrastructure administrators, cloud administrators and cloud operators VMware, Inc. 13

14 Introducing VMware Validated Designs for Software-Defined Data Center 14 VMware, Inc.

15 VMware Software Components in the 4 Validated Design VMware Validated Design is based on a set of individual VMware products with different versions that are available in a common downloadable package. Table 4 1. VMware Software in the VMware Validated Design Product Group and Edition Product Name Product Version VMware vsphere Enterprise Plus ESXi 6.0 Update 2 vcenter Server Appliance (ISO) 6.0 Update 2 VMware Virtual SAN Standard or higher Virtual SAN 6.2 VMware NSX for vsphere Enterprise NSX for vsphere VMware vrealize Automation Advanced or higher vrealize Automation vrealize Orchestrator VMware vrealize Business for Cloud Standard vrealize Orchestrator Plug-in for NSX v Realize Orchestrator Plug-in for vrealize Automation VMware vrealize Business for Cloud and express patch VMware vrealize Operations Manager Advanced or higher vrealize Operations Manager vrealize Operations Management Pack for NSX for vsphere vrealize Operations Management Pack for vrealize Log Insight vrealize Operations Management Pack for vrealize Automation vrealize Operations Management Pack for Storage Devices VMware vrealize Log Insight vrealize Log Insight vrealize Log Insight Content Pack for NSX for vsphere vrealize Log Insight Content Pack for Virtual SAN vrealize Log Insight Content Pack for vrealize Automation VMware, Inc. 15

16 Introducing VMware Validated Designs for Software-Defined Data Center Table 4 1. VMware Software in the VMware Validated Design (Continued) Product Group and Edition Product Name Product Version vrealize Log Insight Content Pack for vrealize Orchestrator 7.0 vrealize Log Insight Content Pack for vrealize Operations Manager 6.x VMware vsphere Data Protection VMware vsphere Data Protection Product Considerations Use the list of software components for VMware Validated Design under the certain considerations. VMware makes available patches and releases to address critical security issues for several products. Verify that you are using the latest security patches and releases for a given component when deploying VMware Validated Design. Because this validated design version provides instructions for a single-region SDDC implementation, the list does not include the VMware products for disaster recovery, such as VMware Site Recovery Manager and vsphere Replication. 16 VMware, Inc.

17 Overview of the SDDC Structure 5 The SDDC architecture in VMware Validated Design consists of layers. The layered structure enables you to create the SDDC in modules and to handle each set of components separately. For information about the design and deployment of each layer, see VMware Validated Design Reference Architecture Guide and VMware Validated Design Deployment Guide for Region A. Figure 5 1. Components of a Software-Defined Data Center Service Management Cloud Management Layer Service Catalog Self-Service Portal Business Continuity Security Orchestration Virtual Infrastructure Layer Hypervisor Pools of Resources Fault Tolerance and Disaster Recovery Governance Portfolio Management Operations Management Physical Layer Virtualization Control Compute Storage Network Backup & Restore Replication Risk Compliance Physical Infrastructure Layer on page 18 The physical layer contains the compute, storage and network resources in your data center. These resources are organized in pods. Virtual Infrastructure Layer on page 20 The virtual infrastructure layer contains the components that provide compute, networking and storage resources to the management and tenant workloads. Cloud Management Layer on page 24 The cloud management layer enables you to deliver tenants with automated workload provisioning by using a self-service portal. Operations Layer on page 25 The operations layer of the SDDC provides capabilities for performance and capacity monitoring, and for backup and restore of the cloud management components. VMware, Inc. 17

18 Introducing VMware Validated Designs for Software-Defined Data Center Physical Infrastructure Layer The physical layer contains the compute, storage and network resources in your data center. These resources are organized in pods. Figure 5 2. Physical Configuration of the SDDC SpineSwitch SpineSwitch SpineSwitch External connection ToR Switch ToR Switch ToR Switch ToR Switch ToR Switch ToR Switch L3 L2 Management pod(4 ESXi hosts) Edge pod(4 ESXi hosts) Compute pods Pods A pod is a logical grouping of hardware that supports a certain function and is easy to replicate. Pods can have different configurations of server, storage, and network equipment. Usually each pod spans one rack, but in smaller environments you can aggregate multiple pods into a single rack. VMware Validated Design uses the following pods: Management Pod Runs the virtual machines of the components that manage the SDDC, such as vcenter Server, NSX Manager, NSX Controller nodes, vrealize Operations Management, vrealize Log Insight, vrealize Automation, vrealize Orchestrator and vrealize Business. VMware Validated Design uses one management pods that occupies half a rack. Compute Pod Hosts the SDDC tenant workloads. VMware Validated Design uses up to 6 compute pods, each pod occupying one rack. Edge Pod Compute pods are usually not set up with external network connectivity. In this case, external connectivity is pooled into edge pods. Edge pods connect the virtual networks in NSX for vsphere and the external networks. VMware Validated Design uses one edge pod that occupies half a rack. 18 VMware, Inc.

19 Chapter 5 Overview of the SDDC Structure Regions and Availability Zones Availability zones and regions have different purposes. Availability zone Represent the fault domain of the SDDC. Multiple availability zones can provide continuous availability of an SDDC. VMware Validated Design supports one availability zone per region. Region Each region is a separate SDDC instance. You use multiple regions for disaster recovery across individual SDDC instances. In VMware Validated Design, regions have similar physical and virtual infrastructure design but different naming. Table 5 1. Regions in VMware Validated Design Region Disaster Recovery Role Region-Specific Domain Name Region A Protected sfo01.rainpole.local Region B Recovery lax01.rainpole.local Network Storage VMware Validated Design uses a Layer 3 leaf-and-spine network architecture. VMware Validated Design provides guidance for the storage of the management components. The design uses two storage technologies: Virtual SAN. Virtual SAN storage is the default storage type for the SDDC management components. The storage devices on Virtual SAN ready servers provide the storage infrastructure. Because VMware Validated Design uses Virtual SAN in hybrid mode, each rack server must have one SSD and two HDD devices that form a disk group with capacity. NFS. NFS storage is the secondary storage for the SDDC management components. It provides space for workload backup, archiving log data and application templates. NFS storage required an NFS-capable external storage arrays. VMware, Inc. 19

20 Introducing VMware Validated Designs for Software-Defined Data Center Virtual Infrastructure Layer The virtual infrastructure layer contains the components that provide compute, networking and storage resources to the management and tenant workloads. vcenter Server Design Table 5 2. vcenter Server Design Details Design Area vcenter Server instances Clusters Deployment model Description You deploy two vcenter Server instances in the following way: One vcenter Server supporting the SDDC management components. One vcenter Server supporting the compute components and workloads. Using this model provides the following benefits: Isolation of management and compute operations Simplified capacity planning Separated upgrade Separated roles You distribute hosts and workloads in the following clusters: Management cluster that contains all management hosts and handles resources for the management workloads. Edge cluster that contains the NSX Controller instances and the NSX Edge services gateway devices for the compute pod. Compute cluster that contains a set of hosts for tenant workloads. The compute cluster configuration is for reference purposes. VMware Validated Design uses two Platform Services Controller instances and two vcenter Server instances. For redundancy, the design joins the two Platform Services Controller instances to the same vcenter Single Sign-On domain, and points each vcenter Server instance to one Platform Services Controller instance. 20 VMware, Inc.

21 Chapter 5 Overview of the SDDC Structure Figure 5 3. vcenter Server Cluster Layout Region A Management Cluster Region A Compute / Edge Cluster Region B Management Cluster Region B Compute / Edge Cluster PSC PSC PSC PSC Mgmt VC Compute VC Mgmt VC Compute VC ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi Dynamic Routing and Application Virtual Networks VMware Validated Design supports dynamic routing for both management and compute workloads, and also introduces a model of isolated application networks for the management components. Dynamic routing support includes the following nodes: Pair of NSX Edge service gateways (ESGs) with ECMP enabled for north/south routing across all regions. Universal distributed logical router (UDLR) for east/west routing across all regions. Application virtual networks provide support for limited access to the nodes of the applications through published access points. Three application virtual networks exist: Common application virtual network that connects the components that are designed to fail over to a recovery region. Application virtual network in Region A for components that are not designed to fail over. Application virtual network in Region B for components that are not design to fail over. VMware, Inc. 21

22 Introducing VMware Validated Designs for Software-Defined Data Center Figure 5 4. Virtual Application Network Components and Design Legend: Transit Networks Compute-Management Edge-Management Management Application Mgmt-Management Internet/ Enterprise Network Compute PODs Edge PODs VC PSC SRM VDP ToR Switches ECMP ESG's Universal Distributed Logical Router ESG Load Balancer /24 Mgmt-xRegion01-VXLAN vrops vra/vro/vrb /24 Mgmt-xRegionА01-VXLAN vrli vrops Collector vra Proxy Software-Defined Storage Design for Management Products Workloads on the management and edge clusters store their data on cluster-specific Virtual SAN datastores. Each Virtual SAN datastore spans all 4 ESXi hosts of each cluster, and each host adds one disk group to the datastore. Applications store their data according to the default storage policy for Virtual SAN. 22 VMware, Inc.

23 Chapter 5 Overview of the SDDC Structure Figure 5 5. Virtual SAN Conceptual Design Virtual Infrastructure Management Other Management Applications NSX Controller (Mgmt) NSX Edge (Mgmt) Virtual Infrastructure Compute Edge NSX Manager (Compute) NSX Manager (Mgmt) SDDC Payload NSX Controller (Compute) NSX Edge (Compute) vcenter Server (Compute) vcenter Server (Mgmt) No Virtual SAN Used Here Virtual SAN Datastore (Edge) Virtual SAN Datastore (Management) Managed by: Compute vcenter Server Managed by: Management vcenter Server Compute Cluster Edge Cluster Management Cluster ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi ESXi Network: Internal SDDC Fabric (Spine/Leaf) Compute Pod Network: External (Internet/MPLS) Management/Edge Pod vsphere Data Protection, vrealize Log Insight and vrealize Automation Content Library use NFS exports. You create two datastores: one in the management cluster for vsphere Data Protection and one in the compute cluster for vrealize Automation. Figure 5 6. NFS Storage Exports Region A NFS Storage Array Region B NFS Storage Array Volume 1 Volume 2 Volume 1 Volume 2 Export (vrealize Automation) Export (vrealize Log Insight) Export (vsphere Data Protection) Export (vrealize Automation) Export (vrealize Log Insight) Export (vsphere Data Protection) VMware, Inc. 23

24 Introducing VMware Validated Designs for Software-Defined Data Center Cloud Management Layer The cloud management layer enables you to deliver tenants with automated workload provisioning by using a self-service portal. Table 5 3. Cloud Management Design Details Design Attribute Description Software components vrealize Automation vrealize Orchestrator vrealize Business Deployment model of vrealize Automation High availability and load balancing Distributed deployment with support for vsphere endpoints by using vsphere Proxy Agent virtual machines. You install the vrealize Automation components on multiple machines. Supported for all nodes except the Microsoft SQL database server and vrealize Business. Endpoints vcenter Server for the management cluster vcenter Server for the compute and edge clusters Blueprint configuration Tenants Fabric groups Business groups Single-machine blueprints A single tenant company called Rainpole. One fabric group in a region with all resources in the compute and edge cluster assigned. Two business groups, one for production and one for development. 24 VMware, Inc.

25 Chapter 5 Overview of the SDDC Structure Figure 5 7. vrealize Automation Tenant Design Rainpole Tenant Production Business Group Business Group Manager Development Business Group Business Group Manager Tenant Admin Prod Reservation Dev Reservation Region A Fabric Group Edge Reservation Prod Reservation Dev Reservation Edge Reservation Region B Fabric Group IaaS Admin Fabric Admin Fabric Admin Region A Data Center Infrastructure Fabric Region B Data Center Infrastructure Fabric Default Tenant System Admin Tenant Creation System Branding System Notification Providers Event Logs Operations Layer The operations layer of the SDDC provides capabilities for performance and capacity monitoring, and for backup and restore of the cloud management components. vrealize Operations Manager You use vrealize Operations Manager to monitor the management components of the SDDC including vsphere, NSX for vsphere and vrealize Automation. vrealize Operations Manager is also sized to accommodate the number of tenant workloads per the design objectives. VMware, Inc. 25

26 Introducing VMware Validated Designs for Software-Defined Data Center Figure 5 8. vrealize Operations Manager Logical Design Region A Management/ Compute vcenter Server vrealize Automation Management/ Compute vcenter Server Region B NSX Remote Collector Cluster Remote Collector Cluster NSX Shared Storage Remote Collector Remote Collector Remote Collector Remote Collector Shared Storage Analytics Cluster Master Master Replica Data Data Table 5 4. vrealize Operations Manager Design Details Design Attribute Description Deployment model Analytics cluster of four nodes: master, master replica and two data nodes Remote collector cluster that consists of two remote collectors that communicate with two vcenter Server instances in the region Monitored components vcenter Server and Platform Services Controller Management, Edge and Compute ESXi hosts All components of NSX for vsphere for the management and compute clusters vrealize Automation and vrealize Orchestrator vrealize Log Insight vrealize Operations Manager (Self Health Monitoring) vrealize Log Insight You use vrealize Log Insight to access the logs of the SDDC management components from a central place and view this information in visual dashboards. 26 VMware, Inc.

27 Chapter 5 Overview of the SDDC Structure Figure 5 9. vrealize Log Insight Logical Design Region A Management/ Compute vcenter Server vrealize Automation Management/ Compute vcenter Server Region B NSX vrealize Log Insight Cluster event forwarding vrealize Log Insight Cluster NSX vrealize Operations Manager Master Worker Worker Master Worker Worker VMDK Storage (Virtual SAN or NAS) Archiving Storage (NAS) VMDK Storage (Virtual SAN or NAS) Archiving Storage (NAS) Table 5 5. vrealize Log Insight Design Details Design Attribute Deployment model Description Cluster of master node and two worker nodes. Monitored components vcenter Server and Platform Services Controller Management, Edge and Compute ESXi hosts All components of NSX for vsphere for the management and compute clusters vrealize Automation and vrealize Orchestrator Analytics cluster nodes of vrealize Operations Manager Archiving Archiving location on an NFS export vsphere Data Protection You deploy vsphere Data Protection to backup the virtual machines of the SDDC management components. vsphere Data Protection stores its data and the backup copies of virtual machines on the NFS datastore in the management cluster. VMware, Inc. 27

28 Introducing VMware Validated Designs for Software-Defined Data Center Figure vsphere Data Protection Design Authentication Authentication Platform Services Controller vcenter Server Platform Services Controller vcenter Server vsphere Data Protection Region A vsphere Data Protection Region B VM vsphere Data Protection VM Snapshot/ Backup Agent VM vsphere Data Protection VM Snapshot/ Backup Agent Backup Datastore Backup Datastore 28 VMware, Inc.

29 Index B bill of material 15 D design objectives 9 documentation guides 11 flow 11 structure 11 documentation overview 5 G glossary 5 I intended audience 5 M main features 7 S SDDC application virtual network 20 architecture 17 backup and restore 25 capabilities 9 cloud management 24 dynamic routing 20 layers 17 logging 25 monitoring and alerting 25 NFS 20 operations 25 physical infrastructure 18 pods 18 regions 18 service catalog 24 software components 15 software-defined networking 20 software-defined storage 20 tenant configuration 24 virtual infrastructure 20 Virtual SAN 20 VMware, Inc. 29

30 Introducing VMware Validated Designs for Software-Defined Data Center 30 VMware, Inc.