Data Centre of the Future Vblock Infrastructure Packages: Accelerating Deployment of the Private Cloud Andrew Smallridge DC Technology Solutions Architect asmallri@cisco.com 1
IT is undergoing a transformation The need for a new IT model has never been more clear Today s IT architecture increases procurement, management costs, and complexity IT is now moving towards a service based consumption model (Private Cloud) This new model requires a new way of thinking about both the underlying technology and the way IT is delivered for customer success navigating the path to that model has never been more complicated 2
Vblock Infrastructure Packages A New Way of Delivering IT Rapid deployment model for virtualized infrastructure Pre-integrated and validated d solutions reduce total cost of ownership Vblock Infrastructure Packages Applications Operating Systems Service-level driven through Virtualization predictable performance and operational Compute characteristics ti Improved compliance/security and reduced risk Network Information Storag e Accelerate Time to Results Reduce TCO 3
Simplified Physical DC Architecture MAN Access and DC Access Firewalls MAN / WAN Virtual Device Contexts DC Core (outside) DC Aggregation (inside) Management Network X X Unified Computing x86 Compute System Production Mission Critical X X Unified EMC Data SAN A Computing x86 Compute VMAX Protection System Non Production Dev / Test Vblock Type 2 Tiered Storage Data Domain Avatar SAN SAN B 4
Vblock Infrastructure Packages: Architecture & Design 5
Vblock Infrastructure Packages Architecture Applications & Operating Systems Systems Management & Monitoring Multi-Tenancy High- Availability Security Service-Tiering Performance Management & Orchestration VMware vsphere 4 Cisco Unified Computing System Vblock Foundation EMC Unified Storage 6
Architectural Principles Units of IT infrastructure with 'matched' performance, operational characteristics and discrete of power, space and cooling Repeatable design patterns facilitate rapid deployment, integration and scalability Built to contain, manage and mitigate failure scenarios in hardware and software environments Designed from the 'Facilities to the Workload' to be scaled for the highest efficiencies in virtualization and workload re-platforming Extensible security, management and orchestration frameworks based on industry standard tools, APIs and methods Design Selection Assembly Result 7
Predictable Performance, Capacity & Capability Predictable and granular SLA measurement and assurance Deterministic space and weight: floor tiles become unit of capacity planning Consistent power and cooling (KWh/BTUs) per unit Pre-determined capacity and scalability Uniform workload distribution and mobility Deterministic fault and security isolation Predictable Facilities i to Workload Impact 8
Vblock Infrastructure Packages Scalable Platform for Building Solutions Vblock 2: Extensible to meet the most demanding di IT needs Vblock 1: Broad range of IT capabilities for organizations of all sizes Vblock 0: Private Cloud in a Rack Test/development platform for Partners and customers Designed for a Broad range of Use Cases 9
Vblock Infrastructure Packages Scalable IT capability and performance Vblock 2: Very Large Virtualized Compute and Storage Array Vblock 1: Virtualized Workload Environment Vblock 0: Virtualized Workload Environment Vblock Unified Infrastructure Management Aggregation g Layer Application and Network Services 10
Vblock 2: Large-scale Cloud Infrastructure Large-scale Private, Public and Hybrid Cloud infrastructure Standardized hardware, IT capabilities and process simplifies operations, reduces TCO Performance, Capability and Capacity Scale-up architecture: 20K+ VMs, 1PB+ storage Industry leading virtualization capabilities Accelerates ROI & Reduces TCO 11
Vblock 1: Scalable Private Cloud infrastructure Broad range of IT capabilities for organizations of all sizes Standardized hardware, IT capabilities and process simplifies operations, reduces TCO Performance, Capability and Capacity 800 3,000+ VMs 58TB to 99TB+ Storage Industry leading virtualization capabilities Accelerates ROI & Reduces TCO 12
Vblock 0: Extending the Vblock Family New Private Cloud in a Rack extends Vblock rapid deployment model for virtualized infrastructure & Private Cloud Standardized hardware, IT capabilities and process simplifies operations, reduces TCO Performance, Capability and Capacity 30 to 500+ VMs 12TB to 42TB+ Storage Industry leading virtualization capabilites Accelerates ROI & Reduces TCO 13
Vblock 1: Consolidation Use Case Projected Performance and Capacity Note: 5,000 users can be supported at IOPS utilization of 107% Balanced Systems design 14
Vblock Scaling Isolated Aggregated Federated LAN LAN LAN LAN LAN LAN OR OR SAN SAN SAN SAN SAN SAN Brains Brains Brains Brains Brains Brains Storage Array Storage Array Storage Array Storage Array Storage Array Storage Array Vblock 0, 1 & 2 Vblock 2 15
Vblock 0: What's in the Architecture? Compute 4-16 Cisco UCS B-series blades 8-16 Sockets 192-768 GB Memory Network Cisco Nexus 1000V Nexus 5010 Storage EMC Celerra NS-120 (Single or Dual) Virtual Data Center OS VMware vsphere 4 Management Software EMC Ionix Unified Infrastructure Manager (UIM) - optional VMware vcenter EMC Navisphere EMC PowerPathP Cisco UCS Manager 16
Vblock 1U: What's in the Architecture? Compute 16-32 Cisco UCS B-series blades 32-64 Sockets 960-1920 GB Memory Network Cisco Nexus 1000V Nexus 5010 Storage EMC Celerra NS 960 62-105 TB capacity EFD, FC and SATA Drives IP, Fibre Channel & iscsi Virtual Data Center OS VMware vsphere 4 Management Software EMC Ionix Unified Infrastructure Manager (UIM) VMware vcenter EMC Navisphere EMC PowerPath Cisco UCS Manager and Fabric Manager 17
Vblock 1: What's in the Architecture? Compute 16-32 Cisco UCS B-series blades 32-64 Sockets 960-1920 GB Memory Network Cisco Nexus 1000V Cisco MDS 9506 (9221i) Storage EMC CLARiiON CX4 480 or 53-91 TB capacity EFD, FC and SATA Drives Fibre Channel & iscsi Celerra NAS Gateway Virtual Data Center OS VMware vsphere 4 Management Software EMC Ionix Unified Infrastructure Manager (UIM) VMware vcenter EMC Navisphere EMC PowerPath Cisco UCS Manager and Fabric Manager 18
Vblock 2: What's in the Architecture? Compute 32-64 Cisco UCS B-series blades 64-128 Sockets 3072-6144 GB Memory Network Cisco Nexus 1000V Cisco MDS 9506 Storage EMC Symmetrix V-Max (2 Engines) 140-211 TB Capacity EFD, FC and SATA Drives Fibre Channel & iscsi Celerra NAS Gateway Virtual Data Center OS VMware vsphere 4 Management Software EMC Ionix Unified Infrastructure Manager (UIM) VMware vcenter Symmetrix Management Console (SMC) EMC PowerPath Cisco UCS Manager and Fabric Manager 19
What s in the Vblock? Unified Computing System (UCS) Cisco UCS 6100 Series Fabric Interconnects Cisco UCS 5100 Series Blade Server Chassis Cisco UCS B-200 Blade Server 48-96 GB Memory Converged Network Adapter (Unified Network) EMC Storage CLARiiON CX4 Symmetrix V-Max Celerra NS-120 Celerra NAS Gateway VMware vsphere 20
Unified Computing System (UCS) Single, scalable integrated system Network + compute virtualization Mgmt LAN SAN A SAN B 21
Traditional Blade Enclosures SAN IPC LAN Today s Approach All fabric types have switches in each chassis Repackaged switches Complex to manage Blade-chassis configuration dependency Costly Small network domain Blad de Blade Chassis Blad de Blad de Blad de 22
Cisco Unified Computing System SAN SAN LAN Infrastructure Management Centralize chassis management Intrinsic system management Single management domain Scalable architecture 10GE/FCoE Two Failure Domains Separate fabrics Central supervisor, forwarding logic Distributed Fabric Extenders Traffic isolation Oversubscription Blade Ch hassis Chassis Management Blade Ch hassis Chassis Management Blade Ch hassis Chassis Management Blade Ch hassis Chassis Management 23
UCS Building Blocks UCS Manager Embedded manages entire system UCS 6100 Series Fabric Interconnect 20 Port 10Gb FCoE UCS-6120 40 Port 10Gb FCoE UCS-6140 UCS Fabric Extender UCS 2100 Series Remote line card UCS 5100 Series Blade Server Chassis Flexible bay configurations UCS Blade Server Industry-standard architecture UCS Adapters Choice of multiple Converged Network Adapters and Virtual Adapters 24
Unified Computing System System Interconnect Components SAN A G G A G LAN G G S Fabric Switch S Fabric Switch G G A G MGMT Compute Chassis Compute Chassis Fabric Fabric R I C C I R Extender Compute Chassis Fabric Extender Fabric x8r x8i C C x8i x8r Extender Compute Chassis Fabric Extender Fabric x8r x8i C C x8i x8r Extender Fabric Extender Fabric x8r x8i C C x8i x8r Extender Extender x8 x8 x8 x8 M Adapter M B Adapter M B Adapter M B X X Adapter B X X x86 Computer X X x86 Computer X X Compute x86 Blade Computer Compute (Half slot) x86 Blade Computer Compute (Half slot) Blade Compute (Half slot) Blade (Half slot) G G P P Adapter P B Adapter P Adapter P B Adapter P Adapter P B Adapter P X Adapter X X X B Adapter X X X X x86 Computer X X X X x86 Computer X X X X Compute x86 Blade Computer Compute (Full slot) x86 Blade Computer Compute (Full slot) Blade Compute (Full slot) Blade (Full slot) SAN B UCS System Configuration 2 UCS 61xx Fabric Interconnects Up to 40 Chassis per System Max 8 Chassis Vblock 2 40G per Fabric Extender 80G per Chassis Up to 8 half widths blades per chassis Up to 4 full width blades per chassis Unified Computing System 25
Unified Computing System (UCS) Cisco UCS 6100 Series Fabric Interconnects Unified network connectivity to blades and chassis 10 Gigabit Ethernet Fibre Channel over Ethernet (FCoE) IP and Fibre Channel to the aggregation layer and SAN Management UCS Manager embedded Vblock Configuration Always configured in pairs Availability Performance and load balancing Vblock 0-6120 Fabric Interconnect (20) 10 Gb fixed ports to blade chassis/aggregation layer Vblock 1-6120 Fabric Interconnect (20) 10 Gb fixed ports to blade chassis/aggregation layer (4) 4 Gb Ports to SAN fabric Vblock 2 6140 Fabric Interconnect (40) 10 Gb fixed ports to blade chassis/aggregation layer (8) 4 Gb Ports to SAN fabric 26
Unified Computing System (UCS) Vblock Fabric Interconnects Design Considerations Availability Always installed in pairs Redundant power and cooling Predictable performance Maximum of 4:1 oversubscription (downstream vs upstream) Balanced configuration Scalability and flexibility Fabric Interconnects 27
Unified Computing System (UCS) Vblock Chassis Configuration Cisco UCS 5100 Series Blade Server Chassis (8) Blades per chassis (2) 2104XP Fabric Extenders Redundant Power and Cooling Vblock Configuration Vblock 0 2 Blade Chassis Vblock 1 & Vblock 1U 2 to 4 Blade Chassis Vblock 2 4 to 8 Blade Chassis 28
Unified Computing System (UCS) Vblock Blade Configuration Cisco UCS B-200 Blade Server 8 Blades per Chassis 2 Intel Xeon 5500, 5600 Series processors Converged Network Adapter (Unified Network) vnic vhba Internal connections to both Fabric Extenders Vblock 0 4-16 blades 192-768 GB memory (48 GB per blade) (2) 73 GB internal HDD Vblock 1 and Vblock 1U 16-32 blades 960-1920 GB memory 6 blades/chassis = 48 GB 2 blades/chassis = 96 GB Vblock 2 32-64 blades 3072-6144 GB memory (96 GB per blade) (2) 73 GB internal HDD 29
Unified Computing System (UCS) Vblock Chassis Configuration Design Considerations Availability Two Fabric Extenders (FEX) per Chassis Each blade as two connections (one to each FEX) N+1 cooling and power Predictable Performance 2:1 Over-subscription But still full 10 Gb to each blade Balanced configuration Distribute vhba and vnic between fabrics Slots statically pinned to a link QoS BB credits for FC traffic Non-FC traffic can be assigned different weights Fabric R Extender x8 Compute Chassis I x8 C C I x8 Fabric R Extender x8 M Adapter B P Adapter B P Adapter X X X X X X x86 Computer x86 Computer Compute Blade (Half slot) Compute Blade (Full slot) 30
Unified Computing System (UCS) Vblock Chassis / Blade Configuration Availability N+1 blades per chassis vnic routing between fabrics OS (Powerpath) vhba failover Predictable performance Dual quad core Xeon 5500, or dual hex core Xeon 5600 processors Balanced configuration Network Memory Compute Scalability and flexibility Virtualize everything VLAN, trunks and port groups 31
What s in the Vblock? Unified Computing System (UCS) Cisco UCS 6100 Series Fabric Interconnects Cisco UCS 5100 Series Blade Server Chassis Cisco UCS B-200 Blade Server 48-96 GB Memory Converged Network Adapter (Unified Network) Unified Network Storage EMC CLARiiON CX4 EMC Symmetrix V-Max EMC Celerra NS-120 EMC Celerra NAS gateway Cisco MDS Fibre Channel switch (Not required for Vblock 0 & Vblock 1U) VMware vsphere 32
Storage: Vblock 0 Vblock 0 CELERRA NS-120 Minimum Maximum Enterprise Flash Drives (EFD) 400GB 0 0 15K Fibre Channel 600 GB 11 22 SATA 1TB 6 30 Total Drive 17 52 Total Capacity* 12 TB 42 TB 33
Storage: Vblock 1, Vblock 1U Vblock 1U CELERRA NS-960 Minimum Maximum Enterprise Flash Drives (EFD) 200GB 6 11 15K Fibre Channel 450 GB 83 135 SATA 1TB 26 47 Total Drive 115 193 Total Capacity* 64 TB 110 TB Vblock 1 CLARiiON CX4 480 Minimum Maximum Enterprise Flash Drives (EFD) 400GB 9 17 15K Fibre Channel 450 GB 79 140 SATA 1TB 17 23 Total Drive 105 180 Total Capacity* 53 TB 91 TB * 70% of raw capacity 34
Storage: Vblock 2 Vblock 2 Symmetrix V-Max (1 or 2 Engine) Minimum Maximum Enterprise Flash Drives (EFD) 400GB 17 25 15K Fibre Channel 450 GB 125 230 SATA 1TB 78 100 Total Drive 220 355 Total Capacity* 140 TB 211 TB 35
Storage: Configuration Storage configuration are application specific Logical device considerations* LUN size Consistent size based on application requirements RAID Protection RAID 1 RAID 5 RAID 6 LUN aggregation using meta devices Size Performance Virtual Provisioning Thin Pool Thin Devices/Fully allocated Simplifies storage provisioning Storage Tiers based on drive and protection ti Storage Templates Storage Policies Local and remote replication requirements * Existing Best Practices Apply 36
Storage: Optional File Services File Server for Vblock 1 and Vblock 2 Gateway configuration sharing CLARiiON or Symmetrix storage Vblock 1 NS-G2 2 Datamovers Vblock 2 NS-G8 2 8 Datamovers May be shared across multiple Vblocks 37
Storage Area Network Vblock 0 and Vblock 1U (2) Cisco Nexus 5010 Optional (8) 4 Gb N-ports to each Fabric Interconnect Vblock 1 (2) Cisco MDS 9222i or 9506 (8) 4 Gb N-ports to each Fabric Interconnect (4-8) 4 Gb N-ports to each CLARiiON Storage Processor Recommend MDS 9506 if >3 Vblock 1 Vblock 2 (2) Cisco MDS 9506 (8) 4 GB N-ports to each Fabric Interconnect (8-16) 4 GB N-ports to each Symmetrix V-Max engine Zoning and VSAN Based on application requirements and existing best practices 38
Storage Design Consideration Balanced configuration Capacity, connectivity, workload (IOPs / MBs) Availability Enterprise class storage RAID protection Extensive remote replication capabilities using MirrorView and SRDF Predictable Performance Large cache Tiered storage including FC, SATA and Enterprise Flash Drives (EFD) Ease of deployment and management Template based provisioning Wizards Fully Automate Storage Tiering (FAST) Virtual Provisioning Local replication capability using SnapView and TimeFinder 39
Vblock Infrastructure Packages: Open Management Framework 40
Vblock Open Management Framework Single Point of Management, Extensible Integration Framework Unified Vblock Management Interface Consolidated view into all Vblock infrastructure Single integration point IT self-service portal Mini service catalog and dashboard for selfprovisioning Policy-based management Fine-grained tracking, traceability, reproducibility System-wide compliance and remediation Automated discovery and deployment Enterprise Systems Management Platforms Enterprise Monitoring Platforms Configuration and Availability and Compliance Events Performance Events Unified Vblock Element Management Example: EMC Ionix UIM Provides Vblock Self-Service Portal, Service Profile Catalog, Policy Based Management, Unified Provisioning, Config and Change, Configuration Compliance Analysis, Infrastructure Recovery (DR) Vblock Vblock Symmetrix Vblock UCS Manager Symmetrix Management Console vcenter Management Console or UCS Manager Symmetrix Navisphere vcenter or UCS Manager Management Navisphere Console or vcenter Navisphere 41
Policy Driven IT Infrastructure IT Requirements # VMs Disk Capacity (MB) Synchronous Replication Fault Tolerant? Security Policy Etc Storage Template Compute Template Fabric Template Application Template Define Map Deploy Templates ensure repeatable, compliant IT processes IT defines storage, server, fabric and application and OS configuration policies to meet the business SLAs Resources rapidly assigned according to IT policies and SLA reducing time to application availability Reduces configuration error and non-compliance Reduce downtime and risk, Improve compliance 42
Vblock Infrastructure Packages: High Availability Framework 43
High Availability in the Vblock Physical redundancy Stateless compute, storage, hypervisor Redundant Storage Processors Redundant d SAN Switches Redundant Fabric Interconnects Redundant Fabric Extender Dual-port Mezzanine Cards Redundant fan trays Grid Redundant PSUs 44
Vblock Infrastructure t Packages Accelerating the Journey to Pervasive Virtualization and Private Cloud Benefits: Improve business responsiveness Reduce risk and operating expenses Support and manage Service-Level Agreements Resource allocation & utilization Security & Compliance Seamless integration with existing Management & Security frameworks Ensure security and minimize risk with certification paths Secure, Extensible, SLA-driven, Infrastructure 45
Thank You 46
High Availability in the Vblock Failure vnic/vhba Path Failure Blade Failure / Mezz Card Failure Interconnect Failure Server/Chassis Failure Storage Component Failure ESX Failure Fibre Channel Uplink Failure Recovery Mechanism Redundant Unified I/O Fabrics Automatic Fabric Failover for vnic EMC PowerPath for vhba HA Clustering across blades Redundant Interconnect modules VMware HA & FT EMC PowerPath HA Storage Architecture RAID Protection VMware HA & FT UCS Fabric Interconnect Pinning EMC PowerPath 47
Vblock Disaster Recovery Granular, Service-Aware Recovery options Geo- Cluster Vblock A Vblock B Vblock DR SRM VM F OTV VM F 1 VM F Local Cluster VM C1 VM C1 VM C3 VM C4 VM C5 VM C6 FT VM A VM A 1 SRM VM A SRM VM A HA PP/ve RAID VM B VM B DRS vsphere vsphere vsphere OTV OTV VMFS A-F FC, FCIP Synchronous Replication VMFS A-F FCIP Asynchronous Replication A, F Local Remote Geographically Remote 48