Best Prac*ces for Deploying Oracle So6ware on Virtual Compute Appliance CON7484 Jeff Savit Senior Technical Product Manager Oracle VM Product Management October 1, 2014
Safe Harbor Statement The following is intended to outline our general product direc*on. It is intended for informa*on purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or func*onality, and should not be relied upon in making purchasing decisions. The development, release, and *ming of any features or func*onality described for Oracle s products remains at the sole discre*on of Oracle. 3
Program Agenda 1 2 3 4 5 Oracle s Virtual Compute Appliance overview Oracle VM Features and Architecture Oracle s Virtual Compute Appliance Best Prac*ces Where to get more informa*on 4
Oracle s Virtual Compute Appliance Overview Oracle VM Por5olio 5
Overview The Oracle s Virtual Compute Appliance is an engineered system for quickly deploying Oracle VM environments It is a converged infrastructure system containing compute, storage, and network resources, all automa*cally discovered and configured The Virtual Compute Appliance is designed for robustness, resiliency, and for applicability to a wide range of VM applica*ons The combina*on of infrastructure and management enables faster VM deployment, faster *me- to- value, lower management cost and higher ROI 6
Oracle VM Features and architecture Oracle VM Por5olio 7
Oracle Virtualiza*on Strategy Making So6ware Easier to Deploy, Access, Manage and Support Virtualiza*on for Oracle: Transform the way you deploy and manage applica*ons Engineer for demanding workloads Unify support for the so6ware solu*on stack Applica*on- Driven Virtualiza*on Top- down approach instead of bocom- up Focus is on applica*ons, not just infrastructure Provide value to the business, not just cool technology
Oracle VM Server Virtualiza*on and Management Oracle VM Manager & Enterprise Manager Manage hundreds- or thousands of servers Central Java management server Web browser- based management console Advanced virtualiza*on management including Dynamic Resource Scheduling (DRS), HA, Dynamic Power Management Oracle VM Server for x86 Installs on bare- metal servers in about a minute Guest opera*ng systems: Solaris on x86, Linux, & Windows Support for paravirtualized- and hardware- virtualized kernels & drivers
Oracle VM 3 Deployment Architecture Oracle VM Manager Browser UI Manage mul*ple server pools Create, configure, clone, share, boot, migrate VMs Convert other virtual machine formats Server pools HA groups Resource groups Live Migra*on groups Shared Storage Repositories NFS, Fibre Channel, iscsi Networks Separate Guest HA Live Migration Storage Management Support heterogeneous configurations Share storage between multiple pools and clusters. Ability to share raw device between VMs Server Pool 1 Oracle VM Servers x86 SPARC * Oracle Storage Storage Repository Partner Storage Server Server Pool Pool 2 2 Virtual Machines Oracle Solaris Oracle Linux Red Hat Enterprise Linux Centos SuSE SLES Microsoft Windows
Oracle s Virtual Compute Appliance 11
Oracle s Virtual Compute Appliance (VCA) The Engineered System for Oracle VM The preceding slides described the architecture and features of Oracle VM Wouldn t it be nice if it could come in a pre- built system and: Include compute hosts, high performance network and storage Design and automa*cally configure all the components so I don t have to That means automa*ng out most of the slides just presented Be designed for availability and performance out of the box Let me manage the en*re system as a single unit That is what the Virtual Compute Appliance does 12
Oracle Engineered Systems Unlock Business Poten*al Converged Infrastructure Systems Unlock Time and Resources TradiGonal Infrastructure Converged Infrastructure Lengthy integration Hundreds of connections Exponential complexity Factory integrated Simple connections Designed for reliability and ease of management
Oracle s Engineered Systems Pormolio Leadership in the converged infrastructure market NEW! Exadata Database Appliance Exalogic Big Data Appliance SuperCluster Oracle s Virtual Compute Appliance ExalyGcs Copyright 2014, Oracle and/or its affiliates. All rights reserved.
The Virtual Compute Appliance From Power on to producgon in about an hour Pre- built, ready to use with minimal setup Automa*c Discovery and installa*on of components Removes the integra*on risk of deployment Integrated apps provisioning with pre- built templates Fully virtualized system with built in so6ware defined networking for ul*mate flexibility
Solu*on: Oracle s Virtual Compute Appliance Enables operagon of the system as one unit, not individual servers Add compute by automa*cally discovering, installing, and adding servers Web- based central front end mgmt console End- to- end automagon and orchestragon So6ware Defined Networking (SDN) automates set- up (leveraging Oracle Fabric Interconnect) Handles installa*on, upgrade, and HA behind the scenes Dynamic resource management Unique full stack: rapid applica*on deployment with Oracle VM Assemblies Fits easily into exisgng data centers Run any x86- based OS and applica*on without modifica*ons Use Oracle or 3rd party storage Easy. 16
Ini*al User Experience: Hardware Provisioning Ready to create VMs and deploy assemblies in about an hour Power on the rack(s) Appliance auto- configures and auto- provisions [~45 minutes more if full rack] - Discovers and provisions compute nodes - Configures internal storage, NFS shares, iscsi LUNs - Creates server pool, and Oracle VM storage repository Log in to configure management IP/Hostname [~5 minutes] Simple expansion Physically install new compute node and turn it on Appliance auto- provisions new node, making it ready to use Fast.
Get Infrastructure Faster, Get Applica*ons Faster Only Oracle can speed both infrastructure and applica*on deployment Virtual Compute Appliance: Power- on to fully configured applica*ons in 1-2 hours Other converged infrastructure: Days or weeks Full Enterprise Applica*on Stack VMs Hardware Servers Storage Network Minutes - 2 hours 1 hour with VCA
Oracle s Virtual Compute Appliance X4-2 Hardware Specifica*ons Overview Network 40Gb/s Server- to- Server Compute Nodes Oracle Sun X4-2 Servers 2 to 25 nodes CPU: Up to 400 cores / 800 threads aggregate Memory: Up to 6.4TB aggregate Only 3 cables per server, fully redundant Storage Four 4x10GbE Fabric Interconnect Ethernet Switch InfiniBand Expansion InfiniBand Expansion Fabric Interconnect Compute Nodes Mgmt Nodes Management Storage Networking Management Oracle Fabric Interconnect F1-15 Oracle Switch ES1-24 Oracle Sun Data Center Infiniband Switch 36 Oracle Sun Data Center Infiniband Switch 36 Oracle Fabric Interconnect F1-15 Oracle Sun X4-2 Servers Oracle Sun X4-2 Servers Oracle ZFS Z3-ES Storage Appliance Redundant controllers, RAID storage
Oracle s Virtual Compute Appliance X4-2 So6ware Overview Oracle VM Server VirtualizaGon All major x86 opera*ng systems Oracle Linux Oracle Solaris Microso6 Windows Server Virtualization and Guest OSes Guest OS* Oracle SDN Networking Server Virtualization Virtual Compute Appliance controller Oracle VM Manager Oracle Fabric Manager Automation & Management * Refer to documenta/on for addi/onal Guest OS support informa/on
Virtual Compute Appliance Components Storage Internal, included storage as system disk Opera*onal storage required for storing management so6ware System disk : 1 x Oracle ZFS Z3- ES Storage Appliance HA controllers 2 x 1U controller / heads 2U disk tray (24 spindles) About 6TB of user- space available External storage: New or exis*ng Oracle or third- party storage NFS or iscsi direct from the guest VMs
Use with Exis*ng or New External Storage NFS or iscsi from the Guest VMs External connec*vity 16 (up to 52*) 10Ge ports FC* ports included Oracle s Virtual Compute Appliance *Planned for future support Copyright 2014, Oracle and/or its affiliates. All rights reserved.
Oracle ZFS Storage Appliance Storage Expansion for Oracle Virtual Compute Appliance Environments High- throughput for 1000s of VMs Op*mized for IOPS, throughput, and file sharing workloads High- availability with up to 2.6PBytes capacity Powerful DTrace storage analy*cs Visual and interac*ve Manage workloads down to the VM level Co- engineered with Oracle Virtual Compute Appliance, Oracle Database, and Oracle Apps Reduced risk Reduced complexity Lower TCO The performance of Flash with the cost of Disk DTrace Storage AnalyGcs ZFS Storage Appliance
Oracle Virtual Networking in the Virtual Compute Appliance 40Gb/sec throughput fabric Converged infrastructure Fewer switches, cards and cables Flat architecture Simple topology, fewer *ers So6ware defined networking Dynamic provisioning of resources Network Isola*on without reliance on VLANs Oracle Fabric Interconnect Oracle SDN
Best Prac*ces 25
VCA incorporates best prac*ces designed in at the factory Numerous engineering and design steps are needed to properly configure an Oracle VM environment Problems and service requests result from mis- configura*on especially in network and storage configura*on Oracle VM is not unique in this, and easier than some, but non- trivial Virtual Compute Appliance addresses this head- on: Automa*cally pre- configures and discovers resources Complex, bricle topologies designed out Isola*on and robustness as default proper*es Fewer Best Prac*ces needed, since fewer configura*on details to get wrong. That s a primary goal of an appliance 26
Best prac*ces with Virtual Compute Appliance There is s*ll a need for guidance A subset of general Oracle VM best prac*ces More things to NOT do, rather than new things to do Keep it simple and it s already done for you are organizing principles VCA discovers and names servers, creates and names pools and networks Do not undo these manually: keep the names and objects created for you Network and storage separa*on are already done Different networks so no need for VLANs to separate VM traffic from mgmt Private and public VM networks can be done with or without VLANs 27
Best Prac*ces with Virtual Compute Appliance and Oracle VM Compute nodes are automa*cally discovered and added to a server pool Compute node == Oracle VM server in Virtual Compute Appliance language Each is named ovcacnnnr1, where NN is the rack unit posi*on The pool (Rack1_ServerPool) defined automa*cally. Currently there is one rack, and all the compute nodes in the rack belong to it. You can change Secure VM Migrate se{ng and Distributed Resource Management policies Don t delete or rename the pool, and don t add addi*onal pools 28
Best Prac*ces with Virtual Compute Appliance and Oracle VM Storage is discovered and used for repositories: ZFSSA has shared Rack1-Repository for VMs and objects available to all nodes Each node has a private repository ovcannr1-localfsrepo on local storage It can only be used for VMs that run only on that compute node. There are uses cases for which this is fine (eg: compute grid) but it should be understood before being used Space is limited in the internal ZFS appliance. It s the VCA s system disk The Best Prac*ce is to use external storage for capacity and IOPS Use internal storage for (rela*vely small) OS system disks External ZS3 appliance connected to the VCA s Infiniband network. Manually create iscsi or NFS repositories and present them to the VCA s servers: normal OVM NAS storage (NFS, iscsi, CIFS/SMB) mounted by the guest VM just as if the VM was running on a physical server. Soon: FC storage to add external LUNs to guest VMs 29
Oracle VM best prac*ces with Virtual Compute Appliance - backup Compute nodes (dom0) do not need explicit backup Usual prac*ce is to recreate a lost server no persistent data there Guest contents are what you protect, and that data lives elsewhere Best pracgce: use external storage, especially ZFS to use snapshots, replicagon Note internal ZFS contents have media and appliance head resiliency Can use ZFS snapshots or Oracle VM clones for oops and overwrites Internal ZFS is not on external network, so cannot backup directly. Use management node as bas*on host to copy from ZFSSA (scp works fine). Backup external guest disk contents just as on bare metal Backup via RMAN, Golden Gate, NetBackup, etc Storage management, informa*on life cycle like non- virtual system 30
Best Prac*ces with Virtual Compute Appliance and Oracle VM Networks are predefined in HA bond pairs, and channels (roles) assigned. Availability, and isola*on for security and non- interference are built- in Virtual machines on the datacenter s network and on a private internal network The VM networks are vm_private and vm_public_vlan Don t remove or rename items built by the automated processes IMPORTANT: make sure VCA unit is connected to datacenter switch at install *me! The main ac*vity expected is to create addi*onal VLAN segments on the exis*ng VM network channels. Other than that, there s licle or no administra*on needed or expected MTU 9000 on VM channels so you can use jumbo frames if desired. Best Prac*ce: use vm_private for traffic between VMs. Never leaves the internal InfiniBand fabric, fast, private, no load on public network 31
Virtual Compute Appliance networks ConnecGvity for guests and management Networks mgmt_public_eth vm_public_vlan vm_private To add VLANs on vm_public_vlan or vm_private: Usage Management and non- VLAN VM network Default choice for guest external connec*vity VLAN 1 from the VLAN Group vm_public_vlan_vgrp Inter- VM network traffic. VLAN 1 from the VLAN Group named vm_private_vgrp Add tags or IDs to vm_public_vlan_vgrp (external) or vm_private_vgrp (internal) VLAN groups. The create VLAN- only network with VM role modeled on vm_public_vlan or vm_private
Best Prac*ces with Virtual Compute Appliance and Oracle VM Best Prac*ces is not just about physical infrastructure Best Prac*ce with the Virtual Compute Appliance (and Oracle VM in general) is to make use of pre- built virtual machine templates Or: simple case, cloning golden VMs Create a standardized, repeatable model for deployment with self- contained appliance virtual machines Eliminate effort, reduce configura*on errors Oracle VM and the Virtual Compute Appliance support this with templates, assemblies and fast VM clones 33
Rapid Infrastructure AND Applica*on Deployment Create VMs manually from ISO images or (beaer) from ready- to- run Oracle VM Templates/Assemblies Simple example: Oracle Linux or Solaris VM [~1 minute] Complex example: Oracle RAC cluster with 16 nodes [~45 minutes] VCA Oracle VM Assembly ProducGon Environment: SOA_PROD_1 SOA_PROD_1 Deployed: Server ProducGon Environment SOA_PROD_1 Pool 1 Download VM VM VM WebLogic Server VM VM DB VM Deployment Policies ConfiguraGon Metadata Deploy Pre- installed, pre- configured, ready to run VMs containing applica*ons Management nodes 34
Applica*on Templates & Assemblies Oracle VM Assembly Produc*on Environment: SOA_PROD_1 SOA_PROD_1 Deployed: Produc*on Environment SOA_PROD_1 VM VM VM WebLogic Server VM VM DB VM Deployment Policies Configura*on Metadata OVF- based Deploy Oracle VM Servers Server Pool 2 Storage Repository Deploy applica*on into Oracle VM Manager as Golden Image Clone, ini*alize, and start- up instance Up and running in hours vs. days or weeks with licle risk 3 Guest Addi*ons Allows direct integra*on between guest so6ware and virtualiza*on layer Assists in orchestra*on of complex, mul*- VM deployments
Summary 36
Summary The Virtual Compute Appliance offers converged infrastructure that can be deployed rapidly and easily in exis*ng Data Centers Oracle VM supports features like virtual machine templates for quick deployment of virtual machines The combina*on of infrastructure and management enables faster deployment, lower management cost and higher ROI 37
Where to get more informa*on 38
Other Virtual Compute Appliance Sessions @ OpenWorld Data Center Op*miza*on with Virtual Compute Appliance Thursday, October 2 at 10:45 AM Intercon*nental Hotel, Grand Ballroom B See us doing live demos in the Engineered Systems showcase Moscone North, bocom of escalators Visit Secure- 24 Demo pod Moscone South, Oracle Linux and Virtualiza*on showcase, #611 39
Resources Virtual Compute Appliance public home page: hcp://oracle.com/vca Virtual Compute Appliance public documenta*on page: hcp://www.oracle.com/technetwork/server- storage/engineered- systems/ virtual- compute- docs- 2082161.html Youtube video hcps://www.youtube.com/watch?v=zt9s6etv_s 40
Safe Harbor Statement The preceding is intended to outline our general product direc*on. It is intended for informa*on purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or func*onality, and should not be relied upon in making purchasing decisions. The development, release, and *ming of any features or func*onality described for Oracle s products remains at the sole discre*on of Oracle. 41
42