Providing Self-Service, Life-cycle Management for Databases with VMware vfabric Data Director

Transcription

1 Providing Self-Service, Life-cycle Management for Databases with VMware vfabric Data Director Graeme Gordon Senior Systems Engineer, VMware 2013 VMware Inc. All rights reserved

2 Traditional IT Application Team DBA System Admin Storage Admin Network Admin Days - weeks to provision a development environment

3 Database Infrastructure Challenges Development Postgre Production Postgre Test Postgre UAT Shadow IT Postgre Enterprise DBA Security Compliance Routine Tasks

4 Forrester Survey Finds a Variety of Resource Constraints in Serving Businesses

5 Virtualization Changed the Game Hardware Consolidation License Infrastructure IT Admin Database Virtualization saves time and cost. Why not virtualize databases?

6 Virtualization is the start of a Journey! Private Cloud DBaaS Automated Lifecycle Management Database Virtualization CIO DB Consolidation IT Automation agility Business of routine License savings Developer tasks and admin Quality productivity of Agility Service Centralized Control Security

7 vfabric Data Director Powers Database-as-a-Service for your Cloud Enables database-aware virtualization on VMware vsphere and provides database-as-a-service for heterogeneous databases and Hadoop Reduce capex through database-aware virtualization Increase IT agility Accelerate analytics and application development Save cost by through database and Hadoop virtualization Automate database and Hadoop lifecycle management Through self-service and automation

8 vfabric Data Director Enables database-aware virtualization on VMware vsphere Provides self-service lifecycle management for heterogeneous databases: Database creation, execution, and retirement Physical to Virtual (P2V) database conversion Data migration between platforms and environments Database and O/S patching and upgrading Backup and recovery Database cloning High availability Resource allocation Currently supports Oracle, SQL Server, vfabric Postgres and Hadoop. Oracle 10g R2, 11g R2

9 Data Director will help you: 1. Stretch Your Servers 2. Liberate Your Licenses 3. Double Your DBA Productivity 4. Secure Your Stuff

10 Data Director will help you: 1. Stretch Your Servers 2. Liberate Your Licenses 3. Double Your DBA Productivity 4. Secure Your Stuff

11 We Looked at 700,000 Servers The average PRODUCTION Oracle Database Instance uses: 4% of CPU 2MB/second of Network 1200 IOPS The average SQL Server database only does slightly better (about 5% CPU). This does not strain a modern server in any way.

12 The Average Oracle DB Fits Easily in a Virtual Machine VM 64 vcpu VM 1TB VM >1,000,000 IOPS VM > 36Gb/s Oracle DB 2 4 CPU 4% utilized Oracle DB 4 8GB 50% utilized Oracle DB 1200 IOPS Oracle DB 2MB/s CPU Memory Disk I/O Network I/O Source: VMware Capacity Planner analysis of > 700,000 servers in customer production environments

13 How Can We Do Better? Virtual Server 75% 25% Physical Server 5% 95% You can consolidate databases on a single server without affecting 0% 20% 40% overall 60% performance. 80% 100% Used Unused Overhead

14 Traditional vs. Virtual Architecture Traditional Architecture Virtual Architecture

15 vmotion

16 Distributed Resource Scheduler Resource Pool VMware ESX VMware ESX VMware ESXi Physical Servers

17 High Availability Resource Pool VMware ESX VMware ESX VMware ESXi Operating Server Failed Server Operating Server

18 Why You Should Care Virtualizing your databases brings: 1. Reduced Hardware Maintenance Costs 2. Minimized Power and Cooling Costs 3. Lowered Administration Costs 4. Avoided Hardware Refresh Costs 5. Decreased Data Center Space 6. Diminished Downtime for End Users Changes to your databases are typically not required. See Whitepaper Total Economic Impact Of VMware vsphere Virtualizing Mission-Critical Oracle Databases, August 2011

19 Data Director will help you: 1. Stretch Your Servers 2. Liberate Your Licenses 3. Double Your DBA Productivity 4. Secure Your Stuff

20 How Can We Use fewer Licenses? Virtual Server 75% 25% Physical Server 5% 95% Oracle and SQL Server are typically licensed by core. If you consolidate by a factor of 10-15x 0% 20% 40% 60% 80% 100% you Used will need Unused far fewer Overhead licenses.

21 A Single License Management Pane Don t get a million dollar surprise because you couldn t track your database licenses.

22 Data Director will help you: 1. Stretch Your Servers 2. Liberate Your Licenses 3. Double Your DBA Productivity 4. Secure Your Stuff

23 How Many Databases Can a DBA Manage?

24 Data Director Accelerates Productivity Before After Self Service Developers/ Administrators DBAs IT Policy Database Team Foundation Tickets Developers IT

25 Data Director Architecture Data Director Application DB Management Server Linux Database Template Library Database Database Database Monitoring Agents Monitoring Agents Monitoring Agents Operating System Operating System Operating System TEMP SWAP LOG DATA T Shell Virtual Machines vcenter ESXi

26 Provision Any Database from a Web Portal

27 Create Your Own Databases, Virtually Data Director Application DB Management Server Linux Database Template Library Database Monitoring Agents Operating System TEMP SWAP LOG DATA T Shell Virtual Machines New Database Based Linked to Parent Template Database Monitoring Agents Operating System

28 A Data Director Database Has a unique ID and IP address Uses binaries from linked clone disks on the parent template Database Monitoring Agents Operating System Runs software and database processes locally (in the VM) Stores data locally (inside the VM)

29 Upgrading or Patching a Database Data Director Application DB Management Server Linux Oracle 11.1 Template Oracle 11.1 Monitoring Agents Linux Oracle 11.2 Template Oracle 11.2 Monitoring Agents Linux DB Based on Oracle Template Oracle Monitoring Agents Linux

30 Cloning a Database Data Director Application Oracle 11.1 Template Shell Virtual Machines DB Management Server Linux Oracle 11.1 Monitoring Agents Linux TEMP SWAP LOG DATA T DB Based on Oracle 11.1 Template Exact Empty Clone DBVM of DB Oracle 11.1 Monitoring Agents Linux Oracle 11.1 Monitoring Agents Linux

31 Linked Clones of a Database Data Director Application Oracle 11.1 Template Shell Virtual Machines DB Management Server Linux Oracle 11.1 Monitoring Agents Linux TEMP SWAP LOG DATA T DB Based on Oracle 11.1 Template Linked Empty Clone DBVM of DB Oracle 11.1 Monitoring Agents Linux Oracle 11.1 Monitoring Agents Linux The linked clone is a separate DB that shares the original storage and keeps a local copy of disk block changes.

32 Complex Operations Made Simple Creating or cloning a database takes about 5 minutes.

33 Administrators Are Still In Control Standards and Best Practices are automatically enforced.

34 Users Still Get What They Need Users can still configure some options and parameters, guided by policy and best practices.

35 Why You Should Care Using Data Director, complex database operations are automated and simplified. 1. Database Creation 2. Database Cloning 3. Data Movement 4. Backup and Recovery 5. Load Balancing 6. Database Retirement Developers and Analysts can create their own databases without an administrator.

36 How Can I Virtualize a Physical Database Data Director Application Oracle 11.1 Template Shell Virtual Machines DB Management Server Linux Oracle 11.1 Monitoring Agents Linux TEMP SWAP LOG DATA T Physical DB Server Clone Empty of Physical DBVM DB Oracle 11.1 Monitoring Agents Linux

37 How Many Databases Can a DBA Manage with Data Director? We break the direct relationship between DBAs and the number of databases under management.

38 Data Director will help you: 1. Stretch Your Servers 2. Liberate Your Licenses 3. Double Your DBA Productivity 4. Secure Your Stuff

39 Database Security is Baked In Concepts like database expiration are built into the provisioning process.

40 Network Security is Baked In Network Security is built into the provisioning process as well.

41 Centralized DBaaS monitoring All service level actions are closely monitored, logged, and tracked.

42 Customized Event Monitoring You can define your own custom triggers for compelling security and compliance events.

43 A Real World Use Case A Production Finance Database has data quality problems and an analyst needs to examine some highly sensitive data. This is a very difficult challenge for: 1. Security 2. Compliance 3. Database Operations 4. System Administration

44 A Real World Use Case Data Director can: Create a linked clone of the original database that has an identical O/S and DB configuration. Ensure changes do not impact original DB. Automatically discover and mask sensitive data. Expire and delete the linked clone after 7 days. Automatically remove any backups or snapshots. Quickly create and apply a patch any databases with a similar configuration. Security Compliance Database Operations System Administration

45 Data Director Summary Stretch Your Servers Liberate Your Licenses Reduce Costs by > 50% Consolidate servers by 10 15X Save on Hardware, Software, Power and Cooling Use the Right Database for the Job Use the most cost-effective licensing for your application Leverage low-cost HA and clustering with vsphere DBA Productivity Don t Let Your DBAs Hit the 40 DB Ceiling Automate provisioning and management Enforce policies and best practices automatically Secure Your Stuff Keep Your Data Secure With Automation Make security a holistic part of the database lifecycle. Help admins keep systems patched and up-to-date.

46 Resources For more information about vfabric Data Director visit the product website: Other resources: Product evaluation center Learning Series Videos vmware.com/hadoop projectserengeti.org

47