Accelerating DevOps With Copy Data Virtualization. June, 2015

Size: px

Start display at page:

Download "Accelerating DevOps With Copy Data Virtualization. June, 2015"

Daniel Booth
10 years ago
Views:

1 Accelerating DevOps With Copy Data Virtualization June, 2015

3 Agile Development and DevOps Is Everywhere Your business is only as agile as its software CIO.COM 60% of CIOs use DevOps as a primary tool to address speed* 60% of Fortune 1000 companies look for automation as a primary DevOps initiative* 83% think that they achieved faster time-to-market because of adopting agile methodologies** 88% of development teams use Agile Development** 61% of the agile development champions are in the management teams** *IDC ** COPYRIGHT 2015 ACTIFIO 3

4 Dev Process. Good Tools For DevOps Code Check In, Frequent Builds SANDBOX DEV AQA QA UAT / STAGING Quick Iterations Compute Provisioning Ex: VMware Application Configuration Ex: Puppet/Chef COPYRIGHT 2015 ACTIFIO 4

6 The Speed Problem The Process DBA Creates copies & masks data The Physics Prototype DEV AQA QA UAT Dev requests copy. Tickets opened. Compute & storage is provisioned Change Management Request SLA 1 2 weeks SLA 1 week SLA 1 week Developer gets a masked copy Ex: The initial copy + 5 physical copies of 5 TB over 1 Gbps will take 5 days Production Data First Copy The same process and time is needed every time data refresh needs to be done COPYRIGHT 2015 ACTIFIO 6

7 Dummy Data Leads To Quality Problems Unit Testing Works Great!! Automated Integration Testing Works! Manual QA Testing Works It Does Not Work!!!!!! Prototype DEV AQA QA UAT Production Problems using dummy data Can t test scalability early Can t test boundary conditions early Bugs surface too late in DEV cycles Results Poor Quality Delayed Releases CRITICAL STAGES Dev vs Ops Blame Game COPYRIGHT 2015 ACTIFIO 7

$The Control Problem CSO\CISO Concerns Data not being masked No$ Increase surface area risk Fail compliance Easy Questions?

8 The Control Problem CSO\CISO Concerns Data not being masked No control on who can access copies No audit track-ability Results Increase surface area risk Fail compliance Easy Questions? How many copies exist? Where are they? Who has access? COPYRIGHT 2015 ACTIFIO 8

9 The Cost Problem Prototype DEV AQA QA UAT All these physical copies drive up costs Large burden on DBAs 1. Clone DB 2. Mask DB 3. Copy Masked DBs 4. Bring DB Online Production Data First Copy COPYRIGHT 2015 ACTIFIO 9

A New Approach: Virtualizing The Stack COMPUTE VIRTUALIZATION NETWORK VIRTUALIZATION DATA VIRTUALIZATION 2010+ 2012+

10 A New Approach: Virtualizing The Stack COMPUTE VIRTUALIZATION NETWORK VIRTUALIZATION DATA VIRTUALIZATION SERVER NETWORK STORAGE Commoditization of Hardware & Service Virtualization Through Software COPYRIGHT 2015 ACTIFIO 10

for instant access and protection DATA PROTECTION DATA INSIGHTS Virtual Data Pipeline

11 Copy Data Virtualization CAPTURE Data at block level, in native format, according to your SLA MANAGE A physical copy, moved once, and stored anywhere USE Unlimited virtual copies for instant access and protection DATA PROTECTION DATA INSIGHTS Virtual Data Pipeline BUSINESS CONTINUITY DATA MOBILITY GOLDEN COPY OF PRODUCTION DEV & TEST OTHER COPYRIGHT 2015 ACTIFIO 11

12 Data Virtualization For Dev-Ops SANDBOX DEV AQA QA UAT \ STAGING Near-Instant Virtual Copy Near-Instant Virtual Copy Near-Instant Virtual Copy Near-Instant Virtual Copy Near-Instant Virtual Copy Development 1. Near-Instant Virtual Copies 2. Self Service 3. Automated Online Virtual DB 4. Point In Time 5. Protect 6. Bookmark 7. APIs Operations 1. Role Based Access Control 2. Data Masking 3. Multi-Hypervisor, Cloud COPYRIGHT 2015 ACTIFIO 12

13 Central Admin By Ops Data Ingested in an incremental for ever fashion 2 Library of virtual copies for various PIT 3 SANDBOX DEV MS SQL DB MS SQL DB V1 V2 Vn AQA ORACLE DB ORACLE DB 1 Golden Copy Actifio V1 V2 4 Vn QA UAT \ STAGING Example: WHO can access SQL DB on WHAT servers WHO can access Oracle DB on WHAT servers Ops: Specify data protection policy. Ops: Specify RBAC for Dev users SUPPORT COPYRIGHT 2015 ACTIFIO 13

14 Self Service By Dev SANDBOX Dev: Self Service: LOGIN. BROWSE. SELECT PIT. MOUNT 5 7 MS SQL DB MS SQL DB V1 V2 Vn ORACLE DB DEV AQA Databases Come Up Online. DB Parameters Customizable. No DBA Needed. No Storage Admin Needed. 8 ORACLE DB Golden Copy Actifio V1 V2 Vn QA Dev: Protect test environment. 6 Dev: Near - Instant Virtual Copies UAT \ STAGING SUPPORT Production Support: Debug real world problems on real data. COPYRIGHT 2015 ACTIFIO 14 9

15 Uninterrupted Testing Accelerates Releases 1 9:00 AM EST 3 10:05 AM EST MS SQL DB MS SQL DB Golden Copy Actifio V1 V2 Vn TEST SERVER 1 QA uses this PIT version for testing Golden Copy Actifio V1 V2 Vn TEST SERVER 2 QA uses the same PIT version on another test server. Continues with other test cases 2 10:00 AM EST TEST CASES Rare issue reproduced. Need DEV to do RCA. But DEV is in 7 am PST. 4 12:00 PM EST MS SQL DB V1 V2 TEST SERVER 1 DEV starts RCA, Debugs, fixes problem, tests the fix QA also has to execute rest of these test cases Golden Copy Actifio Vn TEST SERVER 2 QA executes the rest of the test cases COPYRIGHT 2015 ACTIFIO 15

16 Bookmarks Allow You To Test With Confidence MS SQL DB V1 V2 TEST SERVER Golden Copy Actifio Vn 1 User uses this PIT version for testing; Sets up data protection of test environment. Ex: every 1 hour; Reactive Pro Active Bookmarks created every 1 hour v 2.1 v 2.2 v 2.3 1:00 pm 2:00 pm 3:00 pm 3:30 pm 3 2 Rewind back to 3:00 pm virtual copy bookmark and continue testing 3:30 pm: Testing causes unwanted data corruption Bookmarks created every 1 hour 1:00 pm 2:00 pm 2:15 pm 2:18 pm COPYRIGHT 2015 ACTIFIO 16 v 2.1 v 2.2 temp 5 4 User knows testing may cause data corruption. User creates a bookmark at 2:15 pm If testing causes corruption go back to 2:15 pm bookmark. Else continue testing and delete the 2:15 pm bookmark

17 Data Masking Data Refresh happens automaticall y 5 MS SQL DB Ops: Specify data masking scripts to invoke 1 Actifio has a masked copy that is ready to be consumed by Dev users Actifio 3 SANDBOX DEV AQA 4 Dev can select ONLY masked copies for tests ORACLE DB Golden Copy Masked Copy QA 2 UAT \ STAGING Actifio mounts the data to data masking server. Data is masked here DATA MASKING SERVER SUPPORT COPYRIGHT 2015 ACTIFIO 17

18 Consume Copies Using APIs User Name: Password: LOGIN Welcome to Data Services Login to access virtual copies BROWSE You have access to following virtual copies Virtual Copies App1 App2 App3 MS SQL Oracle GlassFish Test Servers TestServer1 TestServer2 TestServer3 CONNECT Select virtual copies that you want to mount Virtual Copies Test Servers App1 MS SQL TestServer1 Ap2 App2 Oracle TestServer2 App3 GlassFish TestServer3 MOUNT API 1 API 2 API 3 COPYRIGHT 2015 ACTIFIO 18

Key Benefits: Copy Data Virtualization for DevOps HIGHER SPEED Develop & Test Apps Faster UAT & Release Apps Faster Support Apps Faster Self Service For Dev, QA, DBA BETTER QUALITY Catch & Fix Bugs

19 Key Benefits: Copy Data Virtualization for DevOps HIGHER SPEED Develop & Test Apps Faster UAT & Release Apps Faster Support Apps Faster Self Service For Dev, QA, DBA BETTER QUALITY Catch & Fix Bugs Early Minimize Last Minute Surprises Release Products On Time MORE CONTROL Role Based Access Control (WHO, WHAT, WHICH) Data Masking LOWER COSTS Minimize Storage Costs Minimize Burden On DBAs Minimize Burden On IT COPYRIGHT 2015 ACTIFIO 19

20 Example Business Cases

21 Thank You Brian Reagan Actifio Proprietary and Confidential

DATABASE VIRTUALIZATION AND INSTANT CLONING WHITE PAPER

DATABASE VIRTUALIZATION AND INSTANT CLONING TABLE OF CONTENTS Brief...3 Introduction...3 Solutions...4 Technologies....5 Database Virtualization...7 Database Virtualization Examples...9 Summary....9 Appendix...