Abhi Rathinavelu Foster School of Business

Transcription

1 Abhi Rathinavelu Foster School of Business

2 What is Disaster? A disaster is considered any incident or event that results in a major interruption of business operations Major: Earthquake >5.0, Volcanic Eruption, Tsunami, Storm, Fire, Flood, Terror Attacks Minor: Heavy Snow, Equipment Failure, UW Cafeteria Food? ;-)

3 Disaster Recovery Disaster recovery (DR) is the process, policies and procedures related to preparing for recovery or continuation of technology infrastructure critical to an organization after a natural or human-induced disaster. Disaster recovery is a subset of business continuity.

4 Disaster Recovery today 82 percent of established enterprise systems do not have effective protection against problems such as data corruption, accidental deletion, system crashes, viruses, or environmental disasters - Vulnerability Index Study (1997).

5 Why Disaster Recovery? 48-hour system or network outage would put 20% of Fortune 500 companies out of business- Study by the University of Minnesota in Rochester. Average time to get back up and running after a disaster is three to five days- Study by Contingency Planning Research

6 Cost of Disaster Recovery The World Trade Center bombing left the mission-critical systems of Fortune 500 companies isolated and inaccessible. One of the banks in the building lost revenues estimated at US$20 million per day, or $13,889 per minute.

7 Disaster Recovery Planning Subset of Business Continuity Planning (BCP) and handled by Business Impact Analysis (BIA) Recovery Time Objective (RTO) Time taken to recover from Disaster Recovery Point Objective (RPO) Acceptable amount of Data loss Service Level Agreement (SLA)

8 Recovery Approaches for Online service Webserver (Front End) and Database recovery enabled by High Availability (HA) Clusters Data center Failover enabled by Geographically dispersed Data centers

9 Recovery Approaches for online service Data Replication and Remote Backup for use during Recovery Testing Disaster Recovery Deployment Periodic Disaster Recovery exercise

10 Online Service Architecture

11 Online Service Architecture

12 Assess the Risk of Disaster Identify Outage Scenarios - Identify Application data impacted

13 Assess the Risk of Disaster Identify Failure Scenarios # Failure Scenario Cause Recovery 1 Web Servers lost Local failure in DC Provision from spares Redeploy site 2 Database Clusters lost Local failure in DC Provision from spares Restore from local DB backups 3 Storage array lost Local failure in DC Provision from spares Restore from local DB backups 4 VA data center lost Regional failure Bring up WA servers, redeploy site, restore from WA backups

14 Web server Recovery Combination of Hardware re-provisioning Code redeployment Restore from backups Communicate with customers

15 Database cluster recovery An Online Web service maintains info about past transactions with its users in the form of database rows, in-memory data structures, and files on disk Re-provision hardware, re-deploy codebase Restore remote backups from other DC Identify and retrieve Application Data Storage Array recovery is similar

16 Data Center Failover Failover is switching to a redundant or standby computer server, system, hardware component or network upon the failure or abnormal termination of the previously active application, server, system, hardware component, or network. Multi-Datacenter Architecture enables Data Center Failover Active-Active or Active-Passive Ensure Communication with partners

17 Data Center Failover In case of a disaster, the available DC can run independently until the other (failed) DC is brought back online Promote Secondary to Primary and all remote database replicas Data lost recovery and re-sync messages Functionality level verification

18 Testing Disaster Recovery Small scale Production like Test environments which may be in the same Production domain Functional Tests validating the customer experience and the features of the software during and after Disaster recovery. Check for change in Application behavior. Performance tests validating the impact of bringing up remote replicas in different data center

19 Practicing Disaster Recovery Handed over as a list of steps called Standard Operating Procedure (SOP) Review Periodically the steps for Disaster recovery and add new scenarios Typically owned and executed by the Site Operations weekly or monthly

20 Recap Define the Disaster Recovery Plan Assess the Risks Identify types of Recovery Approach Test Disaster Recovery Practice Disaster Recovery

21 Time s Up! About you: Name: Abhi Rathinavelu Department: Foster School of Business Contact Information: abhi99@uw.edu Quick bio: Software Engineer, MBA Student