Virtualization: A Resiliency Enabler Dennis Wenk Principal Business Consultant dennis.wenk@hds.com April 2007 2006 Hitachi Data Systems The Demands Are Changing It is ALL about Never Failing, Non-stop Business Value is Created by Reducing Defect and Avoiding Failures Achieving Balance Between Sensible Investments And Risk Alignment of Business and IT is the primary objective 2 Growing Reliance on Complex Technology Technology Expand Opportunities And And Increase Efficiencies Increase Dependency Efficiencies On Integrated and Interconnected Infrastructures Large Dependency Number Of On Complex Integrated Technologies and Interconnected Infrastructures Reliance On Technology Introduces Risk Large Number Of Complex Technologies Failures & Accidents Are Possible In Complex Environments Even Reliance with Competent, On Technology Ethical, Expert Introduces Oversight Risk Failures & Accidents Are Possible In Complex Unknowingly Accepted Too Much Risk Environments Even with Competent, Ethical, Expanding Expert Risks Oversight Increase Loss Potential Nature Unknowingly Of Threats Accepted Has Changed Too Much Risk Expanding Susceptibility Risks To Low-tech Increase Weapons The Potential For Loss Losses On A Scale Not Previously Experienced Nature Of Threats Has Changed Exposures to Catastrophic Loss is Real but Unlikely Susceptibility To Low-tech Weapons Hackers, Network Outages, Hardware Failures Even Losses successes On A Scale like Seasonal Not Previously & Unexpected ExperiencedBusiness Surges can cause Exposures a Material to Catastrophic Losses Loss is Real but Unlikely 3 1
It is about the DATA asset Business Continuity Is an Operational Risk Data Protection Objective Data Features Are Components Data Are Irreplaceable Corporate Assets Can t Buy a Replacement Copy of Vital Records Without a any Copies, Loss Is Irreversible and Permanent Transactions Value and Speed Have Both Dramatically Increased Reconstruction of Transactional Data Difficult or Impossible Storage a Primary Component to Every BC Solution Redundancy is Worthless Without Mission Critical Data Rapid Recoverability Is Paramount Data Integrity Essential Data Offerings Are Central to BC Solutions Tolerance for Data Loss Is Inversely Proportional to Data Value To Minimize Loss, Copy Must Be Made As Soon As Possible 4 Enter Storage Virtualization NicK Allan, IT Expo Oct 17-22, The Future of Storage l The SNIA Dictionary http://www.snia.org/education/dictionary/v/ defines virtualization as An act of integrating one or more (back end) services or functions with additional (front end) functionality for the purpose of providing useful abstractions. Typically virtualization hides some of the back end complexity, or adds or integrates new functionality with existing back end services. 5 Virtualization An Enabler Aggregate a group of independent storage devices into a single pool of storage capacity independent of their physical location Mask the differences between heterogeneous devices Facilitate the use of storage tiers to match data life cycle needs Simplify and Unify heterogeneous control and management under a single interface Dynamically allocate capacity as needed to any class of storage Enable the matching of the storage resources to the business requirements with assurance of QoS iscsi GigE iscsi NAS FC ESCON FICON Linux/Windows Hitachi WMS100 Hitachi AMS Series SATA Storage with FC & SATA Intermix 6 2
What s Different About Storage? Storage is all about State Preserving the state of data, the state of applications, the state of the business Processor cycles and network bandwidth are transient like electricity and water Storage is mechanical It can not tolerate long delays or timeouts It can not tolerate out of order records It can not drop records Storage Networks must guarantee in order delivery FC uses buffer credit flow control IP Networks are best efforts 7 Different Approaches to Storage Virtualization SAN s are the third leading cause of application failures, with an average outage of 25.5 hours Disaster-Resource.com 2006 8 : Switch vs. Controller Switch based remote replication SW backplane 1 2 3 I/O Port App blade I/O Port 4 through the switch incurs a lot of overhead since it must get information from the Controller from controller to controller is more efficient since it already knows where data is located in the storage Controller replication can be done out side of the operational network The heavy lifting for storage and data management should be done at the edge of the network and not in the core Controller based remote replication 9 3
Virtualization in the Storage Controller No added complexity or latency Not limited to SAN connection Existing Controller functions are mapped across external storage No new standards or APIs required Preserves end-to-end security Virtualization is done at the Controller level as it has been done for many years There is no intermediary step to migration data WAN 10 Non-Disruptive Data Migration between Heterogeneous Storage Systems Open Systems SAN The Storage Virtualization enables non-disruptive data migration Provides the foundation for a tiered storage infrastructure and data lifecycle management Hitachi Lightning 9980 V Hitachi Lightning 9970 V Hitachi Thunder 9585 V EMC CLARiiON DMX Hitachi TagmaStore AMS1000 11 Heterogeneous, Multi Database Environment Integrated Heterogeneous Platforms Mainframe Exchange UNIX Disparate Products Complex Interoperability between sites SATA Less flexibility to change SLAs 10:00:01 09:59:01 10:01:59 Maintain Recovery Consistency Crash Consistency 10:01:59 Edge 09:59:01 I/O Directors Core Consistency High End Switches Directors Data Consistency Data Base Consistency Speed Recovery Process Operational Recovery 10:01:59 Disaster Recovery New Vendor 09:59:01 Reduce Exposures Redeploy Minimize Risks Low Cost Alternate Site 09:55:59 09:58:55 09:57:21 09:57:53 09:58:31 09:57:53 09:58:31 12 4
Example of Heterogeneous Multi Database Environment Integrated Heterogeneous Platforms Alternate Site SATA Mainframe Exchange Edge Directors Switches Core Directors 10:00:01 All Storage Virtualisation High End 09:55:59 Virtualisation UNIX Redeploy New Vendor SATA Low Cost 13 Remote Issues Issues Processing wait-delays during a synchronous remote-replication until secondary copy is updated Asynchronous remote-replication create time delays of the remote mirror Write order and time sequence must be maintained Write I/O s Must Occur In The Proper Order And At The Proper Time RAID Striping means that data is spread across multiple physical drives Resends Due To Network Anomalies Means That I/O s Potentially Arrive Out Of Sequence. Any Delay In The Communication Link Causes A Backup At The Primary Site Potentially Exceeding the Limited Cache Size Primary site Target site Cache Cache 14 Pull replaces Push Written data is chronologically reflected to the secondary site via journal volumes The journal supports consistency across multiple volumes The journal is copied by the remote system Sorting by time stamp, sequence number Journal data is stored in the journal volume Primary site Transfer of the journal file to the remote subsystem Journal Data is written to application volume Target site Journal is transferred asynchronously 15 5
3 Site Remote With Delta Resync 2 Data Centers With Synchronous Have Immediate Recovery When Production Site Has A Fatal Failure. 3 System Solution Uses New Delta Resync Between Hot-standby Site And Remote Recovery Site To Provide Rapid Recovery With No Data Loss. Synchronous Data copied is is also stored in in Vol. and Data is is managed with unified SEQ #s among the 3 systems. Primary site After the failure, the at at the Hot Standby Site applies the delta changes to the at at the Remote Recovery Site to rapidly recover all data up to the point of disaster Intermediate Location Target site Takeover 16 Summary Virtualization Facilitates Data Migration and Remote Storage Controller Virtualization Has Advantages in Remote Pull Versus Push Remote Mitigates Storage & Network Issues Simultaneous Synchronous & Asynchronous Remote Provides Resiliency Rapid fail-over for Short-duration interruptions Overcomes out-of-region catastrophic exposures 17 Thank You Questions? dennis.wenk@hds.com 2006 Hitachi Data Systems 6