DO IT SMARTER Using SVC, Storwize V7000 and Tivoli Storage Productivity Center to Migrate Data Centers Johan van Arendonk
CONFIDENTIEEL E-STORAGE 2
Agenda Data center moves Our Data Migration Solution Migration Scenarios MPR (Multi Protocol Router) TPC Hints and Tips CONFIDENTIEEL E-STORAGE 3
Reasons for moving a data center Outsourcing Consolidation \ Standardization Merge Division CONFIDENTIEEL E-STORAGE 4
Types of Data center moves Total data center (Broom clean) Partial move Move from existence party CONFIDENTIEEL E-STORAGE 5
Requirements Deadlines None \ minor SLA concessions No loss of Performance Guarantee of data integrity and availability No consessions of HA and DR functionality Complete Rollback CONFIDENTIEEL E-STORAGE 6
Dependencies Knowledge Resources Motivation\Co-operation of outsourced organisation CONFIDENTIEEL E-STORAGE 7
What makes Storage migration complex? Compatibility Matrices Different Network infrastructures LAN, WAN, SAN Different Protocols FCP, iscsi, FCoE, NFS, CIFS Required Bandwidth and Storage Capacity CONFIDENTIEEL E-STORAGE 8
Solution for Complexibility CONFIDENTIEEL E-STORAGE 9
SVC\V7000 Enterprise features Advanced Copy Services Scalable (Hosts, Volumes, capacity) Thin Provisioning iscsi, FCoE support Tiering Storage pooling of multiple storage systems Volume Mirroring CONFIDENTIEEL E-STORAGE 10
Our solution: Data Migration Kit SVC (2145-CG8) - For Storage Virtualization - FC, iscsi en FCoE - Enterprise Features SAN Switches Independent from existing SAN infrastructure MPR SAN06B-R For FC replication over IP network / WAN Storwize V7000 Temporary storage for host migrations Storage capacity for change volumes LAN Switch Management LAN, independent from local LAN Management Server Independent from availability local server for management. CONFIDENTIEEL E-STORAGE 11
Data Migration Kit Design based on IBM SVC Internal storage based on V7000 Internal FC Fabrics, - no fabric merge needed with existing Fabrics. No ISL s or IFL s to existing Fabrics MPR used for data replication Connections to the outside world: - 4x FC connectors (SVC) to existing Fabrics - 1x 1Gb eth for management - 1x 1Gb eth for replication CONFIDENTIEEL E-STORAGE 12
Data center moves Our Data Migration Solution Migration Scenarios MPR (Multi Protocol Router) TPC Hints and Tips CONFIDENTIEEL E-STORAGE 13
SVC Image Mode Data Migration provides a direct block-for-block translation with no virtualization Site A Site B Host SVC node IO Group SVC node MPR SVC Global Mirror FCIP MPR SVC node IO Group SVC node IBM/HDS/EMC/etc Block Storage IBM/HDS/EMC/etc Block Storage CONFIDENTIEEL E-STORAGE 14
Basic migration steps Add SVC to SAN Fabrics Create zoning (Inter-node zone, SVC - Storage device zone, host to SVC zone) On existing Storage devices, define the SVC as a new host. On Storage device: unmap \ unmask existing luns from the host. On Storage device: map \ mask these luns to Host SVC On SVC: create a new host definition for the host that has to be migrated On SVC: detect the "new" luns coming from storage device On SVC: map the "new" luns as image mode vdisks to the host. On Host: replace multipath software (if necessary) On Host: rescan the "new" luns Start migration from Source SVC Cluster to Target SVC Cluster. CONFIDENTIEEL E-STORAGE 15
Situations we have tackled with SVC: Small Bandwidth between data centers Parallel FC and iscsi migration Multiple existing fabrics No Storage capacity left for migration Heterogeneous Backend storage devices Keeping current storage remote copy for DR in place CONFIDENTIEEL E-STORAGE 16
Small Bandwidth Use of Global Mirror Change Volumes SVC Cluster Site A SVC Cluster Site B vdisk0 Source vdisk8 Target vdisk9 Change vol vdisk11 Change vol Designed to allow for effective replication over lower bandwidth networks and to reduce any impact on production hosts CONFIDENTIEEL E-STORAGE 17
SVC\V7000 Change Volumes No SVC FlashCopy license needed RPO from minutes to hours (minimum 60 seconds, maximum 24 hours) Change volumes are always thin-provisioned Change volumes cannot be mapped to hosts CONFIDENTIEEL E-STORAGE 18
Small Bandwidth SVC Global Mirror with physical transport Site A Site B Host Flightcase Flightcase SVC node SVC node SVC node Global Mirror Re-sync SVC node SVC node SVC node GM IBM/HDS/EMC/etc Block Storage V7000 Temporary Storage V7000 Temporary Storage IBM/HDS/EMC/etc Block Storage SVC Volume Mirror CONFIDENTIEEL E-STORAGE 19
Volume mirror Vdisk1 is a GM target Mirror to Image mode vdisk Minimal Performance impact SYNCRATE can be modified CONFIDENTIEEL E-STORAGE 20
iscsi Migration VM VM VM VM VM Datastore Datastore iscsi initiator Node Node Node Node Block Storage Lefthand Block Storage SVC SVC GM Block Storage SVC CONFIDENTIEEL E-STORAGE 21
Data Migration with Multiple Fabrics Cust 1 Fabric Red Cust 1 Fabric Blue Cust 2 Fabric Odd Cust 2 Fabric Even IBM EMC HDS IBM HP CONFIDENTIEEL E-STORAGE 22
Data Migration with Multiple Fabrics MPR Cust 1 Fabric Red Cust 1 Fabric Blue Cust 2 Fabric Odd Cust 2 Fabric Even Node1 SVC Cluster Node2 IBM EMC HDS IBM HP CONFIDENTIEEL E-STORAGE 23
Data Migration with Keeping native synchronization Insourcing Site Customer Production Site Customer DR Site SVC GM Host Standby Host SVC Cluster SVC Cluster VDISK10 GM Target VDISK10 SYNC Source Array Native Synchronization LUN SYNC Target CONFIDENTIEEL E-STORAGE 24
Three Site Migration Site A to Site B normal GM Create FlashCopy vdisk10 - vdisk13 (both Site A) Create GM between Site A and Site C Start GM between Site A and Site C After interval: Stop GM between Site A and Site C Restart FlashCopy Re-start GM between Site A and Site C CONFIDENTIEEL E-STORAGE 25
Agenda Data center moves Our Data Migration Solution Migration Scenarios MPR (Multi Protocol Router) TPC Hints and Tips CONFIDENTIEEL E-STORAGE 26
Why MPR - Fabric Isolation - FCIP because of long distances - Flexible CONFIDENTIEEL E-STORAGE 27
MPR Connection (1) CONFIDENTIEEL E-STORAGE 28
MPR Connection (2) CONFIDENTIEEL E-STORAGE 29
MPR Configure a GbE port IP address: Configure IP Route Create FCIP tunnel Flags: -f = enable FastWrite -c = enable Compression 0 = disable compression 1 = Enables Standard compression 2 = Enables Moderate compression 3 = Enable Auto compression Total Effective Tunnel(s) Bandwidth <= 512 Mbps Agressive >512 Mbps and <= 2 Gbps Moderate >2Gbps Standard CONFIDENTIEEL E-STORAGE 30
MPR portcfg fciptunnel modify -c 3 CONFIDENTIEEL E-STORAGE 31
Agenda Data center moves Our Data Migration Solution Migration Scenarios MPR (Multi Protocol Router) TPC Hints and Tips CONFIDENTIEEL E-STORAGE 32
Where does TPC fit in: Base line before migration - What can you expect during migration Performance monitoring during migration - Keep performance SLA s Impact GM, Volume Mirror, FlashCopy - All running at the same time Performance monitoring after migration - Performance increase\decrease Shared Environment - How does existing backend react on new data Trouble shooting remote copy problems CONFIDENTIEEL E-STORAGE 33
SVC 1920 errors: Global and Metro Mirror persistent error. Possible causes: - Primary SVC cluster or SAN fabric problem (10%) - Primary SVC cluster or SAN fabric configuration (10%) - Secondary SVC cluster or SAN fabric problem (15%) - Secondary SVC cluster or SAN fabric configuration (25%) - Intercluster link problem (15%) - Intercluster link configuration (25%) Without TPC: finding the cause can be difficult. CONFIDENTIEEL E-STORAGE 34
Hints and Tips Prepare firewall rules FCIP TCP Port 3225 (Switch-to-switch management traffic) TCP Port 3226 (Actual Data traffic) TCP Port 3227 (WAN analysis tool, ipperf) Take advantage of lsvdisk bytes command To match exact size of Image Mode vdisk and GM Target vdisk Background copy, foreground copy, Partnership bandwidth, gmlinktolerance Understand how it works. Check Vdisk cache when unmapping mdisks from SVC fast_write_state empty Use Mdisk and Vdisk UID s Keep track of backend volumes CONFIDENTIEEL E-STORAGE 35
Summary IBM SAN Volume Controller \ Storwize V7000 Very flexible (for migration and in normal production environments) Tivoli Storage Productivity Center Provides visibility and control Helped us and customers In complex data migration scenarios To adapt the SVC\V7000 as standard virutalization solution CONFIDENTIEEL E-STORAGE 36
Thank You and Happy Moving! CONFIDENTIEEL E-STORAGE 37