Section 2 : Storage Networking Technologies and Virtualization Storage Virtualization Chapter 10 EMC Proven Professional The #1 Certification Program in the information storage and management industry
ISM Course Organization Information Storage and Management Section 1 Storage System Section 2 Storage Networking Technologies and Virtualization Section 3 Business Continuity Section 4 Storage Security and Management Introduction to Information Direct-Attached Storage and Introduction to Securing the Storage and Management Introduction to SCSI Business Continuity Storage Infrastructure Storage System Environment Storage Area Networks Backup and Recovery Managing the Storage Infrastructure Data Protection: RAID Network-Attached Storage Local Replication Intelligent Storage System IP SAN Remote Replication Content-Addressed Storage Storage Virtualization
Chapter Objectives Upon completion of this chapter, you will be able to: o Identify different virtualization technologies o Describe block level virtualization technologies o Describe file level virtualization technologies o Discuss virtual provisioning
Lesson Virtualization Overview Upon completion of this lesson, you will be able to: o Identify and discuss virtualization technologies
What is Virtualization o Virtualization is a technique of abstracting physical resources in to logical view o Increases utilization and capability of IT resource o Simplifies resource management by pooling and sharing resources o Significantly reduce downtime o Planned and unplanned o Improved performance of IT resources
What is a Virtual Machine?
Virtualization Comes in Many Forms Virtual Memory Each application sees its own logical memory, independent of physical memory Virtual Networks Each application sees its own logical network, independent of physical network Virtual Servers Each application sees its own logical server, independent of physical servers Virtual Storage Each application sees its own logical storage, independent of physical storage 7
Memory Virtualization Virtual Memory Each application sees its own logical memory, independent of physical memory Physical memory App App App Swap space Benefits of Virtual Memory Remove physical-memory limits Run multiple applications at once 8
Network Virtualization Virtual Networks Each application sees its own logical network, independent of physical network VLAN A VLAN B VLAN C Switch Switch VLAN trunk Benefits of Virtual Networks Common network links with accesscontrol properties of separate links Manage logical networks instead of physical networks Virtual SANs provide similar benefits for storage-area networks 9
Server Virtualization Before Server Virtualization: After Server Virtualization: Application App App App Operating system App App App Operating system Operating system Single operating system image per machine Software and hardware tightly coupled Running multiple applications on same machine often creates conflict Underutilized resources Virtualization layer Virtual Machines (VMs) break dependencies between operating system and hardware Manage operating system and application as single unit by encapsulating them into VMs Strong fault and security isolation Hardware-independent
Storage Virtualization Servers o Process of presenting a logical view of physical storage resources to hosts o Logical storage appears and behaves as physical storage directly connected to host o Examples of storage virtualization are: o Host based volume management o LUN creation o Tape virtualization Virtualization Layer o Benefits of storage virtualization: o Increased storage utilization o Adding or deleting storage without affecting application s availability o Non disruptive data migration Heterogeneous Physical Storage
Lesson Summary Key topics covered in this lesson: o Various forms of virtualization o Memory, network, server and storage virtualization Additional Task Research on Virtual LAN & Virtual SAN
Lesson Storage Virtualization Implementation Upon completion of this lesson, you will be able to: o Discuss SNIA virtualization taxonomy o Describe Block Level Virtualization technologies and implementation o Describe File Level Virtualization technologies and implementation
SNIA Storage Virtualization Taxonomy What is created Storage Virtualization Block Virtualization Disk Virtualization Tape, Tape Drive, Tape Library Virtualization File System, File/record Virtualization Other Device Virtualization Where it is done Host Based Virtualization Network Based Virtualization Storage Device/Storage Subsystem Virtualization How it is implemented In-band Virtualization Out-of-band Virtualization
Storage Virtualization Requires a Multi Level Approach Server Path management Volume management Replication Storage Network Path redirection Load balancing - ISL trucking Access control - Zoning Storage Volume management - LUNs Access control Replication RAID
Storage Virtualization Configuration Servers Servers Virtualization Appliance Virtualization Appliance Storage Network Storage Network Storage Arrays Storage Arrays Out-of-Band In-Band (a) In out-of-band implementation, the virtualized environment configuration is stored external to the data path (b) The in-band implementation places the virtualization function in the data path (a) (b)
Storage Virtualization Challenges o Scalability o Ensure storage devices perform appropriate requirements o Functionality o Virtualized environment must provide same or better functionality o Must continue to leverage existing functionality on arrays o Manageability o Virtualization device breaks end to end view of storage infrastructure o Must integrate existing management tools o Support o Interoperability in multivendor environment
Block Level Storage Virtualization o Ties together multiple independent storage arrays o Presented to host as a single storage device o Mapping used to redirect I/O on this device to underlying physical arrays o Deployed in a SAN environment o Non disruptive data mobility and data migration o Enable significant cost and resource optimization Servers Virtualization Applied at SAN Level Heterogeneous Storage Arrays
File Level Virtualization Before File-Level Virtualization Clients IP Network Clients After File-Level Virtualization Clients Clients IP Network Virtualization Appliance File Server Storage Array File Server File Server Storage Array File Server NAS Devices/Platforms Every NAS device is an independent entity, physically and logically Underutilized storage resources Downtime caused by data migrations NAS Devices/Platforms Break dependencies between end-user access and data location Storage utilization is optimized Nondisruptive migrations
Lesson: Summary Key points covered in this lesson: o Storage virtualization challenges o Storage virtualization configuration o Types of storage virtualization Additional Task Research on Global File Virtualization
Concept in Practice EMC Invista Host Inside the Intelligent Switch Mapped I/O streams Storage Input I/O stream Mapping operation Intelligent Switches: EMC Invista Fibre Channel switches with custom hardware for enhanced processing Capable of performing operations on data streams at line speed Controlled by instructions from external management software (via APIs)
Invista Video Click here Additional Task Research on EMC Invista
Concept in Practice: EMC Rainfinity File Virtualization Appliance File-data migration Event Log File Virtualization inserted into I/O Client redirection Global Namespace updated Migration complete without down time Global Namespace Manager DFS AD Automount NIS LDAP NFS4 Root root NIS LDAP
Rainfinity Video Click here to play the video Additional Task Research on EMC Rainfinity
Lesson: Virtual Provisioning Upon completion of this lesson, you will be able to: o Explain Virtual Provisioning o Describe and explain Thin vs. Traditional LUNs o Explain the benefits of Virtual Provisioning o Explain how to create, monitor, and manage Thin LUNs
What is Virtual Provisioning o Capacity on demand from a shared storage pool o Logical units presented to hosts have more capacity than physically allocated o Physical storage is allocated only when the host requires it o Provisioning decisions not bound by currently available storage o Above and beyond Thin Provisioning o Includes management tools that make it easier to configure, use, monitor and manage Thin Pools and Thin LUNs Host Reported Capacity Shared Storage Pool Allocated Allocated Allocated Storage perceived by the application is larger than physically allocated storage
Traditional Provisioning vs. Virtual Provisioning 1650 GB Or 1.65 TB Available Capacity LUN 1 LUN 2 LUN 3 Traditional Provisioning 350 GB Actual Data Storage System Virtual Provisioning
Virtual Provisioning Benefits o Reduce administrative costs o Simplifies storage provisioning o Over provisioning can eliminate challenges of expansion o Reduces time required to repeatedly add storage capacity o Reduce storage costs o Increased space efficiency for primary storage and replicas o Storage on demand from shared storage pool o Deploy assets as needed o Reduce levels of unused physical storage o Avoid pre allocating physical storage to applications o Reduce operating costs o Fewer disks consume less power, cooling and floor space o Reduce downtime o Less disruptive to applications
Virtual Provisioning Thin Pool Expansion o Adding drives to the pool non disruptively increases available shared capacity for all Thin LUNs in pool o Drives can be added to a Thin Pool while pool is being used in production o Allocated capacity is reclaimed by the pool when Thin LUNs are deleted Test & Dev Pool 2 Additional Disk Drives
Traditional vs. Thin LUNs Use RAID Groups and traditional LUNs o When microseconds of performance matters o For the best and most predictable performance o For precise data placement o You are not as concerned about space efficiency Use Virtual Provisioning with Thin Pools and Thin LUNs o When the best space efficiency is needed o For minimal host impact o When energy and capital savings are paramount o For applications where space consumption is difficult to forecast
Lesson Summary Key points covered in this module: o Virtual Provisioning o Thin vs. Traditional LUNs o Benefits of Virtual Provisioning
Chapter Summary Key points covered in this chapter: o Virtualization technologies and forms o SNIA storage virtualization taxonomy o Storage virtualization configuration o Storage virtualization challenges o Types of storage virtualization o Virtual provisioning overview
Check Your Knowledge o What are the four forms of virtualization? o Difference between in band and out of band implementation. o What are the challenges of storage virtualization? o What is virtual provisioning?
Cloud Storage Infrastructure EMC Proven Professional The #1 Certification Program in the information storage and management industry
Cloud Computing Video
Challenges with Traditional Storage Approach o Not designed to scale in the multi petabyte o Addition of new arrays for capacity enhancement o Cost and management overhead o Increased time to market o Can address transactional and distributed computing o But fell short for Internet Era requirements o Designed for Operation Within IT s Walls
Cloud Storage Infrastructure: The Big Picture o To deal with Internet Era data growth o A massively scalable infrastructure is required o One that offers global data distribution, self healing, self management, and multi tenancy features o A Cloud approach to storage o A cost effective approach to handling internet era data growth o Focusing on five key infrastructure requirements o Infinite Scale o No Boundaries o Operationally Efficient o Self Management o Self Healing
Use of Cloud Computing Resources o Cloud computing takes hold as 69% of all internet users have either stored data online or used a web based software application Source: Use of Cloud Computing Applications and Services, Pew Internet & American Life Project, 9/12/2008
Defining Cloud Computing Cloud Computing is an emerging IT development, deployment and delivery model, enabling real time delivery of products, services and solutions over the Internet (i.e. enabling cloud services) o Services include o Software as a Service (SaaS) o Storage as a Service (Staas) o Computing as a Service (CaaS) o Hardware as a Service o Examples: o Amazon: Elastic Compute Cloud (EC2), Simple Storage Services (S3) o Google Apps o Storage Cloud Decho (Mozy Online Backup), EMC Atmos o Salesforce.com
Cloud Services: o In cloud execution o Offsite, provided by third party o Accessed via Internet o Not bound to corporate/private network o Minimal/no IT skills to implement o Users need not have expertise o Provisioning o Self requesting o Pricing o Fine grained & usage based pricing capability o User Interface o Simple, not tied to any specific device/platform o System Interface o Web based standard framework o Shared resources o Shared asset approach
Cloud Applications o Enterprise Solutions o Transactional data or high performance file sharing applications o Example: Amazon EC2 o Cloud storage infrastructure o Example: EMC Atmos o End user Solutions o Rich Internet applications and online service providers o Examples: Social media sites, Online photo sharing o Online data backup o Example: Mozy online backup Additional Task Research on Cloud Storage & EMC Atmos
Concept in Practice Atmos Video Click to Read KS2009 Contest Winning Paper - Is Cloud Computing the Game Changer your Company Needs in These Tough Times?
Exercise & Quiz Take the Online Assessment
External Links o VMware Optimize and manage your IT infrastructure, from the desktop to the data center, by virtualizing your computing systems. o Rainfinity File Virtualization Family Virtualize your unstructured data environment and move data including active, open files without disruption. Simplify management of your NAS infrastructure and lower TCO as part of your ILM strategy. o Invista Add intelligence to your existing SAN infrastructure to achieve non disruptive operations, to eliminate planned downtime, and to centralize and streamline storage management and mobility. o Ionix IT Compliance Analyzer Application Edition Automatically identify, monitor and alert IT managers of application configurations and dependencies that violate user defined policies, industry regulations and standards, and best practices. o Ionix Server Manager Gain automated root cause and business impact analysis for virtualized servers and applications. o Ionix Application Discovery Manager Automated, real time discovery and dependency mapping for applications and their hosts across virtual and physical environments. Accurately manage change impact, control configuration drift, correlate infrastructure incidents to application impact, populate CMDBs, and drive data center consolidation, migration and virtualization. o Ionix ControlCenter Simplify and automate tasks such as discovery, monitoring, reporting, planning, and provisioning for large, complex physical and virtual infrastructures. o Visit http://www.emc.com/products/category/virtualization.htm for more information
Quiz End of Section 2 o Storage Networking Technologies and Virtualization o Direct Attached Storage and Introduction to SCSI o Storage Area Networks o Network Attached Storage o IP SAN o Content Addressed Storage o Storage Virtualization Section 2_Quiz For Instructor Use Only Take the Online Assessment Section 2 Answers ** Click to Open the Documents
For your Reading on www.emc.com o Understand Basics of virtualization, Review analyst paper, whitepapers & Customer Stories o Visit : http://www.emc.com/campaign/virtualization.htm
EMC Virtualization Server Virtualization VMware SAN Virtualization Invista Complete Virtualization Solutions File Virtualization Rainfinity
For your Reading on www.vmware.com o Vmware Whitepapers http://www.vmware.com/solutions/whitepapers.html o Technical Resources http://www.vmware.com/resources/techresources/
Watch the Full Keynote Address on www.emcworld.com/keynotes.htm or www.youtube.com/emccorp Keynote Address Paul Maritz President and CEO VMware, Inc. Click to View the Presentation Watch the 2009 Keynote Next Event
Additional Information Attend Free Webinars on http://www.emc.com/events/ondemand-events.esp Customer Showcase More Videos on www.youtube.com/pointbb www.youtube.com/emccorp Demo Fundamentals Product Showcase Tech Trends Tech Deep dives Best Practices
#1 IT company For more information visit http://education.emc.com