Storage Virtualization from clusters to grid

Transcription

1 Seanodes presents Storage Virtualization from clusters to grid Rennes 4th october 2007

2 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

3 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

4 Company Information Founded in 2002 Mission : To provide storage software solutions for commoditized infrastructure Result of several years of research conducted in a major French research center: IRIT 1st prize in the 2003 National Competition for Creation of Innovative Technological Companies (CETI) R&D Team 23 people

5 Partners Technology Partners Research Institutes & Universities

6 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

7 No virtualization: Direct Attached Storage Clusters heterogeneity Hardware, CPUs, OS, interconnect, storage device (SATA, SCSI, SAS, SSD Storage clients: File systems, data bases Applications Properties and limitation of DAS Management doesn t scale Local storage Scalability is local to storage node Load balancing between nodes is difficult Failure management is difficult Direct Attached Storage

8 SAN / NAS virtualization NAS/SAN benefits Shared storage Easier to manage Connect to I/O nodes AS IP FC SAN NAS/SAN drawbacks Incompatibility between systems Hardware costs for High performance systems Bottleneck for data access still exists

9 SAN / NAS virtualization appliance Appliance benefits SAN Mask heterogeneity Manage dynamicity of storage Provide clients (FS, db ) unified data access Load balancing FC NAS SAN/NAS virtualization IP p Appliance drawbacks Additional Hardware Costs of hardware to manage scalability performance and fault tolerance

10 Commodity hardware virtualization: Shared Internal Storage SIS innovation SAN FC NAS Performance Capacity SAN/NAS virtualization IP cialized hardware Commodity hardware p Software only solution Transparent to clients (file systems an database) Mask storage resources heterogeneity and dynamicity Provide fault tolerance capability Fully symmetric architecture Scalability Easy administration

11 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

12 Exanodes features and functionalities Exanodes: a clustered block device virtualization solution for Linux clusters Exanodes uses unused local nodes storage devices in Linux clusters and turns them into a fault tolerant and high performing clustered storage system Exanodes provides a symmetric storage solution with unmatched I/Os parallelism : computing nodes are also storage nodes Exanodes is compatible with Linux file systems (ext3, xfs, GFS ) and is non intrusive Exanodes SIS: clustered block virtualization on commodity hardware Cost effective solution relying on existing devices in clusters

13 Exanodes : features & functionalities High performance shared storage on commodity hardware Using storage devices in parallel provide I/Os treatments speed up Use of high performance interconnect (Gigabit Ethernet, Infiniband) as data path grows storage bandwidth and reduce latency Fault tolerant shared storage system with RAIN: Redundant Array of Inexpensive Nodes Tolerate nodes or disks failures Storage clients (file systems, data Bases) always see a coherent and available logical volume even if nodes or disks fail Mask blocks heterogeneity and dynamicity to file systems and raw device applications Manage heterogeneous storage devices (SATA,SCSI, SAS ) Bidirectional scalability: adding nodes in a cluster, add both shared storage and computing resources

14 Exanodes : file system integration Features Benefits Ease of installation Ease file system management Multiple File system support Local : EXT 3 Clustered : GFS Exanodes with GFS Exanodes provides to GFS a clustered block device, managing storage device heterogeneity and failures GFS manages data coherency on an Exanodes block device Increased performance and scalability due to SIS No additional hardware required for fencing

15 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

16 Grid Virtualization : increased complexity SAN NAS SAN Cluster Grid DAS gateway gateway heterogeneity several clusters WAN geographic distribution latency NO YES multiple sites WAN >> LAN gateway gateway capacity cumulated capacit SIS SIS SIS N/S N/S SAN dynamicity cumulated failures security multi domains

17 Storage services in Grid middleware : VISAGE Applications genomic biomedical // computing... Specialized services resources data authorization confidentiality... ViSaGe: storage components other grid services Grid services admin & monitor visagefs virtualizer Middleware Globus toolkit

18 ViSaGe Virtualizer : Role Heterogeneity is managed unified access ViSaGe: storage components admin & monitor visagefs virtualizer main goals: -performance -fault tolerance Geographic location and latency management migration replication several consistency protocols Read One Write All (large R/W ratio) Majority (small R/W ratio) Weak consistency Large capacity and dynamicity automatic administration Security

19 Toward Global Virtualization : ViSaGe + SIS Actual Futur SIS VISAGE DAS WAN SIS SIS VISAGE WAN SAN N/S NAS

20 Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion

21 Conclusion Move away from the complexity of the traditional storage architectures Adopt the SIS concept! Contacts

22 Q&A

23 Contacts Marc Descamps, Founder & technical director Mathieu Avila, Developper Yoann Lechevallier, Pre sales engineer