Seanodes presents Storage Virtualization from clusters to grid Rennes 4th october 2007
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
Company Information Founded in 2002 Mission : To provide storage software solutions for commoditized infrastructure Result of several years of research conducted in a major French research center: IRIT 1st prize in the 2003 National Competition for Creation of Innovative Technological Companies (CETI) R&D Team 23 people
Partners Technology Partners Research Institutes & Universities
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
No virtualization: Direct Attached Storage Clusters heterogeneity Hardware, CPUs, OS, interconnect, storage device (SATA, SCSI, SAS, SSD Storage clients: File systems, data bases Applications Properties and limitation of DAS Management doesn t scale Local storage Scalability is local to storage node Load balancing between nodes is difficult Failure management is difficult Direct Attached Storage
SAN / NAS virtualization NAS/SAN benefits Shared storage Easier to manage Connect to I/O nodes AS IP FC SAN NAS/SAN drawbacks Incompatibility between systems Hardware costs for High performance systems Bottleneck for data access still exists
SAN / NAS virtualization appliance Appliance benefits SAN Mask heterogeneity Manage dynamicity of storage Provide clients (FS, db ) unified data access Load balancing FC NAS SAN/NAS virtualization IP p Appliance drawbacks Additional Hardware Costs of hardware to manage scalability performance and fault tolerance
Commodity hardware virtualization: Shared Internal Storage SIS innovation SAN FC NAS Performance Capacity SAN/NAS virtualization IP cialized hardware Commodity hardware p Software only solution Transparent to clients (file systems an database) Mask storage resources heterogeneity and dynamicity Provide fault tolerance capability Fully symmetric architecture Scalability Easy administration
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
Exanodes features and functionalities Exanodes: a clustered block device virtualization solution for Linux clusters Exanodes uses unused local nodes storage devices in Linux clusters and turns them into a fault tolerant and high performing clustered storage system Exanodes provides a symmetric storage solution with unmatched I/Os parallelism : computing nodes are also storage nodes Exanodes is compatible with Linux file systems (ext3, xfs, GFS ) and is non intrusive Exanodes SIS: clustered block virtualization on commodity hardware Cost effective solution relying on existing devices in clusters
Exanodes : features & functionalities High performance shared storage on commodity hardware Using storage devices in parallel provide I/Os treatments speed up Use of high performance interconnect (Gigabit Ethernet, Infiniband) as data path grows storage bandwidth and reduce latency Fault tolerant shared storage system with RAIN: Redundant Array of Inexpensive Nodes Tolerate nodes or disks failures Storage clients (file systems, data Bases) always see a coherent and available logical volume even if nodes or disks fail Mask blocks heterogeneity and dynamicity to file systems and raw device applications Manage heterogeneous storage devices (SATA,SCSI, SAS ) Bidirectional scalability: adding nodes in a cluster, add both shared storage and computing resources
Exanodes : file system integration Features Benefits Ease of installation Ease file system management Multiple File system support Local : EXT 3 Clustered : GFS Exanodes with GFS Exanodes provides to GFS a clustered block device, managing storage device heterogeneity and failures GFS manages data coherency on an Exanodes block device Increased performance and scalability due to SIS No additional hardware required for fencing
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
Grid Virtualization : increased complexity SAN NAS SAN Cluster Grid DAS gateway gateway heterogeneity + +++ several clusters WAN geographic distribution latency NO YES multiple sites - +++ WAN >> LAN gateway gateway capacity + +++ cumulated capacit SIS SIS SIS N/S N/S SAN dynamicity + +++ cumulated failures security + +++ multi domains
Storage services in Grid middleware : VISAGE Applications genomic biomedical // computing... Specialized services resources data authorization confidentiality... ViSaGe: storage components other grid services Grid services admin & monitor visagefs virtualizer Middleware Globus toolkit
ViSaGe Virtualizer : Role Heterogeneity is managed unified access ViSaGe: storage components admin & monitor visagefs virtualizer main goals: -performance -fault tolerance Geographic location and latency management migration replication several consistency protocols Read One Write All (large R/W ratio) Majority (small R/W ratio) Weak consistency Large capacity and dynamicity automatic administration Security
Toward Global Virtualization : ViSaGe + SIS Actual Futur SIS VISAGE DAS WAN SIS SIS VISAGE WAN SAN N/S NAS
Agenda Seanodes Presentation Overview of storage virtualization in clusters Seanodes cluster virtualization, with Exanodes Seanodes grid virtualization, ViSaGe virtualizer Conclusion
Conclusion Move away from the complexity of the traditional storage architectures Adopt the SIS concept! http://www.seanodes.com Contacts marc.descamps@seanodes.com yoann.lechevallier@seanodes.com mathieu.avila@seanodes.com
Q&A
Contacts Marc Descamps, Founder & technical director marc.descamps@seanodes.com Mathieu Avila, Developper mathieu.avila@seanodes.com Yoann Lechevallier, Pre sales engineer yoann.lechevallier@seanodes.com