(Scale Out NAS System)

Transcription

3 NAS Storage Trend Current NAS systems which suitable for data sharing on network faced problems occurred by increasing clients and processing huge I/O. New Scale-out NAS system expands its market to solve the problem. Traditional NAS Scale-Out NAS Clients Network WAN + SCALEWAY New SCALEWAY Performance and capacity expansion issues Limitation on single file system size Number of active headers limit Over-Provisioning on storage Multiple mount points File location management required File duplication (Affects read performance) TCO reduction management Just-in-time expansion Independent expansion of performance or capacity Higher utilization rates Non-disruptive technology Integration of management Automated and policy based management Copyright 2010 by Netclips, Ltd. All rights reserved -2-

4 Why Scale-Out NAS Storage? Many enterprises require high-performance storage solutions which can process non-linear high-capacity data like multimedia, digital contents increased geometrically and huge number of files created by applications. Scale-Out NAS Provides integration and management of data over Petabytes Reducing TCO Clients Group Cloud storage on all kinds of business data types, automated and integrated hierarchical storage and 1G/ 10G/ IB information lifecycle management Billions of files are supported by self managed and automated policy based tiered storage Provides capacity expansion, fastest search, backup/restore, expandability, modular design, SAN or Direct availability and flexibility Supports intellectual load-balancing and dynamic thin-provisioning Starts from small but expandable when business requirement changes Shared Disk Pool Copyright 2010 by Netclips, Ltd. All rights reserved -3-

5 What is SCALEWAY? (Scale Out NAS Gateway) Guaranteed high-performance NAS solution which has improved its performance and scalability in the fundamental limits of existing storage products. Copyright 2010 by Netclips, Ltd. All rights reserved -4-

6 SCALEWAY Characteristics l Customized bandwidth configuration from minimum 2 to over 1,000 nodes l Internal storage virtualization makes customized volume configuration for the customer l 14PB on single volume (multiple volume configuration can be possible) l Same vendor or heterogeneous vendors storage support l Reducing TCO by expanding/reducing storage using thin-provisioning l User friendly web based GUI management l Storage policy using ILM l High-cost snapshot, mirroring, replication option included as default l Provides integration and management of data over Petabytes l Designed to expand by Petabytes scale on single global namespace l Cloud storage on all kinds of business data types l automated and integrated hierarchical storage and information lifecycle management l Billions of files supported by tiered storage based on automated policy l Capacity expansion, fastest search, backup/restore, replication l Provides availability, flexibility by modular design l Supports intellectual load-balancing and dynamic thin-provisioning l High-performance, expandability, availability l expandability supported when business requirement changes Copyright 2010 by Netclips, Ltd. All rights reserved -5-

7 Scaleway Infrastructure Client Group UNIX/LINUX Windows MAC Network I/F (NFS, CIFS, FTP, HTTP) 1G/10G Ethernet, Infiniband... Array Group: FC, SAS, SATA, PCI-ex 4G/8G FC, PCI-ex Copyright 2010 by Netclips, Ltd. All rights reserved -6-

8 SCALEWAY I/O Structure Client Data Client Group TCP/IP LAN SCALEWAY.... Storage Volume Disk Array Every SCALEWAY nodes can access storage volumes Clients can access storage volumes through all SCALEWAY nodes SCALEWAY node can be extended to over 1,000 nodes and all nodes are working as active In case of SCALEWAY node failure, the I/O is maintained via other SCALEWAY node by automatic fail-over, and uninterrupted increase or decrease SCALEWAY nodes and storages. By the client s requirements, SCALEWAY nodes can make performance higher and bottlenecks can be solved fundamentally Copyright 2010 by Netclips, Ltd. All rights reserved -7-

9 Automatic Fail Over /Data Clients SCALEWAY node Shared Storage When node or network fails, SCALEWAY handles I/O separately via other live nodes In failure situation, SCALEWAY stores shared storage using other nodes automatically Copyright 2010 by Netclips, Ltd. All rights reserved -8-

10 Flexible Performance Improvement Structure Group 1 Group 2 Group 3 Group 4 Clients TCP/IP LAN Scaleway Nodes.... Extended to over 1,000 nodes Bandwidth SCALEWAY s performances can be improved through adding SCALEWAY nodes by linear When increasing clients and I/O access, it is N Node 기본 : n*4gb easy to solve performance problem by adding SCALEWAY node (to over 1,000 1 (Gb) 1 (Node) 2 3 1Gb NIC : n*12gb 10Gb NIC : n*20gb Max 1,000 Node nodes) Increase or decrease of SCALEWAY nodes when it is on-line Copyright 2010 by Netclips, Ltd. All rights reserved -9-

11 Petabytes Single Volume File System Clients LAN (1Gb/10Gb) SCALEWAY node 14.4PB Maximum 14.4PB on Single volume... Storage Storage can be expanded, regardless of storage vendors FC, SAS, SATA storage can be applied differently for the work depends Copyright 2010 by Netclips, Ltd. All rights reserved -10-

12 Thin Provisioning Adding New Storage Removing Storage X 80% 80% 80% 60% 60% 60% 60% Shared Storage Pool 30% 30% 30% 30% 40% 40% 40% Shared Storage Pool Disk configuration necessary capacity only on on-line status (not required total capacity on initial installation) Volume decrease on on-line status by removing unnecessary disks File system reconfiguration is based on striping (can only on expanding volume space) No data corruption and configured automatically or manually Copyright 2010 by Netclips, Ltd. All rights reserved -11-

13 Easy Management using Web based GUI Storage consolidation through GUI S/W management (web browser access) Supports all OS based on Java Real-time storage usage monitoring notification by storage fault level User Quota Management Cluster Node Management File System Management Storage Usage Management Copyright 2010 by Netclips, Ltd. All rights reserved -12-

14 Storage Policy (ILM) Based on user s data operation policy, storage configuration inside single file system can be possible Separating storage pools (FC, SAS and SATA disks) to maximize operation efficiently for purposes During operation of several pools, data moving between pools by policy adaption can be possible Storage pooling can be possible by dividing storage classes into hierarchical structure System Storage Network Enterprise: Priority Data Area Mid-Rang : Genera Data Area Low-end: Archive Area Tape Copyright 2010 by Netclips, Ltd. All rights reserved -13-

15 Default Feature - Snapshot Using snapshot, it is used for backup and test purpose without damaging real data Instant replication based on Point-in-Point In case of logical data damage, user can restore using scheduled snapshot information Replicated volumes can be used for various purpose Maximum 256 snapshots per file system Snapshot is default feature Storage Snapshot Snapshot MON 09:00 개발/Test TUE 10:00 WED 15:00 Backup Copyright 2010 by Netclips, Ltd. All rights reserved -14-

16 Default Feature - Replication A Site B Site TCP/IP LAN TCP/IP LAN SCALEWAY Cluster SCALEWAY Cluster Original Volume A Backup Volume B WAN Backup Volume A Original Volume B Console Console Replication Asynchronous replication by file Can be built as low cost through LAN/WAN infrastructure Can be built different type of storages between main and backup center Copyright 2010 by Netclips, Ltd. All rights reserved -15-

17 Default Feature - Mirroring Mirroring Providing synchronous replication to storages inside a cluster, making highavailability solution to access data from mirrored disks when a disk fails Block level intra-cluster replication by node (synchronous) Configured as subset of file system Copyright 2010 by Netclips, Ltd. All rights reserved -16-

18 TRANSFER Agent TRANSFER Agent is a customizable data transfer/lifecycle management module to support work environments via connecting with extra-systems for broadcasts, HSM operations and archiving. Watch folder feature : An automatic file transfer from source to destination Supported source volumes : Any file system including SNFS(Xsan) Supported sending file protocols : CIFS, FTP TRANSFER Agent Management Client Transfer error correction by manual request to resend Transfer logs : Filename, start/finish time and/or date to send, transfer results, etc. To re-send, select unsuccessful file(s) and press Re-Send button only Source Network Destination Network Moved by non-digitalized way Copyright 2010 by Netclips, Ltd. All rights reserved -17-

19 HP IBRIX Product Comparison Architecture Scaleway vs HP IBRIX For IBRIX, files are located by disks, but SCALEWAY, files are splitted as blocks to stripe and store data on storage. It is high performance design for single operation uses all file servers/disk LUNs/each disks to store data. Scaleway IBRIX Copyright 2010 by Netclips, Ltd. All rights reserved -18-

20 Applied Fields Digital Media Animation Broadcasting Video Surveillance Highly Available Scalable file storage User File storage Multi-Site installations Disaster Recovery Database Applications DB2 Oracle RAC SAP Web Applications services Web Server Farm Online Data Storage Grid Applications Scientific Computing Life Sciences Analytics Copyright 2010 by Netclips, Ltd. All rights reserved -19-

21 Case Study W Company Filehosting Service 24 File Servers L4 Switch File UP/Down APP Redhat Linux Scaleway Agent Customer Requirements Gigabit S/W Provide up/downloading the same data on multiple file server Supporting large file system (over 10TB) 24 hours uninterrupted service Improving performance for additional services 4 SCALEWAY Nodes 8 SATA Storages SAN Switch Data sharing on file servers through SCALEWAY nodes 24 file servers share 128TB volume 7 multiple volumes (15TB per volume) Improved I/O performance by using agents Performing I/O separated with 4 nodes from file servers Over 1.8 times better performance than ever Custoer satisfied improved performance Before implementation, data was stored and managed on each server Customer satisfied at data sharing of SCALEWAY and using agents on file servers that improve performances Shared Storage Pool Effects after implementation Copyright 2010 by Netclips, Ltd. All rights reserved -20-

22 Case Study H Financial Company HP Blade Server For VM Ware Windows 2003 Customer Requirements Gigabit Switch 1G * 3 LAN Data integration Storage access for virtual server (VMware) system Supports SAN and NAS simultaneously Continuous service in node failure Improving performance for additional services SAN Scaleway Node Group 1G * 4 LAN SAN Switch Implementing integrated infrastructure makes computing management easier Main and backup data operations are separated Real-time data sharing via SCALEWAY Best services provided by 3 nodes and keep work consistency on failure Implement performance by adding nodes for additional services Effects after implementation 4TB(FC HDD) 10TB(SATA HDD) Copyright 2010 by Netclips, Ltd. All rights reserved -21-

23 Case Study M Broadcasting Company Customer Requirements FTP Service 1G * 4 LAN Trunking Streaming Service Scaleway Node CMS Catalog Gigabit Switch HD NLE SD NLE Scaleway Node High performance FTP service Edited video data sharing Supporting large file system (over 20TB) Continuous service in node failure Improving performance for additional services High performances service through 2 SCALEWAY nodes Decrease editing time through realtime data sharing between office and field personnel Provided work consistency by using 2 nodes on failure 40TB(SATA HDD) Improving performances for additional services Effects after implementation Copyright 2010 by Netclips, Ltd. All rights reserved -22-

24 Conclusion Best Performances (1GbE/10GbE/IB supported) Complete stability (RAID, Replication, Mirroring) Reducing TCO by planned procurement from initial installation to the future Prepared for uncertain expansion of storages (Thin Provisioning) Convenience of management (24x7) and storage consolidation satisfying customer s standard Improve performance combining high performance system utilization properly Copyright 2010 by Netclips, Ltd. All rights reserved -23-