WOS. High Performance Object Storage

Transcription

1 Datasheet WOS High Performance Object Storage The Big Data explosion brings both challenges and opportunities to businesses across all industry verticals. Providers of online services are building infrastructures that can support millions of users to interact, store, search and post information from anywhere, anytime. Government organizations are constructing multi-petabyte clouds for environmental studies, space programs and to store security information. Researchers want to collaborate with fellow scientists in remote locations at high speed, in realtime. Large media enterprises are building scale-out storage platforms to store high definition movies in archives that are instantly accessible. Most of the data that is generated today is unstructured information: images, video footage, sensor data, etc. Unstructured data has traditionally been stored in file-based storage systems, but scalability and performance requirements are exceeding the limitations of these traditional storage technologies. As unstructured data is mostly stored as immutable data, simpler storage architectures, like object storage, have become a much better fit. WOS is a high-performance object storage platform designed to easily store petabytes of unstructured data with the highest availability, at the lowest TCO. To maximize performance, WOS has been architected without an underlying POSIX file system. The result is a NoFS pure object architecture, optimized for multisite cloud & web applications. WOS leverages DDN s unique ObjectAssure erasure coding and provides self-healing, automated management, integration with other storage environments and a high-performance REST API. The industry s largest cloud applications rely on WOS for public and private storage clouds, online collaboration and content distribution, cloud backup and archives. What is object storage? The backend architecture of an object storage platform is designed in such a way that all the storage nodes are presented as one single pool; there is no file system hierarchy. When objects are stored, an identifier is created to locate the object in the pool. Applications quickly retrieve the right data for users through the object identifier or by querying the metadata. Users access object storage through applications that will typically use a REST API, an internet protocol, optimized for online applications. This makes object storage ideal for all online, cloud environments.

2 WOS: Revolutionary Object Storage WOS is the industry s leading scale-out cloud storage appliance solution. This revolutionary object-based, cloud storage system addresses the needs of content scale-out and global distribution. Designed from the ground up as a 100% pure object storage platform, WOS features a rich set of advantages other solutions do not have: True Object Storage Platform WOS is a pure object storage platform, with no file systems in its architecture. The NoFS architecture enables high performance and low latency for large and small files and maximizes the storage efficiency. Optimized for Small and Large Files WOS is the only object storage system that is optimized for high-speed throughput of large data volumes and high performance I/O operations for small files. For multisite deployments, the built-in WOS Latency-Aware Access Manager automatically addresses data access requests to the location with the lowest latency. Competitive offerings are typically designed for either small or large files, which limits the use cases for these platforms. Flexible Data Protection WOS is the only object storage platform that offers a choice of data protection mechanisms to ensure the highest data durability AND availability. Reduce your storage overhead while maximizing local durability with erasure coding or add multisite replication to improve availability without affecting the WAN cost. Self-Healing Architecture Keeping traditional storage infrastructures healthy is management-intensive, as replacing disks in a multi-pb environment with traditional storage consumes many hours each month. This is not the case with WOS. Its built-in data protection algorithm, ObjectAssure has unique self-healing capabilities that further reduce the management effort. One Storage Infrastructure WOS is the only object storage platform that seamlessly integrates with other storage solutions. WOS Bridge enables data migration, collaboration and distribution between filebased storage tiers. Easy Application Integration WOS comes with a range of native interfaces, including native and S3 REST API s, CIFS, NFS gateways and application-specific interfaces (C++, Java, ). WOS native REST API was designed to maximize performance and portability: with just 5 simple commands, it is very straightforward to port applications from other platforms to WOS. WOS7000: Enterprise-grade Platform While WOS is architected to be hardware agnostic, we designed the WOS7000 hardware appliance to reduce TCO. Unlike commodity hardware, WOS7000 has an ultra-dense form factor, so there are fewer systems to house, manage, power, cool and maintain.

3 Efficiency Through Simplicity WOS is the perfect example of achieving operational excellence by dissecting the architecture down to the very basics. The architecture of WOS consists of three layers: 1. WOS7000 storage appliances; 2. WOS Core software; 3. A choice of simple interfaces and integrated applications. WOS provides a wide choice of interfaces, including a high-performance REST API, a set of native application API s and file access gateways. WOS Core is the software layer that provides the features and functionality: the management of the WOS clusters, data protection and self healing technologies, latency optimization, the policy engine, and WOS Search. WOS comes pre-installed on the WOS7000 storage appliance, the densest and fastest object storage building block available. Future-proof, WOS7000 can be used in mixed environments with the WOS6000, as well as future hardware platforms. Highlights Significantly more cost efficient than traditional SAN/NAS infrastructures; much lower TCO than other on-premises or 3rd party service online object storage solutions. Delivers high throughput for large objects, high IOPS for small objects, low latency for distributed environments. Scales virtually unlimited in clusters as large as 30PB. Clusters can be single-site or geographically distributed, multi site environments. Easy integration through native REST API, S3 REST API, CIFS and NFS gateways, and application-specific interfaces (C++, Java, ). Rich ecosystem of third party application providers, including: CommVault Simpana, ASG (Atempo) Digital Archive, irods and Pixia. ` ` Provides a unique choice of data protection schemes: synchronous & asynchronous replication, erasure coding or a combination.

4 Industry Leading Performance Unlike traditional storage systems, where each file read may consume ten or more disk operations on the array - with WOS, most file reads are performed in a single disk operation. This makes WOS many times more efficient in accessing data and faster than the fastest POSIX file systems - as well as the most scalable cloud storage services. WOS clouds can deliver millions of random files per second with extremely low latency. WOS offers the same high performance, whether files are large or small, making it the ideal storage platform for both video and high-transaction system environments. Revolutionary Object Storage WOS is the most cost-efficient disk storage solution for large volumes of unstructured data. WOS is significantly cheaper than other solutions: Traditional (file) Storage Dramatic TCO savings compared to traditional SAN/NAS infrastructures. WOS lowers both CAPEX and OPEX by reducing raw storage capacity, power usage, floor space and by eliminating management complexity. Self-healing capabilities resolve the labor-intensive task of finding and replacing broken disks and starting rebuild procedures. At scale (think 10PB infrastructures) this can significantly reduce human resource costs. Other Object Storage Solutions WOS is much more cost efficient than other object storage solutions. The key feature that delivers to these cost savings is the pure object architecture, which eliminates file systems layers and utilizes 99% of disk capacity. Public Storage Clouds / Storage-as-a-Service For smaller initiatives, public storage clouds appear tempting with a low cost entry-point, on-demand scaling and fast time-to-deployment, but these solutions quickly become more costly at larger scale. Petabyte+ Scalability Enable massive scalability within a single global namespace that is globally distributed and accessible. WOS scales powerfully and simply to store hundreds of billions of files and can grow non-disruptively in small increments or be deployed on a massive scale. High Resiliency WOS cloud clustering technology is fully distributed with no single points of failure or bottlenecks. Multiple copies of data are replicated globally for disaster recovery, content distribution and collaboration. Local data protection schemes enable data rebuilds without WAN data transfers. User Defined Metadata and Metadata Search WOS now features a powerful parallel backend metadata search: query one or more indexed fields of user-specified metadata on petabytes of objects. Index up to 5 fields of user metadata Boolean search of one or more indexed fields Returns list of object IDs matching search criteria

5 Use Cases The use cases for object storage are virtually unlimited. WOS has been deployed across several vertical industries; to store many different data types for different purposes. Cloud Service Providers and Web Content Organizations Providers of scale-out web applications deploy WOS as an alternative to public storage cloud platforms. At scale, WOS is much more cost efficient than public services. WOS also provides much better performance, enabling better SLA s for end users. Migrating from a public storage service to WOS requires very little programming effort with its straightforward and efficient REST API. Media and Entertainment WOS stores large digital media assets and accelerates the production workflow across globally distributed teams. For example, content created in New Zealand can be viewed, edited and integrated with live action content created in Los Angeles and postproduction in Mumbai, India. WOS enables worldwide collaboration to shorten production and post-production schedules. Government Intelligence, Law Enforcement, and Defense The exponential growth in geospatial and signal intelligence data collected by space, airborne and ground-based platforms is compounded with the challenges to access this data globally. With WOS, government agencies store hundreds of petabytes of satellite imagery, remote sensing data, telecommunications, web traffic and video surveillance, enabling geographically distributed analysts to access and exploit data from anywhere in the world. Life Sciences and Healthcare Life Science companies are some of the largest data generators in the world. Genome sequencers, pre-clinical imaging devices, MRI and CT scanners create terabytes of data per day. WOS allows these large data sets to be shared among multiple research sites, accelerating consultation, discovery and large-population multisite clinical trials. WOS provides long-term data retention for subsequent research. Digital Libraries Digital Libraries are challenged with archiving, maintaining and preserving data over extensive periods of time. They need to ensure that data is available and accessible for discovery and re-use, without regard to physical location. WOS addresses these Digital Library requirements to cope with the increasing number of large objects such as film, video and archaeological scans that require storage to scale easily to multiple petabytes of data and can be added dynamically, modularly as the Digital Library grows.

6 Cloud Tiering with the GRIDScaler - WOS Bridge WOS Bridge is a tiering solution between WOS and GRIDScaler, DDN s scalable parallel file system & NAS solution. The core of WOS Bridge is a data migration engine that automates and manages data migration from a variety of storage platforms to a WOS storage cloud. WOS replication policies distribute the data to remote locations where it is accessible directly through WOS file gateways or to be migrated back to the original platform. The distributed nature of WOS, and its scalability, performance and efficiency features facilitate a range of new use cases for existing GRIDScaler environments, such as: GRIDScaler archiving, data distribution or worldwide collaboration. WOS Specifications It is possible to deploy a fully functional storage cloud with a single WOS7000 system, then scale as needed by adding more nodes. A cloud can be created out of any number nodes that have IP connectivity to each other, regardless of their physical location. Storage managers create zones in the WOS cluster, assign node(s) in each and create the policies used to manage their cloud storage cluster. Each WOS7000 system is pre-configured with WOS software. The WOS7000 is a four-unit (4U), rackmountable enclosure that houses two power cooling modules, two controllers, and slots for 60 disks. The controllers provide system management and host connectivity interfaces. The two controllers are redundant and hot-swappable modules, which provide intelligence and active/active data protection features. WOS Specifications Maximum Number of Servers [Cluster, Namespace] Maximum # of Unique Objects [Cluster, Namespace] Namespace Growth Maximum Replicas Per Unique Object Maximum Total Cluster Capacity (using 4TB HDDs) Maximum Cluster Aggregate R/W Performance (SAS HDDs) Maximum Namespace Aggregate R/W Performance (SAS HDDs) Latency (4KB Random; 2-way Replication, 15K SAS HDD) Maximum Object Size; Minimum Object Size Cloud Protocol Client Access Multi-Site Read/Write NAS Client Access Parallel File System Tiering Maximum Metadata Space per ObjectlD Data Protection & Distribution Options Monitoring Maximum # of Storage Zones [CIuster, Namespace] Max # of Replication/Protection Policies [Cluster, Namespace] 256, 8192 [2 nodes per WOS7000/WOS6000] 1 Trillion, 32 Trillion Non-Disruptive Scaling, Auto- Balance, Online Upgrades 4-way replication PB; 0.98EB 8M Object Reads; 2M Object Writes 256M Object Reads; 64M Object Writes 9ms Read, 25ms Write (Flash is even better) 5TB; 512B WOS API, REST, S3 CIFS SMB1, SMB2,SMB2.1 WOS Bridge for DDN GRlDScaIer 64MB; 5 Key:Values for Parallel Boolean Search Sync, Async, 8+2 Erasure Code w/ Replication SNMP, GUI, CLI, HTTP 64, , 2048 WOS7000 System Specifications Capacity 4U 60 drives (SAS, SATA, SSD) Connectivity 4 x 10GbE, 2 X IB, cross-connect for HA Processing Modules 2 Intel CPU s, 8 cores, up to 128MB RAM Power Dual redundant, V 50/60Hz 80 Dimensions 4U H, 34 (37 ½ ) D, 19 fit W - 235lbs Learn more at ddn.com/products/wos 9351 Deering Avenue Chatsworth, CA DataDirect Networks, Inc. All Rights Reserved. EXAScaler, GRIDScaler, NoFS, ObjectAssure, Web Object Scaler and WOS are trademarks of DataDirect Networks. Version-1 09/13