Geospatial Imaging Cloud Storage Capturing the World at Scale with WOS TM. ddn.com. DDN Whitepaper DataDirect Networks. All Rights Reserved.

Transcription

1 DDN Whitepaper Geospatial Imaging Cloud Storage Capturing the World at Scale with WOS TM

2 Table of Contents Growth and Complexity Challenges for Geospatial Imaging 3 New Solutions to Drive Insight, Simplicity & Scale 3 The WOS Advantage 3 Scalable Imaging 4 Target Markets 4 Image Gathering Challenges: Solved 5 Designed to Travel: Lightweight & Dense 6 Storage Challenges: Defined 7 DDN Web Object Scaler (WOS): Evolved Storage 8 2

3 Growth and Complexity Challenges for Geospatial Imaging Over two hundred years ago the British began a forty-year long project to accurately and precisely map the subcontinent of India. Now we have access to GPS synchronized aerial cameras and high resolution satellite systems that provide huge amounts of geospatial information. We achieve in days what once took four decades to complete. New Solutions to Drive Insight, Simplicity & Scale Building upon the experience developed over hundreds of petabytes of shipments to many of the world s most contentintensive environments, DDN s Web Object Scaler (WOS) product has been designed from the ground up for the scalable Geospatial imaging capture and processing industry. DDN s WOS system delivers radically different capability as opposed to conventional SAN based image capture. As a cloud storage system, WOS was designed for the needs of the Web2.0 and petabyte content storage generation. The WOS Advantage Petabyte Scalability: More Scalable & Affordable than SAN Unrivaled Simplicity: Designed for the most novice users Self-Healing: Zero intervention required for failures Rapid Rebuilds: Fully recover from lost drives in minutes Replication Ready: Ingest & distribute images globally Disconnect from Cluster: Capture then smoothly return Reliable: Better than RAID 6 data integrity Disaster Recoverable: For uninterrupted ingest Video Optimized: Large transfers speed per disk performance Object Metadata: User-defined metadata makes files smarter 3

4 Scalable Imaging Today s technology has allowed us to gather and study imaging information about our world faster and in more detail than we could ever do before. The data continues to expand, becomes ever more detailed and at the same time the need for rapid global access increases, Geospatial Imaging systems can provide clouds, next-generation scalable technologies that are equal to the task of growing with these requirements. DataDirect Networks (DDN s) WOS platform delivers many times the capability of existing solutions and more suited to the imaging market than any other storage system available today. Target Markets Capturing images from single or multiple sources. Automatically distributing data to key stakeholders. High-data rate transactions. Direct-From-Source-Ingest. 4

5 Block Storage SAN Application server and storage manager Block Storage Image Gathering Challenges: Solved When a Geospatial Image capturing system is deployed in a ship or aircraft, it is used as a complete solution unto itself. This changes, of course, when the captured data needs to be migrated from this system in to the larger data pool. Here the returning system needs to be attached to the ground based storage and all images copied from it to the ground system. Traditional data migration techniques are designed to handle thousands of files all possessing unique file names. The challenges of utilizing traditional storage in Geospatial Imaging migration are significant, including: Cannot fit within a single file system so data is scattered Until file is copied from the capturing system it is not accessible Risk of data loss while data is in isolation or in transit Duplicated file names cause conflict or data loss Location of images difficult to manage Tape and/or disc library Migration from one storage type to another adds risk 5

6 Single WOS node WOS Cluster Immediate Data Availability Designed to Travel: Lightweight & Dense Space and weight constrained environments can take advantage of the lightest and smallest WOS system. At 3U it fits in smaller spaces, and by deploying the optional 2.5 drives, WOS is even lighter. Unique Object Identifiers: WOS uses OID (Object ID s) that are guaranteed to be unique. When committing a file to WOS, the system allows the creation of the same file name but will always use a unique OID. Thus the accidental overwrite of an existing file is impossible. Combined with WOS s self-healing abilities, whether in isolation or as part of the larger cluster, what is stored on WOS will be there when you need it. Works Alone: Nodes and/or zones can be disconnected from the WOS cluster allowing each to work in isolation but with complete data integrity and reliability. Any data gathering environment can carry a WOS component to the actual site, store all the data to WOS and when returned to the cluster, all data gathered can be automatically shared and made instantly available to all users of the cluster. WOS is the ideal hot-swap forward-deployable storage technology. 6

7 Extreme Reliability: WOS offers state of the art data integrity to all files whether as part of an overall cluster or even when a node or zone is completely isolated. WOS offers a proprietary data integrity technology that is superior to RAID 6. This means that even when disconnected you can trust WOS to gather and maintain all mission critical data in complete confidence. SAN Application server and storage manager Block Storage Tape and/or disc library Storage Challenges: Defined Geospatial Image capture, retention and archive is normally handled through a multi-tiered storage system. The migration of the data down the stack is handled by custom solutions that layer complexity on how the data is managed. Traditional storage technology is designed for local storage management, capable of handling several million files in hierarchical file system structures. They allow the storage and retrieval of Geospatial Images via some form of storage gateway. 7

8 The challenges of deploying traditional storage in Geospatial Imaging environments are many, including: Limited number of filenames in a single file system Migrate data from one system to another in order to review Reliability can be compromised moving down the stack Replication tools are largely absent Complex storage architectures are difficult to manage Application server Replicated, Global Namespace Sustains Use During Outages if needed DDN Web Object Scaler (WOS): Evolved Storage Designed for the most content-intensive storage environments in the world, WOS redefines the surveillance video access and management experience. 8

9 Massive Scalability: Able to scale a up to multiple petabytes, WOS storage pools can support billions of files in a single, highperformance global storage cluster. WOS can handle millions of file transactions per second and yet is affordable enough to also be the archive thus allowing the reduction in storage tiers. Large volumes provide for savings on deployment and reduction in use complexity. Replication: WOS policy-based replication can mirror images automatically to up to 4 locations. Thus Geospatial images can be distributed and reviewed anywhere in the world and ingest and playback are uninterrupted even in the event of a whole location outage. Unrivaled Simplicity: Built from the ground up to eliminate the complexity of storage management, WOS can be administered by even the most novice user. Intelligent, self-healing storage technology rapidly and proactively corrects itself from any failure event. Performance-Optimized: By managing disk and network transfers many times higher than traditional systems, WOS ensures more performance efficiency than available elsewhere. 9

10 DDN About Us DataDirect Networks (DDN) is the world s largest privately held information storage company. We are the leading provider of data storage and processing solutions and services, that enable content-rich and high growth IT environments to achieve the highest levels of systems scalability, efficiency and simplicity. DDN enables enterprises to extract value and deliver results from their information. Our customers include the world s leading online content and social networking providers, high performance cloud and grid computing, life sciences, media production organizations and security & intelligence organizations. Deployed in thousands of mission critical environments worldwide, DDN s solutions have been designed, engineered and proven in the world s most scalable data centers, to ensure competitive business advantage for today s information powered enterprise. For more information, go to www. or call TERABYTE. Version 10/11 10