UniFS A True Global File System

Transcription

1 UniFS A True Global File System

2 Introduction The traditional means to protect file data by making copies, combined with the need to provide access to shared data from multiple locations, has created an unwanted explosion in copies in an infrastructure already strained by a decade of relentless data growth. Organizations struggling under the combined pressure of file data growth and an expanding global footprint require a new generation of global file systems that enable IT to consolidate all copies of data required for protection and access into a single master copy. A Global File System completely separates data from any hardware dependencies and in doing so elevates the IT conversation from the nuts and bolts of storage (provisioning, backup, DR, etc.) to a strategic discussion about data management: Who needs access to this data? Where do they need it? What level of performance is required? UniFS is a storage architecture that combines ubiquitous cloud infrastructure with traditionally data center technology. Files are no longer tied to a piece of hardware or location. Data is stored globally in the cloud but available at the local levels of performance dictated by the hardware resources available at each site. The cloud infrastructure providers are adept at dispersed geographic data replication across multiple availability zones which not only protects the data but has the significant benefit of increasing the fluidity of data and the speed at which data can be access from anywhere in the world. Data can move around and be where it needs to be, without IT being involved in arduous and costly replication processes for replicating physical copies and without conflict since the system ensures that there is always only one source of the data. While system virtualization enables compute needs and not server hardware to be at the center of application deployment, UniFS enables data and not hardware to be at the center of storage. The hardware becomes an end-point that can be adjusted to deliver the required level of performance. Central management moves to a global core service that can monitor and manage every component regardless of its location. UniFS maintains security with locally controlled encryption so that organizations can establish a secure data perimeter, every other infrastructure function that needs stability at scale shifts to the core cloud infrastructure. To think global infrastructure, one must think beyond the confines of any one physical appliance or data center. Only then can organizations harness the power of a Global FIle System: one copy of data protected in many ways, accessible everywhere. UniFS Benefits: Simplified Central Management Unlimited and Elastic File System Scalability Unlimited File Versioning (replaces backup and archive) Single File Audit Trail Stream Global and Mobile File Access Right-Size Hardware Performance in Every Location Customer Controlled Security Model Dramatic Cost Reductions This new generation of global file systems provides the abstraction layer that is necessary to separate file data from any hardware or location dependencies. 2

3 Global File System Unlimited Scalability and Global Access with a Global File System A global file system provides a hypervisor-like layer that separates the files from the file storage resources, managing one master copy of the data in a public or private cloud while distributing data access to where it s needed. The global file system manages all metadata required such as versioning, access control, audit records, and locking and provides access to the files via the necessary protocols such as CIFS/SMB and NFS. A global file system is different from a distributed file system or a global name space. In a distributed file system or global name space model, files are tied to a specific piece of hardware, and the distributed file system or global name space finds the file and directs access to it. Sometimes replication is added on top of this to make some access closer to the user. With a global file system, the data is unbound from the hardware, stored in a public or private cloud, and cached access is provided locally to the user with a caching algorithm that keeps the data in use immediately and locally accessible. All of the data, including that in use in multiple local caches, is stored as a single master copy in the public or private cloud, accessible globally from any access point. In this manner the global file system provides the unlimited scalability of the cloud while maintaining the local performance of a traditional NAS device. A global file system is also different from a simple cloud storage gateway or cloud-integrated storage. In the gateway model the cloud simply acts as a tier of storage tied to the single gateway device. A global file system can manage any number of caching devices at the edge and provide the data through any of them, including multiple devices simultaneously. A global file system also provides global locking to prevent any chance of contention. In the event a file is left open due to someone leaving a file open or a local system hang a global file system allows IT to break a lock. Even in the case of a manually broken lock, any file contention is handled by the file system with conflict resolution procedures and no data is ever lost. The global file system allows for unlimited scalability of file data storage, global access and mobility, as well as shared use of data between remote offices that feels to the user as if all the data is local. Right Sized Performance with Caching At The Edge While the master copy is stored in the cloud with a global file system, it is accessed at the edge in the local office through a caching system known as a filer. The filer appears to the user the same way any local NAS device or file server would. Files are accessed via CIFS/SMB, NFS or even FTP. Filers can also provide block storage via iscsi. To a windows user this is another letter drive, to a Mac user it is another server in the finder, and to a mobile device user, simple apps can be used to browse the files and access them. Desktop synchronization can also be provided. Since the device appears as a standard file system, applications using the files function normally as they always have. The filer can be scaled to the workload in the office proving both the processing power and cache storage space required for the file data whether users access it from an application or directly as files. Filers can be provided as high availability appliances as well to ensure continuous access to the data. With caching provided locally to the user, scaled to the performance requirement, user service levels and speed of access are maintained. 3

4 Infinite Versioning with File Data and Snapshots in the Cloud Another function provided by a global file system is versioning. As users change file data in the filer, snapshots can be taken as frequently as once a minute with changes sent to the cloud. With the data stored in the cloud, and snapshots sent there as well, unlimited versions can be kept forever (unless requirements call for purging data after a certain time). By using the cloud s inherent reliability and stability combined with infinite versioning, separate, costly backup and archive systems become unnecessary saving massive amounts of time, money and frustration. Central Management - Software Defined Today, the term software defined is being applied to everything. The reason for this is the power of using software based policy and configuration to control things that use to require reconfiguring hardware. It is yet another benefit from virtualization. Flexibility is increased allowing efficient use of resources, and management can be central so all resources are coordinated in an efficient and secure manner. This is also true of a global file system. Policies can be defined and management can take place through a single management system for a global file system populated with terabytes, even petabytes of data consisting of millions, even billions of discreet files. Through one console, accessibility, access control, protocol access, locking, quotas, audit policy, etc. can all be defined, and the state of the system in any location can be monitored. New storage can be deployed easily. This allows IT to efficiently manage and control the system and provide user access as needed with a much lower staff burden. Security with a Global File System The global file system also increases the security of data, even while using public cloud as the means of storage. The global file system can encrypt all data stored in the cloud. Using the filers, keys are kept locally and owned by the filer administrator. No data in the cloud is ever in the clear, either as it is sent or retrieved (in motion) or while it is stored (at rest). In addition, no keys are kept with the encrypted data. For access control the global file system can be integrated with and joined to Active Directory. This allows the existing enterprise permission system to be applied to all data, and for any data stored in the cloud to be completely secured from hackers, the cloud provider, and anyone else trying to access the data without authorization. 4

5 The Only True Global File System - UniFS UniFS is Nasuni s patented global file system that bridges NAS and SAN access to the scalable object storage of the cloud while providing global access to the data. It is the only file system of its kind. UniFS can operate at unlimited scale without any degradation of performance. This patented capability allows Nasuni to support unlimited scalability with unlimited snapshots and eliminate separate backup. One Master Copy In the Cloud Accessible Everywhere UniFS keeps the master copy of the data in the cloud. This means that data storage is infinitely scalable and protected in the cloud. Availability and scalability of access are maintained since access to the data is not dependent on any given device. UniFS is organized into Volumes that contain the structure of directories and files, as well as metadata such as access control lists, lock state, etc. When a Volume is instantiated on a Filer, its structure is built in the cloud. As files and directories are created, data is chunked, deduplicated, compressed, and encrypted, and stored as objects in the cloud service. UniFS keeps the mapping between the volume structure of files and directories, associated metadata, and objects in the cloud. If given access any other Filer in the network can map to that same Volume and read and write the files and directories using the same process. In this way, access to the master data in the cloud is local to any user anywhere via The Nasuni Filer. UniFS operates using WORM (write-once, readmany) principles. Once an object is written in the cloud, it is permanent. This makes UniFS stable and resilient. As data is changed on Filers, the changes are sent to the cloud as snapshots, allowing the current or any past version of the data to be retrieved instantly. Infinite Versions, Instant Restore Using the scalability of cloud storage, snapshots can be taken as frequently as once a minute and kept forever providing built-in backup and archive at no additional cost and with no additional hardware or software a complete version history of the system is always available at any time. UniFS allows data restoration to any point in time at the file, folder, or volume level instantly by restoring metadata first. VSS Integration End-users can navigate previous snapshots and perform self-service file restore (based on access control permissions) Local and Global Locking UniFS provides file locking at the file system level as applications use it today on any CIFS/SMB or NFS share. When an application opens a file with a lock, it will appear to the application exactly as it does on any other NAS device or Windows File Server. Therefore the application will behave the same way it always does, and there is no change to the user s experience whether collaborating with someone in the next office or across the globe. This also ensures that file locking with UniFS is compatible with every application and requires no special integration or management. When users who write data are distributed at multiple sites, UniFS Global Locking Service allows them to collaborate using the data wherever they are without risk of losing or corrupting any data while preserving all data changes. The Global Locking Service runs in the cloud so locking is always available and scalable to the global enterprise without dependency on any device to maintain lock states. Active Directory Integration Access to can be controlled using Microsoft s Active Directory, the standard for access control in the enterprise. 5

6 Local Performance with Nasuni Filers With caching of data managed by UniFS, The Nasuni Filer looks and feels just like a traditional storage controller ensuring that end-users and applications have the exact same experience on a Nasuni Filer as they would on an array from the traditional vendors. Specifically, The Nasuni Filer can be used to handle both NAS and SAN workloads. The on-premise Nasuni Filer delivers local storage performance with a minimal footprint. Even though customers store hundreds of terabytes with Nasuni, UniFS only caches the most important and most frequently accessed files. Using sophisticated and proprietary caching algorithms, users receive local performance with only a small percentage of the dataset in their local storage. This means less hardware and lower costs. Local Site Shared Site NFS VMs iscsi LUN Figure 1: The Nasuni Filer provides local access Security with UniFS OpenPGP standard for key management a standard that supports an extensive and thorough All data stored with UniFS is encrypted both in flight Chunking Deduplication Compression review Encryption Saved to Cloud process in Renaming the public domain. Using this andoriginal at restfile in the cloud using customer-controlled publicly available and time-tested standard ensures keys. This simple design principle means that customer data will always be available. neither Nasuni nor a cloud storage vendor ever has access to customer data. Furthermore, it transforms cloud storage from an unprotected pool of shared Bandwidth Efficiency with UniFS storage into a secure repositoryremoves that even thereduces most In cache Optimizes for Uses customer s Masks Integrated WAN optimization enablessecure Nasuni transport duplicate bandwidth keys contents hardened security teams can approve. Redundant chunks needs Filers be deployed all over the world even in Masks actual Masksto size sizesecurity protocols, ReducesThe Nasuni Masks size and contents Using established offices and locations with limited and inconsistent bandwidth and contents needs Filer encrypts all data before transmission using connectivity. A perpetually cloud-connected storage military-grade AES-256 encryption. Nasuni further system could saturate your network especially if employs the open-source and highly efficient the local storage controllers frequently need to talk to one another. Not so with UniFS. Original file In cache Chunking Optimizes for transport Deduplication Removes duplicate chunks Compression Reduces bandwidth needs Reduces bandwidth needs Encryption Uses customer s keys Renaming Masks contents Saved to Cloud Secure Redundant Masks size and contents Figure 2: UniFS secure storage in the cloud 6 UniFS A True Global File System Original file Chunking Deduplication Compression Encryption Renaming Saved to Cloud

7 UniFS running on Nasuni Filers communicates directly with the cloud never by connecting directly to other Filers, leveraging the bandwidth of the cloud and not the limited connectivity of your offices. In addition, before any bits are transmitted, data is chunked, compressed and deduplicated against the global file system so that nothing is sent twice. Global deduplication means UniFS is comparing file changes not just locally, but to every file stored in the cloud dramatically reducing the number of bits that need to be sent. Sub-file chunking allows UniFS to transmit only the deduplicated parts of a file that have changed not the whole new version. Compression of every chunk before transmission removes extraneous data, reducing bandwidth needs. Conclusion Legacy file data storage cannot keep up with today s requirements. The rise and growth of the global enterprise, requiring worldwide shared, mobile access to file data with data center performance, availability, protection, disaster recovery and archive has placed demands on IT that cannot be met with traditional file storage solutions - even if there was enough money procure them and time to manage them. There is a current and pressing need for a better way to store file data. Nasuni Cloud NAS, powered by UniFS, allows IT organizations to manage a single, fully protected, fully versioned instance of every data asset. When high performance access is needed, the data is instantiated in a local high performance system. When access is needed across multiple locations, the copies of the data appear at all those locations and a global lock prevents conflicts in order to maintain one clean version of the data. Nasuni Cloud NAS establishes complete control over each data asset and, once and for all, liberates IT from having to make, track and manage all the copies. By taking advantage of the scalability and economics of cloud storage plus the capabilities of the Global File System UniFS while adding in local filers, central management and an operations center, Nasuni Cloud NAS is unique in the market providing an Enterprise Storage solution, that meets this challenge. Nasuni Cloud NAS can provide the infinitely scalable, globally accessible, locally performing, always available file data storage enterprises require at a fraction of the cost and management burden of traditional approaches. Access Control Protection Scalability Central Management Backup Off-site Replication/DR Version Control File Auditing Global File System Archiving Figure 3: UniFS 7

8 About Nasuni Nasuni About Nasuni offers a powerful Storage Infrastructure as a Service: a uniform, complete storage solution delivered as a service, enabling distributed organizations to offload the management of the storage infrastructure (including Nasuni is an backup, enterprise replication storage and company offsite protection) that provides and globally-distributed consume storage on-demand, organizations without a simple, any change to unified the way storage users solution. access By information. combining With on-premises Nasuni, corporate hardware data with is cloud uniformly storage, available Nasuni in delivers all locations, a secure, enabling all-in-one organizations data storage to solution increase that user provides productivity, local performance streamline costs for users, and improve simplified business and centralized agility. management for IT, and an easily scalable, complete storage service for the global enterprise. With Nasuni, Our data team is uniformly is made available up of enterprise in all locations, storage, enabling security organizations and networking to increase industry user veterans productivity, with a shared streamline vision of costs transforming and improve the business way enterprise agility. organizations view data storage. We believe that storage should be as easy to purchase, consume and manage as the electricity that keeps the lights on. Nasuni Corporation 2015, All Rights Reserved 313 Speen Street, Natick, MA WP_4.15