Big Data Unlimited Cloud Storage Atmos Object Storage

Transcription

1 1 Big Data Unlimited Cloud Storage Atmos Object Storage November 10th, 2011

2 2 BIG DATA BY 2020, DIGITAL UNIVERSE WILL GROW TO 90% 35 ZETTABYTES OF THE DIGITAL UNIVERSE IS UNSTRUCTURED

3 3 File/Object Market a Huge Opportunity $B Scale-out file/object storage Storage in the Cloud CAGR= 29% CAGR= 35% 10 9,1 8 6,9 6,1 6 5,2 5,4 4,7 3,8 3,7 4 2,7 2,5 1, ,2 Market for file growing faster than block Market for online storage services growing even faster More and more companies becoming service providers Source: IDC, 2010, #223558, #223396

4 The IT Management Challenge From 2009 to The number of information containers files, packets, images (what is actually managed, protected, and stored in the Digital Universe) will grow 67 times The amount of information will grow 44 times But the number of IT professionals in the world will grow only 1.4 times Source: IDC Digital Universe Study, sponsored by EMC, May 2010 Copyright 2011 EMC Corporation. All rights reserved. 4

5 5 Business Needs Are Transforming Backup Data Growth Business Needs IT Budget & Resources IT Needs to Transform

6 IT is Changing Radically What s Your Response? Copyright 2011 EMC Corporation. All rights reserved. 6 Today s Questions Can you serve applications globally? Can you provide data access from anywhere? Can you handle terabytes of scale and the necessary management? How long does it take to serve end users? Can you move faster? Can you grow dynamically? Do you understand your costs to serve your applications? Are the costs competitive? Yesterday s Answers File system limitations + Cross mounts and silos + Developer and infrastructure pain File system provisioning + Ticketing system + Rounds of approvals and red tape Depreciation + Operating costs + Guesstimates Why tackle new problems with old technology?

7 EMC Atmos Copyright 2011 EMC Corporation. All rights reserved. 7 Announced November 2008 Atmos: A policy-based information management solution for building cloud storage infrastructures Key Attributes Massive scale (objects and petabytes) Supports hundreds of distributed sites Operational efficiency at scale Business objectives achieved via policy Infrastructure for private, public or hybrid clouds Enterprises with bulk requirements Local access for worldwide distributed information Capacity overflow feature external cloud

8 8 Atmos Inside Out Clients / Applications HTTP/S (REST, SOAP), IFS, NFS, CIFS Obj SMD UMD Atmos Multi-Tenancy Atmos Policies Global Namespace Atmos Appliance Access Node SAS Disk Enclosure VIE IS Installation Segment Resource Management Group (RMG) VIE2 RMG2 MUC RMG5 WAN LDN RMG3 BER RMG4 Single Management Public. Private. Hybrid. Cloud

9 9 Object Properties Objects within Atmos are basically traditional files with some additional properties. All objects within Atmos always have the following properties: Data payload (the file data) SMD: System Metadata (Size, Date, Owner, ) Permissions (List of Access Control Grants for Users & Groups) Objects within Atmos may also have the following properties: UMD: User (Custom) Metadata Tags

10 Metadata Based Object Replication Policies Copyright 2011 EMC Corporation. All rights reserved. 10 Site A Site B Application Object (OID or Path/Filename) Meta Meta Meta Policies 240TB Metadata trigger for different Replication Policies System Metadata (like size, time, name patterns, UID etc) User Metadata set by Application Synchronous and/or asynchronous replication options Erasure Coding with different parity options Retention and deletion

11 Atmos Tenancy Model Copyright 2011 EMC Corporation. All rights reserved. 11 NODE 1 NODE 2 NODE 3 NODE 4 NODE 5 NODE 6 NODE 7 NODE 8 NODE 1 CIFS NODE 2 CIFS NODE 3 NFS NODE 4 NFS NODE 5 NODE 6 NODE 7 NODE 8 Tenant A Internal Tenant B External Sub-tenant Marketing Sub-tenant Engineering Sub-tenant Websites Sub-tenant Customer data REST NFS CIFS REST REST User 1 User n User 1 User n User 1 App 1 Users User n App 2 Users User 1 App 3 Users User n App 4 Users RMG1 RMG2 Conceptual grouping of resources 3 level hierarchy: Tenant, Subtenant and User Logical separation of Sub-tenants Unique policies per Tenant Supports thousands of customers, departments, applications or users in one cloud Supports service providers Supports tenancy across locations while providing a unified namespace Supports optimal policy definition for different groups or apps for operational efficiency Allows granular management of access and resources per Tenant, Subtenant and User

12 12 Atmos Deployment Models Purpose-built hardware Standard components factory configured, racked, and cabled Optional high availability and redundancy Software on VMware Certified with EMC VNX series, VMware-supported servers, and third-party storage WS2-120 WS2-240 WS2-360 Atmos Virtual Edition Intel Xeon 5500 Nehalem 2 TB low-power SATA drives* VMware vsphere NFS/Fibre Channel/iSCSI Storage 60 TB cloud entry point Up to 480 TB per rack Up to 720 TB per rack Starts at 10 TB Up to 960 TB per site * 3TB Drive support in Q1/2012

13 13 EMC Atmos: Optimize Apps Across Your Business WEB APPS MOBILITY CONTENT MANAGEMENT FILE SERVER TIERING Atmos SDK (.NET, Java, FX, C, PHP, Ruby, Python, Javascript, Drupal, CAS*) Atmos GeoDrive Documentum Intelligently manages a massive amount of unstructured content over WAN or LAN HTTP/S (REST, SOAP), IFS, NFS, CIFS Global. Intelligent. Web. Self-Service. EMC VNX EMC Celerra NETAPP CTA Atmos Virtual Edition Site #1 STUTTGART Site #2 BERLIN Site #3 TORONTO ATMOS CLOUD Site #4 CLEVELAND

14 14 Typical Atmos Customer Usage Models MANAGE CONTENT-RICH WEB APPLICATIONS Manage and protect global unstructured data intelligently at lower cost PROVIDE INFRASTRUCTURE AS A SERVICE Go to market with multi-tenant, selfservice storage services in 90 days ARCHIVE TO THE CLOUD Isolate distributed archives and applications for security, lower storage costs and simplified management

15 15 Use Case Cloud Storage: Example Atmos GeoDrive Application Windows Access to the Atmos Cloud Windows 7, Vista, XP ATMOS GEODRIVE Windows Server Content in the Cloud in one minute For end users and applications Local network and Internet friendly Advanced features Easy to roll out, install, configure Available with an Atmos license LOS ANGELES NEW YORK LONDON ATMOS CLOUD

16 16 Use Case Cloud Storage: Example Oxygen Cloud and EMC Anywhere access with Enterprise control Corporate Firewall Encrypted and managed corporate files Corporate AD/LDAP ECM NAS Encrypted corporate files Oxygen Cloud ios/android encrypted clients Oxygen Cloud Acct / User Management Desktop Oxygen Cloud Windows/Mac encrypted clients Desktop Desktop Corporate LAN

17 17 THANK YOU