Tactical Advantage for Data Management at Scale and gaining value. Callan Fox, Emerging Technologies Division, EMC.

Transcription

1 Tactical Advantage for Data Management at Scale and gaining value Callan Fox, Emerging Technologies Division, EMC. 1

2 How Much Data Is There? 44 Zettabytes 1 ZB = 1B TBs 7.6B people 200B things 4 Lens 368 COTS Cameras 1.8 Gigapixels ~3 PBs Per Day 2

3 What Is Big Data Exactly? The Department Public Domain 3

4 Unstructured Data Growth 67% 74% 80% EB 71 EB 133 EB Total Capacity Shipped, Worldwide Unstructured Data 4

5 Big Data In The Public Domain Big data is not about the data Gary King - University Professor, Harvard University Information is the oil of the 21st century, and analytics is the combustion engine. Peter Sondergaard - Senior Vice President, Gartner Research Data really powers everything that we do. Jeff Weiner - Chief Executive of LinkedIn. 5

6 ISR Concept Ingest Commonality with Media and Entertainment Processing Exploitation Dissemination 6

7 ISR Trends Sensors are becoming more ubiquitous and resolutions are increasing Cost containment and efficient management continue to be pain points More commodity solutions are becoming available, balloons, better and wider range UAVs, less reliance on satellite Challenged to move away from customised systems and towards more COTS based approaches without specialised integration to support ISR 7

8 Big Data In The Department We are swimming in sensors and drowning in data. Regina Dugan - Director, DARPA Defence is data-rich, and the question now is 'how do we drive that into demonstrating real value for Defence?' Dr. Peter Lawrence - CIO, Australian Department of Defence Addressing big data challenges and applying high-performance analytics can make the difference between predicting a threat and reacting to a catastrophic aftermath. Tim Scully - Chairperson, Data to Decisions Cooperative Research Centre (D2D CRC) 8

9 Terrestrial Surveillance Trends Need For Scalable Video Repositories Resolutions continue to increase Video content analysis Enterprise architectures City wide surveillance systems Mobile video streaming 9

10 Video Content Analysis Facial Recognition Licence Plate Tracking Crowd Assessment Loitering and Traffic Analysis Demographics and Advanced Assessment 10

11 Who Likes Fences? 11

12 Exception Alerting 12

13 Rendered Situational Awareness 13

14 Legacy ISR Deployment Ingest C4ISR Ingest Mobile Ingest Analysis 14

15 EMC Isilon Scale-Out Performance Isilon Flexibility at Scale Tunable Performance and Capacity Traditional NAS Limitations at Scale Storage Controller I/O Threshold Linear I/O Performance Non-linear I/O Performance Isilon OneFS Traditional NAS Technology Scalability Scale-Out Performance, Capacity, Both tuneable Scale-Up Capacity only, limited performance options Performance True linear predictability Degradation of performance & capacity at scale 15

16 IOPS/second Industry Benchmark Results Linear, Predictable Scalability 1,800,000 Powered by COTS Intel Xeon Processor Technology 1,600,000 1,400,000 1,200,000 1,000, , , , , CIFS NFS Predictable SLAs 16

17 Isilon Introduction Scale-out COTS Network Attached Storage (NAS) product family S-Series Linear Scaling of Performance and Capacity Purpose-built for IOPSintensive, random access, file-based applications X-Series Flexible solution for high concurrent and sequential throughput applications NL-Series Ideal for cost-effective, large-capacity storage 17

18 Gain New Levels of Efficiency BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY FULL BALANCED EMPTY AutoBalance Automated data balancing across nodes reduces costs, complexity and risks for scaling storage Eliminate Inefficiencies 60 seconds to add node No migrations ever No reconfiguration No silos No ceiling Eliminates Hot Spots 18

19 Next-Gen Access Methods Analyst Access UAVs Other Collection Systems Isilon Scale-Out ISR Datalake Exploitation / Analytics Mobile Computing Archiving Cloud Interface 19

20 Isilon Efficiencies FILE FILE FILE FILE DATA MANAGEMENT BULLET PROOF SCALABILITY FILE FILE FILE FILE DATA SECURITY PERFORMANCE MANAGEMENT 20

21 Enhanced ISR Deployment Ingest C4ISR Ingest 21

22 ISR Use Case: Military In-theatre Assets Challenge In-theatre assets (UAVs) collect vast amounts of data. This data needs to be made available instantly to local military personnel, as well as analysts that are thousands of kilometres away. Solution Imagery is downlinked to in-country data centres, where it is normalised by PIXIA software and accessed instantly by local users and analysts located halfway around the world. 22

23 ISR Use Case: Military In-theatre Assets Not just GB, TB, PB of data Trillions of files to manage! Images of earth created by satellites, UAVs, and video cameras 23

24 ISR Use Case: Military In-theatre Assets Capture Manage Disseminate Collection from various sensors Correlate and optimise Streamlined data delivery 24

25 PIXIA Example 25

26 Isilon ISR References A USAF Intelligence Wing which reduced their data storage management staffing requirements by roughly 90 percent by moving to Isilon. An ISR organisation which completed a multi-month independent evaluation, selected Isilon for their Proof of Concept (POC), with plans to scale-out to several hundred petabytes. An operational distributed common ground station unit selected Isilon as their Forward Processing, Exploitation and Dissemination (PED) data ingest and storage point. 26

27 Recap: Differentiators for the ISR Mission Manage Data with Flexible, Automated Policies Industry leading scalability, predictable linear performance More Than 80% Storage Utilisation, Automated Storage Tiering, deduplication Efficient Backup and Recovery, Push-Button Disaster Recovery, N+1 Thru N+4 Availability Roles-based Administration, Authentication Zones, WORM Data Protection, Data Encryption Unified Data Services Including NFS, SMB, HTTP, FTP, HDFS and Object, in-place analytics 27

28 Isilon - The ISR Advantage #1 MAGIC QUADRANT EMC = #1 in Ability to Execute EMC = #1 in Completeness of Vision #1 EMC is #1 in Ext. RAID, Network Storage, Open SAN, NAS, Storage SW, Infrastructure SW, Device Management Sources: (1) Gartner, 03/13 (2) Wikibon, 08/13 28

29 Sample of IS(TA)R Accounts Using Isilon and Why? Simplicity and Easy to Use Massive Scalability and Performance Unlocks New Capabilities Unmatched Efficiency Operational Flexibility 29

30 Would You Like To Know More? Callan Fox NAS Systems Specialist, Defence Ryan Tassotti Lead Systems Engineer, Defence Max Crozier Account Director, Defence 30

31