REDEFINE BIG DATA: BECOMING A DATA-DRIVEN BUSINESS WITH THE EMC BUSINESS DATA LAKE CHRIS HARROLD, GLOBAL CTO, BIG DATA SOLUTIONS

Transcription

1 1

2 REDEFINE BIG DATA: BECOMING A DATA-DRIVEN BUSINESS WITH THE EMC BUSINESS DATA LAKE CHRIS HARROLD, GLOBAL CTO, BIG DATA SOLUTIONS 2

3 REDEFINE BIG DATA: BECOMING A DATA-DRIVEN BUSINESS WITH THE #ULTRADATAFORTRESS CHRIS HARROLD, GLOBAL CTO, BIG DATA SOLUTIONS 3

4 BUSINESS DARWINISM 4

5 EVERY INDUSTRY FACING STRUCTURAL CHANGE 5

6 NEW EXPECTATIONS FOR IT Always connected Easily accessible information Personalized experiences Smart on-demand solutions Transparency & integrity Easily collaborate & share Business driver, not just enabler 6

7 THE DATA REVOLUTION HAS BEGUN PRECISION FARMING DRESS THAT DISPLAYS HOW WE FEEL THERMOSTAT THAT KNOWS YOU RE AWAY GLASSES THAT DIRECT US WHERE TO GO CONTACT LENS THAT CONTROLS BLOOD SUGAR FITNESS BAND THAT MEASURES ACTIVITY LEVEL DRONES THAT DELIVER OUR GROCERIES 7

8 BUT SO HAS A SHIFT IN VALUE Product DATA about the product 8

9 THE NEW OPPORTUNITY CONTEXT INTENT Product DATA About The Product REAL-TIME 9

10 MULTI-SOURCE DATA ANALYSIS DELIVERING ACTIONABLE INSIGHT IN REAL-TIME REAL TIME OPERATIONS WEATHER FORECASTING SOIL ANALYSIS MACHINE DATA 10

11 STEPS TO CREATE VALUE FROM DATA Build new applications, products & business models Leverage new analytics to predict the future Gather as much data as possible 11

12 DATA IS A FIXED ASSET IT NEEDS TO BE MANAGED LIKE ONE Organizations need a data-centric culture Everyone needs to increase data awareness Data needs context and purpose Data should be controlled, provisioned, and purposed just like any other fixed asset 12

13 DELIVER A SEAMLESS EXPERIENCE FOR EVERYONE: DATA IS A TEAM SPORT BUSINESS USERS BUSINESS ANALYSTS APPLICATION DEVELOPERS DATA PROGRAMMERS INFRASTRUCTURE DEVELOPERS DATA SCIENTISTS 13

14 WHAT IS AN DATA LAKE? #ULTRADATAFORTRESS? JUST COLLECTING AND ANALYZING DATA IS NOT ENOUGH It is composed of complex ecosystem of tools Security isn t secondary, it s core functionality Data is discoverable and its usage is traceable It should provide access to all business users It should follow business rules and policies 14

15 INCREASE DATA GRAVITY! INCREASING DATA GRAVITY ENABLES RAPID, VALUABLE ANALYTICS KEEP APPS CLOSE TO DATA Deliver data consistently & in a standardized way APPS Get at the data quickly Build views and applications each user really needs KEEP DATA TOGETHER Structured, unstructured, dark SPEED Generated by the enterprise, imported from outside ANALYZE EVERYTHING All of the data ANALYTICS DATA Historic & real-time More sophisticated analyses New combinations and correlations 15

16 SIMPLIFY THE CREATION OF INSIGHTS MAP ANALYTICS USE CASE, ANALYTICS PLATFORMS, & STORAGE Customer Sentiment Analysis Product Performance & Reliability Supply Chain Optimization Product Recommendation Engine Competitive War Games?????? 16

17 FOCUS ON BUSINESS OUTCOMES, NOT ON LOW LEVEL TECHNOLOGY DECISIONS INGEST Capture data from a wide range of sources, traditional and new STORE ANALYZE Use advanced algorithms to discover new, predictive patterns SURFACE ACT Build data-driven applications to meet business needs Store everything in one environment for cross data analysis Share insights with business domain experts 17

18 EVOLVE TO THE #ULTRADATAFORTRESS EXPANDING AND USING WHAT YOU HAVE Data Lake Foundations EMC ANALYTICS STARTER PLATFORM 18

19 BUILT ON FEDERATION TECHNOLOGIES HADOOP VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO 19

20 FLEXIBLE DEPLOYMENT OF TOOLS FOR ADVANCED ANALYTICS AND DATA SCIENCE PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE GREENPLUM DATABASE HAWQ ADVANCED ANALYTICS REDIS GEMFIRE DATA PROCESSING SPRING XD SPARK PIVOTAL HD RABBITMQ BDS ON PIVOTAL CLOUD FOUNDRY HADOOP VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO 20

21 AN OPEN ANALYTICS ECOSYSTEM OPEN ANALYTICS TOOLBOX PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE GREENPLUM DATABASE HAWQ ADVANCED ANALYTICS REDIS GEMFIRE DATA PROCESSING SPRING XD SPARK PIVOTAL HD RABBITMQ BDS ON PIVOTAL CLOUD FOUNDRY HADOOP VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO 21

22 ENABLING CUSTOMER CHOICE EXTENSIBLE ANALYTICS TOOLBOX OPEN ANALYTICS TOOLBOX PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE GREENPLUM DATABASE HAWQ ADVANCED ANALYTICS REDIS GEMFIRE DATA PROCESSING SPRING XD SPARK PIVOTAL HD RABBITMQ BDS ON PIVOTAL CLOUD FOUNDRY HADOOP VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO 22

23 ENABLING CUSTOMER CHOICE CHOICE OF HADOOP DISTRIBUTION OPEN ANALYTICS TOOLBOX PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE GREENPLUM DATABASE HAWQ ADVANCED ANALYTICS REDIS GEMFIRE DATA PROCESSING SPRING XD SPARK PIVOTAL HD RABBITMQ BDS ON PIVOTAL CLOUD FOUNDRY HADOOP VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO 23

24 THE EMC #DATAFORTRESS OF TODAY DATA AND ANALYTICS CATALOG OPEN ANALYTICS TOOLBOX PLATFORM MANAGER ANALYTICS MANAGER DATA MANAGER PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE DATA PROCESSING HADOOP SPRING XD GREENPLUM DATABASE SPARK HAWQ PIVOTAL HD VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO ADVANCED ANALYTICS REDIS RABBITMQ GEMFIRE BDS ON PIVOTAL CLOUD FOUNDRY 24

25 THE #ULTRADATAFORTRESS END OF 2015 DATA AND ANALYTICS CATALOG OPEN PLATFORM MANAGER INGEST MANAGER ANALYTICS MANAGER DATA MANAGER ANALYTICS TOOLBOX PIVOTAL BIG DATA SUITE APPLICATIONS AT SCALE DATA PROCESSING HADOOP SPRING XD GREENPLUM DATABASE SPARK HAWQ PIVOTAL HD VMWARE VCLOUD SUITE EMC II STORAGE DATA LAKE FOUNDATION: ISILON VCE VBLOCK XTREMIO DATA DOMAIN ADVANCED ANALYTICS REDIS RABBITMQ GEMFIRE BDS ON PIVOTAL CLOUD FOUNDRY DATA GOVERNOR 25

26 SIMPLIFY THE INCLUSION OF DATA DEPLOY, CONTROL, AND OPTIMIZE THE ENTIRE PLATFORM PLATFORM MANAGER INGEST MANAGER ANALYTICS MANAGER DATA MANAGER Rapidly provision new data sources Package and deliver analytics tools and services Manage and audit storage and data policies Simplify the integration of disparate data sets 26

27 DELIVER ANALYTICS FOR EVERYONE DATA SCIENCE FOR EVERYONE WITHOUT THE DATA SCIENTIST DATA AND ANALYTICS CATALOG Provide analytics services not just access to data Package and deliver data as a platform Rapidly move from tinkering to monetization Data science without a data scientist 27

28 AVOID A DATA SWAMP STAY OUT OF THE MUD AND KEEP THE INSIGHTS FLOWING Keep data relevant and reliable Make insights and results repeatable and reusable Provide a service-based approach to data Policy-driven data storage and retention DATA GOVERNOR Content and meta-data indexing for all data types 28

29 EMC BIG DATA CONTACTS AT EMC WORLD PEOPLE TO KNOW AND PLACES TO GO Aidan O Brien GM, Big Data Twitter Peeps Web: Chris Harrold CTO of Big Data Louis Frolio Data Scientist, Education Bill Schmarzo The Dean of Big Community: connect/everything_big_data The #UltraDataFortress Booth (656): David Dietrich Data Science EMC Big Data EMC Big Data - Big Data: Today and Tomorrow - Becoming a Data Driven Business with EMC - Challenges of Ingest and Storage - Analyzing and Surfacing Data for Data-Driven Apps - Enabling Analytics Solutions 29

30 QUESTIONS 30

31