HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica

Transcription

1 HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica

2 So What s the market s definition of Big Data? Datasets whose volume, velocity, variety and complexity are beyond the ability of commonly used tools to capture, process, store, manage and analyze them. Velocity Variety Big Data Volume Complexity Information Sources $ 2 CRM, SCM, ERP Video IT Ops Transactional Data Mobile Audio Big Data is no longer just a Buzzword *Gartner, Inc., Big Data Is Only the Beginning of Extreme Information Management, Mark A. Beyer, Anne Lapkin, Nicholas Gall, Donald Feinberg, Valentin T. Sribar, Published 7 April 2011 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Texts Social Media Search Images

3 Information from the Internet of Things: We have gone beyond the decimal system Today data scientist uses Yottabytes to describe how much government data the NSA or FBI have on people altogether. In the near future, Brontobyte will be the measurement to describe the type of sensor data that will be generated from the IoT (Internet of Things) This is our digital universe today = 250 trillion of DVDs Exabyte 1 EB of data is created on the internet each day = 250 million DVDs worth of information. The proposed Square Kilometer Array telescope will generated an EB of data per day Brontobyte This will be our digital universe tomorrow Yottabyte Zettabyte 1.3 ZB of network traffic Terabyte 500TB of new data per day are ingested in Facebook databases Megabyte by Petabyte The CERN Large Hadron Collider generates 1PB per second 10 9 Gigabyte 3

4 The Challenges of Big Data Variety, Velocity, Volume, Time to Value 90% of digital content created by 2015 will be mixed data types ¹ 75% of currently deployed data warehouses will not scale sufficiently to meet new information velocity and complexity of demands by 2016² 48% Worldwide information volume growth of digital content¹ 86% of corporations cannot deliver the right information, at right time to support enterprise outcomes all of the time³ ¹Source: IDC Predictions 2012: Competing for 2020 ²Source: Gartner - The State of Data Warehousing in 2012 ³Source: Coleman Parkes Survey Nov Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

5 Today, Data Analysis is Slow, Painful, and Costly?? 5

6 Legacy Architectures Were Built for a Different World Yesterday s data warehouse and analytic infrastructure Proprietary Expensive Centralized, monolithic Process laden Batch Summary Slow 6

7 Imagine a world where a conversation with your information drives business decisions Social Media Video Audio Texts Word, Excel Messages Logs Transactional Data Clickstream Data Transactional Data Do 40% more of this Logs Clickstream Data Intelligent Information Insight across structured, semistructured & unstructured data Right time, intelligent decision making Images MGD Positive ROI 7 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

8 Vertica, Purpose Built for Answers in Real Time 50x-1000x faster performance at 30% the cost, proven by hundreds of customers Volume Variety Velocity 1000x Value 8

9 Designed for Answers from the Very First Line of Code, Vertica Technology Makes the Difference Columnar Storage and Execution Achieve best data query performance with unique Vertica column store Clustering Add resources on the fly with linear scaling on the grid, commodity hardware Compression Store more data, provide more views, 90% less storage required Continuous Performance Query and load 24x7 with zero administration Database Design Automated performance tuning Advanced Analytics Time-series, geospatial, click-stream and SDK for more 9

10 Hundreds of Customers Across Industries Finding Answers Promotional Testing Behavior Analytics Claims Analyses Click Stream Analyses Patient Records Analyses Clinical data Analyses Fraud Monitoring Financial tracking Tick data back-testing Network Analyses Customer Analytics Compliance Testing Loyalty Analysis Campaign Management 10

11 Learn More about HP Vertica Enterprise Edition Free 30-day evaluation Community Edition Free Download 1TB, 3 nodes my.vertica.com\evaluate White paper: The Disruptive Power of Big Data Now available on our Web site 11

12 HP Vertica in Action 12

13 Separating the Signal from Noise 13

14 14

15 2012 Honda Classic 15

16 Force directed network 16