BCS (NLB) Big Data seminar

Transcription

1 BCS (NLB) Big Data seminar Big Data John Morton, Chief Technology Officer SAS Institute 23 rd November 2011 Copyright 2010 SAS Institute Inc. All rights reserved.

2 Who is SAS: The Leader in Enterprise Analytics Software Anticipate Opportunity, Empower Action, Drive Impact Basic company statistics: Founded 1976: 11,000+ employees in 400+ offices 600+ global alliances 2010 worldwide revenue $2.43 B 24% of revenues reinvested in R&D Ranked in Leader s Quadrant for Gartner s 3 key areas for Analytics: Data Intelligence, Analytics and Reporting IDC: SAS is leader in Analytics with a 34.5% market share Customer Partnerships: 4.5 million users worldwide 50,000+ sites in 114 countries 92 of the Top 100 Fortune Global of 10 Leading Media Agencies Over 1,000 Universities Over 90% of US Federal Agencies All 50 US State Governments Other 2% Manufacturing 6% Healthcare & Life Sciences 8% Retail 4% Services 11% Government 14% Energy & Utilities 2% Financial Services 42% Communications 8% Education 3% 2

3 What is Big Data? Big data is a term applied to data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target currently ranging from a few dozen terabytes to many petabytes of data in a single data set. (Wikipedia) In a 2001 (Gartner), defined data growth challenges (and opportunities) as being three-dimensional, increasing volume (amount of data), velocity (speed of data in/out), and variety (range of data types, sources). In 2011 (Gartner) this now includes Complexity!! May 2011 McKinseys Report Big Data : The next frontier for Innovation, Competition and Productivity stated : US healthcare reduction by $300 B a year 2/3rds from a 8% reduction in national healthcare Retailers can increase operating margin by 60% by fully utilising data Euro 100 B reduction in Government administration across Europe 3

4 Big Data Big data definition Big data is the ability to extract value from huge data sets by employing big data analytics to make better and faster decisions based not only on what has happened, but what will happen next. By identifying patterns, trends and insights from big data, organisations will drive greater innovation, competitiveness and productivity. 4

5 What Does it Mean? - People Future jobs between age of 21 and 38 You and technology Customers/Citizens Pace of Technology 5

6 Technology Shift Dot com boom 30 Terabyte disks 2000 fault tolerant, supercomputers Store everything file systems Visualisation of data - Gamefication In-Database processing Massively-parallel processing (MPP) analytics 6

7 Data Intensive Workloads - Usage Driven Technologies High Performance Analytics Information Search Video 100% Information Integration 0 % Pre-defined Queries Usage Sophistication Ad Hoc Queries Predictive Analytics What-if Analysis 13% 25% TopQuadrant, Forester, Search & Semantic Analysis 20% Intel IT study, Gartner A weeks worth of the information in the Times equals a lifetimes worth of information in 1800 Video content growing at an astonishing pace 40 Exabytes of data created this year. 7

8 What Does it Mean? - Processes Managing Data Grey computing 3.0 Linked Data Business Clock Collaboration 8

9 Decision Making It would appear, Hopkins, that your gut feel was only indigestion. 9

10 What Does it Mean? - Systems Today New Threats (e.g., IM, Rootkit) Tomorrow Perimeter Ambiguity Virtualization Client Diversity The Burton Group Digital Rights Management End-point Performance and Technology VM VM VM VM VM VM VM VM VM VM VM VM Context Aware Boundaries are changing Role of IT? Relationships 10

11 Creating the illusion of simplicity 11 11

12 Open Data and Transparency 12

13 The real value is in the links! Linked data Shareable, understood, unified in format and access to data 13

14 Copyright 2010 SAS Institute Inc. All rights reserved.