Peter Rakers De Verstoring van Big Data



Similar documents
Introduction to Predictive Analytics. Dr. Ronen Meiri

The Big Deal about Big Data. Mike Skinner, CPA CISA CITP HORNE LLP

BIG DATA: ARE YOU READY? Andy Kyiet Demand Flow Intelligence May, 2013

Introduction to the Mathematics of Big Data. Philippe B. Laval

Doing Multidisciplinary Research in Data Science

So Just What Is Big Data? James E. Tcheng, MD, FACC, FSCAI

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics

Age of Big data. Presented by: Mohammad Iqbal BCM -2014

Majed Al-Ghandour, PhD, PE, CPM Division of Planning and Programming NCDOT 2016 NCAMPO Conference- Greensboro, NC May 12, 2016

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica

Applications for Business Intelligence, Predictive Analytics and Big Data

DIGITAL MARKETING STRATEGIES Leveraging The Back-End Tools

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS

Next presentation starting soon Business Analytics using Big Data to gain competitive advantage

Outline. What is Big data and where they come from? How we deal with Big data?

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

BRANDLOGIK. an Introduction to. BIG data. the future is now

Cloud beyond the obvious, an approach for innovation

A Survey on Big Data Concepts and Tools

Big Data. Fast Forward. Putting data to productive use

CIS 4930/6930 Spring 2014 Introduction to Data Science Data Intensive Computing. University of Florida, CISE Department Prof.

Big data, the future of statistics

Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014

Data Analytics in Organisations and Business

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: Vol. 1, Issue 6, October Big Data and Hadoop

Big Data: Public Sector Opportunities, Challenges, and Implications

Digital Earth: Big Data, Heritage and Social Science

LARGE, DISTRIBUTED COMPUTING INFRASTRUCTURES OPPORTUNITIES & CHALLENGES. Dominique A. Heger Ph.D. DHTechnologies, Data Nubes Austin, TX, USA

What happens when Big Data and Master Data come together?

Big Data Analytics: 14 November 2013

DATA. SMALL WORD. COLOSSAL IMPLICATIONS SPR Consulting

BIG DATA & SOCIAL INNOVATION KENNETH THOMAS, CLIENT MANAGER

BIG DATA TRENDS AND TECHNOLOGIES

Strengthening Intelligence and Investigations with Incident Management Software

DATA MINING AND WAREHOUSING CONCEPTS


BIG DATA CHALLENGES AND PERSPECTIVES

Open source Google-style large scale data analysis with Hadoop

DISCOVERING ediscovery

# Not a part of 1Z0-061 or 1Z0-144 Certification test, but very important technology in BIG DATA Analysis

Turning Big Data into Big Decisions Delivering on the High Demand for Data

Is Big Data a Big Deal? What Big Data Does to Science

Discover the WHY, WHAT and HOW of Big Data

Customer Segmentation in the Age of Big Data

How Big Is Big Data Adoption? Survey Results. Survey Results Big Data Company Strategy... 6

Analytical Tools: What Auditors Need to Know About Big Data

Big Data: What s the Big Deal?

What s New About Big Data? Implications for the Accountability Community

CAP4773/CIS6930 Projects in Data Science, Fall 2014 [Review] Overview of Data Science

AN INTRO TO DATA MANAGEMENT

The Changing World of Big Data. And How to Profit from It

Pervasive Location Analytics and A Billion Dollar Opportunity. Jitender Aswani, Portfolio Strategist, Business Analytics, SAP

Game On: How Information is Changing the Rules of Insurance

7 Steps for Launching a Successful Manufacturing Big Data Project

Oracle Big Data for Dummies

Copyright (c) 2012, Meta Business Systems. Mario Bojilov Meta Business Systems 20 February 2013

The 3 questions to ask yourself about BIG DATA

Architectures for massive data management

IJITE Vol.03 Issue - 03, (March 2015) ISSN: Impact Factor 3.570

How To Use Big Data In Healthcare

Big Analytics: A Next Generation Roadmap

Data Centric Computing Revisited

Data Aggregation and Cloud Computing

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

Collaborations between Official Statistics and Academia in the Era of Big Data

WHAT IS BIG DATA? David Bechtold

So What s the Big Deal?

Analytics in the Cloud. Peter Sirota, GM Elastic MapReduce

BIG DATA What it is and how to use?

Modern (Computational) Approaches to Big Data Analytics. CSC 576 Computer Science, University of Rochester Instructor: Ji Liu

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA

Congrats to Game Winners. How can computation use data to solve problems? What topics have we covered in CS 202? Part 1: Completed!

Navigating the big data challenge

The HP IT Transformation Story

BIG DATA, BIOBANKS AND PREDICTIVE ANALYTICS FOR A BETTER CLINICAL OUTCOME

Machina Research. Where is the value in IoT? IoT data and analytics may have an answer. Emil Berthelsen, Principal Analyst April 28, 2016

UBI data management Granularity and related considerations

Are You Ready for Big Data?

Computer Logic (2.2.3)

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract

Big Data Introduction, Importance and Current Perspective of Challenges

ROME, BIG DATA ANALYTICS

Библиотека БГУИР BIG DATA IN BANKING. Constantine DZIK. Dzmitry BALTUNOU. MOHAMMED Utech LLC location Madison, MS USA

Leveraging Technology to Enhance Audit Quality and Effectiveness

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait

Impact of Big Data in Oil & Gas Industry. Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India.

A New Era Of Analytic

Are You Ready for Big Data?

BUY BIG DATA IN RETAIL

Hadoop for Enterprises:

Delivering new insights and value to consumer products companies through big data

Roundpeg 2012 All Rights Reserved. Page 1

Hur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER

Changing the face of Business Intelligence & Information Management

No Data Governance, No Actionable Insights

Big Data and Industrial Internet

THE BIG DATA REVOLUTION

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

ENGINE(S) BEHIND BI. Sam

Transcription:

Peter Rakers De Verstoring van Big Data Na globalisatie en digitalisatie komt dataficatie, het continue genereren van real time gegevens. Voor veel bedrijven werkt dit fenomeen eerder verstorend. Peter Rakers geeft voorbeelden over de opportuniteiten en valstrikken van big data. meer weten over Peter Rakers: www.cropland.be

Disruptive in Belgium Seminar @ Gent, 26 september 2014 Peter Rakers

Data has become raw material that can be used in an innovative way in order to get new products, services or insights with significant added value. 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 3

Cropland will look at your (big) data business case from 4 different angles Customers Products Team Channels 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 4

and on 3 different levels LEVEL 1 INTERNAL DATA ANALYSIS Although obvious at first sight, connecting system A with system B or exchanging marketing information with financial (sales) data or consumer data appear not to be easy in practice. During the start up of a Cropland project, we always analyze the internal data at first in order to take out maximum information from structured sources. 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 5

and on 3 different levels LEVEL 2 THE COMBINATION WITH EXTERNAL DATA After mapping the internal data, we look for associations and correlations with external sources. Free data, but also paid information from other stakeholders or data providers are combined. Unexpected events such as weather, demographic patterns or others could have an important influence on the company s objectives. 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 6

and on 3 different levels LEVEL 3 AN INTERCONNECTED NETWORK OF COMPLEMENTARY BUSINESSES Without exposing company-owned information, Cropland will look at innovative segmentation models based on a concept called the DATA POOL. 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 7

What is foresight? Level of abstrac ction Short term Qualitative Long term Qualitative Short term Quantitative Long term Quantitative TODAY Time into the future 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 8

For today, we can call it Level of abstrac ction War gaming g Scenarios Thinking Forecasting Predictive Analytics TODAY Time into the future 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 9

What is surprising is not the magnitude of our forecast errors, but our absence of awareness of it Nassim Nicholas Taleb Author of 'The Black Swan 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 10

Human beings and organizations do not act in response to reality but to an internally constructed version of reality Kees van der Heijden Strategic Planning Royal Dutch / Shell 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 11

And that s why I believe, That seemingly gyrandom events have potential to become disruptive for others Mohamed Bouazizi, a Tunisian vegetable seller, set himself alight on December 17, 2010 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 12

Topic of the day Scenarios Thinking Predictive Analytics 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 13

Big data definition Big Data usually includes data sets with sizes beyond the ability of commonly used software tools to capture, organize, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target, as of 2012 ranging from a few dozen terabytes to many petabytes of data in a single data set. kb (kilobyte) = 1000 1 =10 3 MB (megabyte) = 1000 2 =10 6 GB (gigabyte) g = 1000 3 =10 9 TB (terabyte) = 1000 4 =10 12 PB (petabyte) = 1000 5 =10 15 EB (exabyte) = 1000 6 = 10 18 ZB (zettabyte) = 1000 7 =10 21 YB (yottabyte) = 1000 8 =10 24 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 14

Big data definition Amount from big to bigger Range from structured to unstructured Speed from batch to streaming Process from Excel to Hadoop from IT/BI to data science 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 15

Big data definition Business Intelligence: Descriptive statistics, trends, linear (structured) data Big Data Inductive statistics, laws, nonlinear (unstructured) systems 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 16

Big data mind shift The ability to work directly with vast amounts of data (N =all) instead of extrapolating smaller sets The willingness to embrace real-world messiness. Only 5% of all available data is structured, meaning in a form that fits neatly into a traditional data base The fact that by machine learning ability, correlations become more powerful over time. N=all time 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 17

Post hoc, ergo propter hoc After this, therefore because of this or correlation is not causality More trumps better The loss in accuracy at micro level is largely compensated by the insights we get at macro level New data scientists and strategists are needed to cope with this paradigm shift Most of our institutions were established under the presumption that human decisions are based on information that is small, exact and causal in nature. More trumps better. The obsession with exactness is an artifact of the informationdeprived analog era. -Viktor Mayer Schönberger, Big Data 2013-2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 18

Big data predictive analytics Data always speaks. It always has a story to tell and there's always something to learn from it. Data scientists t see thisover and over again across PA (predictive analytics) projects. Pull some data together and, although you can never be certain what you'll find, you can be sure you'll discover valuable connections by decoding the language g itspeaks and listening. That's the Data Effect - Eric Siegel, Predictive Analytics 2013-2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 19

Predictive analytics Most data is not accumulated for the purpose of prediction but PA can and will learn from this massive recording of events the same way as human beings learn from the accumulation of life experience. 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 20

Consequences for the public There ain t no such thing as a free lunch Robert Heinlein: The Moon is a Harsh Mistress, SF novel, 1966 according for free for free for free for free for free for free for free for free 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 21

Today Recent mood analysis of 2013 by Twitter (Newsmonkey, March 13, 2014) 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 22

Today Prof. Veronique Hoste of UGent investigated the content of Twitter messages on the risk of suicide and found several key words with significant predictive signaling. The Bringham Young University connected Twitter messages with HIV sexual risk behaviour in well specified areas of the US 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 23

Today DANIEL KATZ, MICHIGAN STATE UNIVERSITY 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 24

Big data adoption position 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 25

Big Data adoption position Core business BLINDSIGHTVICTIM You are attacked on your core activities by players who don t follow the established rules of the game Late BIG DATA B I G D A T A DOPTION FORESIGHT DISRUPTOR As market leader or innovative challenger, you adopted big data opportunities early in your strategy to stay in or enter the game Early I HINDSIGHT SURVIVOR M P INSIGHT EXPERT A You are at the end of your marketing era. C You keep your core activities up to speed Your expertise declines in valued as the T and in parallel, you develop new services game is changing gquickly based on big data insights Parallel business

New kids on the block Core business B I G late D A T A I M P A C T Parallel business early

Conclusion for now Big data is here and it is here to stay It will become an (new) strategic tool to look at the future Access to big data (in real time) offers an important knowledge and decision taking advance It deals with larger sense of group behavior but business derivates focus on an individual approach Companies with datafication of human behavior as core business (e.g. Google, Amazon, Facebook) will only increase their dominance on the global market The next step is that companies can not only predict but also prescibe our behavior without us being aware And so, although we experience mainly the benefits of big data today, there s an important risk (or dark side) in the further evolution of datafication for individuals 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 28

The future for now 2014 Cropland: Disruptive in Belgium - 10 jaar SC, Gent, Sept 26, 2014 29