How Big Is Big Data Adoption? Survey Results. Survey Results Big Data Company Strategy... 6

Size: px
Start display at page:

Download "How Big Is Big Data Adoption? Survey Results. Survey Results... 4. Big Data Company Strategy... 6"

Transcription

1 Survey Results

2 Table of Contents Survey Results... 4 Big Data Company Strategy... 6 Big Data Business Drivers and Benefits Received... 8 Big Data Integration Big Data Implementation Challenges Big Data Implementation Technologies About Talend Page 2

3 Big data represents a significant paradigm shift in enterprise technology and stands to transform much of what the modern enterprise is today. Digital data is everywhere and global data is growing at 40% per year. Companies capture trillions of bytes of information about their customers, suppliers, and operations, and millions of networked sensors are being embedded in the physical world in devices such as mobile phones, energy meters and automobiles, sensing, creating, and communicating data. 1 By collecting and analyzing all this information companies gain insight into new business opportunities and threats. But what exactly is big data? Big data encompasses a complex and large set of diverse structured and unstructured datasets that are difficult to process using traditional data management practices and tools. There is an increasing desire to collect call detail records, web logs, data from sensor networks, financial transactions, social media and Internet text, and then analyze with existing data sources. Conventional data management tools fail when trying to integrate, search and analyze big datasets, which (for now) range from terabytes to multiple petabytes of information. As an example, Walmart handles more than 1 million customer transactions every hour, which is imported into databases estimated to contain more than 2.5 petabytes of data - the equivalent of 167 times the information contained in all the books in the US Library of Congress. 2 New technologies based on the Apache Hadoop Big Data Platform have emerged as a way to analyze large data sets through a technique called massively parallel-processing (MPP) of information. As with any new successful paradigm, there is a technology adoption curve from innovators and early adopters, to the early majority, to the late majority, to laggards. Early adopters are driven by competitive advantage and innovation, take the biggest risks for success, typically use primitive tools, and build it themselves. Conversely, the late majority and laggards strive for the productivity gains others have received and take less risk by adopting proven technologies backed by robust products and services. In the information arms race, companies that can collect and analyze more information should be able to make faster, better-informed decisions compared to their competitors, e.g. by maximizing customer wallet share, by knowing when and why customers may leave, by efficiently creating and targeting new markets, or by deterring fraud. To date most of the big data discussion has been about big data technology. The goal of this survey and whitepaper is to highlight big data adoption challenges, business objectives and benefits, as well as big data technologies being used. 1 Big data: The next frontier for innovation, competition, and productivity McKinsey & Company, May Page 3

4 Survey Results In the summer of 2012, Talend conducted a big data adoption survey of 231 professionals involved in the delivery of data solutions for their company. Survey respondents were closely split between North America (49%) and EMEA (51%), with 60% of respondents in IT and 36% having business titles. 95 respondents who did have a big data strategy, were then asked a series of questions about their experience. Figure 1: Survey Demographics Other 4% EMEA 51% North America 49% IT 60% Business 36% Key findings from the survey are: 41% of companies have a strategy for dealing with big data, indicating the growing adoption of big data. 48% of big data initiatives are driven by the business, 39% by IT, and 13% cross-functionally. For those without a big data strategy, the main reason (76%) is that they do not distinguish big data from existing corporate data. Increasing the depth and accuracy of predictive analytics was the number one driver for big data, reported by 68% of those who have a big data strategy. Using today s definition of big data (> 10 terabytes), 71% of respondents have big data to manage. 62% indicated that they have achieved big data business benefits with the primary benefit being business process optimization (28%) and improvements in marketing and sales (24%). Page 4

5 However, 24 companies reported not receiving a business benefit which may indicate the need for improved big data skillsets, governance and management. The types (inputs) of big data that are being used today include web and social media (57% of respondents) followed by sales data (54% of respondents). 61% replied that their primary big data challenge was allocating sufficient time, budget and resources, with just over half (52%) reporting a lack of big data in-house expertise. Open source Apache Hadoop and Hadoop-based distributions represented over 60% of big data implementation technologies in use or considered for use. Page 5

6 Big Data Company Strategy It was just over 10 years ago when Doug Laney from the Meta Group (now Gartner) published a report 3 on the growing volume, velocity and variety of data and that organizations need to look beyond traditional approaches. The business model of big data early adopters such as Google and Facebook required that they create a strategy to collect and analyze large volumes of data to scale their business. Some companies have big data collection and analysis in their DNA and have built a separate big data strategy. Others recognize that big data is part of a larger total data management function and incorporate big data tools and practices throughout the business to manage big data as well as enterprise data and discrete data. In 2011 there were 9 companies who offered products based on big data (Apache Hadoop) technologies and now there are over 120 vendors clearly showing signs of momentum. The survey results (Figure 2) showed that 41% of organizations do have a big data strategy and 59% do not. Furthermore, 76% of those without a specific strategy replied that they do not distinguish big data from existing corporate data management practices. Figure 2: Does your organization have a strategy for dealing with big data? (n=231) No Yes Figure 3: If no, why? (n=136) We don't distinguish big data from existing corporate data Other reasons 59% 76% 41% 24% For companies that do have a big data strategy (n=95), it is being driven by several company functions (Figure 4), which indicates that big data as a core strategy has moved past an early adopter stage. 39% indicated that big data initiatives are being driven by IT, or a bottom up approach to be more efficient in collecting and analyzing large data sets. However, 48% of big data strategy is being driven by lines of business or executives, which indicates there are compelling business reasons for big data adoption, such as increased revenue, improved customer satisfaction, or faster time to market. 3 Velocity-and-Variety.pdf Page 6

7 Figure 4: The big data initiative is primarily being driven by: Crossfunctional Team 13% Board of Directors 2% Executive Management 20% IT 39% Business and Consumers of Data 26% Early results show that big data is part of larger corporate data initiatives, and is being driven by business more than IT. Page 7

8 Big Data Business Drivers and Benefits Received Data requirements and benefits vary by industry. For example, communications providers, government, healthcare and retail firms all have larger amounts of unstructured data such as text, audio and video files that can benefit from big data collection and analysis. The number one business driver for big data (68%) is increasing the accuracy and depth of predictive analytics or the ability to analyze current and historical data to make future predictions. Revenue optimization (51%) and new revenue generation (48%) were the second and third highest responses as companies seek to do more in-depth analysis to maximize market and wallet share, e.g. improve cross-selling capabilities. Figure 5: What are the business drivers for big data in your organization? (multiple responses, n=95) 80% 70% 60% 68% 50% 40% 48% 51% 30% 20% 10% 0% 31% 20% 19% 16% 1% Page 8

9 For those that have implemented big data projects, 62% indicated that they have achieved business benefits (Figure 6) with the primary benefit being business process optimization (28%) and improvements in marketing and sales (24%). It is a concern that 38% responded No or Unknown, and may be due to the lack of project governance, data quality, big data skillsets and/or available tooling, which is typical for new paradigms. Figure 6: To date, have you realized any business benefit to big data? (n=95) Unknown 13% Yes, particularly in Marketing and Sales 24% No 25% Yes, particularly in Business Process Optimization 28% Yes, particularly in Crime Prevention and Fraud 5% Yes, particularly in Customer Retention 5% Big data business benefits include business process optimization and marketing/sales improvement; however for some projects it is too early to tell or have failed to deliver a benefit. Page 9

10 Big Data Integration Common big data use cases include marketing campaign analysis, recommendation engines, predictive analytics, sentiment analysis, risk management and fraud detection. IT is integrating existing data warehouses and business intelligences systems with diverse sets of structured and unstructured data for more in-depth analysis. The survey revealed that the most common applications being integrated were financial transactions (48.4%) and social media, clickstream and Internet text (48.4%), followed by web logs (35.8%) and call detail records (28.4%). By looking at social media and internet text, firms can understand who the super users are in any social network or community, i.e. ones that have the most influence over others inside social networks. Also, by correlating financial transactions and call detail records with click streams, one can generate a more complete view of customer buying patterns and behavior. Figure 7: Which applications are driving big data needs at your organization? (multiple responses) 60% 50% 40% 48% 48% 30% 36% 20% 28% 25% 25% 10% 16% 0% Call detail records Financial Science, transactions research data or medical data Sensor data Social Video, media, imaging data click- stream or internet search analytics Web logs 8% Other Furthermore the type of big data that is being used today or considered in the future reinforced the previous response. Web and social media are being used by 57% of respondents today with 23% considering it for the future. Sales data was the second highest for being used today (54%) and Page 10

11 considered for the future (32%) for analyzing buying patterns and sales incentives. Biometric data was the lowest on the list. Figure 8: What type of big data are you involved in or considering making part of your Business Intelligence? Actively Involved Considering for the Future Not Considering 19% 23% 14% 25% 22% 30% 30% 69% 36% 54% 42% 51% 8% 18% 34% Web and social media Machine generated (web logs, twitter data (RFID, GPS, feeds, JSON) phone apps and other machine generated data) Sales data (buying patterns and sales incentives) Biometric Human interactions (Qingerprint, voice/ (e- mails, voice mails, face recognition, DNA) call centers) Web and social media are big data s primary inputs with sales data a close second. Page 11

12 Big Data Implementation Challenges The technical challenges in processing big data involve integrating, searching and analyzing large data sets. However, like any new paradigm, companies must also find the right skillsets, get budget approval, navigate company politics, and manage the unknowns. The United States alone faces a shortage of 140,000 to 190,000 people with deep analytical skills as well as 1.5 million managers and analysts to analyze big data and make decisions based on their findings. 4 Many early big data projects are free of explicit project management structure and over time companies will incorporate standards and procedures just as they have with data management projects. In the survey, 61% replied that their primary big data challenge was allocating sufficient time, budget and resources, with just over half (52%) reporting a lack of big data in-house expertise. Also 48% reported data quality challenges, while only 11% reported a challenge getting C-level buy-in for big data projects. Figure 9: What challenges to implementing big data are most hindering your success? (multiple responses) 70% 60% 50% 40% 52% 61% 48% 30% 36% 37% 20% 10% 0% 18% 11% 5% 4% 4 Big data: The next frontier for innovation, competition, and productivity McKinsey & Company, May Page 12

13 Big data processing varies by organization, industry and the types of tools available to process the data. It may be collecting and analyzing terabytes of information or many petabytes of data, and over time it is assumed that the definition of big data will grow. Using today s definition of big data (> 10 terabytes) 71% of respondents (Figure 10) have big data to manage. 46% of respondents have over 100 terabytes of data to manage and 12% had greater than 2 petabytes to manage. Figure 10: What is the total amount of data that exists within your organization? < 10 Terabytes 6% 11% 6% 29% 10 to 99 Terabytes 100 to 499 Terabytes 23% 25% 500 to 1 Petabytes 2 to 5 Petabytes > 5 Petabytes A large majority of companies have over 10 terabytes of data to manage, but the biggest barriers to big data adoption are a shortage of time, budget, expertise and resources. Page 13

14 Big Data Implementation Technologies Many technologies have been developed to integrate, manipulate, manage and analyze big data. Survey respondents were asked which big data technologies they are using or they are considering to use. Apache Hadoop (28%), an open source framework with basic big data constructs (file system, language, and distributed system for managing large datasets) that incorporates MapReduce, was the most popular response. Showing strong support for open source technology, Hadoop and Hadoopbased solutions represented 62% of the responses, The large amount of Other (38%) responses suggest an early adopter, fragmented market, and included selections for big data appliances (e.g. Teradata, Netezza) and NoSQL databases (e.g. Couchbase, MongoDB). Figure 11: Which implementation of big data technology are you considering or are you using already? (n=95) Amazon Web Services 13% Apache Hadoop (own installation) 38% 28% Cloudera (CDH) Greenplum Hortonworks Data Platform 4% 3% 2% 12% MAPR Other Open source Apache Hadoop and Hadoop-based distributions represented over 60% of big data implementations in use or considered for use. Page 14

15 About Talend Talend is the recognized leader in open source integration solutions. The company s holistic integration platform helps organizations minimize costs and maximize the value of data integration, ETL, data quality, master data management, application integration and business process management - while supporting their shift toward big data. More than 3,500 paying customers worldwide, including ebay, ING, The Weather Channel, Deutsche Post and Allianz, subscribe to Talend s solutions and services. With over 20 million downloads, Talend s products are the most trusted integration solutions in the world. The company has major offices in North America, Europe and Asia, and a global network of technical and services partners. Talend s open source approach and flexible integration platform for big data enables users to easily connect and analyze data from disparate systems to help drive and improve business performance. Talend s big data capabilities integrate with today s big data market leaders such as Cloudera, Hortonworks, Google, Greenplum, Mapr, Teradata and Vertica, positioning Talend as a leader in the management of big data. Talend s goal is to democratize the big data market just as it has with data integration, data quality, master data management, enterprise service bus and business process management. Visit to learn more and download your free copy of Talend Open Studio for Big Data. Page 15

The Next Wave of Data Management. Is Big Data The New Normal?

The Next Wave of Data Management. Is Big Data The New Normal? The Next Wave of Data Management Is Big Data The New Normal? Table of Contents Introduction 3 Separating Reality and Hype 3 Why Are Firms Making IT Investments In Big Data? 4 Trends In Data Management

More information

Getting Started Practical Input For Your Roadmap

Getting Started Practical Input For Your Roadmap Getting Started Practical Input For Your Roadmap Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

Why is BIG Data Important?

Why is BIG Data Important? Why is BIG Data Important? March 2012 1 Why is BIG Data Important? A Navint Partners White Paper May 2012 Why is BIG Data Important? March 2012 2 What is Big Data? Big data is a term that refers to data

More information

WHITE PAPER. Four Key Pillars To A Big Data Management Solution

WHITE PAPER. Four Key Pillars To A Big Data Management Solution WHITE PAPER Four Key Pillars To A Big Data Management Solution EXECUTIVE SUMMARY... 4 1. Big Data: a Big Term... 4 EVOLVING BIG DATA USE CASES... 7 Recommendation Engines... 7 Marketing Campaign Analysis...

More information

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage If every image made and every word written from the earliest stirring of civilization

More information

Datenverwaltung im Wandel - Building an Enterprise Data Hub with

Datenverwaltung im Wandel - Building an Enterprise Data Hub with Datenverwaltung im Wandel - Building an Enterprise Data Hub with Cloudera Bernard Doering Regional Director, Central EMEA, Cloudera Cloudera Your Hadoop Experts Founded 2008, by former employees of Employees

More information

Wikibon Big Data Analytics Adoption Survey, 2014-2015 Frequency Analysis

Wikibon Big Data Analytics Adoption Survey, 2014-2015 Frequency Analysis Wikibon.com - http://wikibon.com Wikibon Big Data Analytics Adoption Survey, 2014-2015 Frequency Analysis by Jeff Kelly - 1 July 2014 http://wikibon.com/wikibon-big-data-analytics-adoption-survey-2014-2015-frequency-analysis/

More information

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014 5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for

More information

BIRT in the World of Big Data

BIRT in the World of Big Data BIRT in the World of Big Data David Rosenbacher VP Sales Engineering Actuate Corporation 2013 Actuate Customer Days Today s Agenda and Goals Introduction to Big Data Compare with Regular Data Common Approaches

More information

Bringing Together ESB and Big Data

Bringing Together ESB and Big Data Bringing Together ESB and Big Data Bringing Together ESB and Big Data Table of Contents Why ESB and Big Data?...3 Exploring the Promise of Big Data and ESB... 4 Moving Forward With ESB and Big Data...5

More information

TABLE OF CONTENTS 1 Chapter 1: Introduction 2 Chapter 2: Big Data Technology & Business Case 3 Chapter 3: Key Investment Sectors for Big Data

TABLE OF CONTENTS 1 Chapter 1: Introduction 2 Chapter 2: Big Data Technology & Business Case 3 Chapter 3: Key Investment Sectors for Big Data TABLE OF CONTENTS 1 Chapter 1: Introduction 1.1 Executive Summary 1.2 Topics Covered 1.3 Key Findings 1.4 Target Audience 1.5 Companies Mentioned 2 Chapter 2: Big Data Technology & Business Case 2.1 Defining

More information

Are You Ready for Big Data?

Are You Ready for Big Data? Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?

More information

BEYOND BI: Big Data Analytic Use Cases

BEYOND BI: Big Data Analytic Use Cases BEYOND BI: Big Data Analytic Use Cases Big Data Analytics Use Cases This white paper discusses the types and characteristics of big data analytics use cases, how they differ from traditional business intelligence

More information

DATAMEER WHITE PAPER. Beyond BI. Big Data Analytic Use Cases

DATAMEER WHITE PAPER. Beyond BI. Big Data Analytic Use Cases DATAMEER WHITE PAPER Beyond BI Big Data Analytic Use Cases This white paper discusses the types and characteristics of big data analytics use cases, how they differ from traditional business intelligence

More information

TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP

TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP Pythian White Paper TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP ABSTRACT As companies increasingly rely on big data to steer decisions, they also find themselves looking for ways to simplify

More information

5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK

5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK 5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK CUSTOMER JOURNEY Technology is radically transforming the customer journey. Today s customers are more empowered and connected

More information

How to Leverage Big Data in the Cloud to Gain Competitive Advantage

How to Leverage Big Data in the Cloud to Gain Competitive Advantage How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics

More information

White Paper: Datameer s User-Focused Big Data Solutions

White Paper: Datameer s User-Focused Big Data Solutions CTOlabs.com White Paper: Datameer s User-Focused Big Data Solutions May 2012 A White Paper providing context and guidance you can use Inside: Overview of the Big Data Framework Datameer s Approach Consideration

More information

Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019

Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019 Brochure More information from http://www.researchandmarkets.com/reports/2643647/ Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019 Description: Big Data refers

More information

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics

More information

Mind Commerce. http://www.marketresearch.com/mind Commerce Publishing v3122/ Publisher Sample

Mind Commerce. http://www.marketresearch.com/mind Commerce Publishing v3122/ Publisher Sample Mind Commerce http://www.marketresearch.com/mind Commerce Publishing v3122/ Publisher Sample Phone: 800.298.5699 (US) or +1.240.747.3093 or +1.240.747.3093 (Int'l) Hours: Monday - Thursday: 5:30am - 6:30pm

More information

Big Data Comes of Age: Shifting to a Real-time Data Platform

Big Data Comes of Age: Shifting to a Real-time Data Platform An ENTERPRISE MANAGEMENT ASSOCIATES (EMA ) White Paper Prepared for SAP April 2013 IT & DATA MANAGEMENT RESEARCH, INDUSTRY ANALYSIS & CONSULTING Table of Contents Introduction... 1 Drivers of Change...

More information

Big Data: Are You Ready? Kevin Lancaster

Big Data: Are You Ready? Kevin Lancaster Big Data: Are You Ready? Kevin Lancaster Director, Engineered Systems Oracle Europe, Middle East & Africa 1 A Data Explosion... Traditional Data Sources Billing engines Custom developed New, Non-Traditional

More information

Talend Big Data. Delivering instant value from all your data. Talend 2014 1

Talend Big Data. Delivering instant value from all your data. Talend 2014 1 Talend Big Data Delivering instant value from all your data Talend 2014 1 I may say that this is the greatest factor: the way in which the expedition is equipped. Roald Amundsen race to the south pole,

More information

Big Data Specialized Studies

Big Data Specialized Studies Information Technologies Programs Big Data Specialized Studies Accelerate Your Career extension.uci.edu/bigdata Offered in partnership with University of California, Irvine Extension s professional certificate

More information

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this

More information

BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES

BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data

More information

Analyzing Big Data: The Path to Competitive Advantage

Analyzing Big Data: The Path to Competitive Advantage White Paper Analyzing Big Data: The Path to Competitive Advantage by Marcia Kaplan Contents Introduction....2 How Big is Big Data?................................................................................

More information

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research Benchmarking Large-Scale Data Management Insights from Presentation Confidentiality Statement The materials in this presentation are protected under the confidential agreement and/or are copyrighted materials

More information

Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time?

Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time? Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time? Kai Wähner kwaehner@tibco.com @KaiWaehner www.kai-waehner.de Disclaimer! These opinions are my own and do not necessarily

More information

Are You Ready for Big Data?

Are You Ready for Big Data? Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?

More information

Industry Impact of Big Data in the Cloud: An IBM Perspective

Industry Impact of Big Data in the Cloud: An IBM Perspective Industry Impact of Big Data in the Cloud: An IBM Perspective Inhi Cho Suh IBM Software Group, Information Management Vice President, Product Management and Strategy email: inhicho@us.ibm.com twitter: @inhicho

More information

Big Data Realities Hadoop in the Enterprise Architecture

Big Data Realities Hadoop in the Enterprise Architecture Big Data Realities Hadoop in the Enterprise Architecture Paul Phillips Director, EMEA, Hortonworks pphillips@hortonworks.com +44 (0)777 444 3857 Hortonworks Inc. 2012 Page 1 Agenda The Growth of Enterprise

More information

Big data for the Masses The Unique Challenge of Big Data Integration

Big data for the Masses The Unique Challenge of Big Data Integration Big data for the Masses The Unique Challenge of Big Data Integration White Paper Table of contents Executive Summary... 4 1. Big Data: a Big Term... 4 1.1. The Big Data... 4 1.2. The Big Technology...

More information

The big data business model: opportunity and key success factors

The big data business model: opportunity and key success factors MENA Summit 2013: Enabling innovation, driving profitability The big data business model: opportunity and key success factors 6 November 2013 Justin van der Lande EVENT PARTNERS: 2 Introduction What is

More information

End to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ

End to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,

More information

Business white paper The disruptive power of big data

Business white paper The disruptive power of big data Business white paper The disruptive power of big data How big data analytics is transforming business Business white paper Table of contents 3 Executive overview: The big data revolution 4 The big data

More information

Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019

Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019 MARKET RESEARCH STORE Big Data and Telecom Analytics Market: Business Case, Market Analysis & Forecasts 2014-2019 Market Research Store included latest deep and professional market research report on Big

More information

SAP Makes Big Data Real Real Time. Real Results.

SAP Makes Big Data Real Real Time. Real Results. SAP Makes Big Data Real Real Time. Real Results. MAKE BIG DATA REAL WITH SAP SOLUTIONS: ACCELERATE. APPLY. ACHIEVE Accelerate, Apply, and Achieve Big Results from Your Big Data Big Data represents an opportunity

More information

Reaping the Rewards of Big Data

Reaping the Rewards of Big Data Reaping the Rewards of Big Data TABLE OF CONTENTS INTRODUCTION: 2 TABLE OF CONTENTS FINDING #1: BIG DATA PLATFORMS ARE ESSENTIAL FOR A MAJORITY OF ORGANIZATIONS TO MANAGE FUTURE BIG DATA CHALLENGES. 4

More information

Big Data Analytics Best Practices

Big Data Analytics Best Practices 1 Big Data Analytics Best Practices Marshall Presser Federal Field CTO Greenplum 2 Big Data Makes the Mainstream 3 WHAT DOES IT TAKE? 4 1. New Applications MADlib 5 2. New Skill Sets -- Data Science 6

More information

Forecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014

Forecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Forecast of Big Data Trends Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Big Data transforms Business 2 Data created every minute Source http://mashable.com/2012/06/22/data-created-every-minute/

More information

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait CSC590: Selected Topics BIG DATA & DATA MINING Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait Agenda Introduction What is Big Data Why Big Data? Characteristics of Big Data Applications of Big Data Problems

More information

Big Data Spatial Analytics An Introduction

Big Data Spatial Analytics An Introduction 2013 Esri International User Conference July 8 12, 2013 San Diego, California Technical Workshop Big Data Spatial Analytics An Introduction Marwa Mabrouk Mansour Raad Esri iu UC2013. Technical Workshop

More information

Analytics: The real-world use of big data

Analytics: The real-world use of big data Findings from the research collaboration of IBM Institute for Business Value and Saïd Business School, University of Oxford Analytics: The real-world use of big data How innovative enterprises extract

More information

Global SME Big Data Market 2014-2018

Global SME Big Data Market 2014-2018 Brochure More information from http://www.researchandmarkets.com/reports/2873222/ Global SME Big Data Market 2014-2018 Description: About SME Big Data Big data solutions include a wide range of hardware,

More information

Big Data Explained. An introduction to Big Data Science.

Big Data Explained. An introduction to Big Data Science. Big Data Explained An introduction to Big Data Science. 1 Presentation Agenda What is Big Data Why learn Big Data Who is it for How to start learning Big Data When to learn it Objective and Benefits of

More information

Hadoop Market - Global Industry Analysis, Size, Share, Growth, Trends, and Forecast, 2012 2018

Hadoop Market - Global Industry Analysis, Size, Share, Growth, Trends, and Forecast, 2012 2018 Transparency Market Research Hadoop Market - Global Industry Analysis, Size, Share, Growth, Trends, and Forecast, 2012 2018 Buy Now Request Sample Published Date: July 2013 Single User License: US $ 4595

More information

The New Normal: Get Ready for the Era of Extreme Information Management. John Mancini President, AIIM @jmancini77 DigitalLandfill.

The New Normal: Get Ready for the Era of Extreme Information Management. John Mancini President, AIIM @jmancini77 DigitalLandfill. The New Normal: Get Ready for the Era of Extreme Information Management John Mancini President, AIIM @jmancini77 DigitalLandfill.org Giving Credit Where Credit is Due I didn t make up the term Extreme

More information

Big Data: How can it enhance your strategy?

Big Data: How can it enhance your strategy? 7 Big Data: How can it enhance your strategy? Practice Area: IT Strategy Topic Area: Big Data Connecting the data dots for better strategic decisions Data is essential for organisations looking for answers

More information

Chapter 1. Contrasting traditional and visual analytics approaches

Chapter 1. Contrasting traditional and visual analytics approaches Chapter 1 Understanding Big Data Analytics In This Chapter Defining Big Data Understanding Big Data Analytics Contrasting traditional and visual analytics approaches The era of Big Data is upon us. The

More information

The Enterprise Data Hub and The Modern Information Architecture

The Enterprise Data Hub and The Modern Information Architecture The Enterprise Data Hub and The Modern Information Architecture Dr. Amr Awadallah CTO & Co-Founder, Cloudera Twitter: @awadallah 1 2013 Cloudera, Inc. All rights reserved. Cloudera Overview The Leader

More information

2013 BIG DATA OPPORTUNITIES SURVEY

2013 BIG DATA OPPORTUNITIES SURVEY 2013 BIG DATA OPPORTUNITIES SURVEY By Joseph McKendrick, Research Analyst Produced by Unisphere Research, a Division of Information Today, Inc. May 2013 Sponsored by 2 TABLE OF CONTENTS Executive Summary.............................................................3

More information

Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com

Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated

More information

The disruptive power of big data

The disruptive power of big data Business white paper How big data analytics is transforming business The disruptive power of big data Table of contents 3 Executive overview: The big data revolution 4 The big data imperative 4 Why big

More information

Information-Driven Transformation in Retail with the Enterprise Data Hub Accelerator

Information-Driven Transformation in Retail with the Enterprise Data Hub Accelerator Introduction Enterprise Data Hub Accelerator Retail Sector Use Cases Capabilities Information-Driven Transformation in Retail with the Enterprise Data Hub Accelerator Introduction Enterprise Data Hub Accelerator

More information

Integrating a Big Data Platform into Government:

Integrating a Big Data Platform into Government: Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government

More information

Big Data / FDAAWARE. Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015

Big Data / FDAAWARE. Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015 Big Data / FDAAWARE Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015 1 Agenda BIG DATA What is Big Data? Characteristics of Big Data Where it is being used? FDAAWARE

More information

Hadoop for Enterprises:

Hadoop for Enterprises: Hadoop for Enterprises: Overcoming the Major Challenges Introduction to Big Data Big Data are information assets that are high volume, velocity, and variety. Big Data demands cost-effective, innovative

More information

Deploying Big Data to the Cloud: Roadmap for Success

Deploying Big Data to the Cloud: Roadmap for Success Deploying Big Data to the Cloud: Roadmap for Success James Kobielus Chair, CSCC Big Data in the Cloud Working Group IBM Big Data Evangelist. IBM Data Magazine, Editor-in- Chief. IBM Senior Program Director,

More information

Building Big with Big Data Now companies are in the middle of a renovation that forces them to be analytics-driven to continue being competitive.

Building Big with Big Data Now companies are in the middle of a renovation that forces them to be analytics-driven to continue being competitive. Unlocking Big Data Building Big with Big Data Now companies are in the middle of a renovation that forces them to be analytics-driven to continue being competitive. Data analysis provides a complete insight

More information

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data

More information

Big Data Analytics. Research Report Executive Summary. Assessing the Revolution in Big Data and Business Analytics. Sponsored by

Big Data Analytics. Research Report Executive Summary. Assessing the Revolution in Big Data and Business Analytics. Sponsored by Big Data Analytics Assessing the Revolution in Big Data and Business Analytics Research Report Executive Summary Sponsored by Copyright Ventana Research 2013 Do Not Redistribute Without Permission Sponsor

More information

Talend Open Studio for Big Data. Release Notes 5.2.1

Talend Open Studio for Big Data. Release Notes 5.2.1 Talend Open Studio for Big Data Release Notes 5.2.1 Talend Open Studio for Big Data Copyleft This documentation is provided under the terms of the Creative Commons Public License (CCPL). For more information

More information

Safe Harbor Statement

Safe Harbor Statement Defining a Roadmap to Big Data Success Robert Stackowiak, Oracle Vice President, Big Data 17 November 2015 Safe Harbor Statement The following is intended to outline our general product direction. It is

More information

Big Data and Data Science: Behind the Buzz Words

Big Data and Data Science: Behind the Buzz Words Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing

More information

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect Big Data & QlikView Democratizing Big Data Analytics David Freriks Principal Solution Architect TDWI Vancouver Agenda What really is Big Data? How do we separate hype from reality? How does that relate

More information

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the

More information

Exploiting Data at Rest and Data in Motion with a Big Data Platform

Exploiting Data at Rest and Data in Motion with a Big Data Platform Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, sarah_brader@uk.ibm.com What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags

More information

Apache Hadoop's Role in Your Big Data Architecture

Apache Hadoop's Role in Your Big Data Architecture Apache Hadoop's Role in Your Big Data Architecture Chris Harris EMEA, Hortonworks charris@hortonworks.com Twi

More information

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Agenda Big Data in 15 Mins. Goal: Provide a basic understanding of; What is Big Data; Why it s important

More information

Big Data Analytics for Retail with Apache Hadoop. A Hortonworks and Microsoft White Paper

Big Data Analytics for Retail with Apache Hadoop. A Hortonworks and Microsoft White Paper Big Data Analytics for Retail with Apache Hadoop A Hortonworks and Microsoft White Paper 2 Contents The Big Data Opportunity for Retail 3 The Data Deluge, and Other Barriers 4 Hadoop in Retail 5 Omni-Channel

More information

Big Analytics: A Next Generation Roadmap

Big Analytics: A Next Generation Roadmap Big Analytics: A Next Generation Roadmap Cloud Developers Summit & Expo: October 1, 2014 Neil Fox, CTO: SoftServe, Inc. 2014 SoftServe, Inc. Remember Life Before The Web? 1994 Even Revolutions Take Time

More information

Research Note What is Big Data?

Research Note What is Big Data? Research Note What is Big Data? By: Devin Luco Copyright 2012, ASA Institute for Risk & Innovation Keywords: Big Data, Database Management, Data Variety, Data Velocity, Data Volume, Structured Data, Unstructured

More information

Empower Your organization with

Empower Your organization with Empower Your organization with Big Data Predictive Analytics Solutions AUTOMOBILES MACHINE DATA POINT SALE SOCIAL NET WORK RFID CUSTOMER BASED TEXT DATA SMART METER MOBILE DATA LOCATION BASED STRUCTURED

More information

QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM

QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM QlikView Technical Case Study Series Big Data June 2012 qlikview.com Introduction This QlikView technical case study focuses on the QlikView deployment

More information

Tap into Hadoop and Other No SQL Sources

Tap into Hadoop and Other No SQL Sources Tap into Hadoop and Other No SQL Sources Presented by: Trishla Maru What is Big Data really? The Three Vs of Big Data According to Gartner Volume Volume Orders of magnitude bigger than conventional data

More information

Delivering new insights and value to consumer products companies through big data

Delivering new insights and value to consumer products companies through big data IBM Software White Paper Consumer Products Delivering new insights and value to consumer products companies through big data 2 Delivering new insights and value to consumer products companies through big

More information

Data Refinery with Big Data Aspects

Data Refinery with Big Data Aspects International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data

More information

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 ISSN 2278-7763. BIG DATA: A New Technology

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 ISSN 2278-7763. BIG DATA: A New Technology International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 BIG DATA: A New Technology Farah DeebaHasan Student, M.Tech.(IT) Anshul Kumar Sharma Student, M.Tech.(IT)

More information

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications Big Data Big Data: Introduction and Applications August 20, 2015 HKU-HKJC ExCEL3 Seminar Michael Chau, Associate Professor School of Business, The University of Hong Kong Ample opportunities for business

More information

BUY BIG DATA IN RETAIL

BUY BIG DATA IN RETAIL BUY BIG DATA IN RETAIL Table of contents What is Big Data?... How Data Science creates value in Retail... Best practices for Retail. Case studies... 3 7 11 1. Social listening... 2. Cross-selling... 3.

More information

Real-Time Big Data Analytics + Internet of Things (IoT) = Value Creation

Real-Time Big Data Analytics + Internet of Things (IoT) = Value Creation Real-Time Big Data Analytics + Internet of Things (IoT) = Value Creation January 2015 Market Insights Report Executive Summary According to a recent customer survey by Vitria, executives across the consumer,

More information

Introduction to Engineering Using Robotics Experiments Lecture 17 Big Data

Introduction to Engineering Using Robotics Experiments Lecture 17 Big Data Introduction to Engineering Using Robotics Experiments Lecture 17 Big Data Yinong Chen 2 Big Data Big Data Technologies Cloud Computing Service and Web-Based Computing Applications Industry Control Systems

More information

Big Data Analytics. 10 Best Practice Recommendations. Assessing the Revolution in Big Data and Business Analytics. Sponsored by

Big Data Analytics. 10 Best Practice Recommendations. Assessing the Revolution in Big Data and Business Analytics. Sponsored by Big Data Analytics Assessing the Revolution in Big Data and Business Analytics 10 Best Practice Recommendations Sponsored by Copyright Ventana Research 2013 Do Not Redistribute Without Permission February

More information

Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013

Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Housekeeping 1. Any questions coming out of today s presentation can be discussed in the bar this evening 2. OCF is

More information

Big Data Management and Predictive Analytics as-a-service for the Retail Industry

Big Data Management and Predictive Analytics as-a-service for the Retail Industry Big Data Management and Predictive Analytics as-a-service for the Retail Industry Serendio Predictive Analytics for the Retail Industry 2 Executive Summary The biggest and most successful retailers today,

More information

Business Analytics and Big Data. Computerworld March 2012 Survey Results

Business Analytics and Big Data. Computerworld March 2012 Survey Results Business Analytics and Big Data Computerworld March 2012 Survey Results Purpose & Methodology Survey Sample Survey Method Field Work 1/24/12-2/21/12 Audience Base Computerworld Online Collection Number

More information

Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014

Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014 Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014 Defining Big Not Just Massive Data Big data refers to data sets whose size is beyond the ability of typical database software tools

More information

FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA. Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region

FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA. Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region Big Data Buzz The promise of big data Intelligent Utility - 8/28/11 Big data, analytics

More information

Beyond the Single View with IBM InfoSphere

Beyond the Single View with IBM InfoSphere Ian Bowring MDM & Information Integration Sales Leader, NE Europe Beyond the Single View with IBM InfoSphere We are at a pivotal point with our information intensive projects 10-40% of each initiative

More information

Create and Drive Big Data Success Don t Get Left Behind

Create and Drive Big Data Success Don t Get Left Behind Create and Drive Big Data Success Don t Get Left Behind The performance boost from MapR not only means we have lower hardware requirements, but also enables us to deliver faster analytics for our users.

More information

Big Data Strategy. Use Case Study. Amy O Connor // Field Sales Evangelist

Big Data Strategy. Use Case Study. Amy O Connor // Field Sales Evangelist Big Data Strategy Use Case Study Amy O Connor // Field Sales Evangelist The Importance of a Data Strategy Data is your Most Important Asset Use that Data to achieve your Business Vision 2 Data created

More information

22 SMARTENTERPRISEMAG.COM

22 SMARTENTERPRISEMAG.COM 22 SMARTENTERPRISEMAG.COM Smart Strategies BIG DATA, Big Innovation Smart CIOs are mining their organizations huge data stores for insights that lead to business innovation. By Tom Farre ILLUSTRATION:

More information

Advanced In-Database Analytics

Advanced In-Database Analytics Advanced In-Database Analytics Tallinn, Sept. 25th, 2012 Mikko-Pekka Bertling, BDM Greenplum EMEA 1 That sounds complicated? 2 Who can tell me how best to solve this 3 What are the main mathematical functions??

More information

The Big Deal about Big Data. Mike Skinner, CPA CISA CITP HORNE LLP

The Big Deal about Big Data. Mike Skinner, CPA CISA CITP HORNE LLP The Big Deal about Big Data Mike Skinner, CPA CISA CITP HORNE LLP Mike Skinner, CPA CISA CITP Senior Manager, IT Assurance & Risk Services HORNE LLP Focus areas: IT security & risk assessment IT governance,

More information

Big Data Er Big Data bare en døgnflue? Lasse Bache-Mathiesen CTO BIM Norway

Big Data Er Big Data bare en døgnflue? Lasse Bache-Mathiesen CTO BIM Norway Big Data Er Big Data bare en døgnflue? Lasse Bache-Mathiesen CTO BIM Norway Big Data What is all the fuss about? The effective use of Big Data has the potential to transform economies, delivering a new

More information

Balancing Opportunity and Risk in Big Data

Balancing Opportunity and Risk in Big Data Balancing Opportunity and Risk in Big Data A Survey of Enterprise Priorities and Strategies for Harnessing Big Data WHITE PAPER This document contains Confidential, Proprietary and Trade Secret Information

More information

Tapping Into Hadoop and NoSQL Data Sources with MicroStrategy. Presented by: Jeffrey Zhang and Trishla Maru

Tapping Into Hadoop and NoSQL Data Sources with MicroStrategy. Presented by: Jeffrey Zhang and Trishla Maru Tapping Into Hadoop and NoSQL Data Sources with MicroStrategy Presented by: Jeffrey Zhang and Trishla Maru Agenda Big Data Overview All About Hadoop What is Hadoop? How does MicroStrategy connects to Hadoop?

More information