Customized Report- Big Data

Similar documents
How To Handle Big Data With A Data Scientist

Forecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014

Luncheon Webinar Series May 13, 2013

Big Data Integration: A Buyer's Guide

Addressing Open Source Big Data, Hadoop, and MapReduce limitations

Information Architecture

IBM InfoSphere Guardium Data Activity Monitor for Hadoop-based systems

Big Data Explained. An introduction to Big Data Science.

Big Data in Financial Services Industry: Market Trends, Challenges, and Prospects

Native Connectivity to Big Data Sources in MicroStrategy 10. Presented by: Raja Ganapathy

The Next Wave of Data Management. Is Big Data The New Normal?

locuz.com Big Data Services

A Big Data Storage Architecture for the Second Wave David Sunny Sundstrom Principle Product Director, Storage Oracle

Understanding the Value of In-Memory in the IT Landscape

Transforming the Telecoms Business using Big Data and Analytics

Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges

Using Data Mining and Machine Learning in Retail

Harnessing the power of advanced analytics with IBM Netezza

Improving Data Processing Speed in Big Data Analytics Using. HDFS Method

DATA-DRIVEN EFFICIENCY

Using Big Data for Smarter Decision Making. Colin White, BI Research July 2011 Sponsored by IBM

The Future of Business Analytics is Now! 2013 IBM Corporation

Name: Srinivasan Govindaraj Title: Big Data Predictive Analytics

Protecting Big Data Data Protection Solutions for the Business Data Lake

MySQL and Hadoop: Big Data Integration. Shubhangi Garg & Neha Kumari MySQL Engineering

Oracle Database 12c Plug In. Switch On. Get SMART.

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect

ANALYTICS BUILT FOR INTERNET OF THINGS

Big Impacts from Big Data UNION SQUARE ADVISORS LLC

Big Data Technologies Compared June 2014

Performance and Scalability Overview

TABLE OF CONTENTS 1 Chapter 1: Introduction 2 Chapter 2: Big Data Technology & Business Case 3 Chapter 3: Key Investment Sectors for Big Data

Infomatics. Big-Data and Hadoop Developer Training with Oracle WDP

Virtualizing Apache Hadoop. June, 2012

Three Open Blueprints For Big Data Success

Strategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014

Parallel Data Warehouse

Big Data Are You Ready? Jorge Plascencia Solution Architect Manager

How Transactional Analytics is Changing the Future of Business A look at the options, use cases, and anti-patterns

Executive Summary... 2 Introduction Defining Big Data The Importance of Big Data... 4 Building a Big Data Platform...

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May ISSN BIG DATA: A New Technology

TOP 8 TRENDS FOR 2016 BIG DATA

Navigating Big Data business analytics

Where is... How do I get to...

IBM Data Warehousing and Analytics Portfolio Summary

IBM Big Data in Government

Technology and Trends for Smarter Business Analytics

Data Virtualization A Potential Antidote for Big Data Growing Pains

BIG DATA TECHNOLOGY. Hadoop Ecosystem

Oracle Big Data Building A Big Data Management System

Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time?

Big Data. Fast Forward. Putting data to productive use

CA Technologies Big Data Infrastructure Management Unified Management and Visibility of Big Data

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

Towards a Thriving Data Economy: Open Data, Big Data, and Data Ecosystems

ANALYTICS CENTER LEARNING PROGRAM

How To Use Big Data For Telco (For A Telco)

Hadoop. MPDL-Frühstück 9. Dezember 2013 MPDL INTERN

IBM: An Early Leader across the Big Data Security Analytics Continuum Date: June 2013 Author: Jon Oltsik, Senior Principal Analyst

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!

How To Use Big Data To Help A Retailer

Introducing Oracle Exalytics In-Memory Machine

BIG DATA What it is and how to use?

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities

Next-Generation Cloud Analytics with Amazon Redshift

Big Data. Lyle Ungar, University of Pennsylvania

Big Data and Analytics in Government

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum

BIG DATA & ANALYTICS. Transforming the business and driving revenue through big data and analytics

Actian SQL in Hadoop Buyer s Guide

Apache Hadoop in the Enterprise. Dr. Amr Awadallah,

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics

WHITE PAPER. Harnessing the Power of Advanced Analytics How an appliance approach simplifies the use of advanced analytics

Associate Professor, Department of CSE, Shri Vishnu Engineering College for Women, Andhra Pradesh, India 2

IBM System x reference architecture solutions for big data

Big Data: Are You Ready? Kevin Lancaster

High-Performance Analytics

Big Data Buzzwords From A to Z. By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

CONNECTING DATA WITH BUSINESS

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Ubuntu and Hadoop: the perfect match

Choosing The Right Big Data Tools For The Job A Polyglot Approach

Real Time Fraud Detection With Sequence Mining on Big Data Platform. Pranab Ghosh Big Data Consultant IEEE CNSV meeting, May Santa Clara, CA

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>

The 4 Pillars of Technosoft s Big Data Practice

Intro to Big Data and Business Intelligence

Oracle Big Data SQL Technical Update

Dell* In-Memory Appliance for Cloudera* Enterprise

Affordable, Scalable, Reliable OLTP in a Cloud and Big Data World: IBM DB2 purescale

Transcription:

GINeVRA Digital Research Hub Customized Report- Big Data 1 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 2 2014. All Rights Reserved.

Constantly evolving information technologies and the growing use of the Internet in every aspect of people s lives determined the creation of huge amounts of diverse and rapidly flowing data Context: Characteristics of Big Data Information generated and storage space Total available storage space (Exabytes) Digital information generated (Exabytes) If it is true that the more information one has, the better decisions are made, it is easy to understand the potential value Big Data can generate for the user. Big Data have three main features: High volumes: of data: measured in Zettabytes, equivalent to 1000 7 Bytes; High Variety: data are not equally structured, on the contrary, data with different origins and formats are stored in large Database; High Velocity: it characterizes data both with regards to their origin (capture) and their usage, since rapidity of analysis is essential in order to create value. *SOURCE: BTO elaboration of primary and secondary sources 3 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 4 2014. All Rights Reserved.

The possible applications of Big data are extremely diversified and act upon the whole company s value creation chain, both in operations and in supporting functions Challenges and opportunities The use of Big data allows the creation of value along the whole «Porterian» value creation chain: the following examples explain how this is possible: VALUE CHAIN Company infrastructure Automation, identification of malfunctions and energy savings. HR management Improved monitoring capabilities. R&D More data and more complex analysis allow an improved development of new products, closer to the needs of customers. Supplies The improved awareness of inventories in real-time allows a better management of supplies. Inventory management It consists in integrating of systems for the management of automated warehouses in order to optimize supplies and decrease costs. Operations Allow: Feedback in product innovation Information transparency Real-time performance monitoring. Marketing and sales Enable: Algorythims for the definition of prices Advanced promotional campaigns Market segmentation. Margin Fraud identification capabilities; monitoring of the abandon rate and underlying reasons, an improved risk evaluation 5 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 6 2014. All Rights Reserved.

The characteristics of Big data in terms of quality, speed and variety, make it difficult to manage with relational databases. NoSQL technologies are instead able to ensure speed of analysis and scalability Solutions The path most frequently chosen is the use of NoSQL solutions, a database type developed precisely in order to allow an easy scalability regardless of the quantity and variety. NoSQL Unlike conventional technology, SQL, the structure of the database is not necessarily made of rows and columns, but it has the possibility of being structured in variable patterns; Data is partitioned and balanced between the different nodes of the cluster, and the aggregated queries are distributed by default; Not only the structure but also the query language is different: compared to SQL this concept is defined as MapReduce. ADVANTAGES: This approach gives the possibility of having streams of data that are made available in real time; It makes it easy to change the way data is stored and modify real-time queries that are used; Migrations to operate massive changes are no longer need. 7 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 8 2014. All Rights Reserved.

The market for Big data is characterized by the dominance of the large IT companies and a growing number of startups created to meet specific needs Market Listed below are the market leader in terms of turnover, major IT vendors that are not only focused on Big Data, but that offer a portfolio of solutions to cover every stage of the process: IBM: its main products are InfoSphere BigInsights and Infosphere Streams for the analysis of data flows HP: offering diverse solutions aimed at every infrastructural and information management need. ORACLE: having a large portfolio of infrastructure, data management and advanced analysis products. Another category to consider is that of Pure Players in Big Data, companies that specialize solely in this area. Among these are fast growing companies such as: 10GEN: offers solutions based on the NOSQL MangoDB database; OPERA SOLUTIONS: specialized in complex predictive analysis of data; SPLUNK: offers services and software based on Apache Hadoop; 1010DATA: intelligence systems strong in Data Visualization; CLOUDERA: data analysis and elaboration in the Cloud; ACTIAN: offerse Big data management software, analytic engines and databases. 9 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 10 2014. All Rights Reserved.

The analysis of business data has enabled GE to get an overview of the suspicious behavior identifying patterns of fraudulent behavior COMPANY: Case studies General Electric Consumer & Home Services is a division of GE Group that among the various tasks, also manages the refunds to technicians for the resolution of technical problems at GE's consumer products such as washing machines, dryers, refrigerators and others, that are still under warranty; PROBLEM: The division manages approximately 1 million files per year, many of which are frauds operated by technicians who obtain reimbursement for jobs that actually haven t been carried out. Manual processing, however, could not identify these frauds because it could not give an overview of the issue and identifying the specific behaviors that may be indicative of such scams ; SOLUTION: GE has therefore processed, with the help of a provider, all the old files in order to identify what were the patterns that indicated a fraud and then implemented these into an algorithm in the system of refund files management. Today, the system automatically identifies those files that indicate probable fraudulent behavior. RESULT: GE has estimated that, following the implementation of this system, savings in the first year were approximately 5.1m$. 11 2014. All Rights Reserved.

Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 12 2014. All Rights Reserved.

The profitable management of Big Data is based not only on the choice of appropriate technology, but must also be followed by the development of enabling skills Recommendations Data Scientist IT COMPETENCIES FUNCTIONAL COMPETENCIES ANALYTIC COMPETENCIES The implementation of a system of exploitation of Big Data, is an evolutionary process across the company the success of which is heavily dependent on corporate organization. The path must be gradual and shared and, in particular, there are certain best practices that increase the chances of success of such projects : Creating a project team with people who have balanced analytical skills, functional and IT: "Data Scientist "; Start working on small projects on areas that are of most value to the business. In most cases, so initiatives that involve the analysis of customer needs to make predictions, it is often useful to start analyzing the Datawarehouse already present in the company, which is well known, before searching for new data. By doing so experience is gained and immediately results will we seen through small wins; Before starting, a document explaining how the company intends to leverage big data to achieve of business objectives (scope, requirements, architectures needed) is to be produced. This document must be widely distributed for it to guide all parties involved in the implementation process. 13 2014. All Rights Reserved.

14 2014. All Rights Reserved.