Big Data Are You Ready? Jorge Plascencia Solution Architect Manager

Big Data: The Datafication Of Everything Thoughts Devices Processes Thoughts Things Processes

Why Is Big Data Important? US HEALTH CARE MANUFACTURING GLOBAL PERSONAL LOCATION DATA EUROPE PUBLIC SECTOR ADMIN US RETAIL Increase industry value per year by $300 B Decrease dev., assembly costs by 50% Increase service provider revenue by $100 B Increase industry value per year by 250 B Increase net margin by 60+% In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind. McKinsey Global Institute Source: * McKinsey Global Institute: Big Data The next frontier for innovation, competition and productivity (May 2011)

What Makes it Big Data? SOCIAL BLOG SMART METER 101100101001 001001101010 101011100101 010100100101 VOLUME VELOCITY VARIETY VALUE

Big Data in Action DECIDE ANALYZE ACQUIRE ORGANIZE Make Better Decisions Using Big Data

Big Data in Action DECIDE ACQUIRE Acquire all available data ANALYZE ORGANIZE

Oracle NoSQL Database Application NoSQL Driver Delete Read Application NoSQL Driver Update Read Key value pair database Dynamic data model Highly scalable, available Transparent load balancing Built using BerkeleyDB Nodes Nodes West Nodes Central Nodes East Nodes

Big Data in Action DECIDE ACQUIRE Oracle NoSQL Database ANALYZE ORGANIZE

Big Data in Action DECIDE ACQUIRE Organize and distill big data using massive parallelism ANALYZE ORGANIZE

Hadoop Architecture Management/Monitoring Distributed file system with redundant storage Map/Reduce programming paradigm MapReduce Hadoop Distributed File System (HDFS) Highly scalable data processing Cost-effective model for high volume, low density data

A Map/Reduce Pipeline SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT INPUT 2 INPUT 1 OUTPUT 2 OUTPUT 1

Oracle Data Integrator Reduces Hadoop complexities through graphical tooling

Oracle Loader for Hadoop SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT SHUFFLE /SORT INPUT 2 INPUT 1

Big Data in Action DECIDE ACQUIRE Oracle NoSQL Database Oracle Enterprise Manager Oracle Data Integrator Oracle Loader for Hadoop ANALYZE ORGANIZE

Big Data in Action DECIDE ACQUIRE Analyze all your data, at once ANALYZE ORGANIZE

R Statistical Programming Language Open source language and environment Used for statistical computing and graphics Strength in easily producing publication-quality graphs Highly extensible

Oracle R Enterprise Approach Models run in-database Processes large data sets Uses the power of Oracle Database 11g and Exadata Same code, much faster

Big Data in Action DECIDE ANALYZE ACQUIRE ORGANIZE Oracle NoSQL Database Oracle Enterprise Manager Oracle Data Integrator Oracle Loader for Hadoop Oracle R Enterprise

Big Data in Action DECIDE ACQUIRE Decide based on real-time big data ANALYZE ORGANIZE

Integrated Analytics Platform One Platform, One Model, Multiple Delivery Channels Oracle Business Intelligence Enterprise Edition + Integrating R Analytics Interactive Dashboards Reporting & Publishing Ad-hoc Analysis Detect & Alert Mobile & Disconnected Office Integration Search Embedded Common Enterprise Information Model BI Server & Information Discovery Advanced dashboard visualization, Runs BI and EPM applications, Integrated Security, User Management, Personalization Embed R script s web interface in BI dashboard, Multidimensional Calculation and Integration Engine Graphics will stream to BI dashboard, Intelligent Request Generation and Optimized Data Access Services OLTP & ODS Systems Data Warehouse, Datamart Exadata OLAP Oracle, Siebel, PeopleSoft, Custom Excel XML Big Data

Oracle Endeca Information Discovery Fast & Intuitive Data analysis and exploration from any combination of sources Structured & Unstructured# Unstructured Analytical! Benefits Unprecedented visibility of information Leverage existing investments in BI Self-service data discovery Best business decisions & reduced IT costs. Unique Features Contextual search, Navigation, Analytics Dynamic data and metadata Content acquisition and text enrichment Memory performance

Oracle Integrated Solution Stack for Big Data HDFS Hadoop (MapReduce) Oracle NoSQL Database Oracle Loader for Hadoop Data Warehouse In-Database Analytics Analytic Applications Enterprise Applications Oracle Data Integrator ACQUIRE ORGANIZE ANALYZE DECIDE

Oracle Big Data Platform

Sample of Big Data Use Cases Today AUTOMOTIVE Auto sensors reporting location, problems COMMUNICATIONS Location-based advertising CONSUMER PACKAGED GOODS Sentiment analysis of what s hot, problems FINANCIAL SERVICES Risk & portfolio analysis New products EDUCATION & RESEARCH Experiment sensor analysis HIGH TECHNOLOGY / INDUSTRIAL MFG. Mfg quality Warranty analysis LIFE SCIENCES Clinical trials Genomics MEDIA/ ENTERTAINMENT Viewers / advertising effectiveness ON-LINE SERVICES / SOCIAL MEDIA People & career matching Web-site optimization HEALTH CARE Patient sensors, monitoring, EHRs Quality of care OIL & GAS Drilling exploration sensor analysis RETAIL Consumer sentiment Optimized marketing TRAVEL & TRANSPORTATION Sensor analysis for optimal traffic flows Customer sentiment UTILITIES Smart Meter analysis for network capacity, LAW ENFORCEMENT & DEFENSE Threat analysis - social media monitoring, photo analysis Challenged by: Data Volume, Velocity, Variety 26 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Big Data Use Cases Today s Challenge New Data What s Possible Healthcare Expensive office visits Manufacturing In-person support Location-Based Services Based on home zip code Public Sector Standardized services Retail One size fits all marketing Remote patient monitoring Product sensors Real time location data Citizen surveys Social media Preventive care, reduced hospitalization Automated diagnosis, support Geo-advertising, traffic, local search Tailored services, cost reductions Sentiment analysis segmentation