Big Data, Platforms, Tools, and Advanced Analytics Applications and Capabilities What do you Need

Transcription

1 Big Data, Platforms, Tools, and Advanced Analytics Applications and Capabilities What do you Need Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights

2 2 Copyright 2011, Oracle and/or its affiliates. All rights

3 Global Digital Data Growth Growing leaps and bounds by 40+% YoY! 2009 =.8 Zetabytes =.08 ZB Structured Data =.72 ZB Unstructured Data 2020 = 35 Zetabytes LEGEND Structured Data Unstructured Data = 3.5 ZB Structured Data = 31.5 ZB Unstructured Data* (1 Zetabyte = 1 Trillion Gigabytes) Chart conservatively assumes a constant 9:1 ratio of unstructured data vs. structured data (based upon IDC s estimate that 90% of all digital data is unstructured). Chart does not reflect IDC s projection that unstructured data is currently growing twice as fast as structured data at the rate of 63.7% vs. 32.3% CAGR. Source: IDC Digital Universe Study, A Digital Universe Decade Are Your Ready?, Copyright 2012, Oracle and/or its affiliates. All rights

4 Global Drivers for Analyzing Place-Events-People BIG Data Terabytes, Petabytes, Exabytes, Zettabytes, Yottabytes Sensors, RFID, VIDEO, LIDAR, Raster, 3D, Terrain and City Models Tagged Data, Social Media, Semantics, Ontologies SDIs, INSPIRE, Linked Open Data - Persistent Relationships BIG Hardware: CLOUD Platforms Public and Private Cheaper, more powerful Clusters of Commodity Servers, Virtualization: = Greener Massively parallel database machines (Software Enablement) e.g. Hadoop, Oracle BIG Software Real Time Analytics Biggest value from fastest response Streams and Events - Internet of Things; Spatially Aware CyberSecurity Location Enable All Applications: ERP, CRM, Business Intelligence, Public Sectors Engineered Systems Fully installed and tested (Labor Cost is now Dominant Factor) Support Standards for Interoperability W3C, ISO, OGC, Wide Range 4 Copyright 2011, Oracle and/or its affiliates. All rights

5 Data Volume & Variety Explosion Continues - Terabytes, Petabyes, Exabytes, Zettabytes Sensors, RFID, LIDAR, Raster, 3D, Terrain and City Models, SDIs New data products for consumers, mobility, defense, intelligence, land and water mgmt, transportation, environment, agriculture, and constituent services Terrain Models and 3D for planning, maintenance, emergency response, tourism Tagged Data, Semantics, Ontologies - - Location is a Powerful Organizing Principle Integrate Social Media (Video, Audio, Text, Wikis, Facebook, Imagery) with Spatial 5 Copyright 2011, Oracle and/or its affiliates. All rights

6 Data Velocity: Spatially-aware Real-Time Streams / Events / Internet of Things Track Moving Objects Cars, UAVs Real-Time Business Intelligence Ultra-high throughput (1 million/sec++) and microsecond latency Detect patterns in the flow of events and message payloads, Complex Event Processing-CEP Real-Time Pattern Detection Filtering, correlation, and aggregation across event sources Business Intelligence in Real Time 6 Copyright 2011, Oracle and/or its affiliates. All rights

7 Definition: What is Big Data Anyway? The 4 Vs of Big Data? Volume It s about 100s TeraBytes and Petabytes... BUT could be smaller volumes size is in the eye of beholder Variety Highlights the new types of data from the internet of things that can be stored and analysed Velocity Relates to streams of high frequency data arriving e.g. From a sensor, network, Imagery, UAV, or high volume event Value At volume low value data can highlight high value patterns, trends and insights of significant commercial value 7 Copyright 2012, Oracle and/or its affiliates. All rights

8 Detecting Signal in Noise = New Insight Noise What s the effectiveness of a re-employment campaign? How has it effected the economy What do citizens think about policies & services? Signal... Insight How can sensor data improve maintenance efforts for key assets? Can I track certain suspicious individuals? Can we detect issues and trends before liabilities increase? 8 Copyright 2012, Oracle and/or its affiliates. All rights

9 Big Data in Public Sector Examples of Different Program Areas Use Cases 1. Fraud Prevention 2. Maintenance & Utilities 3. Constituent Sentiment 4. Threat Identification 5. Economic Analysis 6. Healthcare 7. Regulatory Compliance, Licensing & Enforcement 8. Open Government 9. Tax Collections 9 Copyright 2012, Oracle and/or its affiliates. All rights 9

10 Big Data Poses Big Challenge For Military Intelligence The amount of data generated is reaching epic proportions Number of sensors deployed on the ground or aloft on unmanned aerial vehicles (UAVs) and satellites continues to soar, as does the ability to keep this asset in place for longer periods Volume of data being gathered for intelligence, surveillance and reconnaissance (ISR) is already huge. In Afghanistan, ISR acquisition systems gather more than 53TB of data every day. There s a gap between our growing ability to collect data and our limited ability to process that data. We are collecting 1,500% more data than we did 5 years ago. At the same time, our head count has barely risen. Gen. Robert Kehler, commander of the U.S. Strategic Command, late 2011 Throughout the defense industry, there s a concerted effort to deal with socalled big data. There is a recognition that it is simpler to resolve the problems with technology than to boost the staff of skilled analysts. Source: Terry Coslow, Defense Systems, 29 March Copyright 2012, Oracle and/or its affiliates. All rights

11 What Can Federal Agencies Do With Big Data? Example: Weapons of Mass Destruction Tracking Combining Information on: Goods Materials People Money Transportation To give analysts awareness never before possible 11 Copyright 2012, Oracle and/or its affiliates. All rights

12 Secured Example: DHS Risk Analysis External Data Sources Transactional & Operational Systems Contents Repository Databases Web resources Blogs, Mails, news Real-time Data Streams Search, Presentation, Report, Visualization, Query Automatic Responses and Publishing SMS Console Alerts EV Grid Management Enterprise Data Management Infrastructure GeoSpatial Documents Historical Records POIs Demographics Customer Data Call Records Workflow Initiation Real-time Dashboards 12 Copyright 2011, Oracle and/or its affiliates. All rights

13 Maintenance and Utilities Structured, but massive data sets Condition Based Maintenance (CBM+) relies on sensors to collect information about the vehicle condition The condition data is combined with other data such as operational use and cost data Fleet-wide data sets need to be analyzed for trends that lead to increased costs, but analysts do not always know what they are looking for Big Data can help direct the analysts to the areas of most bang-for-the-buck Utilities can use these to spot trends in the massive time series data from millions of smart meter readings and lower costs or prevent blackouts 13 Copyright 2011, Oracle and/or its affiliates. All rights 13

14 Non-Defense & Security Uses Use Cases National Institutes of Health Disease outbreak detection & tracking USDA Food Stamp Fraud detection/tracking Housing and Urban Development Development and use of affordable housing 14 Copyright 2012, Oracle and/or its affiliates. All rights

15 Big Data, Analytics: For Your Domain: What Tools & Platforms are Most Useful to You? SCALE: Terabyte, Petabyte, Exabyte Databases Hadoop, Map Reduce, Many Open Source tools NoSQL, Graph, Relational, Semantics, Ontologies, Cyber Security Attacks, Multi-Level Security Versioning, Compression, Archiving Analytics Software as part of Platforms HOW do you identify all the technologies you need HOW to get ALL those technologies in an COTS Platform Engineered Solution for you Without Extra Labor Costs! 15 Copyright 2012, Oracle and/or its affiliates. All rights

16 Hadoop, MapReduce and Related Technologies Hadoop, HDFS, Hive, MapReduce, HBase Mahout, Sqoop, Zookeeper, Flume, Oozie, Pig, Whirr NoSQL, Key Value Stores What are these? When and why are they important? For what Use Cases? What Problems are YOU trying to solve? And Oracle really supports all of these Open Source Technologies? 16 Copyright 2012, Oracle and/or its affiliates. All rights

17 In-Database Analytics Oracle Integrated Solution Stack for Big Data HDFS Hadoop (MapReduce) Oracle NoSQL Database Oracle Big Data Connectors Data Warehouse Analytic Applications Enterprise Applications Oracle Data Integrator ACQUIRE ORGANIZE ANALYZE DECIDE 17 Copyright 2012, Oracle and/or its affiliates. All rights

18 Big Data Processing & Query Characteristics Batch-Oriented Process data to use Real-Time Deliver a service Bulk storage Fast access to specific record Write once, read all Read, write, delete update 18 Copyright 2011, Oracle and/or its affiliates. All rights

19 Big Data Storage Options: Batch vs. Real-Time Hadoop Distributed File System (HDFS) File System Parallel scanning No inherent structure High volume writes Batch Oriented NoSQL Database (Oracle ) Database Indexed storage / Key Value Pairs Simple data structure High volume random reads and writes Real-Time 19 Copyright 2011, Oracle and/or its affiliates. All rights

20 NoSQL & RDBMS Used Alongside Each Other NoSQL architectures Low value, low density, simple data RDBMS High value, high density, complex data Very simple relationships Schema-free, unstructured or semistructured data Distributed storage and processing Stripped down, special purpose data store Lower overhead ($ per operation) Complex data relationships Schema-centric Designed to scale up & out Lots of general purpose features/functionality High overhead ($ per operation) 20 Copyright 2012, Oracle and/or its affiliates. All rights

21 Oracle NoSQL Database Enterprise Edition Scalable, Highly Available, Key-Value Database Features Flexible Key-Value Data Model ACID transactions Horizontally Scalable Highly Available Elastic Configuration Simple administration Intelligent Driver Commercial grade software and support Application Application NoSQL DB Driver Storage Nodes Datacenter A Application Application NoSQL DB Driver Storage Nodes Datacenter B Java SE 6 (JDK u25)+; Solaris or Linux 21 Copyright 2012, Oracle and/or its affiliates. All rights

22 Why Have Graph Databases Become Very Popular Graph Database Model data in terms of relationships Flexible schema evolves easily by adding new relationships Supports querying and discovery by graph patterns and traversal Enables graph analytics such as reachability, connectivity, transitivity, same as, proximity, centrality Oracle Has Been Shipping Graph Databases For over 10 YEARS :California :USA :NorthAmerica :partof :partof rdf:type :partof :partof owl:transitiveproperty Query: SELECT?x?y FROM WHERE {?x :partof?y } 22 Copyright 2012, Oracle and/or its affiliates. All rights

23 Buzzwords For Apps using Graph Technology What terms to look for: Semantic Web W3C RDF/OWL/SPARQL RDF Resource Description Framework Graph Data Management Knowledge Discovery Knowledge Mining Inferencing / Reasoning Social Network Analysis (SNA) Ontologies Taxonomy/Terminology Mgmt Property Graphs Sentiment Analysis Faceted Search Text Mining NoSQL Database Big Data 23 Copyright 2012, Oracle and/or its affiliates. All rights

24 Using Graphs for Enterprise Applications Enterprise metadata framework for enterprise data & public cloud Semantic terms link instance data with other resources and apps Linked resources enable interoperability between apps Apps RDF Graph Metadata Instance Data 24 Copyright 2012, Oracle and/or its affiliates. All rights

25 RDF / OWL for Enterprise Integration Access & Presentation Layer RDF metadata layer (integrated graph metadata) Index Data Servers Event Server Big Data Appliance Content Mgmt BI Server Data Warehouse Data Sources / Types Machine Generated Data Social Media Human Sourced Information Subscription Services Transaction Systems 25 Copyright 2011, Oracle and/or its affiliates. All rights

26 Supporting Breadth of Enterprise Data End-user and Developer Environments Developers Data Integration JDeveloper Discovery Data Scientists Statistics Mining Business Intelligence Business Users Dashboards Data Services Semantic Metadata Layer Big Data Sources Structured Data Unstructured Data Streaming Services Event Processing Statistics Data Mining Data Management Text Analytics Natural Lang. Processing ODBC Graph Analytics Sound and Video JDBC Spatial Images App Services Web-log Sessionization and Enrichment Applications Vertical Applications Social Media NoSQL Hadoop Relational Sentiment Analysis Horizontal Applications Reference Architecture Compression Security & Encryption 26 Copyright 2012, Oracle and/or its affiliates. All rights

27 Oracle: RDF, OWL Semantic Graph Graph database model for social networks, linked data and integration Key Features Proven scalability for billions of relationships, terabytes of data Standards-based native reasoning Supports open source 3 rd party & Oracle tools Graph querying with SPARQL & SQL languages Compression, parallelism, and partitioning to enhance query, load, and inference performance DoD strength security: top secret, compartmented 27 Copyright 2012, Oracle and/or its affiliates. All rights

28 Supports Ideology: Islamist Supports Group: Al Shabab Group:? Nationality: Somalian Member of Member of Has Nationality: Pakistani Has Person: Abduwali Abdukhadir Muse Person:? Link? Country: UK Currently resides Link? Currently resides Country: Pakistan Person: Chehab Abdouljamid Bouyaly Country: Morocco Member of Currently resides Group: al Qaeda Graph Alignment of Complex Workflows Extract, Transform, Load Feature/term Extraction Semantic categorization Transformation to RDF triple Extracted Entities & Relationships RDF Intelligence Ontology Search, Presentation, Report, Visualization, Query SQL/SPARQL Data Sources Contents Repository Databases Web resources Blogs, Mails, news, RSS feeds Enterprise Data Spatial Documents National Intelligence Scenario 28 Copyright 2012, Oracle and/or its affiliates. All rights

29 Allied Nation Intelligence Service Oracle Spatial and Graph: Social Analysis Objectives Profile suspects through telephone, and social network communications Produce data products for analysts Solution RDF Graph modeling of the social network: people, groups and places of interest Graph analytics discover relationships among individuals & meaning of pseudonyms, aliases, codes, terminology Benefits Find & label same-as relationships Discover of ~100 million relationships / month Tagging for 600 TB / 10b triples graph Top-secret, compartmented security for data Standards-based tools: W3C RDF & SPARQL 29 Copyright 29 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

30 Core Inference Features and Semantic Indexing Forward chaining based inference engine in the database Various native rulebases provided E.g., RDFS, OWL 2 RL, SNOMED (subset of OWL 2 EL), SKOS Validation of inferred data User-defined rules, Proof generation Performance enhancements Parallel Inference, Incremental Inference, Compact data structures Optimized owl:sameas handling Semantic document indexing Programmable API to plug-in 3 rd party extractors (for any data) into the database. If you have software that understands text (NLP), image, audio, or video, plug it in 30 Copyright 2012, Oracle and/or its affiliates. All rights

31 More functions in Oracle Database Release Inference Native OWL 2 EL inference support User defined inferencing Allows generation of new RDF resources Temporal reasoning, Spatial reasoning Web service callouts Ladder Based Inference Fine grained security for inference graph Performance optimization for user defined rules Integration with TrOWL*, an external OWL 2 reasoner TrOWL is a transformation based, tractable reasoner for OWL 2 31 Copyright 2012, Oracle and/or its affiliates. All rights *

32 Oracle Spatial and Graph: Graph Use Cases Data Integration Metadata Flexibility Layer Text Mining & Entity Analytics Point Social Media Analysis Point Network Analysis Unified content metadata for federated resources Validate semantic and structural consistency Apps: Metadata warehouse Master Data Management Taxonomy/vocabulary store Media metadata repository Find related content & relations by navigating connected entities Reason across entities Apps: Documents summary repository Documents catalogue Analyze social relations using curated metadata Blogs, wikis, forums, IM, calendars, video, voice Apps: Social graphs Recommender systems HR skills database Graph analysis of road, utility and multimodal networks, drive-time polygons Apps: Trade area management Service delivery optimization Water, Gas, Electric Utility 32 Copyright 32 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

33 Oracle Spatial and Graph Graph Use Cases Intelligence, Law Enforcement Web and Social Network Solutions Health Care and Life Sciences Transportation Network Management Financial Services Media, Content Management Build graphs in social networks for Threat Analysis Semantically index results of Text Mining Semantic ally link data sets for Integrated Justice system Model a graph of relationships for Social Network Analysis (SNA) Query graph patterns for Activity Analysis Attribute Clusters Terminology management of EHR systems Semantic concept alignment of clinical, research and operational data Information discovery using inferencing rules Fleet management Multimodal transportation planning Routing and Tracking Facilities mgt. Assets monitoring & maintenance Outage management Network planning Coverage area analysis Model same as relationships for Fraud detection Semantic ally link data sets for complete results in Compliance Management Link relevant metadata for Risk Assessment Query graph patterns in Media Metadata to find media of interest Semantically relate media metadata to Repurpose Content 33 Copyright 2012, Oracle and/or its affiliates. All rights

34 Oracle Spatial and Graph - Types Points Web Services (OGC) SPARQL End Point Oracle Spatial and Graph Lines Polygons Geocoding Routing Inferencing Rasters Network Graphs e1 f1 e2 n1 n2 f2 e4 e3 Topologies 3D RDF Semantic Graphs 34 Copyright 2012, Oracle and/or its affiliates. All rights

35 Ontology-driven Geospatial Applications - Connect Actionable Knowledge Application Ontologies National Mapping Private Cloud RDF & OWL Metadata Environmental Monitoring Spatial Data Simple Features GeoRaster Topology Networks Gazetteers Geographic Names Raster Data 35 Copyright 2012, Oracle and/or its affiliates. All rights Data Integration National Map schemas Geographic names Temporal Naïve Geography Disaster Response Famine Relief

36 It s Not Just about Linking Integrate domains of knowledge through common vocabularies (ie SKOS) Manage relationships between collections of images and associated metadata RDF as flexible and extensible data model supports powerful search and end-user discovery of related content Rich platform for data integration, data repurposing, and better quality control and classification Semantic Aggregation & Navigation of Data 36 Copyright 2011, Oracle and/or its affiliates. All rights

37 Active Frequent Access Automatic Data Optimization Occasional Access Dormant 37 Copyright 37 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

38 ILM: Hot/Cold Data Classification Enhanced Insight into Data Usage: heat map ACTIVE Recently inserted, actively updated Block and Segment level statistics on last Read and last Update FREQUENT ACCESS Infrequently updated, Frequently Queried DORMANT Retained for long term analytics and compliance with corporate policies and regulations 38 Copyright 2012, Oracle and/or its affiliates. All rights

39 ILM: Automatic Compression & Tiering Usage based and custom compression and tiering ALTER TABLE orders ILM ADD CompressionPolicy COMPRESS Partitions for Query AFTER 90 days from creation; ALTER TABLE sales ILM ADD MovePolicy TIER Partitions TO Archive_TBS ON OrdersClosedPolicy; 39 Copyright 2012, Oracle and/or its affiliates. All rights

40 Data Compression Reduce storage footprint, read compressed data faster Hot Data X Advanced Row Compression Warm Data X Columnar Query Compression Archive Data X Columnar Archive Compression Copyright 2012, Oracle and/or its affiliates. All rights Copyright 2012, Oracle and/or its affiliates. All rights Confidential Oracle Restricted

41 Security 41 Copyright 41 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

42 Connecting: CYBERSECURITY is Major Challenge Information Security and Privacy Oracle Database Encryption & Masking Access Control Monitoring Blocking & Logging 42 Copyright 2012, Oracle and/or its affiliates. All rights Monitoring Configuration Management Audit Vault Total Recall Access Control Database Vault Label Security Encryption & Masking Advanced Security Secure Backup Data Masking

43 Oracle Database Security Solutions Comprehensive Security Platform PREVENTIVE DETECTIVE ADMINISTRATIVE Encryption Database Firewall and Network Monitoring Privilege Analysis Redaction and Masking Audit Consolidation Sensitive Data Discovery Privileged User Controls Reporting and Alerting Configuration Scanning 43 Copyright 43 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

44 Redacting Data Challenges Secure sensitive personal information Redact data in applications, queries and reports Avoid changing applications, queries and reports 44 Copyright 2012, Oracle and/or its affiliates. All rights

45 Redacting Sensitive Data Mask Application Data Dynamically Policy enforced redaction of sensitive data Call Center Operator Soc. Sec. # DOB 11/06/71 PIN 5623 Payroll Processing 45 Copyright 45 Copyright 2012, Oracle 2012, Oracle and/or and/or its affiliates. its affiliates. All rights All rights Confidential Oracle Restricted

46 Connecting: Tools to Find Connections: Discovery & Predictive Analysis Anomaly Detection Problem Classification Sample Problem Given demographic data about a set of customers, identify customer purchasing behavior that is significantly different from the norm (Fraud?). For Sensors, Events problem? Good News? Association Rules Find the items that tend to be purchased together and specify their relationship market basket analysis Clustering Segment demographic data into clusters and rank the probability that an individual will belong to a given cluster. For customers / govt constituents, what do they want to know about? Feature Extraction Given demographic data about a set of customers, group the attributes into general characteristics of the customers F1 F2 F3 F4 46 Copyright 2011, Oracle and/or its affiliates. All rights

47 Analysis with R R workspace console Oracle Database 11g statistics engine OBIEE, Web Services Function push-down data transformation & statistics Transparently leverage Hadoop for High Performance Analytics to Oracle Big Data Appliance (Oracle R Connector for Hadoop) 47 Copyright 2012, Oracle and/or its affiliates. All rights

48 Predictive Analytics with R, BI, Data Mining R workspace console Oracle statistics engine Function push-down data transformation & statistics OBIEE, Web Services No changes to the user experience Scale to large data sets Embed in operational systems Development Production Consumption 48 Copyright 2012, Oracle and/or its affiliates. All rights

49 Information Discovery and Hadoop Complementary Big Data Capabilities Oracle Endeca Information Discovery Massive scalability Batch execution Technical experts develop analyses Deep Large-Scale Processing Data Variety - structured and unstructured data No fixed pre-defined model required Populates Informs In-memory analytics Interactive query response times Targets business users Fast Self-service Information Discovery 49 Copyright 2012, Oracle and/or its affiliates. All rights

50 Big Data in Healthcare Find relationship between gene to cancer interaction Use Case Cross-referenced the relationships between genes and five major cancer types across 20 million medical publication abstracts Cross-referenced genes from 60Million patients and mirna for a simulated 900Million population. Understanding additional layers of the pathways these genes operate in and the drugs that target them is expected to help researchers in their work 2012 Government Big Data Solution 50 Copyright 2013, 2012, Oracle and/or its affiliates. All rights

51 Oracle In-Database Analytics Platform Oracle R Enterprise Oracle Data Mining Spatial Analytics Text and Search RDF Graph Analytics SQL Analytics Parallel Processing Engine XML Relational OLAP Spatial Data Layer RDF Media 51 Copyright 2012, Oracle and/or its affiliates. All rights

52 Big Data Apparent Disconnect Two Separate Developer Worlds Unstructured Data Hadoop, HDFS, Hive, MapReduce, HBase Mahout, Sqoop, Zookeeper, Flume, Oozie, Pig, Whirr Distributed File Systems Transaction (Key-Value Stores) Acquire Big Data Environments Organize MapReduce Solutions Traditional Environments Analyze NoSQL Flexible Specialized Developer Centric Structured Data DBMS (OLTP) Extract Transform and Load (ETL) DBMS (DW) Advanced Analytics SQL Trusted Secure Administered Acquire Organize Analyze 52 Copyright 2012, Oracle and/or its affiliates. All rights

53 Hadoop, HDFS, Hive, MapReduce, HBase Mahout, Sqoop, Zookeeper, Flume, Oozie, Pig, Whirr Unstructured Data Structured Data Oracle s Approach To Big Data Provide all Technologies, Engineered Together Distributed File Systems Oracle Big Data Appliance Transaction (Key-Value Stores) Acquire DBMS (OLTP) Acquire Big Data Environments Organize MapReduce Solutions Traditional Environments Extract Oracle Transform Exadata and Load Database (ETL) Machine Organize DBMS (DW) Analyze Advanced Analytics Analyze Oracle Exalytics In-Memory Machine NoSQL Flexible Specialized Developer Centric SQL Trusted Secure Administered 53 Copyright 2012, Oracle and/or its affiliates. All rights

54 Big Data and Cloud Computing Next Generation Enterprise Data Platform CIO Big Data Private Cloud Drive Business Value Deliver Top Line Growth Drive Business Efficiency and Agility Deliver Bottom Line Savings Business Value Secure 54 Copyright 2011, Oracle and/or its affiliates. All rights

55 Public Clouds and Private Clouds Used by multiple tenants on a shared basis Hosted and managed by cloud service provider Public Clouds SaaS PaaS IaaS I N T E R N E T Lower upfront costs Outsourced management OpEx Trade-offs I N T R A N E T Private Cloud Lower total costs Exclusively used by a single organization Controlled and managed by in-house IT Greater control over security, compliance, QoS CapEx & OpEx Apps SaaS PaaS IaaS Oracle Technology Supplies both Public and Private clouds 55 Copyright 2011, Oracle and/or its affiliates. All rights

56 In-Database Analytics Oracle Complete Big Data Platform Big Data Exadata Exalytics Appliance Exadata Exalytics Big Data Appliance Cloudera s Distribution including Apache Hadoop Oracle NoSQL Database Open Source R Applications Oracle Big Data Connectors InfiniBand Oracle Data Integrator Oracle Advanced Analytics Data Warehouse Oracle Database InfiniBand Analytic Applications Alerts, Dashboards, MD- Analysis, Reports, Query Web Services BI Abstraction ACQUIRE ORGANIZE ANALYZE DECIDE 56 Copyright 2012, Oracle and/or its affiliates. All rights

57 Why Build A Hadoop Appliance? Time to Build Optimizations Maintenance 57 Copyright 2011, Oracle and/or its affiliates. All rights

58 Required Skills for MapReduce Development Java Hadoop Framework Parallel Algorithms & Manage Large Clusters of Machines 58 Copyright 2011, Oracle and/or its affiliates. All rights

59 Big Data: Batch-Oriented Processing using Hadoop: Map Reduce Simple Example INPUT 1 MAP MAP OUTPUT 1 MAP MAP MAP REDUCE REDUCE REDUCE MAP REDUCE REDUCE MAP MAP MAP SHUFFLE /SORT REDUCE REDUCE MAP SHUFFLE /SORT MAP INPUT 2 MAP MAP MAP MAP SHUFFLE /SORT REDUCE REDUCE MAP MAP SHUFFLE /SORT REDUCE MAP MAP MAP SHUFFLE /SORT REDUCE REDUCE REDUCE OUTPUT 2 59 Copyright 2011, Oracle and/or its affiliates. All rights

60 HW/SW Efficiencies: But Labor Costs Growing - Complete, Engineered System Needed Services $500B $400B $300B $200B $100B Procurement Leveraging Hardware Software 60 Copyright 2011, Oracle and/or its affiliates. All rights

61 Oracle Big Data Appliance Optimized and Complete All you need to store and integrate big data Integrated with Oracle Exadata Analyze all your data Easy to Deploy Risk Free, Quick Installation and Setup Single Vendor Support Full Oracle support for all hardware and software 61 Copyright 2012, Oracle and/or its affiliates. All rights

62 Oracle Exadata Database Machine Data Warehousing, Transaction Processing, Consolidation Fastest Data Warehouse & OLTP Best Cost/Performance Data Warehouse & OLTP Optimized Hardware (per rack) Processor: up to128 Intel Cores and 2 TB DRAM Network: 880 GB/Sec Throughput Storage: 5 TB Flash and up to 336 TB Disk Software Breakthroughs Exadata Smart Storage Grid Smart Flash Cache Hybrid Columnar Compression Parallel Scale-Out Database and Storage Scales from ¼ Rack to 8 Full Racks 62 Copyright 2012, Oracle and/or its affiliates. All rights

63 Oracle Exalytics In-Memory Machine First engineered system for analytics Visual Analysis without limits Smarter analytic applications 63 Copyright 2011, Oracle and/or its affiliates. All rights

64 In-Database Analytics Oracle Complete Big Data Platform Big Data Exadata Exalytics Appliance Exadata Exalytics Big Data Appliance Cloudera s Distribution including Apache Hadoop Oracle NoSQL Database Open Source R Applications Oracle Big Data Connectors InfiniBand Oracle Data Integrator Oracle Advanced Analytics Data Warehouse Oracle Database InfiniBand Analytic Applications Alerts, Dashboards, MD- Analysis, Reports, Query Web Services BI Abstraction ACQUIRE ORGANIZE ANALYZE DECIDE 64 Copyright 2012, Oracle and/or its affiliates. All rights

65 Cloud Computing Oracle Engineered Systems 65 Copyright 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 8