Architecting for the Internet of Things & Big Data Robert Stackowiak, Oracle North America, VP Information Architecture & Big Data September 29, 2014
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 3
Who Oracle is Talking to about the Internet of Things Aircraft Suppliers & Manufacturers Automotive Suppliers & Manufacturers Computer & Mobile Device Manufacturers Energy Management Firms & Utilities Entertainment & Media Healthcare / Extended Care Providers Home & Commercial Appliance Manufacturers Insurance Companies IT Service Providers Railroads Retailers Security Systems Providers
Capillary Networks Network Firewall Intranet Firewall Database Firewall Oracle IoT Reference Architecture IoT Identity & Access Mgmt Datacenter Management Server Management & Monitoring Smart Sensor Device Access Management Device Identity Management Identity Directory/Database Big Data Data Aggregator Business Intelligence Agent Sensor Agent Gateway Local Event Analysis Agent & Mgmt Proxy Gateway Protocol Mediation Web Services Security Web Services Mgmt IoT Management Device Registration & Mgmt Message Cache s Provisioning Management Console Data Routing & Analysis Big Data Store NoSQL DB Key Value Data Store Database RDBMS Data & Knowledge Discovery Tools Performance Management Alerts, Dashboards & Reports Advanced Analysis & Data Science Tools Complex Event Processing Distributed Data Grid Enterprise Integration Complex applications integration & SOA Gather Enrich Stream Manage Acquire Organize & Analyze
Capillary Networks Network Firewall Intranet Firewall Database Firewall Oracle IoT Reference Architecture IoT Identity & Access Mgmt Datacenter Management Server Management & Monitoring Smart Sensor Device Access Management Device Identity Management Identity Directory/Database Big Data Data Aggregator Business Intelligence Agent Sensor Agent Gateway Local Event Analysis Agent & Mgmt Proxy Gateway Protocol Mediation Web Services Security Web Services Mgmt IoT Management Device Registration & Mgmt Message Cache s Provisioning Management Console Data Routing & Analysis Big Data Store NoSQL DB Key Value Data Store Database RDBMS Data & Knowledge Discovery Tools Performance Management Alerts, Dashboards & Reports Advanced Analysis & Data Science Tools Complex Event Processing Distributed Data Grid Enterprise Integration Complex applications integration & SOA Gather Enrich Stream Manage Acquire Organize & Analyze
The Data that Lands in Hadoop and NoSQL Characteristics Data with variety as well as volume and velocity All sorts of data can land here for processing (semi-structured, structured, streaming data not in rows and columns) Data could come from sensors, social media & other web sites as well as from traditional sources
SOURCES BIG DATA MANAGEMENT BUSINESS ANALYTICS BIG DATA APPLICATIONS Oracle and the Big Data Components BY INDUSTRY & z LINE OF BUSINESS DISCOVERY BUSINESS ANALYTICS DATA RESERVOIR DATA WAREHOUSE
Unified Information Architecture Maturity Phases Silos Standardize Optimize Information as a Platform One off tools/solutions Bottom-up Local business unit driven Many versions of truth Independent data marts Enterprise standard tools/solutions Data warehouse and dependent data marts IT & LOB partnership Secure, consistent access to all data Agile, flexible architecture Analyze just in time structured & unstructured data together Advanced analytics & real-time recommendations All stage 3 capabilities delivered as a platform (service/cloud) Access of tools and data among broad subscriber group Maturity & Capability
Platform Strategy with Real-time Recommendations Information Discovery Engine Structured Data Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools Discoveries Semi-structured Data Hadoop High Volume Distributed File System MapReduce output ERP, CRM & Other Transactional Apps Real-Time Analytics and Recommendations R, SAS Location & User Profile Recommend Sensors Website Logs & Data NoSQL DB
Potential Oracle Products in the Footprint Fast, Intuitive Data Discovery Endeca Information Discovery on Exalytics Unstructured Data Analysis Structured Data Analysis Big Data Connectors Reliable, Available, Secure Source of Truth Oracle Database DW on Exadata ODI Advanced Analytics, In- Memory, Big Data SQL Analyst Friendly Reporting Query & Analysis Tools Oracle BI Foundation Suite, Hyperion on Exalytics Real-time Recommendations Cloudera HDFS on Big Data Appliance Oracle ERP & CRM Solutions on Exadata Oracle Real-Time Decisions R, SAS OEP Sensors Website Logs & Data Oracle NoSQL DB
Oracle Remote Service Delivery Extending the Footprint
Capillary Networks Network Firewall Intranet Firewall Database Firewall Oracle IoT Reference Architecture IoT Identity & Access Mgmt Datacenter Management Server Management & Monitoring Smart Sensor Device Access Management Device Identity Management Identity Directory/Database Big Data Data Aggregator Business Intelligence Agent Sensor Agent Gateway Local Event Analysis Agent & Mgmt Proxy Gateway Protocol Mediation Web Services Security Web Services Mgmt IoT Management Device Registration & Mgmt Message Cache s Provisioning Management Console Data Routing & Analysis Big Data Store NoSQL DB Key Value Data Store Database RDBMS Data & Knowledge Discovery Tools Performance Management Alerts, Dashboards & Reports Advanced Analysis & Data Science Tools Complex Event Processing Distributed Data Grid Enterprise Integration Complex applications integration & SOA Gather Enrich Stream Manage Acquire Organize & Analyze
A Methodology & Information Architecture Workshops IT Focus Visioning (IT & LOBs) Implementation (IT, SI & LOBs) Use Case Hypothesis (LOBs) Roadmap to Implementation (IT & LOBs) Technical Information Architecture (IT) Business Information Mapping (LOBs)
Next Step: Contact Oracle if you Need Help North America Information Architecture & Big Data: robert.stackowiak@oracle.com Oracle Enterprise Architects / Information Architecture: robin.link@oracle.com Hadoop Big Data Workshops: robert.stanoch@oracle.com EMEA Information Architecture & Big Data: doug.cackett@oracle.com 15
16