Architecting your Business for Big Data Your Bridge to a Modern Information Architecture Robert Stackowiak Vice President, Information Architecture & Big Data Oracle
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 2
Internet of Things, Big Data, Data Warehouse in the News Image from Google Trends, April 2015
Information Architecture Workshops IT Focus Visioning (IT & LOBs) Implementation (IT, SI & LOBs) Use Case Hypothesis (LOBs) Roadmap to Implementation (IT & LOBs) Technical Information Architecture (IT) Business Information Mapping (LOBs)
Big Data In State & Local Government 1. Improved decision-making 2. Improve mission outcomes 3. Identify and reduce inefficiencies 4. Eliminate waste, fraud and abuse 5. Productivity 6. Boost ROI, cut total cost of ownership (TCO) 7. Enhance transparency 8. Improve Fire & Safety 9. Reduce security threats and crime
Big Data & Logistics Management FUNCTIONAL AREA BUSINESS CHALLENGE OPPORTUNITY Distribution Center & Warehouse Management Transportation Network Resource Planning Properly sized and located distribution centers and warehouses Ability to scale network up or down based on demand Increased inventory turnover Decreased inventory write-downs Consistent available floor space Consistent time to delivery Reduced stock moves to centers Accurate demand forecasting Optimal fleet utilization Optimal driver /crew availability Improve safety Route Optimization Most optimal pick-up and delivery Predictable time to delivery Optimize fuel utilization Account for traffic conditions Reduce mileage /maximize load Maintenance Optimal maintenance scheduling for on-time delivery and cost containment Minimize breakdowns Minimize potential liability Improve service levels
Big Data & Healthcare Payers FUNCTIONAL AREA BUSINESS CHALLENGE OPPORTUNITY Fraud & Abuse Management Prevent payments to fraudulent claims Effective and early detection of fraudulent and wrongful claims resulting in direct cost savings Health optimization and improved care Operational Excellence Marketing and program awareness Enable right care to achieve the best outcomes at the lowest cost Increased member enrollment Efficient claims management Optimal spending on marketing and promotions to drive profitable business results More consistent care Understand true factors driving prescribed treatment and effectiveness Consult with practitioners and partners suggesting ways to improve outcomes and quality of care Drive increased patient satisfaction through better case and disease management Identify early high risk patients and suggest wellness and preventive programs Guide partners on moving patients to lower cost alternative treatments and facilities when viable Improve efficiency reputation Improve profitability Reduce overall cost of claims Provide faster payment of legitimate claims Better market segmentation and effective campaigns Cross-sell / up-sell to existing Improve information management and analysis, privacy and security
Big Data & Higher Education FUNCTIONAL AREA BUSINESS CHALLENGE OPPORTUNITY Student and Faculty Acquisition Student Course Major Selection Student Performance Acquire the most talented students who will also have a successful academic career Attract and acquire most reputed and talented faculty Assure that students select majors that will lead to academic and post graduate success Maximize student performance so that academic and personal goals will be achieved Increase share of top students recruited Increase graduation rate Align student passion to course of study Improve graduation rate Improve alumni job prospects / placement Understand academic problems early and take corrective action Encourage better habits and techniques to improve performance Student Retention Retain gifted students throughout their academic career Understand student dissatisfaction early and take corrective action Improve institution sentiment in the broader community Teaching Effectiveness Understand and promote most effective instructors Improve student academic experience and outcome Research Optimization Shorten time consuming research and produce accurate and impactful outcomes Reward the most impactful instructors Share best practices across the institution Take corrective action where instruction is least effective Analyze enormous experimental data sets using predictive models Eliminate errors through automated data acquisition Differentiate research capabilities versus other institutions Student Progression Identify at risk students and get back on track to graduation Analyze at risk students and cause of issues Improve graduation rates
Unified Information Architecture Maturity Phases Silos Standardize Optimize Information as a Platform One off tools/solutions Bottom-up Local business unit driven Many versions of truth Independent data marts Enterprise standard tools/solutions Data warehouse and dependent data marts IT & LOB partnership Secure, consistent access to all data Agile, flexible architecture Advanced analytics & real-time recommendations Analyze just in time structured & streaming data together All stage 3 capabilities delivered as a platform (service/cloud) Access of tools and data among broad subscriber group Internet of Things introduced Maturity & Capability
4 th Generation Data Architecture for Big Data Business Data Data Streams Data Streaming Events 1 2 3 Decisions Analytics Real-Time Data Services Telematics Industry Services Internet of Things Sentiment Execution Innovation Social and Log Data Enterprise Data Other Data Sources Data Management Reservoir Data Factory Warehouse Discovery Lab Reports Model First & Dashboards Analytics Reporting-oriented Often enterprise wide in scope, cross LoB you know the questions to ask Discovery Data First Analytics Search Modeling Data Exploration Highly visual and/or interactive you don t know the questions to ask
Footprint in Most Organizations Today Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools ERP, CRM & Other Transactional Apps
Information Discovery Introduced Information Discovery Engine Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools ERP, CRM & Other Transactional Apps
Information Discovery Tool Personal Excel Files Oracle BI Server Models IT Provisioned Enterprise Data Cloud and Social Documents and Web Pages Add New Data Integrate diverse data from personal files, enterprise sources and external web content Ask New Questions Leverage best in class search combined with consumer-style navigation, right out of the box See New Patterns Search results organize imperfect data, Live text enrichment exposes hidden themes. Powerful, interactive data visualizations reveal new insights
Information Discovery Example Jere Matthews, Chief Data Analysis, Commonwealth of PA, Oracle OpenWorld, October 1, 2014
The Data that Lands in Hadoop and NoSQL Characteristics Data with variety as well as volume and velocity All sorts of data can land here for processing (semi-structured, structured, streaming data not in rows and columns) Data could come from sensors, social media & other web sites as well as from traditional sources
Hadoop Introduced Information Discovery Engine Structured Data Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools Discoveries Hadoop High Volume Distributed File System ERP, CRM & Other Transactional Apps R, SAS NoSQL DB NoSQL DB Sensors Website Logs & Data NoSQL DB
Unified Information Architecture Information Discovery Engine Structured Data Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools Discoveries Data Residing in Hadoop Hadoop High Volume Distributed File System R, SAS ERP, CRM & Other Transactional Apps NoSQL DB NoSQL DB Sensors Website Logs & Data NoSQL DB
Big Data & Information Mapping
Platform Strategy with Real-Time Recommendations & Actions Information Discovery Engine Structured Data Historic Source of Truth Data Warehouse / Data Marts Advanced Analytics Reporting, Query and Analysis Tools Business Intelligence Tools Discoveries Data Residing in Hadoop Hadoop High Volume Distributed File System NoSQL DB Event Proc. NoSQL DB R, SAS ERP, CRM & Other Transactional Apps Location & User Profile Real-Time Analytics and Recommendations Recommend Sensors Website Logs & Data NoSQL DB
Potential Oracle Products in the Footprint Endeca on Exalytics, Oracle Big Data Discovery Discoveries Data Residing in Hadoop CDH on Oracle Big Data Appliance OEP NoSQL DB NoSQL DB R, SAS Structured Data Big Data Connectors ODI Historic Source of Truth Oracle Database Data Warehouse on Exadata ODI Oracle ERP & CRM Solutions on Exadata Advanced Analytics, In- Memory, Big Data SQL Location & User Profile Reporting, Query and Analysis Tools Oracle BI Foundation Suite on Exalytics Oracle Real-Time Decisions Recommend Sensors Website Logs & Data Oracle NoSQL DB
Washington Suburban Sanitary Commission ORGANIZATION OVERVIEW Est 1918, 8 th largest water utility in the US Covers 1000 sq mi and 1.8M residents 5600 miles of fresh water pipes and 5400 miles of sewer Already an Exadata, Exalogic & Exalytic customer CUSTOMER PERSPECTIVE IT should serve as a catalyst to business success. It s an asset to be used to analyze our business operations and understand customer behavior. Mujib Lodhi, CIO CHALLENGES/OPPORTUNITIES Predictive analytics on water network health Better connection with customers via social media Large dataset on historical facilities metrics (FIT) RESULTS BDA delivered 12/29 Oracle working with WSSC to develop first production analytics SOLUTIONS Big Data Appliance, Big Data Connectors & Big Data SQL 12c Options: Multi-tenant, In Memory, ASO, Audit Vault Oracle EM12c December 2014
Oracle Delivers Value from ALL Data Best for Business, Best for IT Better Insights, Decisions, Actions From measurement to analysis, forecasting & optimization Insights across time, functions and roles Persistent version of the truth for ALL DATA Most Complete, Open, Integrated Discovery to Dashboards to Analytics to Data Management Standards based & blending of Open Source components Multiple Engineered Systems & software integration points World Class Analytics Infrastructure Best of Breed capabilities at each layer of the stack Uniquely enables complete analysis of ALL DATA Enterprise: scalable, reliable, manageable, secure
Assessing Readiness for Change IT Readiness History of delivering to business specs Embrace agile methodologies Can deliver the right data at right time Have data warehouse skills Have data integration skills Have reliable, available, serviceable infrastructure Meet all data security requirements Have Hadoop / NoSQL database skills Have Internet of Things skills (mid-tier) Business Readiness Sponsorship understood & aligned Funding sources understood & aligned Commitment to fact-based decision making Prioritized business needs established Analyst tools at right level of sophistication Understand data meaning & sourcing Can measure and control data quality Can measure benefits from analytics
Typical Benefits Jere Matthews, Chief Data Analysis, Commonwealth of PA, Oracle OpenWorld, October 1, 2014
Finding Content... Industry Big Data Whitepapers including IoT Communications Service Providers Financial Services & Banking Healthcare Payers Healthcare Providers Higher Education Logistics & Transportation Manufacturing Media & Entertainment Oil & Gas Pharmaceuticals & Life Sciences Retail Utilities Access Oracle s Public Enterprise Architecture Web Site http://www.oracle.com/goto/ea
Next Steps? Information Architecture Workshops Oracle Enterprise Architects Oracle Information Architecture & Big Data Team Big Data and the Internet of Things (Apress) Information Architecture book published May 8, 2015 Contact robert.stackowiak@oracle.com, Twitter: @rstackow