Optimized for the Industrial Internet: GE s Industrial Data Lake Platform

Transcription

1 Optimized for the Industrial Internet: GE s Industrial Lake Platform

2 Agenda Opportunity Solution Challenges Result GE Lake 2 #IndustrialInternet

3 Big opportunities with Industrial Big The power of 1% Driving outcomes that matter Increasing freight utilization rail Predictive maintenance healthcare Predictive diagnostics power $27B Industry value by reducing system inefficiency $63B Industry value by reducing process inefficiency $66B Industry value with efficiency improvements in gas-fired power plant fleets Note: Illustrative examples based on potential one percent savings applied across specific global industry sectors over 15 years. Source: GE estimates 3 #IndustrialInternet

4 Industrial Big fast and vast 50B Machines will be connected on the internet by X Industrial growth within next 10 years Sensor Historian CRM, ERP, etc. Geo-location Content (images, videos, manuals, etc.) Machine Logs Social network 35GB per day from each Smart Meter 50X growth in healthcare ( ) 1TB per flight In practice only 3% of potentially useful is tagged and even less is analyzed* 9MM points per hour for each locomotive 500GB per blade by gas turbines *Sources: IDC, Ericsson, Wikibon, Fast Company, ComputerWeekly 4 #IndustrialInternet

5 Today s approaches are not prepared for onslaught of Industrial Big Too slow Too expensive Too rigid 80% of an analytics project typically involves gathering and then preparing the for analysis* *Source: IDC 5 #IndustrialInternet

6 Yesterday s warehouse architecture What is it telling me? How is it doing? How does it look? 1 2 All over the place across multiple locations Limited types Mostly structured and semi-structured types scientist Field operations Business analyst ONE STATIC DATA MODEL 3 Snapshot Limited to narrow snapshots and time CRM, ERP, etc. Logs Social network Geo-location TRADITIONAL DATA WAREHOUSE 6 #IndustrialInternet

7 Industrial Lake architecture Underpinned by governance appropriate to Business and Location How long will it last without failures or maintenance? Is my asset performing optimally? How to configure for best operational results? Is my asset ready when there is market opportunity? One place Access to all in one place to quickly respond to the speed of business change Any Handing of all types including documents, images machine, sensor All Access to real-time and historical and not limited to snapshot of Sensor scientist Field operations Business analyst Content (images, videos, manuals, etc.) FLEXIBLE DATA MODELS INDUSTRIAL DATA LAKE Machine Historian CRM, ERP, etc. Logs, click streams Social network Geolocation Rapid access to all for analytics 7 #IndustrialInternet

8 A day in the life management scientist Current situation Field operations Business analyst Analytics and operations scientist New way Field operations Business analyst Add semantic meta Replica of source governance INDUSTRIAL DATA LAKE Add semantic meta Replica of source loading ingestion Real-time ingestion CRM, ERP, etc. Logs Social network Geo-location collection CRM, ERP, etc. Logs, click streams Social network Geolocation Sensor Content (images, videos, manuals, etc.) Machine Historian Time to analyze Cost scientist Field operations Business analyst Agility scientist Field operations Business analyst Time Cost INDUSTRIAL DATA LAKE collection ingestion Analytics and governance operations collection ingestion Analytics and governance operations Rigid Agile 8 #IndustrialInternet

9 Industrial Lake Customer focus Industrial Lake Appliance Pre-integrated with management, compute, and storage monetization and outcomes Consume Analyze Predictive / prescriptive analytics and visualization Security Management of all, any in one place Manage Process High performance computing 9 #IndustrialInternet

10 Industrial Lake Optimized for industrial workloads Optimized for missioncritical workloads for addressing key SLAs such as Security, resiliency etc. for Industrial Internet applications Fast ingestion, storage and compute including machine to support multiple schema and types Highperformance analysis using massively parallel processing architecture supporting Apache Hadoop governance and federation, with geographicallydispersed deployment options 10 #IndustrialInternet

11 Industrial Lake Supports SLAs for industrial workload KPIs Availability Optimized for missioncritical workloads for Industrial Internet applications Capacity Elastic On-demand >99.99% 99.95% Planned downtime active disaster recovery Continuous operations, active-active Resiliency <30ms 30-40ms Medium/High High Performance / latency Industrial solutions OT focus (ex: M&D, CBM, ALM, etc.) Enterprise solutions IT focus (ex: CRM, SCM, ERP, etc.) Security 11 #IndustrialInternet

12 Target Availability SLA Cost comparison SLA Cost associated Typical industry Use Case Feature list required <=99% $ Batch update systems, Retail Web Sites, Social Media sites, Big clusters 99.9% $$ Retail Web Sites, Social Media sites, Relational bases 99.99% $$$ Hi-Frequency Trading, Medical support systems % $$$$$ Hi-Frequency Trading, Medical support systems, Stock Exchanges ex. Nasdaq, NYSE, Air-traffic controllers NameNode HA, Higher Replication than 3, Hardware redundancy, Monitoring and Alerting, Centre Redundancy, 2X Projected Capacity implementation All of the above + Full Centre Redundancy, Automatic Failover, 3X Projected Capacity implementation All of the above + Full Centre Redundancy including near real time replication, 4X Projected Capacity implementation All of the above + Auto-recovering components, 5X Projected Capacity implementation 100% $$$$$$ Real-time Trading systems, Stock Exchanges ex. Nasdaq, NYSE, On-board flight computer, Air-traffic controllers All of the above + 10X Projected Capacity implementation 12 #IndustrialInternet

13 Big without Governance Dumping into Big lake without repeatable processes and governance will create messy, uncontrollable environment Insights harvested from ungoverned lake, is not reliable and trustworthy If the insights can not be fully trusted, it s difficult to make business decisions confidently. Solutions for Industrial Internet, deep domain expertise 13 #IndustrialInternet

14 GE as a Custodian of Customer Owned & Services Custodian Infrastructure a person who has responsibility for or looks after something Synonyms: keeper, guardian, steward, protector "the custodian of the relic" Management Custodian Roles Enforcement & Measurement Protection Customer Owned Access Controls Visibility Metrics Privacy 14 #IndustrialInternet

15 Governance Disciplines Protect, Manage and Improve Information Quality Accuracy Completeness Consistency Lifecycle Provenance Lineage Retention Complianc e Regulatory Corporate Meta Dictionary Directory of all assets Classification and Tagging Auditing Monitoring Logging Log Analysis 15 #IndustrialInternet

16 Full Governance Enforcement Lake Onboarding Tool Process API Qualification Fit Gap Analysis Design & build Quarantine OnBoard Outcomes Parties Compliance Contractual Security Risk Platform Engineering Design Testing DevOps Deployment Vault Certified Patterns DevOps 16 #IndustrialInternet

17 Governance Key Technology Capabilities Capability Description Meta Catalog A repository of meta describing elements, lineage and relationships of the within the lake Business Glossary Glossary of business terms, definitions and related properties built on top of the technical meta catalog Policy Store Centralized store of access & usage policies and rights by object Policy Enforcement Engine to provide security enforcement as a service abstracted from consumption method Collaboration & Governance Portal providing stewards, providers, custodians and consumers with collaboration, issue resolution, enhancement request and change management capabilities 17 #IndustrialInternet

18 Security Risk for Big More implies higher risk of exposure New types may give rise to new security breach scenarios Evolving and experimental analysis implies security policies are less likely to be in place Linkage to other already under compliance may create scenarios where compliance could be violated. 18 #IndustrialInternet

19 Top Opportunity Areas for Security Perimeter: Infrastructure Protection: Encryption Access Control: Privacy Visibility: Management Communication protocols Access policy based encryption Secure dissemination integrity/proven ance Key management Searching / filtering encrypted Secure collection / aggregation Proof of storage Secure outsourcing of computation Secure collaboration 19 #IndustrialInternet

20 Classification and Tagging Confidential Ingest Secure and Encrypt Transmission Destroy Archive Lake 2.0 Store Use Secure and Encrypt Storage Access based Controls Masking Share SQL Interception 20 #IndustrialInternet

21 Platform Validation via Information Security Policy Framework (ISPF) Main Design Characteristics One Framework Multiple Certifications Full ISO 27001/2 Certification End-to-end Infrastructure Visibility Extend Compliance for GE and its Customers Unified Monitoring Framework Central Controls Separate Monitors Complete Suite Layered Approach ISMS (Information Security Mgmt System) Common Control Set ISMS Management Governance & Ops 21 #IndustrialInternet

22 Lake Consumption Patterns Use case patterns 1 Integration & visualization Structured Batch / CDC based replication Simple transformation w/ mastering Reporting tools 2 Advanced Analytics Structured + Unstructured Batch / CDC based replication Machine Learning, Predictive Modeling Reporting tools & self discovery tools 3 Search + API Structured + Unstructured Batch / CDC based replication Machine Learning, Predictive Modeling Search & API access to visualization 4 Real-time analytics Structured + Unstructured Real time ingestion Simple real time processing API based real time access 22 #IndustrialInternet

23 Case study GE Aviation Asset productivity, minimize disruptions, improved forecasting 25 Airlines 3.4M Flights 340TB 2000X Performance improvement 10X Cost reduction 7 days Time-to-market for new analytic app Note: Illustrative Aviation example based on Predix solution currently in development. Estimates based on exploration, simulation and asset utilization models. Isolate root causes Identify sub-optimal performance parts Minimize disruptions 23 #IndustrialInternet

24 GE Manufacturing Brilliant Factories Use case Quality Predict the quality of the manufactured part using predictive analytics Machine health Collect from machine tools, that enable predictive maintenance Business Value Reduction in defects Eliminate unplanned downtime Reduce energy costs Increase throughput Energy Consumption Save and optimize energy costs. Predict future costs. Use historical to identify energy consumption trends, and how external conditions impact energy consumption Process Optimization Process, effects, and environmental variables for monitoring analytics by operation/machine/area, increasing machine uptime. 24 #IndustrialInternet

25 Thank you General Electric reserves the right to make changes in specifications and features, or discontinue the product or service described at any time, without notice or obligation. These materials do not constitute a representation, warranty or documentation regarding the product or service featured. Illustrations are provided for informational purposes, and your configuration may differ. This information does not constitute legal, financial, coding, or regulatory advice in connection with your use of the product or service. Please consult your professional advisors for any such advice. GE, the GE Monogram, Predix, Predictivity are trademarks of General Electric Company General Electric Company All rights reserved.