The future of Big Data A United Hitachi View

Transcription

1 The future of Big Data A United Hitachi View Alex van Die Pre-Sales Consultant 1 Oktober

2 Agenda Evolutie van Data en Analytics Internet of Things Hitachi Social Innovation Vision and Solutions 2

3 De wereld waar we in leven en werken 3 Political conflict Technology innovation Economic fluctuation Medical breakthroughs Unemployment Globalization Aging population Emerging, growth markets Security concerns Social networking

4 Data centers: onderdeel van ons dagelijks leven 08:15 07:00 06:00 06:30 08:00 4

5 Een technologische verschuiving THE THIRD PLATFORM CLOUD BIG DATA MOBILITY SOCIAL 5

6 De dynamische IT van vandaag de dag DEVICES/APPS 3X MOBILE THE CIO CHALLENGE VIRTUAL MACHINES 4X UNSTRUCTURED DATA FILE BLOCK $$/GB/REQ. IT SPEND/BUDGET AMOUNT OF DATA CLOUD OVERALL IT 5X IT AND BUSINESS TIME CONVERGED $15B IT LOB $2B 7X

7 Het technologische landschap veranderd Private, Hybrid, Public Rise of Google, Amazon, etc. Customer shift to consumption model / managed services 7 RAPID GROWTH OF APPLICATIONS AND MOBILE DEVICES Est. 10B+ devices by 2015 CLOUD & CONSUMPTION MODELS INCREASED USE OF FLASH / SSD EMERGENCE OF BIG DATA & ANALYTICS Pressures on current BI/analytics market Value from unstructured and machine data Performance I/O requirements Both storage AND server Data, Application, and Content Drivers KEY TECHNOLOGY DRIVERS Infrastructure / Storage Commoditization UNSTRUCTURED DATA GROWTH 10x rate of structured OPEN SOURCE IMPACT UNSTRUCTURED DATA STRUCTURED Server, Storage, Network SERVERIZATION OF STORAGE SAN è NAS / File-Based è white box server / storage Massive scale out for Big Data

8 Data vermenigvuldiging in de praktijk BUSINESS DRIVEN HUMAN DRIVEN MACHINE DRIVEN NEW YORK STOCK EXCHANGE: 2.7 billion shares 1TB daily TWITTER: 645M users 700M "tweets" 20 TB daily 4-ENGINE BOEING JET: 25,000 flights 1920TB daily LARGE SYNOPTIC SURVEY TELESCOPE (LSST): Galaxy map 3200 MP 30,000 pics 3000 TBs daily 8 WHAT DOES 24 HOURS OF DATA LOOK LIKE?

9 Analytics en Data revolutie DATA EVOLUTION Tx Tx THE PAST WHAT HAPPENED? BI AND REPORTING TRANSACTIONAL FINANCIAL APPS, BUSINESS APPS HUMAN EMPLOYEES, CUSTOMERS THE PRESENT WHAT S HAPPENING NOW? REAL TIME ANALYTICS EVOLUTION THINGS INDUSTRIAL INFRASTRUCTURE, MOBILE DEVICES. THE FUTURE WHAT WILL HAPPEN? PREDICTIVE 9

10 The Internet of Things De nieuwe industriele revolutie PERVASIVE CONNECTIVITY Dynamic network of interconnected machines and people INTELLIGENT MACHINES Embedded intelligence MACHINE DATA BY BILLION THINGS WILL BE CONNECTED TO THE INTERNET 42% OF ALL DATA WILL BE GENERATED BY MACHINES (IDC) Volume, variety and velocity Data overload! 2.5 quintillion bytes per day ADVANCED ANALYTICS Highly specialized vertical solutions Predictive analytics, pattern analysis, machine learning.. 10

11 Making a Difference, a Big Difference Integrating IT and Infrastructure Technologies for a Safer, More Secure World Social Innovation Business The Internet of Things That Matter 11

12 Het verschil maken ROBOTICS IT INFRASTRUCTURE RAILWAY CONTROL SYSTEMS AND TRAINS WIND TURBINES AUTOMOTIVE SYSTEMS MEDICAL IMAGING WEARABLES SENSORS MINING EQUIPMENT GAS TURBINES PROGRAMMABLE CONTROLS 12

13 Hitachi is uniek INNOVATE WITH INFORMATION Information- Infrastructure Innovation Analytics Innovation Social Innovation We build the IT hardware and software infrastructure to capture, manage, and analyze big data We have the deep domain expertise to turn big data into big value ONE HITACHI We build the machines and social infrastructure that generate big data 13

14 Global Centers for Analytic Innovation UK / FRANCE Healthcare Automotive DENMARK Energy Efficiency Digitalization Smart Mobility INDIA Energy Transportation Analytics Framework CHINA Transportation Energy Healthcare JAPAN Mining Transportation Energy Healthcare Automotive Analytics Framework USA Energy Oil and Gas Mining IT Analytics CME Automotive Analytics Framework SINGAPORE CME Oil and Gas Transportation Energy Healthcare 14

15 De fundering voor Social Innovation CLOUD HEALTHCARE TELECOM SECURITY IT SaaS INFORMATION INTELLIGENCE Aggregate Identify Analyze CaaS CONTENT MANAGEMENT Mobilize Protect Archive Search PaaS IaaS CONTINUOUS INFRASTRUCTURE Consolidate Virtualize Scale Automate Converge 15 15

16 Telco Analytics Service Performance Optimization Social Innovation: Our Vision Connected Health Research Diagnostics Access Connected Rail Safety Efficiency Maintenance Surveillance Public safety Emergency response Traffic control Connected Cars Safe Efficient Informative 16 CONFIDENTIAL For use by Hitachi Data Systems employees and other audiences under NDA only.

17 Analytics Solutions TELCO Network Analytics MACHINE-TO-MACHINE Data Center Analytics HEALTHCARE Connected Health Advanced Analytics Architecture Intelligent Content Management Continuous Infrastructure 17

18 Evolving Analytics Architecture Foundation for Social Innovation Solutions 18 DATA SOURCES Deep Domain Expertise Tx SOLUTIONS (HITACHI, GLOBAL SYSTEMS INTEGRATORS AND PARTNERS) SMART INGEST Data capture Stream processing Event extraction Data enrichment BULK INGEST Capture and index METADATA MGT Continuous extraction Unstructured, semi-structured Domain specific VISUALIZATION AND INSIGHTS PRESENTATION AND ACTION Event detection: predictive and prescriptive control Search, diagnosis, correlation and root-cause analysis ANALYSIS AND COMPUTE Real-time analytics, batch analytics, hybrid analytics Machine learning, NLP, voice/image/video DATA STORAGE AND MANAGEMENT Specialized data stores Optimized infrastructure In-memory, federated, scale-out, distributed Curated architecture integrating Hitachi, Open Source and partner IP. Open and flexible. Cloud and on-premise deployment. Promotes reuse and best-practice repeatability. Reduces application complexity to speed time to market. SERVICES 1

19 Network Analytics for CME In partnership with JDSU, Hitachi Consulting, Hitachi Telecom Division and HGC-IA BUSINESS OBJECTIVES Telecom Infrastructure is a massive capital and operational expense. Billions spent annually on CAPEX alone. Optimization delivers huge ROI and improved customer experience. SOLUTION Ingest real-time network data from highly granular probes. Combine trend analysis, machine learning and real-time analytics to provide instant consumable insight. Deliver deep network visibility, dynamic optimization and proactive intervention

20 Data Center Analytics Available through managed services (summer), wider availability later in year BUSINESS OBJECTIVES Transform data-center data into meaningful insights. Predictive device failure. Root-cause analysis. Anomaly detection. SOLUTION Real-time streaming data sources collected and analyzed. Correlates multi-channel data sources. Predict events before they happen and take action on the data. Provides real-time operational intelligence from any IT devicegenerating systems logs. Partner-based data-center analytics software deployed by HDS on Hitachi compute blades, managed by HDS. 20

21 Network Analytics for CME Hitachi Construction, Wenco, HGC-IA, HCC, HDS Better operational insight. BUSINESS OBJECTIVES Reduction in non-productive time via dispatching. Predictive maintenance. UNDER DEVELOPMENT Mining operations simulations apply machine learning to drive new dispatch algorithms. Predictive maintenance algorithms. Operational dashboard. Solution architecture

22 The Future of Big Data A United Hitachi View Integrating IT and Infrastructure Technologies for a Safer, More Secure World Social Innovation Business When Information Technology Meets Operational Technology Innovation Happens! 22 CONFIDENTIAL For use by Hitachi Data Systems employees and other audiences under NDA only.

23 Questions and Discussion 23

24 Thank You 24