The IoT Inc Business Meetup Silicon Valley

Similar documents
The Rise of Industrial Big Data. Brian Courtney General Manager Industrial Data Intelligence

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

Machina Research. Where is the value in IoT? IoT data and analytics may have an answer. Emil Berthelsen, Principal Analyst April 28, 2016

SQream Technologies Ltd - Confiden7al

Real Time Big Data Processing

SAP and Hortonworks Reference Architecture

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

From Spark to Ignition:

Introducing Oracle Exalytics In-Memory Machine

ANALYTICS BUILT FOR INTERNET OF THINGS

Fog Computing and the Internet of Things: Extend the Cloud to Where the Things Are

How To Use Hp Vertica Ondemand

Big Data Use Case. How Rackspace is using Private Cloud for Big Data. Bryan Thompson. May 8th, 2013

Hortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc All Rights Reserved

Innovation Session BIG DATA. HP EMEA Software Performance Tour 2014

Laurence Liew General Manager, APAC. Economics Is Driving Big Data Analytics to the Cloud

Build Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015

The Future of Data Management

Big Data and Its Impact on the Data Warehousing Architecture

The IoT Inc Business Meetup Silicon Valley

In-memory computing with SAP HANA

How Companies are! Using Spark

Big Data Analytics: Today's Gold Rush November 20, 2013

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

So What s the Big Deal?

Next-Generation Cloud Analytics with Amazon Redshift

Architecting Your Company. Ann Winblad Co-Founder and Managing Director

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON

GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION

Overview: X5 Generation Database Machines

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies

EMC/Greenplum Driving the Future of Data Warehousing and Analytics

System Architecture. In-Memory Database

Internet of Things. Opportunity Challenges Solutions

Microsoft Analytics Platform System. Solution Brief

How To Handle Big Data With A Data Scientist

Native Connectivity to Big Data Sources in MSTR 10

How to make BIG DATA work for you. Faster results with Microsoft SQL Server PDW

YOU VS THE SENSORS. Six Requirements for Visualizing the Internet of Things. Dan Potter Chief Marketing Officer, Datawatch Corporation

SQL Server In-Memory by Design. Anu Ganesan August 8, 2014

An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise

How Transactional Analytics is Changing the Future of Business A look at the options, use cases, and anti-patterns

How To Use Big Data For Telco (For A Telco)

Inge Os Sales Consulting Manager Oracle Norway

Architectural patterns for building real time applications with Apache HBase. Andrew Purtell Committer and PMC, Apache HBase

Cisco Data Preparation

[Hadoop, Storm and Couchbase: Faster Big Data]

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

QLIKVIEW INTEGRATION TION WITH AMAZON REDSHIFT John Park Partner Engineering

THE DEVELOPER GUIDE TO BUILDING STREAMING DATA APPLICATIONS

The Flash-Transformed Financial Data Center. Jean S. Bozman Enterprise Solutions Manager, Enterprise Storage Solutions Corporation August 6, 2014

2009 Oracle Corporation 1

Big Data Technologies Compared June 2014

Netezza and Business Analytics Synergy

HYPER-CONVERGED INFRASTRUCTURE STRATEGIES

SAP Real-time Data Platform. April 2013

Big Data Analytics Nokia

Building your Big Data Architecture on Amazon Web Services

Virtual Data Warehouse Appliances

Big Data Use Cases Update

Breaking News! Big Data is Solved. What Is In-Memory Computing and What Does It Mean to U.S. Leaders? EXECUTIVE WHITE PAPER

Using an In-Memory Data Grid for Near Real-Time Data Analysis

Market Pulse Research: Big Data Storage & Analytics

INVENTING THE FUTURE HITACHI DATA SYSTEMS BIG DATA ROADMAP MICHAEL HAY

Why DBMSs Matter More than Ever in the Big Data Era

The Internet of Things and Big Data: Intro

Dell* In-Memory Appliance for Cloudera* Enterprise

Big Data Processing: Past, Present and Future

Disrupting The Market: Predictive Analytics As A Service

Oracle Big Data Building A Big Data Management System

Il mondo dei DB Cambia : Tecnologie e opportunita`

Accelerating Enterprise Big Data Success. Tim Stevens, VP of Business and Corporate Development Cloudera

Using In-Memory Data Fabric Architecture from SAP to Create Your Data Advantage

Big Data. Value, use cases and architectures. Petar Torre Lead Architect Service Provider Group. Dubrovnik, Croatia, South East Europe May, 2013

Scaling Your Data to the Cloud

Pulsar Realtime Analytics At Scale. Tony Ng April 14, 2015

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

Understanding the Value of In-Memory in the IT Landscape

Safe Harbor Statement

Dashboard Engine for Hadoop

Big Data. Fast Forward. Putting data to productive use

What Is In-Memory Computing and What Does It Mean to U.S. Leaders? EXECUTIVE WHITE PAPER

Zynga Analytics Leveraging Big Data to Make Games More Fun and Social

Unified Big Data Processing with Apache Spark. Matei

Moving From Hadoop to Spark

SOLVING REAL AND BIG (DATA) PROBLEMS USING HADOOP. Eva Andreasson Cloudera

SCALABLE FILE SHARING AND DATA MANAGEMENT FOR INTERNET OF THINGS

Big Data Storage Challenges for the Industrial Internet of Things

Big Data and Advanced Analytics Applications and Capabilities Steven Hagan, Vice President, Server Technologies

Tapping Into Hadoop and NoSQL Data Sources with MicroStrategy. Presented by: Jeffrey Zhang and Trishla Maru

BigMemory & Hybris : Working together to improve the e-commerce customer experience

Real-Time Enterprise Management with SAP Business Suite on the SAP HANA Platform

Real-Time Big Data Analytics SAP HANA with the Intel Distribution for Apache Hadoop software

Oracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database

Transcription:

The IoT Inc Business Meetup Silicon Valley Meeting 8 April 2015 Bruce Sinclair (Organizer): bruce@iot-inc.com

Target of Meetup For business people selling products and services into IoT but of course everyone else is welcome: techies, end-users, Focus of presentations and discussions: Iot-Inc. 2015

Looking for help Reviews Help attract great speakers and members If you ve been attending for a while and like the group, go to homepage to leave a review Help for our sponsor Need to justify their continued support Plug and Play are looking to partner with companies big and small Become a sponsor Suggest locations to hold future meetings Iot-Inc. 2015

Notes Next Meeting Bruce Sinclair, President at Iot-Inc Introduction to the Business of the Internet of Things Presentation, video and notes for today s meeting will be sent in one week Iot-Inc. 2014

Iot-Inc. 2015

IoT Meets Big Data: The Opportunities and Challenges Syed Hoda Chief Marketing Officer @shoda Analytics Built for IoT

The Industry s Leading IoT Analytics Platform Company! Massive volumes of data! High-velocity data! Edge analytics! Real-time insights Cisco Entrepreneurs in Residence 2014 IoT Excellence Award #1 Big Data Startup www.parstream.com @parstream

Have you heard about this IoT thing? 3

IoT is top-of-mind with CEO s, CIO s, and VC s 2015 Tech Predictions 1. Digital transformation 2. Internet of Things 3. Convergence of big data with consumer data 4. Hybrid cloud 5. Collaboration 6. Predictive analytics will lead big data 7. Mobile wearable technology 8. A Platform and orchestration is needed 9. Networked Economy 10. The end of apps Top 10 Strategic Technology Trends for 2015 1. Computing Everywhere 2. Internet of Things 3. 3-D Printing 4. Advance, Pervasive Analytics 5. Context-Rich Systems 6. Smart Machines 7. Cloud Computing 8. Software Defined Infrastructure 9. Web-scale IT 10. Risk-Based Security VCs Look To The Future As IoT Investments Soar In 2014, investors contributed over $300 million in 97 venture rounds for IoT startups 4

The massive size and growth of IoT IoT Market Size (by 2025) Connected Devices (by 2020) Data Growth (2013 vs 2020) $6.1T $7.1T $14.4T 26B 32B 50B Total Data 4.4ZB 44.4ZB 10x IoT Data.09ZB 4.4ZB 49x 5

BIG data is outpacing Moore s Law! Data Growth (2013 vs 2020) The Opportunity AND The Challenge Total Data 4.4ZB 44.4ZB 10x IoT Data.09ZB 4.4ZB 49x 6

Analytics drives business value in IoT Analytics have been transformative in wide areas of customer and product service. Sensor enabled industrial analytic applications are the next frontier July 2014 The value of IoT is in the data. The quicker enterprises can start analyzing their data the more business value they can derive. June 2014 Analytics accelerates IoT adoption. data analytics is the most important factor to increase the benefits of IoT John Chambers, October 2014

Just do it! Right? Well, not so fast. 8

Market Pulse: Global IoT/Big Data Survey - Global/cross-industry survey - Cross functional participants - 50/50 mix of business and technology leaders - Various stages of IoT experience and progress - Focus on the use and value of data in IoT initiatives Full report at: sites.parstream.com/parstream-iotsurvey-whitepaper

Only a third have quantifiable success metrics 33% Have quantifiable metrics to track success 38% Learning and exploring is the objective 29% Have document goals, but difficult to quantify

96% have faced challenges with their IoT project 58% Business process/policy (e.g. privacy) 51% User adoption of new technology 41% Timely collection and analysis of data 40% Sensors or devices 4% Have not faced challenges

Challenges being faced at all stages of the data collection and analysis process 44% Too much data to analyze effectively 36% Difficult to capture useful data 30% Analysis capabilities are not flexible or aligned 27% Not sure what questions to ask 26% Data is analyzed too slowly to be useful

Only 8% making full use of their IoT data 8% Fully capture and analyze data in a timely fashion 59% Do some analytics, but need to improve 17% Capture and store IoT data, but don t/can t analyze it 16% Don t store IoT data

92% would see benefits by more effectively capturing and storing IoT data 70% Make better, more meaningful decisions 53% Make decisions faster 27% Make more decisions 8% No benefits

Business owners more likely to see ROI increase through faster, more flexible analytics Business Technology 58% Significant increase in ROI 28% 34% Slight increase in ROI 57% 8% Minimal Impact on ROI 15%

Survey Summary: Three key insights IoT projects vary widely but all have challenges 96% Faced project challenges (#1 process, #2 users, #3 data) IoT not delivering full potential because of data challenges 8% Fully capture and analyze IoT data in a timely fashion Better IoT data collection and analysis would deliver more value 86% Would increase the ROI of their IoT investment

Other than that Mrs. Lincoln, how was the play? 17

Imagine a world Where IoT analytics enable an energy company to 30TB 15% $18K/hr; $158M/yr Analyze Data in Real-time Increase Efficiency Generate Operational/ Economic Benefits (20,000 Wind Turbines; 10 GW Capacity;.3 Capacity Factor; $40/MW-hour) 18

IoT analytics has a set of distinct requirements Big Data Data is growing faster and bigger because of number of sensors 10B+ rows 5TB+ Fast Data Data streamed from sensors requires fast ingestion 1M+ rows per sec Edge Analytics IoT data is mostly generated at the Edges of the network 100+ Locations Real-Time Insights Use cases require near real time analytics <1 sec query response time 19

IoT analytics has a set of distinct requirements. Big Data Data is growing faster and bigger because of number of sensors 10B+ rows 5TB+ Wind turbine: 100 turbines x 100M rows per year Race car: 400M records / day x 365 days test drive Telco: 1.000 cells x 1.000 rows / sec x 1 days - wow Traffic analysis: 60M cars x 1 read / min x 365 days Oil rig: 1 rig = 8 billion records / day (not verified) Fast Data Data streamed from sensors requires fast ingestion 1M+ rows per sec Network monitoring: 1M rows per sec per cell Asset monitoring: 60M cars x 1 reading per minute Airplane monitoring: 4 turbines x 3k sensors x 100Hz Oil exploration: 10.000 wells x 100 sensors x 1Hz Oil rig: 1 drilling rig x 10.000 sensors x avg 100Hz Edge Analytics IoT data is mostly generated at the Edges of the network 100+ Locations Manufacturing: 300.000 plants in US (2012) Cars / ships / airplanes: >1 billion world wide Telco: 190.000 cell towers in US (2013) Oil: 950.000 wells worldwide; 500.000 in US Mobile advertising: de-central adserving / monitoring Real-Time Insights Use cases require near real time analytics <1 sec query response time Dashboarding: real-time visualization, many queries Network monitoring: root cause analysis, optimization Asset monitoring: conditional monitoring, safety Security: anomalie detection, building safety Traffic: location aware recommendations 20

Existing products don t fulfill IoT requirements Product Columnar Databases Row-based Databases Value Stores Hadoop Batch Hadoop Streaming Requirements HP Vertica, Redshift Oracle, Informix... Cassandra, MongoDB Cloudera, Hortonworks Spark / Shark Storm BIG DATA Capacity FAST DATA Import EDGE Analytics Capability REAL TIME Insights INTEGRATED Platform IoT DATA Storage Structure See details in backup 21

ParStream has the fastest query response times RedShift 1 second 10 seconds 22 seconds 31 seconds 38 seconds 98 seconds Environment: Single EC2 XL node with 15 GB RAM, 2 TB disk on Amazon AWS. OTP data set with 150 Million records. Query set based on customer use-cases. 22

Use-cases should drive technology decisions Stream-Analytics Complex Event Processing Real-Time IoT Analytics < 1..10 ms 10..100 ms Operations Analytics OLTP Reporting In-Memory DB OLAP Massively parallel (MPP) Real-Time Batch-Analytics Hadoop / Cassandra / Impala 1 sec 1 min 10 min 1 hr Response Time 4 hrs Gigabyte Terabyte Petabyte Big Data 23

ParStream is integrated with leading IoT solutions Custom Apps DATAWATCH Visualization Analytics Data Collection 24

25 Now what?

Doing IoT 1. Who s in charge here?: The need for a Chief IoT Officer! 2. Data = Competitive Advantage: Analyze more and more often 3. Follow the money: Where/how can IoT data monetized? 4. Use cases drive technology decisions: Information > IT 5. Rational experimentation: IoT 2015 = ebusiness 1999 26

Selling IoT 1. Follow the money: Help customers make money or save money! 2. Agile product roadmaps: Sense and respond faster! 3. Sell to Business + IT: IoT has a complex, evolving org chart 4. Whole offer: Build/buy/partner to create what customers want 5. The power of platforms: Metcalf s Law = Relevance 27

Thank you! Syed Hoda Chief Marketing Officer @shoda Analytics Built for IoT

Backup Slides Analytics Built for IoT

ParStream is the only solution for IoT analytics requirements Customer Applications and Visualization Tools Geo- Distributed Analytics Alarm + Action Time Series Advanced Analytics ParStream DB IoT Data Collection Platforms Enterprise Data Sources 30

ParStream is uniquely positioned for real-time IoT analytics Billions of Records REAL-TIME IMPORT REAL-TIME QUERYING Small Form Factor / Low TCO FLEXIBLE ANALYTICS Thousands of Columns 31

ParStream s patented technology provides a competitive advantage 1 2 3 4 High Performance Compressed Indexes Provide ultra-high query performance Massive parallel processing Delivers linear scalability and high query throughput Lockless architecture Enables ultra-fast query and data import performance Small footprint Enables analytics at the edge with a low TCO SQL API / JDBC /ODBC In-Memory and Disk Technology Massively Parallel Processing (MPP) Real-Time Analytics Engine High Performance Compressed Index (HPCI) 3 rd generation Columnar Storage C++ UDx API Multi-Dimensional Partitioning Shared Nothing Architecture High Speed Parallel Loader with Low Latency 32

Edge analytics delivers real-time insights by minimizing network traffic Traditional Analytics Edge Analytics Application Application 40 records found 40 records found Centralized storage 20 Billion Rows 20B rows ParStream Geo-Distributed Server 40 Rows 4B rows 4B rows 4B rows 4B rows 4B rows ParStream 3 rows 14 rows 5 rows 12 rows ParStream ParStream ParStream ParStream 6 rows 33 Keith Nosbusch, CEO Rockwell Automation remote monitoring and diagnostics of physical assets such as liquid natural gas terminals made possible by enabling analytics at the source of data will increase speed to insights and also alleviate the need to transport massive amounts of data across the network

ParStream introduces EdgeAnalyticsBox The industry s first appliance built for edge analytics/gda New Product of the Week Specifically designed to enable edge analytics (Geo-Distributed Analytics). Ruggedized for use in real-world edge analytics applications such as oil/drilling sites, cell phone towers, wind farms, etc. Pre-loaded and tested with ParStream software. Technical Specs: Intel Core i5/i7 processor, 8-16 GB RAM and 64-128GB SSD EdgeAnalyticsBox provides customers with the convenience of a one-stop shop for the their edge analytics needs, however, customers can run GDA on any standard hardware with certain processing and storage requirements. 34

Industry-leading Product Recognition Cisco Entrepreneurs in Residence 2014 IoT Excellence Award #1 Big Data Startup ParStream is the most reliable System in our Data Center CTO, etracker ParStream enabled us to scale internationally - TCO is much lower than with Hadoop VP Eng, Searchmetrics "ParStream s ability to analyze terabytes of data with sub-second response time helps us generate significant value." President, Envision Energy 35

Demo: Sensor Analytics for Real-time Environmental Compliance 36

The key to generating value from IoT data: Actionable Insights Devices Devices Devices Aggregation Data Rules or Ondemand Insights Action REAL-TIME DATA INGESTION + IMMEDIATE QUERIES = ACTIONABLE / TIMELY INSIGHTS