April 2016 JPoint Moscow, Russia. How to Apply Big Data Analytics and Machine Learning to Real Time Processing. Kai Wähner.

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "April 2016 JPoint Moscow, Russia. How to Apply Big Data Analytics and Machine Learning to Real Time Processing. Kai Wähner. kwaehner@tibco."

Transcription

1 April 2016 JPoint Moscow, Russia How to Apply Big Data Analytics and Machine Learning to Real Time Processing Kai LinkedIn / Xing Please connect!

2 Copyright TIBCO Software Inc. Analyse and Act on Critical Business Moments 2

3 Key Take-Aways Insights are hidden in Historical Data on Big Data Platforms Machine Learning and Big Data Analytics find these Insights by building Analytics Models Event Processing uses these Models (without Rebuilding) to take Action in Real Time

4 Copyright TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Analysis of Historical Data 3) Real Time Processing 4) Live Demo 4

5 Copyright TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Analysis of Historical Data 3) Real Time Processing 4) Live Demo 5

6 Copyright TIBCO Software Inc. Machine Learning Machine learning is a method of data analysis that automates analytical model building. Using algorithms that iteratively learn from data, machine learning allows computers to find hidden insights without being explicitly programmed where to look. 6

7 Copyright TIBCO Software Inc. 10 Examples of Machine Learning Spam Detection Credit Card Fraud Detection Digit Recognition Speech Understanding Face Detection Shape Detection Product Recommendation Medical Diagnosis Stock Trading Customer Segmentation 7

8 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Self-service Visual Analytics Dashboards Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 8

9 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Visual Analytics Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 9

10 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Self-service Visual Analytics Dashboards Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 10

11 Copyright TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Analysis of Historical Data 3) Real Time Processing 4) Live Demo 11

12 Copyright TIBCO Software Inc. Analytical Pipeline 12

13 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Self-service Visual Analytics Dashboards Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 13

14 Copyright TIBCO Software Inc. Analytical Pipeline 14

15 Data Acquisition Copyright TIBCO Software Inc.

16 Copyright TIBCO Software Inc. Analytical Pipeline 16

17 Data Munging / Wrangling / Mash-up Copyright TIBCO Software Inc.

18 Copyright TIBCO Software Inc. Data Munging - Transformations cust_id dept sku dollar gift date C FALSE A FALSE C TRUE B FALSE C TRUE B FALSE C FALSE n cust_id A B C total # orders first_date last_date

19 Copyright TIBCO Software Inc. Analytical Pipeline 19

20 Exploratory Data Analysis Copyright TIBCO Software Inc.

21 Copyright TIBCO Software Inc. Exploratory Data Analysis The greatest value of a picture is when it forces us to notice what we never expected to see John W. Tukey, 1977

22 Visual Analytics - Interactive Brush-Linked Copyright TIBCO Software Inc.

23 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Visual Analytics Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 23

24 Copyright TIBCO Software Inc. Analytical Pipeline 24

25 Copyright TIBCO Software Inc. Which picture represents a model? A model is a simplification of the truth that helps you with decision making.

26 Copyright TIBCO Software Inc. Model Building Supervised Models known, labeled responses Regression (for example Linear Regression) Categorical (for example Random Forest) Unsupervised Models no labeled responses Clustering (for example k-means clustering)

27 Model Building Copyright TIBCO Software Inc.

28 Model Building Employees who write longer s earn higher salaries! Copyright TIBCO Software Inc.

29 Model Improvement Copyright TIBCO Software Inc.

30 Model Improvement Managers Staff Copyright TIBCO Software Inc.

31 Copyright TIBCO Software Inc. Analytical Pipeline 31

32 Copyright TIBCO Software Inc. Model Validation How is the IQ of a kid related to the IQ of his / her mum?

33 What tools do Data Scientists use? Copyright TIBCO Software Inc.

34 Copyright TIBCO Software Inc. Alternatives for Data Scientists (no complete list) Tooling Open Source Closed Source R Source Code 34

35 R Language R is well known as the most and increasingly getting more popular programming language used by data scientists for modeling. It is developing very rapidly with a very active community. Copyright TIBCO Software Inc.

36 R with Revolution Analytics (now Microsoft) Open Source GPL License (including its restrictions) Copyright TIBCO Software Inc.

37 TERR - TIBCO s Enterprise Runtime for R TIBCO has rewritten R as a Commercial Compute Engine Latest statistics scripting engine: S a S-PLUS a R a TERR Runs R code including CRAN packages Engine internals rebuilt from scratch at low-level Redesigned data objects, memory management High performance + Big Data TERR is licensed from TIBCO TERR Installs (free) with Spotfire Analyst / Desktop + other TIBCO products Spotfire Server can manage all TERR / R scripts, artifacts for reuse Standalone Developer Edition Supported by TIBCO No GPL license issues Copyright TIBCO Software Inc.

38 Spark MLlib MLlib is Spark s machine learning (ML) library. Its goal is to make practical machine learning scalable and easy. It consists of common learning algorithms and utilities, including classification, regression, clustering, collaborative filtering, dimensionality reduction, as well as lower-level optimization primitives and higher-level pipeline APIs. You can even combine Mllib module with R language Copyright TIBCO Software Inc.

39 Copyright TIBCO Software Inc. H20 An Extensible Open Source Platform for Analytics Best of Breed Open Source Technology Easy-to-use WebUI and Familiar Interfaces Data Agnostic Support for all Common Database and File Types Massively Scalable Big Data Analysis Real-time Data Scoring (Nanofast Scoring Engine)

40 TIBCO Spotfire with R / TERR Integration Let the business user leverage Analytic Models (created by the Data Scientist) to find insights! Example: Customer Churn with Random Forest Algorithm refresh model button lives a random forest algorithm requires no a priori assumptions at all, it just always works The business user doesn t need to know what random forest is to be empowered by it Select variables for the model Copyright TIBCO Software Inc.

41 TIBCO Spotfire with H2O Integration Example: Predictive Analytics for Manufacturing ( scrap parts as early as possible ) Copyright TIBCO Software Inc.

42 TIBCO Spotfire with H2O Integration Example: Predictive Analytics for Manufacturing ( scrap parts as early as possible ) Copyright TIBCO Software Inc.

43 SaaS Machine Learning Managed SaaS service for building ML models and generating predictions Integrated into the corresponding cloud ecosystem Easy to use, but limited feature set and potential latency issues if combined with external data or applications Copyright TIBCO Software Inc.

44 Copyright TIBCO Software Inc. PMML (Predictive Model Markup Language ) XML-based de facto standard to represent predictive analytic models Developed by the Data Mining Group (DMG) Easily share models between PMML compliant applications (e.g. between model creation and deployment for operations)

45 Copyright TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Analysis of Historical Data 3) Real Time Processing 4) Live Demo 45

46 Copyright TIBCO Software Inc. Analytics Maturity Model Analytics Self-service Visual Analytics Dashboards Advanced Analytics Event Processing Measure Diagnose Predict Optimize Alert Automate Analytics Maturity Immediate Value to the Organization Long-Term Competitive Advantage A good Big Data Analytics platform can provide value to the organization across the full spectrum of use cases 46

47 Copyright TIBCO Software Inc. Streaming Analytics Event Streams time Continuous Queries Sliding Windows Filter Aggregation Correlation

48 Copyright TIBCO Software Inc. Operational Intelligence in Action Machine-to-Machine Automation Automated action based on models of history combined with live context and business rules Actions by Operations Human decisions in real time informed by up to date information The Challenge: Create, understand, and deploy algorithms & rules that automate key business reactions 48 The Challenge: Empower operations staff to see and seize key business moments

49 Copyright TIBCO Software Inc. Alternatives for Stream Processing (no complete list!) PRODUCT OPEN SOURCE CLOSED SOURCE Azure Microsoft Stream Analytics FRAMEWORK 49

50 Copyright TIBCO Software Inc. Comparison of Stream Processing Frameworks and Products Slide Deck from JavaOne 2016: 50

51 Copyright TIBCO Software Inc. Visual Development of Streaming Analytics Streaming Operators Connectivity Visual Development Testing & Simulation Mature Tooling / Support Middleware Integration

52 Live Datamart Ad-hoc continuous query Alerts Dynamic aggregation Action Live visualization 52

53 How to apply analytic models to real time processing without rebuilding them? Copyright TIBCO Software Inc.

54 Real Time Close Loop: Understand Anticipate Act Streaming Analytics to operationalize insights and patterns in real time without rebuilding the models TERR Spark MLlib MATLAB Open Source R SAS H20 Stream Processing PMML

55 TIBCO StreamBase + R / TERR

56 TIBCO StreamBase + H20

57 TIBCO StreamBase + PMML

58 Closed Loop: Automatically Recompute (and Improve) the Analytic Model Compute your performance metric Spot not good enough performance Recompute model

59 Copyright TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Analysis of Historical Data 3) Real Time Processing 4) Live Demo 59

60 An outage on one well can cost $10M per hour. We have outages per year. - Drilling operations VP, major oil company Copyright TIBCO Software Inc.

61 Predictive Analytics (Fault Management) Temporal analytic: If vibration spike is followed by temp spike then voltage spike [within 4 hours] then flag high severity alert. Voltage Temperature Vibration Device history

62 Complete Big Data Architecture SENSOR DATA TRANSACTIONS Action Streaming Event Server Analytics Aggregate Correlate Analytics Live Monitoring Continuous query processing Alerts Operational Analytics MESSAGE BUS MACHINE DATA Integration Bus Rules Stream Processing Manual action, escalation Live UI Operations SOCIAL DATA Internal Data Cleansed Data History Data Storage Big Data HISTORICAL ANALYSIS Data Discovery Data Sheets BI Machine Learning Data Scientists API Enterprise Service Bus SOA ERP MDM DB WMS

63 Demo Environment CSV Batch JSON Real Time Action Streaming StreamBase Analytics Aggregate Correlate Analytics Live Datamart Continuous query processing Alerts Operational Analytics XML Real Time Rules Manual action, escalation Live UI Operations Internal Data Flume HDFS HDFS HISTORICAL ANALYSIS R / TERR Data Scientists H2O Oracle RDBMS Avro Parquet PMML Hadoop (Cloudera) Spotfire TIBCO Fast Data Platform

64 Live Demo TIBCO Spotfire + StreamBase + TERR + Live Datamart

65 Key Take-Aways Insights are hidden in Historical Data on Big Data Platforms Machine Learning and Big Data Analytics find these Insights by building Analytics Models Event Processing uses these Models (without Rebuilding) to take Action in Real Time

66 Questions? Please contact me! Kai LinkedIn / Xing Please connect!

Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time?

Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time? Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time? Kai Wähner kwaehner@tibco.com @KaiWaehner www.kai-waehner.de Disclaimer! These opinions are my own and do not necessarily

More information

Big Data Architecture

Big Data Architecture Big Architecture Guido Schmutz BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH Guido Schmutz Working for Trivadis for more than

More information

whitepaper Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R

whitepaper Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R Table of Contents 3 Predictive Analytics with TIBCO Spotfire 4 TIBCO Spotfire Statistics Services 8 TIBCO Enterprise Runtime

More information

Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R

Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R Predictive Analytics with TIBCO Spotfire and TIBCO Enterprise Runtime for R PREDICTIVE ANALYTICS WITH TIBCO SPOTFIRE TIBCO Spotfire is the premier data discovery and analytics platform, which provides

More information

Zementis. Universal Deployment of KNIME Models. Big Data and Real-time Scoring. KNIME User Group Meeting, Berlin February

Zementis. Universal Deployment of KNIME Models. Big Data and Real-time Scoring. KNIME User Group Meeting, Berlin February Zementis Universal Deployment of KNIME Models Big Data and Real-time Scoring KNIME User Group Meeting, Berlin February 2015 www.zementis.com Zementis Zementis Zementis provides software for operational

More information

R / TERR. Ana Costa e SIlva, PhD Senior Data Scientist TIBCO. Copyright 2000-2013 TIBCO Software Inc.

R / TERR. Ana Costa e SIlva, PhD Senior Data Scientist TIBCO. Copyright 2000-2013 TIBCO Software Inc. R / TERR Ana Costa e SIlva, PhD Senior Data Scientist TIBCO Copyright 2000-2013 TIBCO Software Inc. Tower of Big and Fast Data Visual Data Discovery Hundreds of Records Millions of Records Key peformance

More information

Welcome to the second half ofour orientation on Spotfire Administration.

Welcome to the second half ofour orientation on Spotfire Administration. Welcome to the second half ofour orientation on Spotfire Administration. In this presentation, I ll give a quick overview of the products that can be used to enhance a Spotfire environment: TIBCO Metrics,

More information

SAP Solution Brief SAP HANA. Transform Your Future with Better Business Insight Using Predictive Analytics

SAP Solution Brief SAP HANA. Transform Your Future with Better Business Insight Using Predictive Analytics SAP Brief SAP HANA Objectives Transform Your Future with Better Business Insight Using Predictive Analytics Dealing with the new reality Dealing with the new reality Organizations like yours can identify

More information

Eric Ledu, The Createch Group, a BELL company

Eric Ledu, The Createch Group, a BELL company Eric Ledu, The Createch Group, a BELL company Intelligence Analytics maturity Past Present Future Predictive Modeling Optimization What is the best that could happen? Raw Data Cleaned Data Standard Reports

More information

Big Data Analytics with Spark and Oscar BAO. Tamas Jambor, Lead Data Scientist at Massive Analytic

Big Data Analytics with Spark and Oscar BAO. Tamas Jambor, Lead Data Scientist at Massive Analytic Big Data Analytics with Spark and Oscar BAO Tamas Jambor, Lead Data Scientist at Massive Analytic About me Building a scalable Machine Learning platform at MA Worked in Big Data and Data Science in the

More information

EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS

EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS Marcia Kaufman, Principal Analyst, Hurwitz & Associates Dan Kirsch, Senior Analyst, Hurwitz & Associates Steve Stover, Sr. Director, Product Management, Predixion

More information

ORACLE TAX ANALYTICS. The Solution. Oracle Tax Data Model KEY FEATURES

ORACLE TAX ANALYTICS. The Solution. Oracle Tax Data Model KEY FEATURES ORACLE TAX ANALYTICS KEY FEATURES A set of comprehensive and compatible BI Applications. Advanced insight into tax performance Built on World Class Oracle s Database and BI Technology Design after the

More information

Some vendors have a big presence in a particular industry; some are geared toward data scientists, others toward business users.

Some vendors have a big presence in a particular industry; some are geared toward data scientists, others toward business users. Bonus Chapter Ten Major Predictive Analytics Vendors In This Chapter Angoss FICO IBM RapidMiner Revolution Analytics Salford Systems SAP SAS StatSoft, Inc. TIBCO This chapter highlights ten of the major

More information

6.0, 6.5 and Beyond. The Future of Spotfire. Tobias Lehtipalo Sr. Director of Product Management

6.0, 6.5 and Beyond. The Future of Spotfire. Tobias Lehtipalo Sr. Director of Product Management 6.0, 6.5 and Beyond The Future of Spotfire Tobias Lehtipalo Sr. Director of Product Management Key peformance indicators Hundreds of Records Visual Data Discovery Millions of Records Data Mining or Data

More information

Microservices and Containers in the Middleware World

Microservices and Containers in the Middleware World Microservices and Containers in the Middleware World April 2016 JPoint Moscow, Russia Kai Wähner Technology Evangelist kwaehner@tibco.com LinkedIn / Xing @KaiWaehner www.kai-waehner.de Key Takeaways A

More information

Up Your R Game. James Taylor, Decision Management Solutions Bill Franks, Teradata

Up Your R Game. James Taylor, Decision Management Solutions Bill Franks, Teradata Up Your R Game James Taylor, Decision Management Solutions Bill Franks, Teradata Today s Speakers James Taylor Bill Franks CEO Chief Analytics Officer Decision Management Solutions Teradata 7/28/14 3 Polling

More information

Busting Financial Crime with TIBCO

Busting Financial Crime with TIBCO Busting Financial Crime with TIBCO Ana Costa e Silva, PhD Senior Data Scientist, TIBCO Software What if you could use just one financial crime fighting solution that would empower your business users to

More information

The Data-Driven Enterprise: Game Changing Data and Analytics. June 2016

The Data-Driven Enterprise: Game Changing Data and Analytics. June 2016 The Data-Driven Enterprise: Game Changing Data and Analytics June 2016 1 Information Builders About Us Better Data. Better Analytics. Founded in 1975 Global market presence 1,350 employees 9,000 customers

More information

The Internet of Things

The Internet of Things The Internet of Things Lucus Darnell Chief Innovation Evangelist @ T I B C O # D i g i t a l D i ff e r e n c e Everything is connected! Three Key Takeaways #1: The Internet of Things is exploding! #2:

More information

locuz.com Big Data Services

locuz.com Big Data Services locuz.com Big Data Services Big Data At Locuz, we help the enterprise move from being a data-limited to a data-driven one, thereby enabling smarter, faster decisions that result in better business outcome.

More information

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms

More information

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Highly competitive enterprises are increasingly finding ways to maximize and accelerate

More information

SEIZE THE DATA. 2015 SEIZE THE DATA. 2015

SEIZE THE DATA. 2015 SEIZE THE DATA. 2015 1 Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. BIG DATA CONFERENCE 2015 Boston August 10-13 Predicting and reducing deforestation

More information

Big Data on Tap Jonathan Gray

Big Data on Tap Jonathan Gray Unified Integration for Data-Driven Applications Big Data on Tap Jonathan Gray Founder & CEO November 7, 2016 Hadoop Enables New Applications and Architectures ENTERPRISE DATA LAKES BIG DATA ANALYTICS

More information

SAP Predictive Analytics: An Overview and Roadmap. Charles Gadalla, SAP @cgadalla SESSION CODE: 603

SAP Predictive Analytics: An Overview and Roadmap. Charles Gadalla, SAP @cgadalla SESSION CODE: 603 SAP Predictive Analytics: An Overview and Roadmap Charles Gadalla, SAP @cgadalla SESSION CODE: 603 Advanced Analytics SAP Vision Embed Smart Agile Analytics into Decision Processes to Deliver Business

More information

Empowering the Masses with Analytics

Empowering the Masses with Analytics Empowering the Masses with Analytics THE GAP FOR BUSINESS USERS For a discussion of bridging the gap from the perspective of a business user, read Three Ways to Use Data Science. Ask the average business

More information

Ganzheitliches Datenmanagement

Ganzheitliches Datenmanagement Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist

More information

Hurwitz ValuePoint: Predixion

Hurwitz ValuePoint: Predixion Predixion VICTORY INDEX CHALLENGER Marcia Kaufman COO and Principal Analyst Daniel Kirsch Principal Analyst The Hurwitz Victory Index Report Predixion is one of 10 advanced analytics vendors included in

More information

BIG DATA ANALYTICS For REAL TIME SYSTEM

BIG DATA ANALYTICS For REAL TIME SYSTEM BIG DATA ANALYTICS For REAL TIME SYSTEM Where does big data come from? Big Data is often boiled down to three main varieties: Transactional data these include data from invoices, payment orders, storage

More information

The Role of Data & Analytics in Your Digital Transformation. Michael Corcoran Sr. Vice President & CMO

The Role of Data & Analytics in Your Digital Transformation. Michael Corcoran Sr. Vice President & CMO The Role of Data & Analytics in Your Digital Transformation Michael Corcoran Sr. Vice President & CMO 1 The Role of Data & Analytics in Your Digital Transformation Agenda Strategies for Success Potential

More information

Kai Wähner. The Next-Generation BPM for a Big Data World: Intelligent Business Process Management Suites (ibpms)

Kai Wähner. The Next-Generation BPM for a Big Data World: Intelligent Business Process Management Suites (ibpms) The Next-Generation BPM for a Big Data World: Intelligent Business Process Management Suites (ibpms) Kai Wähner kontakt@kai-waehner.de @KaiWaehner www.kai-waehner.de Xing / LinkedIn Please connect! Kai

More information

Azure Data Lake Analytics

Azure Data Lake Analytics Azure Data Lake Analytics Compose and orchestrate data services at scale Fully managed service to support orchestration of data movement and processing Connect to relational or non-relational data

More information

Data Integration Checklist

Data Integration Checklist The need for data integration tools exists in every company, small to large. Whether it is extracting data that exists in spreadsheets, packaged applications, databases, sensor networks or social media

More information

Data Mining + Business Intelligence. Integration, Design and Implementation

Data Mining + Business Intelligence. Integration, Design and Implementation Data Mining + Business Intelligence Integration, Design and Implementation ABOUT ME Vijay Kotu Data, Business, Technology, Statistics BUSINESS INTELLIGENCE - Result Making data accessible Wider distribution

More information

Big Data Analytics. An Introduction. Oliver Fuchsberger University of Paderborn 2014

Big Data Analytics. An Introduction. Oliver Fuchsberger University of Paderborn 2014 Big Data Analytics An Introduction Oliver Fuchsberger University of Paderborn 2014 Table of Contents I. Introduction & Motivation What is Big Data Analytics? Why is it so important? II. Techniques & Solutions

More information

Predictive Analytics

Predictive Analytics Predictive Analytics How many of you used predictive today? 2015 SAP SE. All rights reserved. 2 2015 SAP SE. All rights reserved. 3 How can you apply predictive to your business? Predictive Analytics is

More information

Azure Machine Learning, SQL Data Mining and R

Azure Machine Learning, SQL Data Mining and R Azure Machine Learning, SQL Data Mining and R Day-by-day Agenda Prerequisites No formal prerequisites. Basic knowledge of SQL Server Data Tools, Excel and any analytical experience helps. Best of all:

More information

Data Science in Action

Data Science in Action + Data Science in Action Peerapon Vateekul, Ph.D. Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University + Outlines 2 Data Science & Data Scientist Data Mining Analytics with

More information

brought to you by WebAction June 2016

brought to you by WebAction June 2016 brought to you by WebAction & June 2016 Executive Summary At Nugravity, our corporate vision is to make every customer s business more successful day by day through technology. We have been successfully

More information

www.pwc.com Implementation of Big Data and Analytics Projects with Big Data Discovery and BICS March 2015

www.pwc.com Implementation of Big Data and Analytics Projects with Big Data Discovery and BICS March 2015 www.pwc.com Implementation of Big Data and Analytics Projects with Big Data Discovery and BICS Agenda Big Data Discovery Oracle Business Intelligence Cloud Services (BICS) Use Cases How to start and our

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

Bring your data to life with Microsoft Power BI. Peter Myers Bitwise Solutions

Bring your data to life with Microsoft Power BI. Peter Myers Bitwise Solutions Bring your data to life with Microsoft Power BI Peter Myers Bitwise Solutions Presenter introduction Peter Myers Independent BI Expert, Bitwise Solutions BBus, SQL Server MCSE, Data Platform MVP (since

More information

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Apps and data source extensions with APIs Future white label, embed or integrate Power BI Deploy Intelligent

More information

2015 Analyst and Advisor Summit. Advanced Data Analytics Dr. Rod Fontecilla Vice President, Application Services, Chief Data Scientist

2015 Analyst and Advisor Summit. Advanced Data Analytics Dr. Rod Fontecilla Vice President, Application Services, Chief Data Scientist 2015 Analyst and Advisor Summit Advanced Data Analytics Dr. Rod Fontecilla Vice President, Application Services, Chief Data Scientist Agenda Key Facts Offerings and Capabilities Case Studies When to Engage

More information

Big Data Are You Ready? Jorge Plascencia Solution Architect Manager

Big Data Are You Ready? Jorge Plascencia Solution Architect Manager Big Data Are You Ready? Jorge Plascencia Solution Architect Manager Big Data: The Datafication Of Everything Thoughts Devices Processes Thoughts Things Processes Run the Business Organize data to do something

More information

Deriving Value From Big Data Visual, Predictive, GeoLocation and Event Analytics

Deriving Value From Big Data Visual, Predictive, GeoLocation and Event Analytics Deriving Value From Big Data Visual, Predictive, GeoLocation and Event Analytics Nick Young Solutions Consultant - APJ nyoung@tibco.com Analytics Insight to Action Value Grow Revenue Reduce Risk Analytics

More information

SAS Fraud Framework for Banking

SAS Fraud Framework for Banking SAS Fraud Framework for Banking Including Social Network Analysis John C. Brocklebank, Ph.D. Vice President, SAS Solutions OnDemand Advanced Analytics Lab SAS Fraud Framework for Banking Agenda Introduction

More information

Unified Batch & Stream Processing Platform

Unified Batch & Stream Processing Platform Unified Batch & Stream Processing Platform Himanshu Bari Director Product Management Most Big Data Use Cases Are About Improving/Re-write EXISTING solutions To KNOWN problems Current Solutions Were Built

More information

Lavastorm Analytic Library Predictive and Statistical Analytics Node Pack FAQs

Lavastorm Analytic Library Predictive and Statistical Analytics Node Pack FAQs 1.1 Introduction Lavastorm Analytic Library Predictive and Statistical Analytics Node Pack FAQs For brevity, the Lavastorm Analytics Library (LAL) Predictive and Statistical Analytics Node Pack will be

More information

Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop

Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop 1 Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop 2 Pivotal s Full Approach It s More Than Just Hadoop Pivotal Data Labs 3 Why Pivotal Exists First Movers Solve the Big Data Utility Gap

More information

An Integrated Big Data & Analytics Infrastructure June 14, 2012 Robert Stackowiak, VP Oracle ESG Data Systems Architecture

An Integrated Big Data & Analytics Infrastructure June 14, 2012 Robert Stackowiak, VP Oracle ESG Data Systems Architecture An Integrated Big Data & Analytics Infrastructure June 14, 2012 Robert Stackowiak, VP ESG Data Systems Architecture Big Data & Analytics as a Service Components Unstructured Data / Sparse Data of Value

More information

Mastering Big Data. Steve Hoskin, VP and Chief Architect INFORMATICA MDM. October 2015

Mastering Big Data. Steve Hoskin, VP and Chief Architect INFORMATICA MDM. October 2015 Mastering Big Data Steve Hoskin, VP and Chief Architect INFORMATICA MDM October 2015 Agenda About Big Data MDM and Big Data The Importance of Relationships Big Data Use Cases About Big Data Big Data is

More information

White Paper. How Streaming Data Analytics Enables Real-Time Decisions

White Paper. How Streaming Data Analytics Enables Real-Time Decisions White Paper How Streaming Data Analytics Enables Real-Time Decisions Contents Introduction... 1 What Is Streaming Analytics?... 1 How Does SAS Event Stream Processing Work?... 2 Overview...2 Event Stream

More information

Five Reasons Spotfire Is Better than Excel for Business Data Analytics

Five Reasons Spotfire Is Better than Excel for Business Data Analytics Five Reasons Spotfire Is Better than Excel for Business Data Analytics A hugely versatile application, Microsoft Excel is the Swiss Army Knife of IT, able to cope with all kinds of jobs from managing personal

More information

Practical Data Science with Azure Machine Learning, SQL Data Mining, and R

Practical Data Science with Azure Machine Learning, SQL Data Mining, and R Practical Data Science with Azure Machine Learning, SQL Data Mining, and R Overview This 4-day class is the first of the two data science courses taught by Rafal Lukawiecki. Some of the topics will be

More information

HADOOP IN ENTERPRISE FUTURE-PROOF YOUR BIG DATA INVESTMENTS WITH CASCADING. Supreet Oberoi Nov. 4-6, 2014 Big Data Expo Santa Clara

HADOOP IN ENTERPRISE FUTURE-PROOF YOUR BIG DATA INVESTMENTS WITH CASCADING. Supreet Oberoi Nov. 4-6, 2014 Big Data Expo Santa Clara DRIVING INNOVATION THROUGH DATA HADOOP IN ENTERPRISE FUTURE-PROOF YOUR BIG DATA INVESTMENTS WITH CASCADING Supreet Oberoi Nov. 4-6, 2014 Big Data Expo Santa Clara ABOUT ME I am a Data Engineer, not a Data

More information

KNIME Big Data Workshop

KNIME Big Data Workshop KNIME Big Data Workshop Tobias Kötter and Björn Lohrmann KNIME 2016 KNIME.com AG. All Rights Reserved. Variety, Volume, Velocity Variety: integrating heterogeneous data.. and tools Volume: from small files......to

More information

Algorithmic Operations: Integrating Real-Time Analytics into your Business. Richard Tibbetts CTO, TIBCO Event Processing QCon San Francisco 2014

Algorithmic Operations: Integrating Real-Time Analytics into your Business. Richard Tibbetts CTO, TIBCO Event Processing QCon San Francisco 2014 Algorithmic Operations: Integrating Real-Time Analytics into your Business Richard Tibbetts CTO, TIBCO Event Processing QCon San Francisco 2014 Macro Trend: Digital Business Transformation Changing Consumer

More information

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data: Global Digital Data Growth Growing leaps and bounds by 40+% Year over Year! 2009 =.8 Zetabytes =.08

More information

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS.

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. ALTILIA turns Big Data into Smart Data and enables businesses to

More information

The Internet of Things and Big Data: Intro

The Internet of Things and Big Data: Intro The Internet of Things and Big Data: Intro John Berns, Solutions Architect, APAC - MapR Technologies April 22 nd, 2014 1 What This Is; What This Is Not It s not specific to IoT It s not about any specific

More information

GROW YOUR ANALYTICS MATURITY

GROW YOUR ANALYTICS MATURITY GROW YOUR ANALYTICS MATURITY Gain and Sustain a Competitive Edge FROM DATA TO ACTION YOU VE HEARD THE BIG DATA BUZZ. WE RE SWIMMING IN MORE DATA THAN EVER. But it s not about the amount of data, the different

More information

Integrating Cloudera and SAP HANA

Integrating Cloudera and SAP HANA Integrating Cloudera and SAP HANA Version: 103 Table of Contents Introduction/Executive Summary 4 Overview of Cloudera Enterprise 4 Data Access 5 Apache Hive 5 Data Processing 5 Data Integration 5 Partner

More information

REAL-TIME OPERATIONAL INTELLIGENCE. Competitive advantage from unstructured, high-velocity log and machine Big Data

REAL-TIME OPERATIONAL INTELLIGENCE. Competitive advantage from unstructured, high-velocity log and machine Big Data REAL-TIME OPERATIONAL INTELLIGENCE Competitive advantage from unstructured, high-velocity log and machine Big Data 2 SQLstream: Our s-streaming products unlock the value of high-velocity unstructured log

More information

MicroStrategy Course Catalog

MicroStrategy Course Catalog MicroStrategy Course Catalog 1 microstrategy.com/education 3 MicroStrategy course matrix 4 MicroStrategy 9 8 MicroStrategy 10 table of contents MicroStrategy course matrix MICROSTRATEGY 9 MICROSTRATEGY

More information

Moving From Hadoop to Spark

Moving From Hadoop to Spark + Moving From Hadoop to Spark Sujee Maniyam Founder / Principal @ www.elephantscale.com sujee@elephantscale.com Bay Area ACM meetup (2015-02-23) + HI, Featured in Hadoop Weekly #109 + About Me : Sujee

More information

From Spark to Ignition:

From Spark to Ignition: From Spark to Ignition: Fueling Your Business on Real-Time Analytics Eric Frenkiel, MemSQL CEO June 29, 2015 San Francisco, CA What s in Store For This Presentation? 1. MemSQL: A real-time database for

More information

Izenda & SQL Server Reporting Services

Izenda & SQL Server Reporting Services Izenda & SQL Server Reporting Services Comparing an IT-Centric Reporting Tool and a Self-Service Embedded BI Platform vv Izenda & SQL Server Reporting Services The reporting tools that come with the relational

More information

Introducing the Reimagined Power BI Platform. Jen Underwood, Microsoft

Introducing the Reimagined Power BI Platform. Jen Underwood, Microsoft Introducing the Reimagined Power BI Platform Jen Underwood, Microsoft Thank You Sponsors Empower users with new insights through familiar tools while balancing the need for IT to monitor and manage user

More information

Oracle Big Data Discovery Unlock Potential in Big Data Reservoir

Oracle Big Data Discovery Unlock Potential in Big Data Reservoir Oracle Big Data Discovery Unlock Potential in Big Data Reservoir Gokula Mishra Premjith Balakrishnan Business Analytics Product Group September 29, 2014 Copyright 2014, Oracle and/or its affiliates. All

More information

Simplifying Big Data Analytics: Unifying Batch and Stream Processing. John Fanelli,! VP Product! In-Memory Compute Summit! June 30, 2015!!

Simplifying Big Data Analytics: Unifying Batch and Stream Processing. John Fanelli,! VP Product! In-Memory Compute Summit! June 30, 2015!! Simplifying Big Data Analytics: Unifying Batch and Stream Processing John Fanelli,! VP Product! In-Memory Compute Summit! June 30, 2015!! Streaming Analy.cs S S S Scale- up Database Data And Compute Grid

More information

BIG DATA What it is and how to use?

BIG DATA What it is and how to use? BIG DATA What it is and how to use? Lauri Ilison, PhD Data Scientist 21.11.2014 Big Data definition? There is no clear definition for BIG DATA BIG DATA is more of a concept than precise term 1 21.11.14

More information

Spotfire and Tableau Positioning. Summary

Spotfire and Tableau Positioning. Summary Licensed for distribution Summary Both TIBCO Spotfire and Tableau allow users of various skill levels to create attractive visualizations of data, displayed as charts, dashboards and other visual constructs.

More information

Direct-to-Company Feedback Implementations

Direct-to-Company Feedback Implementations SEM Experience Analytics Direct-to-Company Feedback Implementations SEM Experience Analytics Listening System for Direct-to-Company Feedback Implementations SEM Experience Analytics delivers real sentiment,

More information

Streaming Analytics and the Internet of Things: Transportation and Logistics

Streaming Analytics and the Internet of Things: Transportation and Logistics Streaming Analytics and the Internet of Things: Transportation and Logistics FOOD WASTE AND THE IoT According to the Food and Agriculture Organization of the United Nations, every year about a third of

More information

Interactive Visual Data Exploration with Spark in Databricks Cloud. Hossein

Interactive Visual Data Exploration with Spark in Databricks Cloud. Hossein Interactive Visual Data Exploration with Spark in Databricks Cloud Hossein Falaki @mhfalaki About Databricks Founded by creators of Apache Spark Offers Spark as a service in the cloud Dedicated to open

More information

SAP Predictive Analytics Roadmap Charles Gadalla SAP SESSION CODE: #####

SAP Predictive Analytics Roadmap Charles Gadalla SAP SESSION CODE: ##### SAP Predictive Analytics Roadmap Charles Gadalla SAP SESSION CODE: ##### LEARNING POINTS What are SAP s Advanced Analytics offerings Advanced Analytics gives a competitive advantage, it can no longer be

More information

Understanding Your Customer Journey by Extending Adobe Analytics with Big Data

Understanding Your Customer Journey by Extending Adobe Analytics with Big Data SOLUTION BRIEF Understanding Your Customer Journey by Extending Adobe Analytics with Big Data Business Challenge Today s digital marketing teams are overwhelmed by the volume and variety of customer interaction

More information

BIG DATA: FROM HYPE TO REALITY. Leandro Ruiz Presales Partner for C&LA Teradata

BIG DATA: FROM HYPE TO REALITY. Leandro Ruiz Presales Partner for C&LA Teradata BIG DATA: FROM HYPE TO REALITY Leandro Ruiz Presales Partner for C&LA Teradata Evolution in The Use of Information Action s ACTIVATING MAKE it happen! Insights OPERATIONALIZING WHAT IS happening now? PREDICTING

More information

Predictive Analytics Techniques: What to Use For Your Big Data. March 26, 2014 Fern Halper, PhD

Predictive Analytics Techniques: What to Use For Your Big Data. March 26, 2014 Fern Halper, PhD Predictive Analytics Techniques: What to Use For Your Big Data March 26, 2014 Fern Halper, PhD Presenter Proven Performance Since 1995 TDWI helps business and IT professionals gain insight about data warehousing,

More information

Salesforce.com and MicroStrategy. A functional overview and recommendation for analysis and application development

Salesforce.com and MicroStrategy. A functional overview and recommendation for analysis and application development Salesforce.com and MicroStrategy A functional overview and recommendation for analysis and application development About the Speaker Prittam Bagani Director, Product Management Prittam started working

More information

Big & Fast Data Analytics. Event Analytics for Production Surveillance and Machine Management. Michael O Connell, PhD Chief Data Scientist TIBCO

Big & Fast Data Analytics. Event Analytics for Production Surveillance and Machine Management. Michael O Connell, PhD Chief Data Scientist TIBCO Big & Fast Data Analytics Event Analytics for Production Surveillance and Machine Management Michael O Connell, PhD Chief Data Scientist TIBCO Copyright 2000-2014 TIBCO Software Inc. Smart Energy Production

More information

<no narration for this slide> 1 2 The standard narration text is : After completing this lesson, you will be able to: < > SAP Visual Intelligence is our latest innovation

More information

www.sryas.com Analance Data Integration Technical Whitepaper

www.sryas.com Analance Data Integration Technical Whitepaper Analance Data Integration Technical Whitepaper Executive Summary Business Intelligence is a thriving discipline in the marvelous era of computing in which we live. It s the process of analyzing and exploring

More information

How SAP Business Intelligence Solutions provide real-time insight into your organization

How SAP Business Intelligence Solutions provide real-time insight into your organization How SAP Business Intelligence Solutions provide real-time insight into your organization 28 Oct 2015 Agenda 1) What is Business Intelligence (BI) 2) SAP BusinessObjects Features Overview 3) Demo & Report

More information

How to use Big Data in Industry 4.0 implementations. LAURI ILISON, PhD Head of Big Data and Machine Learning

How to use Big Data in Industry 4.0 implementations. LAURI ILISON, PhD Head of Big Data and Machine Learning How to use Big Data in Industry 4.0 implementations LAURI ILISON, PhD Head of Big Data and Machine Learning Big Data definition? Big Data is about structured vs unstructured data Big Data is about Volume

More information

An Open-Source Streaming Machine Learning and Real-Time Analytics Architecture

An Open-Source Streaming Machine Learning and Real-Time Analytics Architecture An Open-Source Streaming Machine Learning and Real-Time Analytics Architecture Using an IoT example (incubating) (incubating) Fred Melo @fredmelo_br 1 William Markito @william_markito Traditional Data

More information

Three Reasons Why Visual Data Discovery Falls Short

Three Reasons Why Visual Data Discovery Falls Short Three Reasons Why Visual Data Discovery Falls Short Vijay Anand, Director, Product Marketing Agenda Introduction to Self-Service Analytics and Concepts MicroStrategy Self-Service Analytics Product Offerings

More information

Oracle Business Intelligence EE. Prab h akar A lu ri

Oracle Business Intelligence EE. Prab h akar A lu ri Oracle Business Intelligence EE Prab h akar A lu ri Agenda 1.Overview 2.Components 3.Oracle Business Intelligence Server 4.Oracle Business Intelligence Dashboards 5.Oracle Business Intelligence Answers

More information

SQL Saturday #462 Parma 28 November, 2015 Azure Machine Learning. From Design to Integration

SQL Saturday #462 Parma 28 November, 2015 Azure Machine Learning. From Design to Integration SQL Saturday #462 Parma 28 November, 2015 Azure Machine Learning From Design to Integration Presenter Introduction Peter Myers Independent BI Expert Bitwise Solutions BBus, SQL Server MCSE, MCT, Data Platform

More information

Hadoop Ecosystem B Y R A H I M A.

Hadoop Ecosystem B Y R A H I M A. Hadoop Ecosystem B Y R A H I M A. History of Hadoop Hadoop was created by Doug Cutting, the creator of Apache Lucene, the widely used text search library. Hadoop has its origins in Apache Nutch, an open

More information

HROUG. The future of Business Intelligence & Enterprise Performance Management. Rovinj October 18, 2007

HROUG. The future of Business Intelligence & Enterprise Performance Management. Rovinj October 18, 2007 HROUG Rovinj October 18, 2007 The future of Business Intelligence & Enterprise Performance Management Alexander Meixner Sales Executive, BI/EPM, South East Europe Oracle s Product

More information

Skyminer Big Data Solution Features Highlights. Company Proprietary Sensitive Information

Skyminer Big Data Solution Features Highlights. Company Proprietary Sensitive Information Skyminer Big Data Solution Features Highlights Purpose 1. Add value to the data by providing a unified archive and efficient analysis tools 2. Help using monitoring data to improve operations, detect and

More information

Harnessing the Power of the Microsoft Cloud for Deep Data Analytics

Harnessing the Power of the Microsoft Cloud for Deep Data Analytics 1 Harnessing the Power of the Microsoft Cloud for Deep Data Analytics Today's Focus How you can operate your business more efficiently and effectively by tapping into Cloud based data analytics solutions

More information

Essential Elements of an IoT Core Platform

Essential Elements of an IoT Core Platform Essential Elements of an IoT Core Platform Judith Hurwitz President and CEO Daniel Kirsch Principal Analyst and Vice President Sponsored by Hitachi Introduction The maturation of the enterprise cloud,

More information

Databricks. A Primer

Databricks. A Primer Databricks A Primer Who is Databricks? Databricks vision is to empower anyone to easily build and deploy advanced analytics solutions. The company was founded by the team who created Apache Spark, a powerful

More information

Roadmap Talend : découvrez les futures fonctionnalités de Talend

Roadmap Talend : découvrez les futures fonctionnalités de Talend Roadmap Talend : découvrez les futures fonctionnalités de Talend Cédric Carbone Talend Connect 9 octobre 2014 Talend 2014 1 Connecting the Data-Driven Enterprise Talend 2014 2 Agenda Agenda Why a Unified

More information

Data Virtualization for Agile Business Intelligence Systems and Virtual MDM. To View This Presentation as a Video Click Here

Data Virtualization for Agile Business Intelligence Systems and Virtual MDM. To View This Presentation as a Video Click Here Data Virtualization for Agile Business Intelligence Systems and Virtual MDM To View This Presentation as a Video Click Here Agenda Data Virtualization New Capabilities New Challenges in Data Integration

More information

Executive Summary... 2 Introduction... 3. Defining Big Data... 3. The Importance of Big Data... 4 Building a Big Data Platform...

Executive Summary... 2 Introduction... 3. Defining Big Data... 3. The Importance of Big Data... 4 Building a Big Data Platform... Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure Requirements... 5 Solution Spectrum... 6 Oracle s Big Data

More information

Actian SQL in Hadoop Buyer s Guide

Actian SQL in Hadoop Buyer s Guide Actian SQL in Hadoop Buyer s Guide Contents Introduction: Big Data and Hadoop... 3 SQL on Hadoop Benefits... 4 Approaches to SQL on Hadoop... 4 The Top 10 SQL in Hadoop Capabilities... 5 SQL in Hadoop

More information