Smart Grid Data Management Challenges

Size: px
Start display at page:

Download "Smart Grid Data Management Challenges"

Transcription

1 Smart Grid Data Management Challenges Marie-Luce PICARD EDF R&D 16 Novembre 2010

2 Outline 1. Smart grids : What? Where? What for? 2. A road map for Smart Grids functionalities and issues 3. Some experiments done at EDF R&D 4. Conclusion EDF R&D : Créer de la valeur et préparer l avenir 2

3 Smart Grids : What? Where? What for? EDF R&D : Créer de la valeur et préparer l avenir 3

4 Smart-Grids projects everywhere in the world... Key: red=electricity, green=gas, blue=water and triangle=trial or pilot where circle=project EDF R&D : Créer de la valeur et préparer l avenir 4

5 Smart-Grids projects everywhere in the world... EDF R&D : Créer de la valeur et préparer l avenir 5

6 Commission de Régulation de l Énergie (CRE) :... And in France ERDF : linky.erdfdistribution.fr A law on smart-metering has been signed by the government by the end of August It implies : - On 01/01/2012 all new meters have to be smart - On 31/12/2014, 50% of installed meters have to be smart - On 31/12/2016, 95 % of installed meters have to be smart. EDF R&D : Créer de la valeur et préparer l avenir 6

7 Smart Grids : what? And what for? Environmental, economical, social and policy drivers lead to a deep change of the energy sector : Climate change, environmental concerns Increased pressure of operational and financial efficiency Increasing awareness of consumers, role of citizens Technological pressure (IT, smart devices) Source Wikipedia A smart grid delivers electricity from suppliers to consumers using digital technology with two-way communications to control appliances at consumers' homes to save energy, reduce cost and increase reliability and transparency. It overlays the electrical grid with an information and net metering system, and includes smart meters. Such a modernized eletricity network is being promoted by many governments as a way of addressing energy independence, global warming and emergency resilience issues.

8 A road map for Smart Grids functionalities and issues EDF R&D : Créer de la valeur et préparer l avenir 8

9 A road map for Smart Grids functionalities Future Decision support Integrated communication AMI / smart metering Today EDF R&D : Créer de la valeur et préparer l avenir 9

10 A road map for Smart Grids functionalities Future Decision support Integrated communication AMI / smart metering full integration of renewables and distributed generation increase customer participation SCADA, supervisory functions real time pricing, demand response self healing Individual load curves (hourly), available in a batch mode (the day after) Real time alarms Today EDF R&D : Créer de la valeur et préparer l avenir 10

11 A road map for Smart Grids functionalities and issues Future Decision support Integrated communication AMI / smart metering closed-loop system of systems transactive hierarchichal control privacy distributed intelligence (routers, database, CEP) real time processing for metering data and network data Entreprise service bus, SOA MDMS Standards : CIM, Zigbee Today Deployment but also complex IT and social projects EDF R&D : Créer de la valeur et préparer l avenir 11

12 Smart Grid Data Management challenges Data Management challenges : need for scalabality? Storage of large volume of time-series Historians, large scale relational data-bases, distributed NoSQL approaches Trade off between distributed intelligence and centralised processing Systems of systems, transactive hierachichal control Real-time processing that might be included into distributed architecture CEP tools Real time BI (low latency) Distributed data-mining Answer to scalabality, but also privacy Adaptive modelling, on-line machine learning The necessary functions remain the same, the key issue is The necessary functions remain the same, the key issue is manage manage the the complexity complexity to to support support the the necessary necessary business business capabilities at any scale as well as manage the separation capabilities at any scale as well as manage the separation of responsabilities to avoid dueling control systems of responsabilities to avoid dueling control systems (SDG&E) (SDG&E) EDF R&D : Créer de la valeur et préparer l avenir 12

13 Some experiments done at EDF R&D EDF R&D : Créer de la valeur et préparer l avenir 13

14 On-going research project : needs for storing large volume of time series Data : Individual up to 30 millions- and aggregated load curves (10 minutes intervals, at least 2 years lenght) Meteorological data (hourly measures of temperatures, georeferenced) Contractual information Needs : Curve selection Computation of aggregated curves Missing data processing, synchronisation, forecasting modeling EDF R&D : Créer de la valeur et préparer l avenir 14

15 On-going research project : needs for storing large volume of time series (2) Solutions considered : Data historians Relational data-bases NoSQL approaches (Hadoop HBASE with PigLatin and Hive scripts...) Local and cloud storage Work in progress EDF R&D : Créer de la valeur et préparer l avenir 15

16 Real-time computation of aggregated curves Computation of aggregated load curves : Grouped by logical criteria : i.e. customer segment Grouped by topological criteria : i.e. network node Issues Real-time processing (30 millions of curves, feeders) Poor data quality : missing data, delays... Bandwidth constraints Elements of answers : Broadcast multipath architecture On the fly estimation EDF R&D : Créer de la valeur et préparer l avenir 16

17 Real-time computation of aggregated curves (2) Use of summation sketches The method is duplication insensitive Implementation within the StreamBase CEP ; on the fly processing of curves (duplicated 6 times) Results :

18 Evolution of demand forecasting approaches Today : Short term (national) forecasts have a very good accuracy (MAPE : 1,5%) The current methods should work on stationary signals, and forecast the demand for well defined portfolio Tomorrow : Variable portfolio, non stationary signals (customers should leave and join the company, difficult periods to forecast, uncertainties, integration of renewables and new uses like electric vehicles) Massive individual data will be available : Streaming data : how to take them into account for short term (1 day ahead) or very short term (from 1 hour to 24 hours ahead) forecasts? Adaptivity Individual data : how could forecast approachs benefit from their use? Aggregation (clustering, sampling)

19 Evolution of demand forecasting approaches (2) Results : Work on adaptive GAM (Generalized Additive Models) for short term forecasting Example : Residus de prévision Résidus de prévision sur un an (fenêtre de taille 100, modélisation du niveau moyen et de l effet retard en ligne) RMSE GAM : 900 MW. RMSE GAM en ligne : 714 MW GAM GAM en ligne 1/9/ /9/2007 4/10/ /10/ /11/2007 4/12/ /12/ /1/2008 6/2/ /2/ /3/ /3/ /4/ /5/2008 3/6/ /6/2008 7/7/ /7/ /8/ /8/

20 Conclusion EDF R&D : Créer de la valeur et préparer l avenir 20

21 Smart Grid data management challenges? Smart grids projects (or large experiments) do exist all around the world Deployment, IT and social projects Roadmap : long term vision will drive a very strong evolution of the energy sector Needs for scalability : Storage of large volumes of time series Centralised or distributed approaches Real-time processing (scalable and distributed CEP) Large-scale data-mining : Distributed data-mining could give answers to scalabality and privacy On-line models

22 Special thanks to Alexis Bondu Xavier Brossat Yousra Chabchoub Leeley Daio Pires Dos Santos Alzennyr Gomes Da Silva Yannig Goude Benoît Grossin Georges Hébrail Bruno Jacquin Sylvie Mallet Amandine Pierrot

23 Rererences MDMS : rapport du GTM Research Smarter IBM Research, Brian Gaucher, Manager Smarter Energy, IBM T.J. Watson Research Center Analytics and transactive control design for the Pacific Northwest Smart Grid Demonstration Project, P. Huang, J. Kalagnanam, R. Natarajan (IBM Research Watson), D. Hammerstrom and R. Melton, Battle Memorial Institue, Pacific Northwest Division, Richland. ( hadoop.apache.org Agrégation robuste de données en temps réel : application aux compteurs électriques communicants, Y. Chabchoub, B. Grossin, soumis à EGC 2011 Short term electricty load forecasting with adaptive GAM models, Y. Goude, A. Pierrot, ISF 2010 A range of methods for electrical consumption forecasting, X. Brossat, ISF

24 MDMS : Metering Data Management Systems MDMS : software platform acquiring metering data from numerous sources and providing them, after integration, synchronisation and cleansing, to differents target users.

A SMART ELEPHANT FOR A SMART-GRID: (ELECTRICAL) TIME-SERIES STORAGE AND ANALYTICS. EDF R&D SIGMA Project Marie-Luce Picard

A SMART ELEPHANT FOR A SMART-GRID: (ELECTRICAL) TIME-SERIES STORAGE AND ANALYTICS. EDF R&D SIGMA Project Marie-Luce Picard A SMART ELEPHANT FOR A SMART-GRID: (ELECTRICAL) TIME-SERIES STORAGE AND ANALYTICS WITHIN HADOOP EDF R&D SIGMA Project Marie-Luce Picard Forum TERATEC June 26th 2013 OUTLINE 1. CONTEXT 2. A PROOF OF CONCEPT

More information

SMART ENERGY SMART GRID. More than 140 Utilities companies worldwide make use of Indra Solutions. indracompany.com

SMART ENERGY SMART GRID. More than 140 Utilities companies worldwide make use of Indra Solutions. indracompany.com SMART GRID Solutions More than 140 Utilities companies worldwide make use of Indra Solutions indracompany.com SMARt ENERGY SMART GRID Solutions Integrated Solutions for Smart Grid Management Electrical

More information

Informix The Intelligent Database for IoT

Informix The Intelligent Database for IoT Informix The Intelligent Database for IoT Kiran Challapalli Informix Competitive Technology & Enablement challapalli@in.ibm.com +91-80431-91802 Agenda What is Internet of Things (IoT) Why it matters IoT

More information

Research of Smart Distribution Network Big Data Model

Research of Smart Distribution Network Big Data Model Research of Smart Distribution Network Big Data Model Guangyi LIU Yang YU Feng GAO Wendong ZHU China Electric Power Stanford Smart Grid Research Institute Smart Grid Research Institute Research Institute

More information

Empowering intelligent utility networks with visibility and control

Empowering intelligent utility networks with visibility and control IBM Software Energy and Utilities Thought Leadership White Paper Empowering intelligent utility networks with visibility and control IBM Intelligent Metering Network Management software solution 2 Empowering

More information

Overview of Tallahassee s Smart Grid Initiative

Overview of Tallahassee s Smart Grid Initiative Overview of Tallahassee s Smart Grid Initiative Smart Grid Technologies Seminar February 4, 2011 1 Tallahassee s Utility Systems Tallahassee provides Electric, Gas and Water service to 113,000 customers

More information

ALSTOM Energy Management Business. Challenges related to Smart Energy Eco Systems

ALSTOM Energy Management Business. Challenges related to Smart Energy Eco Systems ALSTOM Energy Management Business Challenges related to Smart Energy Eco Systems March 2010 Laurent SCHMITT ALSTOM Power Energy Management VP for Strategy & Innovation ALSTOM CO 2 Strategy Alstom is the

More information

Data stream approaches for electric load curve analysis. Georges Hébrail, Marie-Luce Picard BILab : bilab.enst.fr ISF 2008, June 24th, Nice

Data stream approaches for electric load curve analysis. Georges Hébrail, Marie-Luce Picard BILab : bilab.enst.fr ISF 2008, June 24th, Nice Data stream approaches for electric load curve analysis 1 Georges Hébrail, Marie-Luce Picard BILab : bilab.enst.fr ISF 2008, June 24th, Nice Outline Deployment of a smart metering infrastructure What is

More information

Make the most of your energy

Make the most of your energy Make the most of your energy Runar Hansesætre, Country President Schneider Electric Norway. Negawatt 2012 The Energy trends Energy Efficiency is mainstream Smart Grid is emerging New economies are driving

More information

Queensland Australia Smart Grid Trials

Queensland Australia Smart Grid Trials Queensland Australia Smart Grid Trials Grahame Foulger Director SmartGrid Partners gfoulger@smartgridpartners.com.au +61419502980 Company or Institution Logo 4 th International Conference on Integration

More information

Utility Analytics, Challenges & Solutions. Session Three September 24, 2014

Utility Analytics, Challenges & Solutions. Session Three September 24, 2014 The Place Analytics Leaders Turn to for Answers Member.UtilityAnalytics.com Utility Analytics, Challenges & Solutions Session Three September 24, 2014 The Place Analytics Leaders Turn to for Answers Member.UtilityAnalytics.com

More information

Big Data: Business Insight for Power and Utilities

Big Data: Business Insight for Power and Utilities Big Data: Business Insight for Power and Utilities A Look at Big Data By now, most enterprises have encountered the term Big Data. What they encounter less is an understanding of what Big Data means for

More information

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the

More information

Comprehensive Analytics on the Hortonworks Data Platform

Comprehensive Analytics on the Hortonworks Data Platform Comprehensive Analytics on the Hortonworks Data Platform We do Hadoop. Page 1 Page 2 Back to 2005 Page 3 Vertical Scaling Page 4 Vertical Scaling Page 5 Vertical Scaling Page 6 Horizontal Scaling Page

More information

I. TODAY S UTILITY INFRASTRUCTURE vs. FUTURE USE CASES...1 II. MARKET & PLATFORM REQUIREMENTS...2

I. TODAY S UTILITY INFRASTRUCTURE vs. FUTURE USE CASES...1 II. MARKET & PLATFORM REQUIREMENTS...2 www.vitria.com TABLE OF CONTENTS I. TODAY S UTILITY INFRASTRUCTURE vs. FUTURE USE CASES...1 II. MARKET & PLATFORM REQUIREMENTS...2 III. COMPLEMENTING UTILITY IT ARCHITECTURES WITH THE VITRIA PLATFORM FOR

More information

Towards Smart and Intelligent SDN Controller

Towards Smart and Intelligent SDN Controller Towards Smart and Intelligent SDN Controller - Through the Generic, Extensible, and Elastic Time Series Data Repository (TSDR) YuLing Chen, Dell Inc. Rajesh Narayanan, Dell Inc. Sharon Aicler, Cisco Systems

More information

BIG (SMART) DATA ANALYTICS IN ENERGY TRENDS AND BENEFITS

BIG (SMART) DATA ANALYTICS IN ENERGY TRENDS AND BENEFITS BIG (SMART) DATA ANALYTICS IN ENERGY TRENDS AND BENEFITS SAS INSTITUTE 360 POWER FOR AN INTEGRATED COMPANY MANAGEMENT Customer around the globe trust SAS at more than 65.000 locations 91 of Top100 FORTUNE

More information

EC 350 Simplifies Billing Data Integration in PowerSpring Software

EC 350 Simplifies Billing Data Integration in PowerSpring Software White Paper EC 350 Simplifies Billing Data Integration in PowerSpring Software Executive Summary In the current energy environment, gas-metering data must be collected more frequently and in smaller increments

More information

Energy Demand Forecasting Industry Practices and Challenges

Energy Demand Forecasting Industry Practices and Challenges Industry Practices and Challenges Mathieu Sinn (IBM Research) 12 June 2014 ACM e-energy Cambridge, UK 2010 2014 IBM IBM Corporation Corporation Outline Overview: Smarter Energy Research at IBM Industry

More information

Integrating the customer experience through unifying software - The Microsoft Vision

Integrating the customer experience through unifying software - The Microsoft Vision VAASAETT - RESPOND 2010 Integrating the customer experience through unifying software - The Microsoft Vision Principal Author Andreas Berthold- van der Molen, Microsoft EMEA Contents The New Energy Ecosystem

More information

How To Calculate Electricity Load Data

How To Calculate Electricity Load Data Combining Forecasts for Short Term Electricity Load Forecasting Weight 0.0 0.2 0.4 0.6 0.8 1.0 0 1000 2000 3000 4000 5000 Step M. Devaine, P. Gaillard, Y.Goude, G. Stoltz ENS Paris - EDF R&D - CNRS, INRIA

More information

CenterPoint Energy Robert B. Frazier Director of Electric Technology

CenterPoint Energy Robert B. Frazier Director of Electric Technology Smart Grid The Texas Experience CenterPoint Energy Robert B. Frazier Director of Electric Technology WHO IS CENTERPOINT ENERGY? Public company traded on the New York Stock Exchange (CNP) Headquartered

More information

Smart Metering and RF Mesh Networks for Communities

Smart Metering and RF Mesh Networks for Communities Smart Metering and RF Mesh Networks for Communities AMI RF Mesh Networks Wireless neighborhood networks (typical) Attractive bandwidth/cost trade off Signal penetration Path diversity (reliability) Self

More information

Blueprints and feasibility studies for Enterprise IoT (Part Two of Three)

Blueprints and feasibility studies for Enterprise IoT (Part Two of Three) Blueprints and feasibility studies for Enterprise IoT (Part Two of Three) 1 Executive Summary The Internet of Things provides a host of opportunities for enterprises to design, develop and launch smart

More information

2010 SMART GRID INVESTMENTS INFORMATION TECHNOLOGY

2010 SMART GRID INVESTMENTS INFORMATION TECHNOLOGY EB-00-0 Exhibit G Tab Schedule Page of 00 SMART GRID INVESTMENTS INFORMATION TECHNOLOGY CUSTOMER PORTALS PILOT Customer Display Integration: The implementation of a customer display in the future is identified

More information

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect

Big Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect Big Data & QlikView Democratizing Big Data Analytics David Freriks Principal Solution Architect TDWI Vancouver Agenda What really is Big Data? How do we separate hype from reality? How does that relate

More information

Testing Big data is one of the biggest

Testing Big data is one of the biggest Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing

More information

How To Improve Your Energy Efficiency

How To Improve Your Energy Efficiency Conquering Data and Analytics Obstacles in Smart Utilities Copyright 2010 SAS Institute Inc. All rights reserved. The Panel Kate Rowland Editor-in-Chief of Intelligent Utility Magazine Energy Central Alyssa

More information

FINANCIAL SERVICES: FRAUD MANAGEMENT A solution showcase

FINANCIAL SERVICES: FRAUD MANAGEMENT A solution showcase FINANCIAL SERVICES: FRAUD MANAGEMENT A solution showcase TECHNOLOGY OVERVIEW FRAUD MANAGE- MENT REFERENCE ARCHITECTURE This technology overview describes a complete infrastructure and application re-architecture

More information

Advanced Data Management and Analytics for Automated Demand Response (ADR) based on NoSQL

Advanced Data Management and Analytics for Automated Demand Response (ADR) based on NoSQL Advanced Data Management and Analytics for Automated Demand Response (ADR) based on NoSQL Bert Taube btaube@versant.com Versant Corporation www.versant.com Rolf Bienert Rolf@openadr.org OpenADR Alliance

More information

Luncheon Webinar Series May 13, 2013

Luncheon Webinar Series May 13, 2013 Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration

More information

Industry Data Model Solution for Smart Grid Data Management Challenges

Industry Data Model Solution for Smart Grid Data Management Challenges Industry Data Model Solution for Smart Grid Data Management Challenges Presented by: M. Joe Zhou & Tom Eyford UCAiug Summit 2012, New Orleans, LA October 23, 2012 UCAiug Summit 2012, New Orleans, LA 1

More information

ESS event: Big Data in Official Statistics. Antonino Virgillito, Istat

ESS event: Big Data in Official Statistics. Antonino Virgillito, Istat ESS event: Big Data in Official Statistics Antonino Virgillito, Istat v erbi v is 1 About me Head of Unit Web and BI Technologies, IT Directorate of Istat Project manager and technical coordinator of Web

More information

The Rise of Industrial Big Data. Brian Courtney General Manager Industrial Data Intelligence

The Rise of Industrial Big Data. Brian Courtney General Manager Industrial Data Intelligence The Rise of Industrial Big Data Brian Courtney General Manager Industrial Data Intelligence Agenda Introduction Big Data for the industrial sector Case in point: Big data saves millions at GE Energy Seeking

More information

Smart Metering System for Smart Communities

Smart Metering System for Smart Communities Smart Metering System for Smart Communities Chuck Sathrum, Director Smart Grid Solutions Metering s Transitional Role Product Oriented Value Process Oriented Value People Oriented Value EM Meter Send Bill

More information

Next Generation Distribution Management Systems (DMS) and Distributed Energy Resource Management Systems (DERMS)

Next Generation Distribution Management Systems (DMS) and Distributed Energy Resource Management Systems (DERMS) Next Generation Distribution Management Systems (DMS) and Distributed Energy Resource Management Systems (DERMS) S. S. (Mani) Venkata, Principal Scientist Glenn Brice, Director, DMS and DERMS Alstom Grid

More information

Whitepaper. Storm is coming: are you ready for big data? By Johan Crols. Copyright 2012 Ferranti Computer Systems. All rights reserved

Whitepaper. Storm is coming: are you ready for big data? By Johan Crols. Copyright 2012 Ferranti Computer Systems. All rights reserved Whitepaper Storm is coming: are you ready for big data? By Johan Crols Copyright 2012 Ferranti Computer Systems. All rights reserved 3 storm is coming Are you taking any risks? Massive amounts of smart

More information

Strategic Microgrid Development for Maximum Value. Allen Freifeld SVP, Law & Public Policy Viridity Energy 443.878.7155

Strategic Microgrid Development for Maximum Value. Allen Freifeld SVP, Law & Public Policy Viridity Energy 443.878.7155 Strategic Microgrid Development for Maximum Value Allen Freifeld SVP, Law & Public Policy Viridity Energy 443.878.7155 1 MICROGRIDS Island Mode Buying and Selling Mode Retail Cost Structure to Maximize

More information

I/O Considerations in Big Data Analytics

I/O Considerations in Big Data Analytics Library of Congress I/O Considerations in Big Data Analytics 26 September 2011 Marshall Presser Federal Field CTO EMC, Data Computing Division 1 Paradigms in Big Data Structured (relational) data Very

More information

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here> s Big Data solutions Roger Wullschleger DBTA Workshop on Big Data, Cloud Data Management and NoSQL 10. October 2012, Stade de Suisse, Berne 1 The following is intended to outline

More information

Demand Response in the Pacific Northwest

Demand Response in the Pacific Northwest Demand Response in the Pacific Northwest Presented by: Lee Hall, BPA Smart Grid and Demand Response Program Manager Carol Lindstrom, BPA Energy Efficiency Marketing Larry Bryant, Kootenai Electric Cooperative

More information

GigaSpaces Real-Time Analytics for Big Data

GigaSpaces Real-Time Analytics for Big Data GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and

More information

Preparing for Distributed Energy Resources

Preparing for Distributed Energy Resources Preparing for Distributed Energy Resources Executive summary Many utilities are turning to Smart Grid solutions such as distributed energy resources (DERs) small-scale renewable energy sources and energy

More information

Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control

Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control Developing Scalable Smart Grid Infrastructure to Enable Secure Transmission System Control EP/K006487/1 UK PI: Prof Gareth Taylor (BU) China PI: Prof Yong-Hua Song (THU) Consortium UK Members: Brunel University

More information

Enabling the SmartGrid through Cloud Computing

Enabling the SmartGrid through Cloud Computing Enabling the SmartGrid through Cloud Computing April 2012 Creating Value, Delivering Results 2012 eglobaltech Incorporated. Tech, Inc. All rights reserved. 1 Overall Objective To deliver electricity from

More information

The Data Management Challenge: Making Extremely Large Amounts of Data Useful and Actionable

The Data Management Challenge: Making Extremely Large Amounts of Data Useful and Actionable The Data Management Challenge: Making Extremely Large Amounts of Data Useful and Actionable Todd Pistorese OSIsoft 777 Davis Street San Leandro, CA 94577 Summary The introduction of AMI has created a data

More information

Amplify Serviceability and Productivity by integrating machine /sensor data with Data Science

Amplify Serviceability and Productivity by integrating machine /sensor data with Data Science Data Science & Big Data Practice INSIGHTS ANALYTICS INNOVATIONS Manufacturing IoT Amplify Serviceability and Productivity by integrating machine /sensor data with Data Science What is Internet of Things

More information

Independent process platform

Independent process platform Independent process platform Megatrend in infrastructure software Dr. Wolfram Jost CTO February 22, 2012 2 Agenda Positioning BPE Strategy Cloud Strategy Data Management Strategy ETS goes Mobile Each layer

More information

More Data in Less Time

More Data in Less Time More Data in Less Time Leveraging Cloudera CDH as an Operational Data Store Daniel Tydecks, Systems Engineering DACH & CE Goals of an Operational Data Store Load Data Sources Traditional Architecture Operational

More information

Smart Cities & Integrated Corridors: from Automation to Optimization

Smart Cities & Integrated Corridors: from Automation to Optimization Smart Cities & Integrated Corridors: from Automation to Optimization Presentation to the National Rural ITS Conference August 28, 2013 Cary Vick, Director of Business Development; Smart Mobility for Smart

More information

An Oracle White Paper November 2010. Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics

An Oracle White Paper November 2010. Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics An Oracle White Paper November 2010 Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics 1 Introduction New applications such as web searches, recommendation engines,

More information

Addressing Open Source Big Data, Hadoop, and MapReduce limitations

Addressing Open Source Big Data, Hadoop, and MapReduce limitations Addressing Open Source Big Data, Hadoop, and MapReduce limitations 1 Agenda What is Big Data / Hadoop? Limitations of the existing hadoop distributions Going enterprise with Hadoop 2 How Big are Data?

More information

How can (SAP) Technology help implementing SmartGrids

How can (SAP) Technology help implementing SmartGrids How can (SAP) Technology help implementing SmartGrids Seinsing consultation, EC-Brussels, 28th March 2007 Dr Maher Chebbo Vice President Utilities Industry for EMEA SAP AG Chairman Demand and Metering

More information

THE FUTURE OF SMART GRID COMMUNICATIONS

THE FUTURE OF SMART GRID COMMUNICATIONS THE FUTURE OF SMART GRID COMMUNICATIONS KENNETH C. BUDKA CTO STRATEGIC INDUSTRIES MAY 2014 THE GRID OF THE FUTURE WIDE-SCALE DEPLOYMENT OF RENEWABLES INCREASED ENERGY EFFICIENCY PEAK POWER REDUCTION, DEMAND

More information

Data Science & Big Data Practice

Data Science & Big Data Practice INSIGHTS ANALYTICS INNOVATIONS Data Science & Big Data Practice Manufacturing Internet of Things (IoT) Amplify Serviceability and Productivity by integrating machine /sensor data with Data Science What

More information

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON 2 The V of Big Data Velocity means both how fast data is being produced and how fast the data must be processed to meet demand. Gartner The emergence

More information

USE CASES BROADBAND EXPERIENCE EVERYWHERE, ANYTIME SMART VEHICLES, TRANSPORT & INFRASTRUCTURE MEDIA EVERYWHERE CRITICAL CONTROL OF REMOTE DEVICES

USE CASES BROADBAND EXPERIENCE EVERYWHERE, ANYTIME SMART VEHICLES, TRANSPORT & INFRASTRUCTURE MEDIA EVERYWHERE CRITICAL CONTROL OF REMOTE DEVICES 5g Use Cases BROADBAND EXPERIENCE EVERYWHERE, ANYTIME 5g USE CASES SMART VEHICLES, TRANSPORT & INFRASTRUCTURE MEDIA EVERYWHERE CRITICAL CONTROL OF REMOTE DEVICES INTERACTION HUMAN-IOT Ericsson Internal

More information

Siemens 2020 Our strategy and innovation focus Lecture at Koç University Unrestricted Siemens AG 2014. All rights reserved.

Siemens 2020 Our strategy and innovation focus Lecture at Koç University Unrestricted Siemens AG 2014. All rights reserved. Siemens Corporate Technology Istanbul, September 4, 2014 Siemens 2020 Our strategy and innovation focus Lecture at Koç University Unrestricted Siemens AG 2014. All rights reserved. Contents Siemens strategy

More information

High-Performance Analytics for The Smart Grid

High-Performance Analytics for The Smart Grid High-Performance Analytics for The Smart Grid This white paper is the result of a research survey conducted by GTM Research and the SAS. More than 70 North American utility executives responded to this

More information

The Smart Grid in 2010

The Smart Grid in 2010 The Smart Grid in 2010 New Energy Symposium The New York Academy of Sciences August 9th, 2010 David J. Leeds About Greentech Media / GTM Research Web-based publisher of information on the future technology

More information

Architecting an Industrial Sensor Data Platform for Big Data Analytics: Continued

Architecting an Industrial Sensor Data Platform for Big Data Analytics: Continued Architecting an Industrial Sensor Data Platform for Big Data Analytics: Continued 2 8 10 Issue 1 Welcome From the Gartner Files: Blueprint for Architecting Sensor Data for Big Data Analytics About OSIsoft,

More information

Internet of things (IOT) applications covering industrial domain. Dev Bhattacharya dev_bhattacharya@ieee.org

Internet of things (IOT) applications covering industrial domain. Dev Bhattacharya dev_bhattacharya@ieee.org Internet of things (IOT) applications covering industrial domain Dev Bhattacharya dev_bhattacharya@ieee.org Outline Internet of things What is Internet of things (IOT) Simplified IOT System Architecture

More information

Enabling the Use of Data

Enabling the Use of Data Enabling the Use of Data Michael Kagan, CTO June 1, 2015 - Technion Computer Engineering Conference Safe Harbor Statement These slides and the accompanying oral presentation contain forward-looking statements

More information

High Performance Data Management Use of Standards in Commercial Product Development

High Performance Data Management Use of Standards in Commercial Product Development v2 High Performance Data Management Use of Standards in Commercial Product Development Jay Hollingsworth: Director Oil & Gas Business Unit Standards Leadership Council Forum 28 June 2012 1 The following

More information

MAKING THE METERING SMART - A TRANSFORMATION TOWARDS SMART CITIES

MAKING THE METERING SMART - A TRANSFORMATION TOWARDS SMART CITIES MAKING THE METERING SMART - A TRANSFORMATION TOWARDS SMART CITIES Agenda 1. Introduction The way towards Smart Cities Smart Metering as a part of a Smart City Traditional Grids & Smart Grid Management

More information

Le Cloud Computing selon IBM : stratégie et offres, zoom sur WebSphere CloudBurst

Le Cloud Computing selon IBM : stratégie et offres, zoom sur WebSphere CloudBurst Le Cloud Computing selon IBM : stratégie et offres, zoom sur WebSphere CloudBurst Hervé Grange WebSphere Client Technical Expert Stéphane Woillez Senior IT Architect - Cloud Computing Champion IBM France

More information

A Big Data Platform to Support a Modernized Electric Grid

A Big Data Platform to Support a Modernized Electric Grid A Big Data Platform to Support a Modernized Electric Grid Renewable Database: Integrating, sharing, and analyzing timeseries data Matt Shawver 1 Modernized Grid Modernized Grid: New Information Systems

More information

Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems

Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems Brian McCarson Sr. Principal Engineer & Sr. System Architect, Internet of Things Group, Intel Corp Mac Devine

More information

METER DATA MANAGEMENT FOR THE SMARTER GRID AND FUTURE ELECTRONIC ENERGY MARKETPLACES

METER DATA MANAGEMENT FOR THE SMARTER GRID AND FUTURE ELECTRONIC ENERGY MARKETPLACES METER DATA MANAGEMENT FOR THE SMARTER GRID AND FUTURE ELECTRONIC ENERGY MARKETPLACES Sebnem RUSITSCHKA 1(1), Stephan MERK (1), Dr. Heinrich KIRCHAUER (2), Dr. Monika STURM (2) (1) Siemens AG Germany Corporate

More information

Risk Management, Equipment Protection, Monitoring and Incidence Response, Policy/Planning, and Access/Audit

Risk Management, Equipment Protection, Monitoring and Incidence Response, Policy/Planning, and Access/Audit Page 1 of 10 Events Partners Careers Contact Facebook Twitter LinkedIn Pike Research Search search... Home About Research Consulting Blog Newsroom Media My Pike Logout Overview Smart Energy Clean Transportation

More information

Automated Machine Learning For Autonomic Computing

Automated Machine Learning For Autonomic Computing Automated Machine Learning For Autonomic Computing ICAC 2012 Numenta Subutai Ahmad Autonomic Machine Learning ICAC 2012 Numenta Subutai Ahmad 35% 30% 25% 20% 15% 10% 5% 0% Percentage of Machine Learning

More information

Demand Response Management System Smart systems for Consumer engagement By Vikram Gandotra Siemens Smart Grid

Demand Response Management System Smart systems for Consumer engagement By Vikram Gandotra Siemens Smart Grid Demand Response Demand Response Management System Smart systems for Consumer engagement By Vikram Gandotra Siemens Smart Grid siemens.com/answers The Siemens Smart Grid Suite DRMS part of Grid Application

More information

Real-time Big Data Analytics with Storm

Real-time Big Data Analytics with Storm Ron Bodkin Founder & CEO, Think Big June 2013 Real-time Big Data Analytics with Storm Leading Provider of Data Science and Engineering Services Accelerating Your Time to Value IMAGINE Strategy and Roadmap

More information

Demystifying Big Data Government Agencies & The Big Data Phenomenon

Demystifying Big Data Government Agencies & The Big Data Phenomenon Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed

More information

Global Big Data Market: Trends & Opportunities (2014-2019) June 2015

Global Big Data Market: Trends & Opportunities (2014-2019) June 2015 Global Big Data Market: Trends & Opportunities (2014-2019) June 2015 Scope of the Report The report titled Global Big Data Market: Trends and Opportunities (2014-2019), analyzes the potential opportunities

More information

Sensor Devices and Sensor Network Applications for the Smart Grid/Smart Cities. Dr. William Kao

Sensor Devices and Sensor Network Applications for the Smart Grid/Smart Cities. Dr. William Kao Sensor Devices and Sensor Network Applications for the Smart Grid/Smart Cities Dr. William Kao Agenda Introduction - Sensors, Actuators, Transducers Sensor Types, Classification Wireless Sensor Networks

More information

BIG DATA TRENDS AND TECHNOLOGIES

BIG DATA TRENDS AND TECHNOLOGIES BIG DATA TRENDS AND TECHNOLOGIES THE WORLD OF DATA IS CHANGING Cloud WHAT IS BIG DATA? Big data are datasets that grow so large that they become awkward to work with using onhand database management tools.

More information

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research &

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & Innovation 04-08-2011 to the EC 8 th February, Luxembourg Your Atos business Research technologists. and Innovation

More information

IBM Solutions for the Digital Smart Grid

IBM Solutions for the Digital Smart Grid Advanced Energy 2011 Annual Conference IBM Solutions for the Digital Smart Grid Mickey Nix Executive Solutions Architect, Tivoli Industry Solutions Tivoli Netcool Development, IBM Software Group Moving

More information

Web of Systems for a digital world

Web of Systems for a digital world Web of Systems for a digital world Dubai, siemens.com From the Internet to the Web of Systems Internet World Wide Web Web 2.0 Web of Systems ARPANET TCP/IP http VoIP Mobile web Social media Smart grid

More information

The 5G Infrastructure Public-Private Partnership

The 5G Infrastructure Public-Private Partnership The 5G Infrastructure Public-Private Partnership NetFutures 2015 5G PPP Vision 25/03/2015 19/06/2015 1 5G new service capabilities User experience continuity in challenging situations such as high mobility

More information

Title. Click to edit Master text styles Second level Third level

Title. Click to edit Master text styles Second level Third level Title Click to edit Master text styles Second level Third level IBM s Vision For The New Enterprise Data Center Subram Natarajan Senior Consultant, STG Asia Pacific subram.natarajan@in.ibm.com Multiple

More information

Agenda do Mini-Curso. Sérgio Yoshio Fujii. Ethan Boardman. sergio.fujii@areva-td.com. ethan.boardman@areva-td.com

Agenda do Mini-Curso. Sérgio Yoshio Fujii. Ethan Boardman. sergio.fujii@areva-td.com. ethan.boardman@areva-td.com Agenda do Mini-Curso Sérgio Yoshio Fujii sergio.fujii@areva-td.com Ethan Boardman ethan.boardman@areva-td.com Agenda do Mini-Curso Sistemas de Distribuição (DMS) Characteristics of Distribution Network

More information

How are energy companies adapting to the changing rules in the energy sector? Jaroslav Zlabek Country President Schneider Electric Polska

How are energy companies adapting to the changing rules in the energy sector? Jaroslav Zlabek Country President Schneider Electric Polska How are energy companies adapting to the changing rules in the energy sector? Jaroslav Zlabek Country President Schneider Electric Polska Sopot November, 2011 the energy challenges today 2 The solution

More information

Emerging Trends and Opportunities

Emerging Trends and Opportunities Emerging Trends and Opportunities Smart Homes & End User Engagement track_ TEF. Digital 04.11.2014 Emilio Martinez de la Fuente Head of Utilities & Building Energy Efficiency Telefonica M2M Global Unit

More information

Integrating a Big Data Platform into Government:

Integrating a Big Data Platform into Government: Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government

More information

Massive Cloud Auditing using Data Mining on Hadoop

Massive Cloud Auditing using Data Mining on Hadoop Massive Cloud Auditing using Data Mining on Hadoop Prof. Sachin Shetty CyberBAT Team, AFRL/RIGD AFRL VFRP Tennessee State University Outline Massive Cloud Auditing Traffic Characterization Distributed

More information

Lakeside. Lakeside Software and IBM: Statement of Fact. SysTrack. A Lakeside Software White Paper November 2011

Lakeside. Lakeside Software and IBM: Statement of Fact. SysTrack. A Lakeside Software White Paper November 2011 A Software White Paper November 2011 Software and IBM: Statement of Fact Joint Statement of Fact (SOF) Regarding Business Relationship Software, Inc. & IBM Corporation SysTrack 2 SysTrack and HIPAA Table

More information

Big Data and Advanced Analytics Technologies for the Smart Grid

Big Data and Advanced Analytics Technologies for the Smart Grid 1 Big Data and Advanced Analytics Technologies for the Smart Grid Arnie de Castro, PhD SAS Institute IEEE PES 2014 General Meeting July 27-31, 2014 Panel Session: Using Smart Grid Data to Improve Planning,

More information

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities Technology Insight Paper Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities By John Webster February 2015 Enabling you to make the best technology decisions Enabling

More information

Teradata s Big Data Technology Strategy & Roadmap

Teradata s Big Data Technology Strategy & Roadmap Teradata s Big Data Technology Strategy & Roadmap Artur Borycki, Director International Solutions Marketing 18 March 2014 Agenda > Introduction and level-set > Enabling the Logical Data Warehouse > Any

More information

Case study: Real Time Decision Making with Smart Data Analytics. Thomas Doggett Co-founder & Chief Marketing Officer Calico Energy

Case study: Real Time Decision Making with Smart Data Analytics. Thomas Doggett Co-founder & Chief Marketing Officer Calico Energy Case study: Real Time Decision Making with Smart Data Analytics Thomas Doggett Co-founder & Chief Marketing Officer Calico Energy Real-Time Decision Making with Smart Data & Analytics About Calico Data:

More information

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing

More information

Introduction. Along with consulting, I previously. developing regulatory policy initiatives

Introduction. Along with consulting, I previously. developing regulatory policy initiatives 1 Customer Data Privacy in AMI Applications Will McNamara Sr. Manager, Energy & Utilities West Monroe Partners 2 Introduction Will McNamara, Senior Manager, and Lead for WMP s Regulatory Support & Stakeholder

More information

BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES

BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data

More information

Cisco IT Hadoop Journey

Cisco IT Hadoop Journey Cisco IT Hadoop Journey Srini Desikan, Program Manager IT 2015 MapR Technologies 1 Agenda Hadoop Platform Timeline Key Decisions / Lessons Learnt Data Lake Hadoop s place in IT Data Platforms Use Cases

More information

ADMS(Advanced Distribution Management System ) in Smart Grid

ADMS(Advanced Distribution Management System ) in Smart Grid ADMS(Advanced Distribution Management System ) in Smart Grid 柯 佾 寬 博 士 Yi-Kuan Ke, Ph.D. 2014/03/28 Smart Grid Solution Smart Grid Solution Overview Smart Grid Solutions Smart Network Operation - Distribution

More information

Redefining MDM for a Smart Grid Enabled

Redefining MDM for a Smart Grid Enabled Redefining MDM for a Smart Grid Enabled Enterprise Florida Power and Light Radha Swaminathan Director, AMI Information Technology, MDM and its future in a smart grid enabled enterprise A key component

More information

Managing Electrical Demand through Difficult Periods: California s Experience with Demand Response

Managing Electrical Demand through Difficult Periods: California s Experience with Demand Response Managing Electrical Demand through Difficult Periods: California s Experience with Demand Response Greg Wikler Vice President and Senior Research Officer Global Energy Partners, LLC Walnut Creek, CA USA

More information

The Internet of Things

The Internet of Things The Internet of Things Vijay Sethia Senior Product Manager, IBM Software Group 2014 IBM Corporation Agenda The Internet of Things The IBM IoT On-Prem Cloud Sample IoT Application 1 The Internet of Things

More information