Business Intelligence for the Modern Utility

Size: px

Start display at page:

Download "Business Intelligence for the Modern Utility"

Della Phelps
8 years ago
Views:

1 Business Intelligence for the Modern Utility Presented By: Glenn Wolf, CISSP (Certified Information Systems Security Professional) Senior Consultant Westin Engineering, Inc. Boise, ID September 15 th, :00-8:40am 1

Security Professional) Senior Consultant Westin

2 Agenda Introduction Performance Management Challenges of Data Management for Decision Support Transaction Processing vs. Business Intelligence Systems Business Intelligence and Service Oriented Architectures Benefits of Business Intelligence Business Intelligence Applications Dashboards vs. Scorecards Business Intelligence Trends and Products Secure Data Transfer from SCADA and Other Systems Critical Success Factors Next Steps 2

Business Intelligence Systems Business Intelligence and Service Oriented Architectures Benefits of Business

3 Introduction Business Intelligence: The skills, technologies, applications and practices used to help a business (or organization) acquire a better understanding of its commercial context. Common Business Intelligence Applications Spreadsheets, Ad-hoc Query Tools Reporting, Analysis (OLAP) Dashboards / Scorecards Data Mining / Predictive Analysis Business Intelligence Data Sources Raw Source Systems (OLTP) Data Warehouse / Data Mart / Operational Data Store (ODS) Optimized BI Server Cache Flat Files / Data Extracts 3

Common Business Intelligence Applications Spreadsheets, Ad-hoc Query Tools Reporting, Analysis (OLAP) Dashboards / Scorecards Data

4 Performance Management Develop Business Strategies and Goals Performance Decision Reporting Support Process Develop Analyze Develop Routinely Analyze Communicate Appropriate Routinely Results Communicate Appropriate Monitor Results Results to to Measures and Monitor against Results to Measures and the the Results against Stakeholders Targets the Results Targets Stakeholders Targets Targets Implement Appropriate Corrective Actions Are we achieving our mission? Are we achieving our vision? What is our actual performance against desired targets? Are we continuously improving? Are we effectively communicating the results? 4

Results against Stakeholders Targets the Results Targets Stakeholders Targets Targets Implement Appropriate Corrective Actions Are we achieving our mission?

5 Challenges of Data Management for Business Intelligence Many disparate systems ( silos ) too much data, not enough information. Lack of integrated systems Proprietary database systems or data models. Aggregation and reporting confined within each system. Reporting is cumbersome and slow, and often affects operational systems (slow-downs and crashes). Too many people using spreadsheets coming up with different answers to the same questions. 5

Aggregation and reporting confined within each system.

6 Transaction Processing Systems vs. Business Intelligence Systems Transaction Processing Systems Highly optimized for specific business areas High frequency of quick updates and quick retrieval Data is real-time Record-locking and query caching issues Servers need fast CPU, fast I/O (disk, network) Databases are highly normalized (broken down) 6

specific business areas High frequency of quick updates and quick retrieval Data is

7 Transaction Processing Systems vs. Business Intelligence Systems Business Intelligence Systems Highly optimized to aggregate data from many sources; data aggregated into cubes built around subject matter interests Large bulk queries only; optimized to address sorting and grouping issues Data is not real-time Servers need fast CPU, lots of memory, lots of disk space Metrics are pre-computed and management-approved 7

sources; data aggregated into cubes built around subject matter interests Large bulk queries only;

8 Business Intelligence and Service Oriented Architectures The Old Way Self-contained, standalone BI applications Mish-mashed infrastructure of acquired, forceintegrated platforms Monolithic BI technologies, loosely integrated via proprietary standards Legacy architectures and proprietary licensing models The New Way Componentized and modular Service-implemented architecture Built from the ground up as a set of services Exposed via AJAX and Web Services Commitment to a standards-based architecture and adoption-friendly licensing model 8

architectures and proprietary licensing models The New Way Componentized and modular Service-implemented architecture Built from the

9 Business Intelligence: Benefits Support Performance Improvement Initiatives. Provide sustainable support for business processes through automation. Reduce staff time associated with report generation and production. Support data quality improvement initiatives and overall data governance. Drive one version of the truth. Enable more timely (and accurate) decision making. 9

Reduce staff time associated with report generation and production.

10 Business Intelligence Systems: A Different Kind of Data Management Core Utility Applications Finance / HR Budgeting Purchasing Project Management Maintenance Mgmt. LIMS SCADA PIMS CAD 10

11 11 Business Intelligence Systems: A Different Kind of Data Management

12 12 Business Intelligence Systems: A Different Kind of Data Management

13 13 Business Intelligence Systems: A Different Kind of Data Management

14 Utility Intelligence Applications: Providing Information for Decision Making Performance Dashboards & Scorecards Supervisors Department Heads Analysts General Managers 14

15 Utility Intelligence Systems: Comparing Technologies Purpose Dashboard Monitors and measures operational processes Scorecard Monitors progress toward established objectives Data Events, Transactional Aggregates, Consolidation Refresh Rate Near real-time ( latest and greatest ) Periodic ( snapshots ) Measures Exceptions linked to operations Targets linked to strategic plans 15

Transactional Aggregates, Consolidation Refresh Rate Near real-time ( latest and greatest )

16 Utility Intelligence Systems: Not Mutually Exclusive Manage Measures Progression Measure Monitor Measures Anything 16

17 Utility Intelligence Systems: Comparing Technologies Purpose Dashboard Monitors and measures operational processes Scorecard Monitors progress toward established objectives Data Events, Transactional Aggregates, Consolidation Refresh Rate Near real-time ( latest and greatest ) Periodic ( snapshots ) Measures Exceptions linked to operations Targets linked to strategic plans 17

18 18 Performance Dashboards: Monitoring Operational Processes

19 Utility Intelligence Systems: Comparing Technologies Purpose Dashboard Monitors and measures operational processes Scorecard Monitors progress toward established objectives Data Events, Transactional Aggregates, Consolidation Refresh Rate Near real-time ( latest and greatest ) Periodic ( snapshots ) Measures Exceptions linked to operations Targets linked to strategic plans 19

20 The Balanced Scorecard: A Framework for Monitoring Progress Objectives Measures Targets Initiatives 20

21 21 Performance Scorecards: Drilling Down

22 Business Intelligence Products: Software Tools with Different Capabilities Web Access Tools Simple Development Tools Complex Development Tools Pentaho BI Crystal Reports Jaspersoft Hyperion Production Reports (SQR) Microsoft Reporting Services Cognos Report Studio MicroStrategy Report Services IBI Web Focus Business Objects Web Intelligence SAS Web Report Studio Hyperion Interactive Reports MicroStrategy Web Cognos Query Studio Rulers Relative Object Placement Programmatic control of layout and formatting 22 Multiple grids & graphs Highlight exceptions Easily position objects on page Mixed grid / graph

23 Business Intelligence: Key Trends Wide Variety of Software Tools addressing the needs of different user groups Software Vendor Consolidation only a few vendors remaining, including the big ones (Microsoft, IBM, SAP) BI Software Suites buyers want integrated toolsets Open Source BI solid market presence due to ease of integration Continuous Improvement - Strong links to Performance Management 23

24 The Benefits of BI Suites Business flexibility Extensive features and functionality built in Improved cost-benefit ratio Reduced complexity Pre-Integrated Components Vendor commitments to enhancements Streamlined design and implementation Additional benefits of open source BI Lower costs Lower upfront costs pilot projects more feasible Extensive community of experts Pre-integrated components from the ground up Future plans fully communicated 24

25 Secure Data Transfer from SCADA and Other Systems SCADA should be on its own network Create DMZ (DeMilitarized Zone) between SCADA and IT networks SCADA network pushes data to copy of servers in the DMZ IT network users can access server copies in DMZ No access from IT network to SCADA network If a DMZ server is compromised, intruder is stuck there Monitor interconnections and access points with Network-based Intrusion Detection System (NIDS) 25

26 Business Intelligence Implementation: Critical Success Factors Provide the technical basis for the BI environment Servers, network connectivity, data source accessibility Scalability, reliability Identify and define the data Data sources databases and/or manual inputs Data quality and data quality assurance processes Data mapping, derivation, transformation, and aggregation according to requirements and business rules Data terms defined in business terms (metadata) Utilize proven practices for application design and implementation Assemble business requirements Define the applications for queries, reports, and charts Design the information model 26

27 Business Intelligence: Next Steps Business Intelligence Needs Assessment Start with Pilot Project Identify the Top Questions that Need Answering Automate the Most Useful / Time Consuming Reports Phased Rollout Keep Stakeholders Involved End-User Training on Tools Maintain Realistic Performance Targets 27

28 Questions Glenn Wolf, CISSP Senior Consultant, Westin Engineering, Inc. we-inc.com or westinsolutions.com 28

29 Use for Slides Containing Large Graphical Diagrams Overview Overview Overview Overview Overview Extra pieces for color reference etc. 29

Business Intelligence

Business Intelligence Software Tools for Decision Support Speaker: Rod van Buskirk Principal Consultant Westin Engineering AWWA California-Nevada Section 2010 Annual Fall Conference, Sacramento, California