Netezza and Business Analytics Synergy

Transcription

1 Netezza Business Partner Update: November 17, 2011 Netezza and Business Analytics Synergy Shimon Nir, IBM

2 Agenda Business Analytics / Netezza Synergy Overview Netezza overview Enabling the Business with Cognos 10 BI Cognos 10 BI / Netezza Optimization 2

3 Foundation for Business Analytics and Optimization Transactional & Collaborative Applications Integrate Analyze Business Analytics Applications Manage Master Data Big Data Cubes Data Streams External Information Sources Content Streaming Information Data Warehouses Govern Quality Lifecycle Security & Privacy Standards 3

4 IBM Business Analytics Portfolio 4

5 Netezza and IBM Business Analytics IBM Business Analytics Breadth of Analytical Capabilities Revolutionary Way to work with BI Cost Effective Scale Driving better business outcomes Netezza Solutions Speed Scalability Simplicity Optimized foundation for analytics Integrated & Optimized 5

6 New business value with in-database analytics Netezza customers use in-database analytics to: 1 Predict with more accuracy Use raw, transaction level data Infuse data with outside data Exploit more predictor variables 2 Deliver predictions faster Move from batch to near-real time Shift from months to minutes 3 Respond rapidly to changes Go from reporting to action Take action with on-demand analytics Deploy analytics into production 6

7 IBM Netezza In-Database Analytics Version 2.0 Netezza In-Database Analytics Transformations Mathematical Geospatial Predictive Statistics Time Series No data movement Analyze deep and wide data High performance, parallel computation Data Mining 7

8 Agenda Business Analytics / Netezza Synergy Overview NETEZZA overview Enabling the Business with Cognos 10 BI Cognos 10 BI / Netezza Optimization 8

9 IBM Netezza Appliance. Purpose-built analytics engine Integrated database, server and storage Standard interfaces Low total cost of ownership Speed: x faster than traditional system Simplicity: Minimal administration and tuning Scalability: Peta-scale user data capacity Smart: High-performance advanced analytics 9

10 Simplicity no Tablespaces no Partitioning no Indexes no Log-Management 1x DB Server Cluster (active/passive) Connectors: IP

11 Business Analytics software Information Management Inside IBM Netezza Appliance Hardware + Netezza Database Red Hat Linux 5 64-bit Storage IBM 1TB Disk Drive 7.2K SAS Host SMP Administration IBM x3650 M2 x2 Quad-Core - Intel 2.6 GHz CPUs 16 GB Memory Motor MPP Data streaming IBM HS22 S-Blade Intel Xeon Processor x2 Quad core GHz Westmere 24 GB Memory 11

12 Business Analytics software The Netezza TwinFin Appliance Disk Enclosures SMP Hosts S- Blades (with FPGA-based Database Accelerator ) Slice of User Data Swap and Mirror partitions High speed data streaming SQL Compiler Query Plan Optimize Admin Processor & streaming DB logic High-performance database engine streaming joins, aggregations, sorts, etc.

13 Business Analytics software The Netezza S-Blade Intel Quad-Core 2+ GHz CPU 24 GB DRAM IBM BladeCenter Server Dual-Core FPGA 125 MHz SAS Expander Module Netezza DB Accelerator

14 Asymmetric Massively Parallel Processing SOLARIS AIX Netezza TwinFin Appliance Client TRU64 HP-UX WINDOWS LINUX ODBC 3.X JDBC Type 4 OLE-DB SQL/92 SQL Compiler 1 2 S-Blade Processor & streaming DB logic S-Blade Processor & streaming DB logic Query Plan Execution Engine 3 S-Blade Processor & streaming DB logic Source Systems ETL Server DBA CLI 3rd Party Apps High-Speed Loader/Unloader Optimize Admin Front End SMP Host Network Fabric 920 High-Performance Database Engine Streaming joins, aggregations, sorts S-Blade Processor & streaming DB logic Massively Parallel Intelligent Storage High Performance Loader 14

15 Asymmetric Massively Parallel Processing SOLARIS AIX Netezza TwinFin Appliance Client TRU64 HP-UX WINDOWS LINUX SQL SQL Compiler Snippets S-Blade Processor & streaming DB logic S-Blade Processor & streaming DB logic Query Plan Execution Engine 3 S-Blade Processor & streaming DB logic Source Systems ETL Server DBA CLI 3rd Party Apps High-Speed Loader/Unloader Optimize Admin SQL Front End SMP Host Network Fabric 920 High-Performance Database Engine Streaming joins, aggregations, sorts S-Blade Processor & streaming DB logic Massively Parallel Intelligent Storage High Performance Loader 15

16 Data Streaming select DISTRICT, PRODUCTGRP, sum(nrx) from MTHLY_RX_TERR_DATA where MONTH = ' ' and MARKET = and SPECIALTY = 'GASTRO' Netezza DB Accelerator FPGA Core CPU Core IBM Blade Server Portion of the tabla (ZoneMaps) Uncompress Projection Restriction Visibility Complex Joins, Aggs, etc. MTHLY_RX_TERR_DATA (compressed) sum(nrx) select DISTRICT, PRODUCTGRP, sum(nrx) where MONTH = ' ' and MARKET = and SPECIALTY = 'GASTRO' 16

17 Asymmetric Massively Parallel Processing SOLARIS AIX Netezza TwinFin Appliance Client TRU64 HP-UX WINDOWS LINUX ODBC 3.X JDBC Type 4 OLE-DB SQL/92 SQL Compiler Consolidate 1 2 S-Blade S-Blade Processor & streaming DB logic Processor & streaming DB logic Query Plan Execution Engine 3 S-Blade Processor & streaming DB logic Source Systems ETL Server DBA CLI 3rd Party Apps High-Speed Loader/Unloader Optimize Admin Front End SMP Host Network Fabric 920 High-Performance Database Engine Streaming joins, aggregations, sorts, etc. S-Blade Processor & streaming DB logic Massively Parallel Intelligent Storage High Performance Loader 17

18 Agenda Business Analytics / Netezza Synergy Overview Netezza overview Enabling the Business with Cognos 10 BI Cognos 10 BI / Netezza Optimization 18

19 Full breadth of BI for every decision-maker Query, reporting, analysis, scorecards and dashboards Delivered where, when and how needed Revolutionary way to work with BI Unified workspace with built-in collaboration View of all time horizons: past, present & future Easy progression from viewing to exploration to more advanced analysis Free to answer critical business questions Answer how am I doing, why, and what should I be doing? Ensure organization-wide insight and alignment 19

20 Cognos BI Business Insight Unified Workspace Revolutionary Self-Service Business Intelligence Highlights Limitless and interactive All time horizons Drag and drop assembly Seamless graduated experience 20 Intuitive and easy to use from simple viewing to advanced analytics faster and higher end user adoption rates

21 Cognos BI Business Insight Unified Workspace Cognos BI Historical Trends SPSS Predictive Analytics Churn Prediction Customer Segmentation Risk Analysis Cognos Real Time Call Center Data Cognos Analytical Apps Workforce Management 21

22 Cognos BI Business Insight Advanced Author Business Intelligence Content for Business users Highlights Easily Author BI Content Drag and drop assembly Interactive Data Analysis 22

23 Health Care Cost Spike Cognos BI / SPSS & Netezza Find similar Physicians that have occurred cost spikes. Cognos 10 BI Analyze details Modeler Server 23 Netezza

24 Agenda Business Analytics / Netezza Synergy Overview Netezza overview Enabling the Business with Cognos 10 BI Cognos 10 BI / Netezza Optimization 24

25 Cognos BI is Optimized for Netezza Cognos BI Dynamic Query Mode Cache Transformation engine Plan Tree Transformation Libs Repos Logs Linear Data Scale 4X Faster Cache Execution engine Run Tree MDX SQL HResult Fastest Query Response Optimized SQL for Netezza 64-bit in-memory Dynamic Cache Optimized for aggregation Dedicated Cognos Engineering resources 25

26 Cognos BI V10.1.1: Dynamic Query Cache 6 SQL Queries: Total 7 sec Drill on Men 3 SQL Queries: Total 3 sec 3 Cache Hits 26 Dynamic Query Cache 64-bit Memory Cache In-Memory Calculations

27 Cognos BI Faster for Analysis Cognos BI V scales significantly better with larger data in an analysis scenario Cognos BI V reduces the SQL load on the Netezza server due to caching We optimized the SQL as part of DQM so that the SQL in Netezza runs by a factor of 5 faster. Example : against a 2.8B row fact table we were able to execute the report in 14s and 8s of that was SQL compared to CQM where it took 50 sec and 42 sec for the SQL10:09:32 PM 27 * Based on findings in the lab using Cognos Business Intelligence V with Dynamic Query Mode compared to previous versions of Cognos Business Intelligence. TPC-DS sample data was used.

28 Faster Performance under Concurrency # Queries Under concurrency Cognos BI V reduces the number of queries going back to the database Cognos BI V reduces the load on the database so that query times are consistent with increased user concurrency We optimized the connections with DQM which means that we can increase concurrency on Netezza 28

29 An end to end Business Analytics solution drives lightning fast analytics Performance is the mantra for us embed larger extents of data enabled extended visibility into the trends Shashi Vangala, Manager & Chief Solutions Architect of Business Intelligence 29

30 30