Intelligent BI Testing. Key to Reliable Information. Data to Impact. Sanjay Nayyar Delivery manager Business Intelligence & Analytics, Sogeti t Spant Bussum, 23 november 2015 Sogeti BI & Analytics Intelligent BI Testing 1
Data Explosion Data Generated from dawn of civilization till 2003 was around 5.000.000.000.000.000.000 bytes (10 18 B) or to make it simple 5 Exabyte Data Generated everyday is around 2.500.000.000.000.000.000 bytes (10 18 B) or to make it simple 2.5 quintillion bytes Sogeti BI & Analytics Intelligent BI Testing 2
Reference https://www.domo.com/blog/2014/04/data-never-sleeps-2-0/ Sogeti BI & Analytics Intelligent BI Testing 3
How is Data explosion impacting us Customer Experience Digital Transformation Internet of Things (IOT) Business Intelligence and Analytics Sogeti BI & Analytics Intelligent BI Testing 4
Market Trend on QA & Testing 50% 40% 30% 20% 10% 0% Testing Proportion of Budget 40% 35% 23% 26% 18% 2012 2013 2014 2015 2018 Testing Proportion of Budget Reference - https://www.capgemini.com/thought-leadership/world-quality-report-2015-16 Sogeti BI & Analytics Intelligent BI Testing 5
World Quality Report 2015-2016 Key recommendations from the report: 1. Refocus QA and Testing on customer experience and business assurance. 2. Transform the traditional Test Center of Excellence (TCOE) using agile and DevOps practices. 3. Expand testing teams skills beyond manual test towards test automation. 4. Prioritize testing with predictive analytics and continuous feedback. Reference - https://www.capgemini.com/thought-leadership/world-quality-report-2015-16 Sogeti BI & Analytics Intelligent BI Testing 6
Value BI Testing Maturity Model Sogeti s BI Testing Maturity Model Initial Managed BI Testing Process is not clearly defined No integrated BI Test planning & Strategy based on BI Vision Reactive & Manual Defined Non-Functional Testing Defining BI Test Policy & Test Strategy (Manual & automation Testing) Test Planning BI Test Monitoring & Control Focused Measured Implementing BI Test Policy & Test Strategy (Manual & automation Testing) across all the projects & BICC Testing end to end Enterprise Warehouse Testing MDM Strategic Information Integration Enterprise Warehouse and Integrated Reporting Stragey Single Version of Truth Integrated MDM Optimization Test Measurement & Test Matrix BI Quality Evaluation Comparing against Industry standards Pervasive Integrated Business Performance Management Enterprise alignment, accountability Advanced Analytics BI Defect prevention Test Process improvement BI Automation Testing Quality Control Information On Demand Information to the Masses (Internal and External) EmbeddedAnalytics Unaware Basic Reporting Manual Effort Disjoined Solutions Tactical Improved Information Access & Delivery Department & functional data marts Subject Area datawarehouse Gartner s BI Maturity Model Time Sogeti BI & Analytics Intelligent BI Testing 7
Test Entry points BI Testing Approach (DWH) DATA SOURCE DATA FLOW BI RESULTS 1 METADATA & SECURITY CRM DATA VALIDATION OLAP DATA EXTRACTION Star Schema Model DATA MINING ERP DATA PROFILING DATA VISUALUZATION FINANCE DATA CLEANING DATA TRANSFORMATION Data Marts REPORTS DASHBOARDS FLAT FILES DATA LOADING (CSV,TXT,.XLS, XML) Data vault Model ALERTS ETL DATA WAREHOUSE 2 Test Entry points 3 Test Entry points 4 Test Entry points 5 Test Entry points Sogeti BI & Analytics Intelligent BI Testing 8
SOURCES DATA SYSTEM APPLICATIO NS BI Testing Approach(Big Data) BusinessObjects BI 4 5 Test Entry points Test Entry points HANA RDBMS EDW MPP OPERATIONAL TOOLS INFRASTRUCTURE Metadata Management (HCatalog) DEV & DATA TOOLS Test Entry points 3 Existing Sources (CRM, ERP, Logs, Structured) Emerging Sources (Sensor, Sentiment, Geo, Unstructured) Test Entry points 2 Test Entry points 1 Sogeti BI & Analytics Intelligent BI Testing 9
BI Testing Tool model Quality Reporting Defect Management Test Control Testware Management Progress Reporting Test Design Test Execution Manual/Automated Test Design Manual/Automated Unit test Manual/Automated Functional test Test Environment Manual/Automated Data Quality test Manual/Automated Performance & Security test Test Data Management Test Environment Management Sogeti BI & Analytics Intelligent BI Testing 10
BI Testing Tool model Quality Reporting Defect Management Test Control Testware Management Progress Reporting Test Design Test Case Generator Manual/Automated Test Design SFQC Manual/Automated Unit test Manual/Automated Functional test Test Execution ETL Toolbox Reporting Toolbox Manual/Automated Data Quality test Manual/Automated Performance & Security test Test Environment Test Data Management Test Environment Management Sogeti BI & Analytics Intelligent BI Testing 11
Toolboxes BI Testing Maturity Toolbox Takes 2-4 weeks to provide roadmap Source Files Quality Checker Testing Toolbox Saves 30% of effort Data Quality Testing Toolbox Saves 30% of effort ETL Testing Toolbox Source Target Comparer Testing Toolbox Saves 30% of effort Test Case Generator Saves 35% of effort Report Testing Toolbox Saves 40% of effort Test Datamanagement Toolbox Saves 30% of effort Sogeti PowerPoint Referentie 2014 12
Conclusion Intelligent BI testing makes BI testing fun and interesting. Able to detect defects much earlier in the Data Flow chain. Helps them concentrate on the critical functional areas of testing. Reduces time taken by monotonous testing activities. Sogeti PowerPoint Referentie 2014 13
Thank You!!..and your Questions Sogeti PowerPoint Referentie 2014 14