Outlines. Business Intelligence. What Is Business Intelligence? Data mining life cycle

Transcription

1 Outlines Business Intelligence Lecture 15 Why integrate BI into your smart client application? Integrating Mining into your application Integrating into your application What Is Business Intelligence? mining life cycle Business intelligence (BI) is a broad category of business processes, application software and other technologies for gathering, storing, analyzing, and providing access to data to help users make better business decisions Why integrate BI into your app? BI makes applications smarter! Your customers get more value from their data Big payoff with small amounts of coding

2 What Is SQL Server Mining? Mining platform for analysis and deployment of data mining solutions Nine algorithms developed in conjunction with Microsoft Research Tools for the creation and comprehension of models What Does Mining Do? Illustrated Training DM Engin e DB data Client data Application data Mining Model DM Engin e To Predict DB data Client data Application data Just one row Familiar API s and query language for embedding data mining into intelligent applications Mining Model Mining Model Predicted Intelligent Applications Information Delivery Make decisions without coding Mining algorithms learn business rules directly from the data, freeing you from trying discover and code them yourselves Customized for each client Mining learns the rules from the client s data resulting in logic that is automatically specialized for each individual client Automatically update themselves As your client s business changes, so do the factors that impact their business. Mining allows your application logic to be automatically updated through a simple processing step. Applications do not need to be rewritten, recompiled or redeployed, and are always online even during processing Source Systems ERP CRM LOB Enterprise ETL Marts Warehouse Enterprise Analysis (, Mining) Client Portal Familiar, Powerful BI Tools Third Party Applications Devices Business Performance Management & Analysis Visualization Geospatial Project management Integrated Enterprise BI Platform Business Analysis Enterprise Performance Management

3 SQL Server 2005 Example: before Integration Services Alerts & escalation Integrate Analyze Call centre data: semi structured Text Mining Staging ETL mining acquisition from source systems and integration transformation and synthesis enrichment, with business logic, hierarchical views discovery via data mining presentation and distribution access for the masses SQL Server 2005 launches November 7, 2005 Staging Warehouse ETL Hand Legacy data: binary files coding Cleansing & ETL s ETL Staging Application database Mobile data Integration and warehousing require separate, staged, operations. Preparation of data requires different, often incompatible, tools difficult to audit. and escalation is a slow process, delaying smart responses sequential operations. Heavy data volumes make this scenario increasingly unworkable. Example: with Integration Services Alerts & escalation Call centre: semi-structured data Legacy data: binary files Application database Text mining components Custom source Standard sources mining components Merges cleansing components SQL Server Integration Services Mobile data Warehouse s Integration and warehousing are a seamless, manageable, operation. Sourced, prepare and load data in a single, auditable process. and escalation can be parallelized with the warehouse load. Scales to handle heavy and complex data requirements. Enterprise ETL platform High performance High scale More trustworthy and reliable Best in class usability Rich development environment Source control Visual debugging of control flow and data Great range of transforms out-of-the-box Highly extensible Custom tasks Custom enumerations Custom transformations

4 Enterprise BI Today Source Model Tool M Online Analytical Processing () Browser (1) M Browser (2) mart mart data warehouse (DW) Tool (3) Tool (2) Tool (1) Enterprise BI A Messy Reality Relational Versus s Source Model Tool Flexible schema Feature Relational versus M M mart mart Browser (1) Browser (2) Tool (3) Tool (2) Real time data access Single data store Simple management Detail reporting High performance End-user oriented Ease of navigation and exploration DW Tool (1) Rich analytics Rich semantics Duplicate Duplicate Models

5 Enterprise BI With A UDM Enterprise BI With A UDM Source Model Tool Source Model Tool M Browser (1) M Browser (1) M Browser (2) M Browser (2) mart UDM Tool (2) mart UDM Tool (2) mart DW Tool (1) BI Applications mart DW Tool (1) BI Applications A single dimensional model for all analysis and Relational reporting needs Analysis Services Unified Dimensional Model Integrating relational and views Advanced Business Intelligence KPIs, MDX scripts, translations, currency Web services Native XML/A Critical Server Abilities Pro-active caching Bringing the best of M to R

6 Value of Mining Business Knowledge New Set of Algorithms Relative Business Value SQL Server 2005 Mining s (Adhoc) s (Static) Decision Trees Clustering Time Series Introduced in SQL Server 2000 Easy Usability Difficult Sequence Clustering Association Naïve Bayes 5 new algorithms Graphical tools/wizards 12 embeddable viewers Tightly integrated with AS, DTS, Integration with Web/Office apps Neural Net Mining Model Algorithms Server Mining Architecture Microsoft Decision Trees Microsoft Clustering Microsoft Naïve Bayes Microsoft Time Series Microsoft Association Microsoft Sequence Clustering Microsoft Neural Network Microsoft Linear Regression Microsoft Logistic Regression Deploy BI Dev Studio (Visual Studio) Analysis Services Server Your Application OLE DB/ ADOMD/ XMLA Mining Model Mining Algorithm App Source

7 Programmatically Creating Models Analysis Management Objects Object model for administrative tasks Mining Extensions (DMX) Programmatically Creating Models Analysis Management Objects Object model for administrative tasks Mining Extensions (DMX) CREATE MINING MODEL TargetMailDT (CustID LONG KEY, Gender TEXT DISCRETE, CommuteDist TEXT DISCRETE, Education LONG CONTINUOUS, BikeBuyer LONG DISCRETE PREDICT ) USING Microsoft_Decision_Trees INSERT INTO TargetMailDT (CustID, Gender, CommuteDist, Education,, BikeBuyer) OPENQUERY ([My Source], SELECT CustID, Gender, ComDist, Education, BikeBuyer ) CREATE SESSION MINING MODEL TargetMailDT (CustID LONG KEY, Gender TEXT DISCRETE, CommuteDist TEXT DISCRETE, Education LONG CONTINUOUS, BikeBuyer LONG DISCRETE PREDICT ) USING Microsoft_Decision_Trees Dynamic mining using client data INSERT INTO TargetMailDT (CustID, Gender, CommuteDist, Education,, Local Mining Architecture Why Integrate Services Into Your App? Model File ADOMD.Net/OLE DB Local Analysis Services (msmdlocal) Mining Model Decision Tree/Clustering algorithms Your Application App Source Retrieve Process data efficiently: filtering, sorting, grouping, aggregations, etc. Present data in a variety of ways: lists, tables, charts, matrices Add visual appeal to data: fonts, colors, border styles, background images, etc. Enable interactive reports: collapsible sections, document map, bookmarks, interactive sorting, etc. Support printing and print preview Export to multiple formats (Microsoft Office Excel, PDF, XML) Integrate with managed report server environment: security, caching, scheduling, delivery, etc. Bottom Line: More functionality, less code

8 Services In Visual Studio 2005 Server Mode Microsoft Visual Studio 2005 includes Services functionality in standard editions and above Window Forms and ASP.NET report viewer controls make it easy to embed Services functionality in applications Integrated report designer for designing and embedding reports in language projects Freely redistributable with no run-time restrictions Server mode requires a SQL Server 2005 license Publish Designer (Visual Studio) Server Your Application Viewer (Remote Mode) Web Services API Processing and Rendering Source SQL Server Catalog (Metadata) Local Mode Designing In Local Mode Designer (Visual Studio) Embed Definition Viewer (Local Mode) Processing Your Application Source Retrieve creation is integrated with Windows or Web language project (Add New Item ) Integrates with Visual Studio data tools Build report from project data sources (XSD) Supports Sources window Supports Source Configuration Wizard Supports TableAdapter Configuration Wizard Full Interactivity Expand/Collapse sections Drillthrough reports, including drillthrough from charts Interactive sorting

9 Services Manager Introduced with SQL Server 2000 Open, extensible enterprise reporting solution authoring, management, delivery Office System integration VS.NET development environment SQL Server 2005 enhancements Integration with AS, DTS, management tools Developer enhancements Improved report interactivity Rich end-user reporting Rich Client Printing Multi-Valued Parameters Export to Excel, PDF Delivery Date Picker Parameters Sorting

10 Graphical Layout Builder A new ad-hoc report design tool for Services Targeted at business users who want to find and share answers to interesting questions Driven from a business model of the data so users do not need to understand the underlying data structures Fully integrated with Services and delivered in SQL Server 2005 Builder Client Users download and launch the client from Manager (new or existing report) Finished reports can be saved on the server Builder Model Designer For editing models used by Builder Auto-generation of models from data sources

11 Application Examples Resources Healthcare Builds models predicting health degradation in citizens Sends reports to physicians of top patients likely to get sick Alert Governments with predictable decease Marketing Traffic Sales Forecast Targeting client Real-time predictive traffic info delivered to web and mobile devices Everything. msdn.microsoft.com/sql SQL Server Mining SQL Server Forums