Open Source meets Business Intelligence An Introduction to Pentaho Seminar Business Intelligence 06.02.07 Konstanz Monika Podolecheva
Agenda BI concept and goals BI Market Overview Proprietary BI Vendors Open Source and BI Open Source Market Open Source BI Vendors OS SW: pros and cons From Data gathering, Processing and Analysis to Report JasperSoft Inc. Pentaho Products Pentaho Examples and Demo
BI: Concept and Objectives BI Concept: Techniques as Data warehousing, Data mining, and Reporting based on gathering, storage, preprocessing, analysis and reporting for data Objectives: help companies to become a more comprehensive knowledge of the factors affecting their business and help companies to make better business decisions. Huge amount of unstructured data BI Solutions Strategic planning, deriving trends, objectives definition
BI Market Segmentation and Overview Query, reporting, and analysis SW includes ad hoc query and multidimensional analysis tools as well as dashboards and production reporting tools. Query and reporting tools are designed specifically to support ad hoc data access and report building by either IT or business users. Advanced analytics software includes data mining and statistical software and uses technologies such as neural nezworks, rule induction, and clustering, etc. to discover relationships in data and make predictions Source: IDC, July 2006
BI Tools Revenue Share by Region and by Operating Environment Source: IDC, July 2006
BI Market Facts and Trends BI market grows because applying BI tools leads to better market analysis better budget controlling better strategy planning Broader adoption of BI software is expected to continue as more end users gain access to query and reporting tools and as organizations embed BI software into operational applications supporting all business processes A IDC shows an optimistically trend: therefore brings higher rate of return Source: IDC, August 2006!The BI market is dominated by larger, full-service companies, such as IBM and Oracle, and specialized vendors, such as SAS, Cognos, Business Objects and Hyperion.
Proprietary BI Vendors Arcplan Actuate Business Objects Cognos Hyperion Solutions Information Builders Microsoft MicroStrategy Oracle Panorama Software SAP SAS Institute, etc. Source: Gartner (January 2007)
Open Source and BI Open Source Market First signs that OOS is coming into the BI tools market: Vendors such as Pentaho, JasperSoft, and Actuate clearly display the first signs of a potential market niche. The impact of open source BI tools will be very limited over the next five years During the latter part of the current 15-year cycle of the BI market, OSS may develop into a stronger competitive force (IDC, 2006) especially because of the costs for the commercial tools. Trends: OS Databases widely used BI OS Strategy: JasperSoft Idea: BI becomes embedded in individual applications and much more transepent. And by making a complex function affordable, that function becomes universal.
Open Source BI Vendors Pentaho Complete solution with Pentaho BI Suite Palo MOLAP-Server (German vendor Jedox) JasperSoft Specialist for Reporting- Tools such as JasperReports BIRT Reporting-Solution of Eclipse Foundation (taken over by Acuate) Weka Algorithm collection for Data Mining of the University of Waikato
From Data gathering, Processing and Analysis to Report (1) Data Gathering and Storage: open source databases MySQL, PostgreSQL, and the Jedox database Palo Preprocessing: Extraction, Transformation & Loading (ETL): Tool Kettle, the CloverETL-Framework and Enhydra Octopus Analysis: OLAP (On Line Analytical Processing) The most popular free OLAP-Server is the Java based Mondrian-Project ; Another algorithm collection for Data Mining is Weka
From Data gathering, Processing and Analysis to Report (2) Reporting-Engines such as the Java-Bibliothek JasperReports (JasperSoft) Visualizing the Reports - ireport-designer (Jaspersoft) Further: combining OLAP-Server JasperAnalysis and the ETL- Tool JasperETL! JasperIntelligence-Suite BI-Framework. Pentaho: offers ETL-, Analysis-, Reporting- und Workflow- Solutions that can be combined in the Pentaho BI Suite. These solutions can be integrated in Standalone-Applications under the Mozilla Public License, Version 1.1.) The German partner of Pentaho is Ancud IT since Mai 2006.
OS SW: pros and cons Advantages OSS no license costs reduced dependence on software vendors flexible and easier to customize Disadvantages OSS lack of long-term support lack of long-term maintenance
JasperSoft Inc. JasperSoft is founded 2004 in San Francisco, CA, U.S.A with less than 50 employees. JasperSoft is delivering Commercial Open Source in the area of Business Intelligence Specialist in Reporting, Analysis and Integration Open Source Products: JasperReport - delivers reports to the screen, printer or into PDF, HTML, XLS, CSV and XML files; can stand alone or be embedded directly into a user's application to give it advanced reporting capabilities. JasperServer - interactive and managed reporting for JasperReports JasperAnalysis - interactive data analysis / OLAP server JasperETL - high-performance data integration ireport - powerful graphical report designer Commercial line: JasperDecisions
Pentaho Pentaho is founded 2004 in Orlando, U.S.A Pentaho manages, facilitates, supports, and takes the lead development role in the Pentaho BI Project - a pioneering initiative by the Open Source development community to provide organizations with a comprehensive set of Business Intelligence (BI) capabilities that enable them to radically improve business performance, efficiency, and effectiveness. Experienced team: Founded by industry veterans with a track record of delivering successful BI products for leading commercial vendors including Business Objects, Cognos, Hyperion, IBM, Oracle, and SAS.
Pentaho Products: Reporting Pentaho Reporting allows organizations to easily access, format, and distribute information to employees, customers, and partners (former known as JFreeReport) Pentaho Reporting has the following features: Full on-screen print preview; Output to the screen, printer or various export formats: PDF, HTML,CSV, Excel Support for servlets (uses the JFreeReport extensions) Complete source code included (subject to the GNU LGPL); Extensive source code documentation Unmatched flexibility through a heavily modularized architecture etc
Pentaho Products: Analysis Pentaho Analysis (The Mondrian project) helps to operate with maximum effectiveness by gaining the insights and understanding to make optimal decisions; Mondrian is an OLAP server that enables you to interactively analyze very large datasets stored in SQL databases without writing SQL. Pentaho Analysis has the following features: Integrates directly with Microsoft Excel PivotTable services, supporting data refresh, drill-down, data pivoting and more Provides an easy, interactive way for business users to analyze critical business information, by exploring the data to quickly uncover trends or anomalies. For example, a user looking at sales information for last year could easily drill down from the yearly summary to break out sales by quarter, compare sales across product lines, or analyze specific sales performance in different geographic regions Allows users to enhance the data with Excel formatting and Excel charts etc
Pentaho Products: Data Integration Pentaho Data Integration (The Kettle project) delivers powerful Extraction, Transformation and Loading (ETL) capabilities Pentaho Data Integration is used for: Data warehouse population with built-in support for slowly changing dimensions, junk dimensions and much, much more. Export of database(s) to text-file(s) or other databases Import of data into databases, ranging from text-files to excel sheets Data migration between database applications Exploration of data in existing databases. (tables, views, synonyms, ) Information enrichment by looking up data in various information stores (databases, text-files, excel sheets, ) Data cleaning by applying complex conditions in data transformations Application integrationist
Pentaho Products: Dashboards Pentaho Data Integration (adopted Kettle project) provide immediate insight into individual, departmental, or enterprise performance and gives business users the critical information for understanding and improvement organizational performance
Pentaho Products: Data Mining Pentaho Data Mining WEKA is integrated in Pentaho Data Mining and provides the BI suite with a the following set of machine learning algorithms: Clustering Neural Networks Decision Trees etc. Graphical data mining design and administration tools are integrated Graphical user interfaces are provided for data pre-processing, classification, regression, clustering, association rules, and visualization.
Pentaho Exapmles: Budged Actual Input Data
Pentaho Analysis: Example Filtering Options
Pentaho Analysis: Example
Pentaho Analysis: Example
Pentaho Analysis: Example
Pentaho: Dashboard Example
Thank you for your attention!
Literatur Worldwide Business Intelligence Tools 2005 Vendor Shares, July 2006 Source: http://www.sas.com/news/analysts/idc_bi_0706.pdf Worldwide Business Intelligence Tools 2005 Vendor Shares, October 2006 Source: http://www.sas.com/news/analysts/idc_analytics2_1006.pdf Alexandra Kleijn, Business Intelligence mit Open Source, Heise Open, 2006. Source: http://www.heise.de/open/artikel/73725 Martin LaMonica : Open source meets business intelligence, CNET News.com, published: April 23, 2006, 2006. http://news.com.com/2100-7344_3-6064045.html http://www.jaspersoft.org http://www.pentaho.com