The Inverted Data Warehouse based on TARGIT Xbone -- How the biggest of data can be mined by the little guy Presented by Dr. Morten Middelfart, TARGIT CTO targit.com/research morton@targit.com @dr_morton on Twitter
According to Gartner TARGIT is the world largest BI vendor for companies using Microsoft Dynamics products. TARGT has a concentration on Microsoft Dynamics that no other vendor is even close to replicate Gartner 2013 - More than 3500 of our 4800 clients run on Dynamics - Over 330,000 users wordwide Most competitive BI product in the world BARC 2012 Highest win rate in competitive deals BARC 2012 In Gartner s Magic Quadrant for ease of Use the last 4 consecutive years. BARC survey listed TARGIT as the Easiest to Use BI solution by a wide margin and TARGIT is used by more users within an organization than any other BI platform.
Customer Sample 4800+ World-Wide since 1997 Retail and Wholesale Service Manufacturing
Decision Based on Facts Use all available information Action Changes Communication Reaction/Action Orientation Analytics Simulation Observation Dashboards Reports Agents
5
Hive/Hadoop & BigQuery
Why don t we query 32.5 BILLION rows of search data at least daily to see how we rank?
TARGIT your decisions in fewest clicks Big Data Data that exists in such large amounts or in such unstructured form that it is difficult to handle in the traditional data warehouse or any other type of database. Right?
From Control to No Control
Challenge by Big Data from SME perspective o Loss of Control o Data amounts overwhelming o Data Scientist rather than an Accountant -> Sampling!
Prior Art ETL -> DW Query, then Present Drag-Drop Dimensions/Measures
DATA SOURCES SERVER CLIENT AX 2.5 2012r2, Oracle, MS SQL etc. Retail MS SQL, UC Cisco, MS SQL DWH etc. Analysis Services 2000-2012 TARGIT Enterprise Edition Other data sources and databases MY SQL SQ Server 2000-2012 Oracle SADAS EXASOL IBM DB2 Generic Connections Excel Flat files
DATA SOURCES SERVER CLIENT AX 2.5 2012r2, Oracle, MS SQL etc. Retail MS SQL, UC Cisco, MS SQL DWH etc. Analysis Services 2000-2012 TARGIT Enterprise Edition Other data sources and databases MY SQL SQ Server 2000-2012 Oracle SADAS EXASOL IBM DB2 Generic Connections Excel Flat files
TARGIT Xbone o NoETL -- just drag-drop o Auto-Detect Dimensions & Measures o Extended use of Dimensions & Measures o Dropbox aware
Inverted Data Warehouse (IDW) o Inspiration from CERN s LHC o Shotgun Approach ; equal to formulating hypotheses; data scientist o No single point of failure (parallel Query Nodes have also been tested)
Conclusion Possible to Query 32.5B rows for the Little Guy Robust Operationally & Strategically Useful
References 1. Stephen Few. Show Me the Numbers: Designing Tables and Graphs to Enlighten. Second Edition Analytics Press, 2012. 2. Nick Heath. Cern: Where the Big Bang meets big data. TechRepublic www.techrepublic.com/blog/european-technology/cern-where-the-big-bang-meets-big-data/, as of August 14th, 2013. 3. Charles Roe, IDC summary. The Growth of Unstructured Data: What To Do with All Those Zettabytes? Dataversity www.dataversity.net/the-growth-of-unstructured-data-what-are-we-going-to-do -with-all-those-zettabytes/, as of August 12th, 2013. 4. R. Kimball. The Data Warehouse Lifecycle Toolkit: Expert Methods for Designing, Developing, and Deploying Data Warehouses. Wiley, 1998. 5. M. Middelfart. CALM: Computer Aided Leadership & Management. iuniverse, 2005. 6. M. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97{98, 2007. 7. M. Middelfart. Presentation of data using meta-morphing. United States Patent 7,779,018. Issued August 17th, 2010. 8. M. Middelfart. Method and user interface for making a presentation of data using metamorphing. United States Patent 7,783,628. Issued August 24th, 2010. 9. M. Middelfart. Hyper related OLAP. United States Patent 8,468,444. Issued June 18th, 2013. 10. M. Middelfart. Intelligent Wizard for human language interaction in Business Intelligence. To appear in ebiss 2013. 11. Wikipedia. Column-oriented DBMS en.wikipedia.org/wiki/column-oriented DBMS, as of August 21st, 2013. 12. TARGIT. TARGIT Xbone { Ad-hoc analytics for everyone www.targit.com/en/experience-targit/products/xbone, as of August 12th, 2013.
Future Work Speech!
targit.com for fully functional demo morton@targit.com @dr_morton on Twitter