BI SURVEY 13 SUMMARY RESULTS FROM THE

Transcription

1 SUMMARY RESULTS FROM THE BI SURVEY 13 The BI Survey is the most comprehensive independent survey of the on-line analytical processing and business intelligence market This summary of the major result categories of The BI Survey 13 results was produced by MicroStrategy with full approval by BARC.

2 Copyright Information All Contents Copyright 2014 MicroStrategy Incorporated. All Rights Reserved. Trademark Information The following are either trademarks or registered trademarks of MicroStrategy Incorporated in the United States and certain other countries: MicroStrategy, MicroStrategy 6, MicroStrategy 7, MicroStrategy 7i, MicroStrategy 7i Evaluation Edition, MicroStrategy 7i Olap Services, MicroStrategy 8, MicroStrategy 9, MicroStrategy Distribution Services, MicroStrategy MultiSource Option, MicroStrategy Command Manager, MicroStrategy Enterprise Manager, MicroStrategy Object Manager, MicroStrategy Reporting Suite, MicroStrategy Power User, MicroStrategy Analyst, MicroStrategy Consumer, MicroStrategy Delivery, MicroStrategy BI Author, MicroStrategy BI Modeler, MicroStrategy Evaluation Edition, MicroStrategy Administrator, MicroStrategy Agent, MicroStrategy Architect, MicroStrategy BI Developer Kit, MicroStrategy Broadcast Server, MicroStrategy Broadcaster, MicroStrategy Broadcaster Server, MicroStrategy Business Intelligence Platform, MicroStrategy Consulting, MicroStrategy CRM Applications, MicroStrategy Customer Analyzer, MicroStrategy Desktop, MicroStrategy Desktop Analyst, MicroStrategy Desktop Designer, MicroStrategy ecrm 7, MicroStrategy Education, MicroStrategy etrainer, MicroStrategy Executive, MicroStrategy Infocenter, MicroStrategy Intelligence Server, MicroStrategy Intelligence Server Universal Edition, MicroStrategy MDX Adapter, MicroStrategy Narrowcast Server, MicroStrategy Objects, MicroStrategy OLAP Provider, MicroStrategy SDK, MicroStrategy Support, MicroStrategy Telecaster, MicroStrategy Transactor, MicroStrategy Web, MicroStrategy Web Business Analyzer, MicroStrategy World, Application Development and Sophisticated Analysis, Best In Business Intelligence, Centralized Application Management, Information Like Water, Intelligence Through Every Phone, Intelligence To Every Decision Maker, Intelligent E-Business, Personalized Intelligence Portal, Query Tone, Rapid Application Development, MicroStrategy Intelligent Cubes, The Foundation For Intelligent E-Business, The Integrated Business Intelligence Platform Built For The Enterprise, The Platform For Intelligent E-Business, The Scalable Business Intelligence Platform Built For The Internet, Office Intelligence, MicroStrategy Office, MicroStrategy Report Services, MicroStrategy Web MMT, MicroStrategy Web Services, Pixel Perfect, Pixel-Perfect, MicroStrategy Mobile, MicroStrategy Integrity Manager and MicroStrategy Data Mining Services are all registered trademarks or trademarks of MicroStrategy Incorporated. All other company and product names may be trademarks of the respective companies with which they are associated. Specifications subject to change without notice. MicroStrategy is not responsible for errors or omissions. MicroStrategy makes no warranties or commitments concerning the availability of future products or versions that may be planned or under development. Patent Information This product is patented. One or more of the following patents may apply to the product sold herein: U.S. Patent Nos. 6,154,766, 6,173,310, 6,260,050, 6,263,051, 6,269,393, 6,279,033, 6,400,265, 6,567,796, 6,587,547, 6,606,596, 6,658,093, 6,658,432, 6,661,340, 6,662,195, 6,671,715, 6,691,100, 6,694,316, 6,697,808, 6,704,723, 6,741,980, 6,765,997, 6,768,788, 6,772,137, 6,788,768, 6,798,867, 6,801,910, 6,820,073, 6,829,334, 6,836,537, 6,850,603, 6,859,798, 6,873,693, 6,885,734, 6,940,953, 6,964,012, 6,977,992, 6,996,568, 6,996,569, 7,003,512, 7,010,518, 7,016,480, 7,020,251, 7,039,165, 7,082,422, 7,113,993, 7,127,403, 7,174,349, 7,181,417, 7,194,457, 7,197,461, 7,228,303, 7,260,577, 7,266,181, 7,272,212, 7,302,639, 7,324,942, 7,330,847, 7,340,040, 7,356,758, 7,356,840, 7,415,438, 7,428,302, 7,430,562, 7,440,898, 7,486,780, 7,509,671, 7,516,181, 7,559,048, 7,574,376, 7,617,201, 7,725,811, 7,801,967, 7,836,178, 7,861,161, 7,861,253, 7,881,443, 7,925,616, 7,945,584, 7,970,782, 8,005,870, 8,051,168, 8,051,369, 8,094,788, 8,130,918, 8,296,287, 8,321,411, 8,452,755, 8,521,733, and 8,522,192. Other patent applications are pending.

3 TABLE OF CONTENTS Overview of The BI Survey 13 Page 3 Are The BI Survey 13 results consistent with the trends from the prior 11 years? Page 3 Are the differences between the mega-vendors and an independent vendor like MicroStrategy significant? Page 4 Are the differences between the specialty vendors and an independent vendor like MicroStrategy significant? Page 4 How important is product response time and performance? Page 4 How should organizations select products? Page 4 The BI Survey 13 summary results Page 4 Business value Page 5 Mobile BI Page 5 Innovation Page 6 Advanced information design Page 7 Product performance Page 8 Data volume Page 8 Product satisfaction Page 9 Vendor relationship Page 10 Vendor support Page 10 Conclusion Page 11 For more information about The BI Survey 13, please visit: www. bi-survey.com

4

5 THE BI Survey 13 - Summary Results SUMMARY RESULTS FROM THE BI SURVEY 13 The BI Survey is the world s most comprehensive independent survey of the business intelligence (BI) market space and products and is conducted annually by the Business Application Research Center (BARC). The BI Survey 13 follows eleven successful editions of The BI Survey. It is important to note that last year the numbering of The BI Survey has changed so that The Survey number now aligns with the year in which the data was collected. Overview of The BI Survey The Survey is the largest and most thorough fact-based analysis of the BI market currently available, using 12 years of experience to analyze market trends and debunk many myths surrounding the BI industry. The BI Surveys provide insight into actual BI implementation experiences as well as the usage patterns and technical characteristics of the most popular BI products. The BI Surveys examine how companies choose their BI products, how they use these products, and how successful they are with them. The Survey is also notable in that it takes on challenging issues not covered by typical BI product reviews, such as barriers to wider deployments and factors leading to product discontinuance. As a result, the Survey is uniquely positioned to detail BI purchasing and deployment best practices. The BI Survey conclusions are solely based on statistical analysis of information provided by respondents who have delivered business benefit. This year, statistically-significant data was collected for 30 different BI products. This edition has increased the range of products reviewed. It includes not just products from well-known BI giants, but also specialist tools from much smaller vendors and open source vendors. Each of these 30 BI products was analyzed across 28 Key Performance Indicators (KPIs). Products analyzed in The BI Survey 13, listed in alphabetical order and including the number of responses per product, were: arcplan (98), Bissantz (92), BOARD (74), Corporate Planning (34) Cubeware Cockpit (88), Cyberscience (60), Dimensional Insight (61), Evidanza (29), IBM Cognos BI (96), IBM Cognos TM1 (51), Infor (85), Information Builders (52), Jedox (127), Logi Analytics (41), Microsoft Excel (44), Microsoft SSAS (145), Microsoft SSRS (50), MicroStrategy (128), Oracle Essbase (54), Oracle BI Foundation Suite (47), Pentaho (36), Phocas (68), Pyramid Analytics (45), QlikTech (178), SAP BO Webl (71), SAP BW (103), SAS (36), Tableau (48), TARGIT (62), Yellowfin (30) and Others (133). This BI Survey 13 Summary, prepared by MicroStrategy using BARC s results and charts, focuses not only on the six largest BI platform vendors, including MicroStrategy, SAP Business Objects, SAP BW, Oracle BIEE, IBM Cognos, and Microsoft SSRS to make direct comparisons within a like group of vendors typically considered for similar types of BI applications but also the specialty vendors Tableau and QlikTech to compare visual data discovery capabilities and to account for multiple product offerings within a product suite. The BI Survey is 100% independent of any BI vendor influence and is not commissioned, funded, suggested, or sponsored by vendors in any way. Vendors have no input into the questions or into the analysis of Survey results. Therefore, business intelligence consumers can be reassured that the survey accurately reflects real-world experiences of individuals in companies like theirs and is free from vendor influence and author bias. In total, 3,149 people responded to The Survey with 2,298 answering a series of detailed questions about their usage of a named product. The KPIs are calculated so that better-than-average products always have scores of greater than 1.0, while less good products score less than 1.0. When viewing the peer group KPI charts, note that the average for each peer group will usually be either higher or lower than 1.0 because the peer groups are all subsets of the overall sample. The products are sorted by value, the better the product the higher the value. The average is displayed as a green bar and separates the products into two groups, the ones that have performed better than average and the ones that have performed worse than average. Are The BI Survey 13 results consistent with the trends from the prior 11 years? Though the results range widely between vendors, most of these findings are consistent with prior survey findings. Interestingly, the same vendors 3

6 which outperformed in The BI Survey 13 have outperformed in the market over the previous eleven years. Similarly, the set of vendors who did not generally perform well this year have also not fared well in the past eleven years of the survey. Specifically, MicroStrategy has scored at, or been very close to, the top in Data Volume, Mobile BI, Innovation, Business Benefit, Vendor Support, and Product Quality/Satisfaction and across all Scalability and Performance categories for eleven years running. In contrast, SAP BO has been at or near the bottom in these same categories over the same twelve-year time frame. Are the differences between the mega-vendors and an independent vendor like MicroStrategy significant? Based on the survey results, significant differences exist between the megavendors and an independent vendor like MicroStrategy. As an independent or best-of-breed vendor MicroStrategy is wholly focused on BI, optimized for open system solutions and has been developed completely organically. Conglomerate or mega-vendors are vendors such as SAP BO, IBM Cognos, Oracle and Microsoft that offer a full enterprise software stack and optimize their BI offerings for their software stack and grow by acquisition. This document will show that the mega-vendors often score lower than independent vendors like MicroStrategy. Furthermore, MicroStrategy outperformed the conglomerate vendors in most key areas such as Data Volume, Mobile BI, Innovation, Business Benefit, Product Satisfaction, Support Quality, Query Performance, Advanced Information Design and Recommendation among others. Are the differences between the specialty vendors and an independent vendor like MicroStrategy significant? Based on the survey results, significant differences exist between specialty vendors like Tableau and QlikTech and an independent vendor like MicroStrategy. MicroStrategy offers agility and excellent visual data discovery capabilities along with governance. This document shows that MicroStrategy outperformed Tableau and QlikTech in key areas like Investment, Data Volume, Mobile BI, Product Satisfaction, Chosen as Standard and Competitive Win Rate. How important is product response time and performance? The BI Survey 13 looked closely at the impact of query performance and found, as in every year the survey has been conducted, the most frequentlyreported product problem continues to be poor query performance. If users have to wait too long every time they run a query, they become frustrated and user adoption is poor. As expected, The BI Survey 13 also found that fast query performance continues to be amongst the most frequently cited selection criteria for software. According to The BI Survey 13, sites that used good query performance as a key selection criterion were more successful in business terms than those that did not. 1 Organizations should prioritize query performance as a key criterion in their vendor selection to maximize overall project success. As BARC says, Most participants focused instead on criteria such as functionality (47 percent), ease-of-use for report recipients (42 percent), fast query performance (36 percent) and ease-ofuse for report designers (34 percent). 2 This continues to remain equally valid in The BI Survey 13. How should organizations select products? The BI Survey 13 looked at the impact of multi-product competitive evaluations on project success. Once again, BI projects based on a multiproduct competitive evaluation and selection process achieve far more business benefits than those based on a single product selection or no formal product evaluation. Vendors such as SAP Business Objects and Oracle, which are selected most often for corporate reasons, such as product bundling, without a multi-product competitive evaluation achieve low scores in all of the business benefit and project success areas analyzed. The BI Survey 13 Summary Results This document evaluates MicroStrategy against different peer groups like Competitive peer group, Large International Vendors, Dashboard Vendors and the specialty vendors QlikTech and Tableau. The Competitive peer group is a custom peer group and represents the set of products that are typically considered for similar types of enterprise BI applications. It consists of the following vendors: MicroStrategy, SAP Business Objects, IBM Cognos, Oracle OBIEE, Microsoft SSRS, SAP BW. There is also a comparison with the specialty vendors QlikTech and Tableau who offer dashboarding and visual data discovery capabilities. The document evaluates the peer groups across a number of the KPIs analyzed in The BI Survey 13. The KPIs presented here are grouped into three critical areas to allow the reader to quickly assess how the BI platform products perform in real-world deployments: Business Value Product Performance Vendor Relationship 4 1 BARC The BI Survey 13 The Results by Melanie Mack and Dr. Carsten Bange, January, BARC The BI Survey 13 Best Practices by Melanie Mack and Dr. Carsten Bange, January, 2014

7 THE BI Survey 13 - Summary Results Business value Mobile BI: How many sites currently use Mobile BI with their BI tool MicroStrategy (1) 2.07 Tableau (2) Oracle BI Found. Suite (3) QlikTech (4) IBM Cognos BI (5) Average SAP BW (6) SAP BO Webl (7) Microsoft SSRS (8) Average MicroStrategy Competitive Peer Group BARC THE BI Survey 13 Mobile BI measures whether a BI product is being used for mobile BI functionality in the respondent s company. As can be seen in the figure above, MicroStrategy scored 88% higher than the average, over 300% higher than SAP BO, 65% higher than IBM Cognos, 53% higher than QlikTech and 33% higher than Tableau. As BARC testifies, Our experience in the field is that mobile BI is strongly demanded by customers and commonly used in the early stages of a software selection process. 3 Customers have responded positively to MicroStrategy s high investment and focus on mobile BI. Its solution supports not just BI but also a range of broader mobile functions, said Dr. Carsten Bange, founder and CEO of BARC. Another expected result because of MicroStrategy s focus and investment in the mobile BI market over the past few years. The company spotted the trend before other vendors and was therefore first into market with a well-received solution. The larger vendors do not perform as well with their technology in this area. Their offerings lack the functionality and acceptance that users expect from them. MicroStrategy focused on the ipad early and bet on the right horse. MicroStrategy s mobile product is a full mobile enterprise application development platform. BI is just the starting point as MicroStrategy also enables transactions and rich multimedia and analytics. Transactions include mapping, alerting, approval management, and editable grids and data entry. Rich multimedia enables the embedding of videos, ebooks, PDF documents, games, and other media directly into the BI app for a fully integrated experience, ensuring users never have to leave the application. Mobile is a clear example of MicroStrategy s innovation and tendency to be on the forefront of offering new BI functionality based on leading edge technologies, said Dr. Carsten Bange. 3 BARC The BI Survey 13 The Results by Melanie Mack and Dr. Carsten Bange, January,

8 Innovation: Combines the Cloud BI, Collaboration, Mobile BI and Advanced information design KPIs to measure the product s level of innovation MicroStrategy (1) QlikTech (2) Oracle BI Found. Suite (3) SAS (4) IBM Cognos BI (5) Oracle Essbase (6) Information Builders (7) Average Microsoft SSRS (8) Infor (9) IBM Cognos TM1 (10) Microsoft SSAS (11) Microsoft Excel (12) SAP BO Webl (13) SAP BW (14) Average Large International Vendors Peer Group BARC THE BI Survey 13 Innovation is an aggregate KPI comprised of the following root KPIs: Cloud BI, Collaboration, Mobile BI and Advanced information design. The BI Survey 13 asked respondents whether they are using the above technologies or functionality as provided by their vendors. As seen in the figure above, respondents are choosing MicroStrategy for these new technologies far more frequently than its peers. MicroStrategy rated 43% more innovative than the average of this peer group, 32% more innovative than Cognos, and 121% more innovative than SAP BO. If they are to compete successfully, vendors such as MicroStrategy must pay great attention to market trends and innovation. This is where the company excels and its leading position is endorsed by The Survey s respondents. MicroStrategy s new innovations are well integrated into its BI suite and it is one of the market leaders in mobile BI and visualization. But rather than focusing on short term innovations, MicroStrategy has a long term strategy based on releasing stable products that are highly integrated. Companies also perceive the company as an innovative vendor having addressed cloud and mobile BI quite early and implemented technology much better than other, larger vendors, said Dr. Carsten Bange. 6

9 THE BI Survey 13 - Summary Results Advanced information design: How many sites currently use advanced information design with their BI tool Infor (1) 1.37 MicroStrategy (2) 1.15 Information Builders (3) QlikTech (4) SAS (5) Oracle Essbase (6) Microsoft SSRS (7) Average Microsoft SSAS (8) Oracle BI Found. Suite (9) IBM Cognos BI (10) SAP BO Webl (11) IBM Cognos TM1 (12) SAP BW (13) 0.45 Microsoft Excel (14) 0.35 Average Large International Vendors Peer Group BARC THE BI Survey 13 Advanced Information Design measures how many sites are using advanced information design with their BI product. The BI Survey 13 asked respondents whether the tool they are most familiar with is being used for advanced information design by their company. As seen in the figure above, MicroStrategy is one of the top vendors compared to its peers. MicroStrategy leads in all information design peer groups and shows the tool can support information design standards, said Dr. Carsten Bange. MicroStrategy rated 35% more than the average of this peer group, 57% more than Cognos, and 61% more than SAP BO, and 17% more than QlikTech under the Advanced Information Design KPI. 7

10 Product Performance Data volume: The average volume of data reported in respondents largest applications MicroStrategy (1) SAP BW (2) Oracle BI Found. Suite (3) Average SAP BO Webl (4) 1.75 Microsoft SSRS (5) 1.39 Tableau (6) IBM Cognos (7) QlikTech (8) 0.05 Average MicroStrategy Competitive Peer Group BARC THE BI Survey 13 Once again MicroStrategy beats every one of its competitors in the data volume category. For the twelfth consecutive year, MicroStrategy customers indicated that they, by far, analyzed the largest volumes of data. As the figure above shows, MicroStrategy customers analyze median data volumes that are 95% larger than the average in this peer group, 720% larger than QlikTech customers, 356% larger than QlikTech customers, 361% larger than IBM Cognos customers, and 134% larger than SAP BO customers. The company tops each peer group in the data volume KPI this is unique and consistent with previous years results. From our research and consulting experience we know MicroStrategy is often a choice in large data warehouse projects. This reflects upon the strength of its ROLAP engine and new inmemory cubes. Its administration features also support large numbers of users and manage query performance for large databases, said Dr. Carsten Bange. Cube-based OLAP products, such as those employed by some of the Microsoft and Cognos products, inherently limit the level of detail that can be analyzed as their speed is based on their data being pre-aggregated. These products are optimized for analysis of summary-level or small volumes of data, but are not suitable for the more valuable, transaction-level BI applications. In contrast, MicroStrategy s proprietary Relational OLAP (ROLAP) technology allows interactive analysis of multiple terabyte-sized data warehouses, including hundreds of TBs and at the speed of thought so analyses feel natural. 8

11 THE BI Survey 13 - Summary Results Product satisfaction: Measures the frequency of problems encountered with the product MicroStrategy (1) Oracle BI Found. Suite (2) QlikTech(3) Microsoft SSRS (4) IBM Cognos BI (5) Average SAP BW (6) SAP BO Webl (7) Average MicroStrategy Competitive Peer Group BARC THE BI Survey 13 The Product Satisfaction KPI measures product problems. As this is a negative measure, the KPI is lower with a larger number of problems and increases as the number of problems decreases. MicroStrategy s lead in product satisfaction is clear from the above figure. The MicroStrategy platform has been organically designed and built from the ground up with no part of it having been acquired externally. It s one of the most unified and organic BI platforms in the market. The result is a higher level of quality. In contrast, mega-vendor BI platforms like Oracle OBIEE, IBM Cognos, and SAP BO have been cobbled together from numerous acquisitions. Users see substantial differences in quality between products organically designed and developed by a single company and products that are the result of numerous acquisitions, some of which cause redundancy and others that just add complexity. MicroStrategy shows itself to be one of the top players when it comes to customer satisfaction. This is in no small part due to its clean, modern technology and good customer support, said Dr. Carsten Bange. He added, Customers really like the integrated, modern and clean architecture of MicroStrategy s BI suite and so it is no surprise that it achieves the leading ranking in this category. 9

12 Vendor relationship Vendor support: Measures user satisfaction with the level of vendor support provided for the product Information Builders (1) 1.23 SAS (2) MicroStrategy (3) Microsoft SSAS (4) QlikTech (5) Microsoft SSRS (6) Infor (7) SAP BW (8) IBM Cognos TM1 (9) Average IBM Cognos BI (10) Oracle BI Found. Suite (11) Oracle Essbase (12) Microsoft Excel (13) 0.33 SAP BO Webl (14) 0.14 Average Large International Vendors Peer Group BARC THE BI Survey 13 The level and depth of vendor support is becoming increasingly critical as BI becomes more integrated into organizations operations. Better product support often results in higher application success rates and helps to ensure customers get full value from their BI investments. A consistent finding throughout The BI Surveys is that companies striving to maximize the business benefits of a BI project should prioritize customer support quality as a key evaluation criterion. The three mega vendors (Oracle, IBM and SAP) customers have traditionally been the least satisfied with the quality of support. MicroStrategy speculates that low overall product support quality ratings for these vendors likely stems from their strategy to acquire rather than to organically develop their products. Given the historically poorly rated support of acquired technologies, it is likely that customers of all BI platforms resulting from large mergers will see continued ongoing support challenges. As shown in the figure above, MicroStrategy scores 29% higher than the average in this peer group, 621% higher than SAP BO, 60% higher than Oracle and 40% higher than IBM Cognos. 10

13 THE BI Survey 13 - Summary Results Conclusion The BI Survey 13, the leading independent survey of real-world BI implementations provides unique, statistically significant insight into actual BI implementations and customer experiences with various BI products. The results of the survey provide an important guide to the product capabilities and support that users can expect from the various vendors. Survey respondents are both critical and candid in their assessments. Since the choice of a BI product has a significant impact on overall BI project success, it is recommended that meaningful product evaluations, starting with a close review of the product benchmarks in The BI Survey 13, should be conducted when embarking on new BI projects. Notable in The BI Survey 13 results are the widely varying customer experiences and product results among the BI products. Some of the many categories in which clear vendor trends have emerged over the past twelve years include: In addition to achieving high ratings in the large international vendor peer group, MicroStrategy also achieved high ratings in Dashboard vendor peer group. Over a number of consecutive BI Surveys, MicroStrategy has consistently scored at or near the top of its peer group in Data volume, Performance, Mobile and Innovation. This trend has continued in The BI Survey 13. This is a reflection of MicroStrategy s continued focus on the quality and performance of the platform as well as its dedication to innovation, said Dr. Carsten Bange, Founder and CEO of BARC. He added, The results of The BI Survey match closely with BARC s field experience. MicroStrategy is one of the top vendors in query performance, user satisfaction, and mobile support. It also shows it can compete not only with the big vendors but also in the Ad-hoc Analysis and Dashboard peer groups with smaller and specialized products. Data Volume Vendor Support Innovation Mobile BI Chosen as a Standard Investment Product Satisfaction Competitive Win Rate Melanie Mack, co-author of The BI Survey, stated: I attribute MicroStrategy s continued high rankings in The BI Survey to its focus on maintaining the integrity and quality of its unified platform. In addition, the company continues to be at the forefront of new functionality. In the above categories, for the select peer group, MicroStrategy has consistently been a leader, sometimes by a wide margin, in the twelve years The BI Survey has been conducted. MicroStrategy ranked first in Data Volume, Mobile, and Innovation among large international vendors in a comprehensive survey of companies using business intelligence software products. 11

14

15

16 microstrategy.com 1850 Towers Crescent Plaza Tysons Corner, VA Copyright All Rights Reserved. COLL