November 6, 2013 Dresner Advisory Services, LLC 2013 Edition Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study Licensed to TIBCO Software
Disclaimer This report should be used for informational purposes only. Vendor and product selections should be made based on multiple information sources, face-to-face meetings, customer reference checking, product demonstrations and proof-of-concept applications. The information contained in all Wisdom of Crowds Market Study Reports reflects the opinions expressed in the online responses of individuals who chose to respond to our online questionnaire, and does not represent a scientific sampling of any kind. Dresner Advisory Services, LLC shall not be liable for the content of Reports, study results, or for any damages incurred or alleged to be incurred by any of the companies included in the Reports as a result of its content. Reproduction and distribution of this publication in any form without prior written permission is forbidden. 2
Business Intelligence: A Definition We define Business intelligence (BI) as Knowledge gained through the access and analysis of business information. Business Intelligence tools and technologies include query and reporting, OLAP (on-line analytical processing), Data Mining and advanced analytics, end-user tools for ad hoc query and analysis and dashboards for performance monitoring. Howard Dresner, The Performance Management Revolution: Business Results Through Insight and Action (John Wiley & Sons, 2007) 3
Introduction This year we celebrated the sixth anniversary of Dresner Advisory Services! Our thanks to all of you that have been with us along the way encouraging and challenging us! We published our first Wisdom of Crowds Business Intelligence Market Study in 2010 with a goal of reaching and informing Business Intelligence users evaluating BI vendors and products. That year we also published our first thematic research study - Mobile Business Intelligence. Since then, we have published more thematic reports on Mobile Computing, Cloud BI and Collaborative BI. And, for 2013, we have exceeded all expectations and have added Embedded BI, BI Emerging Technologies and, this, our inaugural Small and Mid-Sized Enterprise (SME) Business Intelligence Market Study Report. The Small and Mid-Sized Enterprise Business Intelligence Market Study is a breakout of our flagship 2013 Wisdom of Crowds Business Intelligence Market Study. It was prepared by Dresner Advisory Services with assistance from Jim Ericson, a well-known consultant and journalist in the Business Intelligence field. Like our latest thematic reports, the 2013 Small and Mid-Sized Enterprise Business Intelligence Market Study benefits from enhanced user trending and technology sections in our flagship study. It ranks 21 vendors in five segments and taps Small and Mid-Sized Enterprise business interest in areas such as Cloud Computing plans and where priorities are changing. In closing, we re very excited about both the market and our ability to continue to add substantial perspective and value to it! Thanks for your support! Best, Howard Dresner Chief Research Officer Dresner Advisory Services 4
Contents Business Intelligence: A Definition... 3 Introduction... 4 Benefits of the Study... 8 A Consumer Guide... 8 A Supplier Tool... 8 External Awareness... 8 Internal Planning... 8 About Howard Dresner and Dresner Advisory Services... 9 About Jim Ericson... 10 Survey Method and Data Collection... 11 Data Collection... 11 Data Quality... 12 Vendor/Market Categories... 13 Executive Summary... 15 Study Demographics... 17 Geography... 17 Functions... 18 Vertical Industries... 19 Analysis & Trends... 21 How SMEs are Different... 22 Length of Experience... 22 Adoption of Cloud-Based Business Intelligence... 23 Technology Priorities Changing... 25 Departments/Functions Driving Business Intelligence... 26 Departmental Drivers... 26 User Roles Targeted for Business Intelligence... 28 Objectives for Business Intelligence... 29 Business Intelligence Objectives by Function... 30 Penetration of Business Intelligence... 31 5
SME Success with Business Intelligence... 33 Number of Business Intelligence Tools in Use... 34 SME Key Related Technologies / Initiatives... 35 SME Vendor Stacked Rankings... 38 Business Intelligence Titans... 39 Large Established Pure-Play Business Intelligence Vendors... 39 High Growth Business Intelligence Vendors... 40 Specialized Business Intelligence Vendors... 40 Emerging Business Intelligence Vendors... 41 Detailed SME Vendor Scores... 42 Actuate Detailed Score for SME... 43 Birst Detailed SME Score... 44 Dimensional Insight Detailed SME Score... 45 Dundas Detailed SME Score... 46 IBM Detailed SME Score... 47 idashboards Detailed SME Score... 48 Infor Detailed SME Score... 49 Information Builders Detailed SME Score... 50 Jaspersoft Detailed SME Score... 51 Jedox Detailed SME Score... 52 Logi Analytics Detailed SME Score... 53 Microsoft Detailed SME Score... 54 Oracle Detailed SME Score... 55 Panopticon Detailed SME Score... 56 Pentaho Detailed SME Score... 57 Phocas Detailed SME Score... 58 QlikTech Detailed SME Score... 59 SAP/BusinessObjects Detailed SME Score... 60 Tableau Detailed SME Score... 61 Tibco Spotfire Detailed SME Score... 62 6
Yellowfin Detailed SME Score... 63 SME Business Intelligence Buyer s Guide... 64 Traditional Platform Support - Vendors (A D)... 64 Traditional Platform Support - Vendors (I)... 65 Traditional Platform Support - Vendors (J M)... 66 Traditional Platform Support - Vendors (O P)... 67 Traditional Platform Support - Vendors (Q T)... 68 Traditional Platform Support - Vendors (T Z)... 69 Cloud Platform Support - Vendors (A D)... 70 Cloud Platform Support - Vendors (I)... 71 Cloud Platform Support - Vendors (J-M)... 72 Cloud Platform Support - Vendors (P-S)... 73 Cloud Platform Support - Vendors (S-Z)... 74 Mobile Platform Support - Vendors (A-D)... 75 Mobile Platform Support - Vendors (I)... 76 Mobile Platform Support - Vendors (J-M)... 77 Mobile Platform Support - Vendors (Q-P)... 78 Mobile Platform Support - Vendors (Q-T)... 79 Mobile Platform Support - Vendors (T-Z)... 80 Appendix - The 2013 Wisdom of Crowds Business Intelligence Market Survey Instrument... 81 7
Benefits of the Study The Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study provides a wealth of information and analysis offering value to both consumers and producers of Business Intelligence technology and services. A Consumer Guide As an objective source of industry research, consumers use the Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study to understand how their peers are using and investing in Business Intelligence and related technologies. Using our trademarked 33-dimension vendor performance measurement system, users glean key insights into BI software supplier performance, enabling: Comparisons of current vendor performance to industry norms Identification and selection of new vendors A Supplier Tool Vendor Licensees can use the Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study in several important ways, for example to: External Awareness - Build awareness for the Business Intelligence market and supplier brand, citing The Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study trends and vendor performance - Create lead and demand-generation for supplier offerings through association with The Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study brand, findings, webinars, etc. Internal Planning - Refine internal product plans and align with market priorities and realities as identified in The Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study - Better understand customer priorities, concerns and issues - Identify competitive pressures and opportunities 8
About Howard Dresner and Dresner Advisory Services The Wisdom of Crowds Small and Mid-Sized Enterprise Business Intelligence Market Study was conceived, designed and executed by Dresner Advisory Services, LLC - an independent advisory firm - and Howard Dresner, its President, Founder and Chief Research Officer. Howard Dresner is one of the foremost thought leaders in Business Intelligence and Performance Management, having coined the term Business Intelligence in 1989. He has published two books on the subject, The Performance Management Revolution Business Results through Insight and Action (John Wiley & Sons Nov. 2007) and Profiles in Performance Business Intelligence Journeys and the Roadmap for Change (John Wiley & Sons Nov. 2009). He lectures at forums around the globe and is often cited by the business and trade press. Prior to Dresner Advisory Services, Howard served as Chief Strategy Officer at Hyperion Solutions and was a Research Fellow at Gartner, where he led its Business Intelligence research practice for 13 years. Howard has conducted and directed numerous in-depth primary research studies over the course of the past two decades and is an expert in analyzing these markets. Through the Wisdom of Crowds Business Intelligence market research reports, Howard engages with a global community to redefine how research is created and shared. Landmark research reports include: - Wisdom of Crowds Business Intelligence Market Study - Wisdom of Crowds Cloud Business Intelligence Market Study - Wisdom of Crowds Embedded Business Intelligence Market Study - Wisdom of Crowds Collaborative Business Intelligence Market Study - Wisdom of Crowds Mobile Computing/Mobile Business Intelligence Market Study Howard (www.twitter.com/howarddresner) conducts a weekly Twitter tweetchat on Fridays at 1PM ET. The hashtag is #BIWisdom. During these live events the BIWisdom tribe discusses a wide range of Business Intelligence topics. More information about Dresner Advisory Services can be found at www.dresneradvisory.com. 9
About Jim Ericson Jim Ericson is a consultant and journalist who studies end user management practices and industry trending in the data and information management fields. From 2004 to 2013 he was the Editorial Director at Information Management magazine (formerly DM Review) where he created architectures for user and industry coverage for many contributors across the breadth of the data and information management industry. As lead writer he interviewed and profiled more than 100 CIOs, CTOs, and program directors in a 2010-2012 program called 25 Top Information Managers. His related feature articles earned ASBPE national bronze and multiple Mid-Atlantic region gold and silver awards for Technical Article and for Case History feature writing. A panelist, interviewer, blogger, community liaison, conference co-chair and speaker in the data management community, he also sponsored and co-hosted a weekly podcast in continuous production for more than five years. Jim s earlier news background as senior news producer at NBC/Mutual Radio Networks and as managing editor at MSNBC s first Washington, D.C. affiliate online news bureau trained and cemented his understanding of fact-finding, topical reporting and serving broad audiences. 10
Survey Method and Data Collection For this inaugural SME study, we sampled different subsets of the 2013 Wisdom of Crowds Business Intelligence Market Survey. For the purposes of this study, Dresner Advisory Services defines Small Enterprise as an organization with between one and 100 employees; Mid-Sized Enterprise an organization with between 101 and 1,000 employees; and Large Enterprise as an organization with more than 1,000 employees. The study was constructed from a survey instrument to collect data and used social media and crowd-sourcing techniques to recruit participants. Data Collection The 2013 Wisdom of Crowds Business Intelligence Market Study collected a total of 1,182 completed surveys. Of that total, 523 surveys were submitted by Small and Mid- Sized (SME) organizations. This report focuses on the responses of those SME organizations and draws comparisons between their responses and those of the full sample. 290 270 SME Study Sample 273 250 250 230 210 190 170 150 1-100 101-1,000 Figure 1 SME Study Sample 11
Data Quality All respondent entries were carefully scrutinized and verified to ensure that only qualified participants are included in the study. Surveys submitted by consultants and consulting groups were omitted from the study base. 12
Vendor/Market Categories For the purposes of this SME report, we utilize the same five sub-categories of BI vendors as were used in the full sample report. These include the Titans, Established Pure-Play, High Growth, Emerging, and Specialized categories. Two of the vendors in the larger report, SAS Institute and MicroStrategy, were excluded here because of insufficient SME user samples. Titans are the largest vendors, with extensive product and service offerings including Business Intelligence. In all cases these vendors have acquired Business Intelligence vendors. Included in this category are: IBM/Cognos, Infor, Microsoft, Oracle, and SAP/BusinessObjects. Large Established Pure-Play BI vendors are predominately focused upon Business Intelligence software and services and have typically been in business for 15 or more years - with well-established customer bases and revenue streams. Several are publicly held concerns. These include Actuate, Information Builders, and QlikTech. Specialized BI vendors are established (10+ years old), focused on a specific market segment (e.g., vertical industry) and are substantially smaller than Large Established Pure-Plays. Included in this category are: Dimensional Insight, Dundas, Panopticon, and Phocus. High Growth BI vendors have achieved critical mass in the market and are growing at an extremely high rate well above the industry average. For 2013, vendors include: Logi Analytics, Pentaho, Tableau, and Tibco Spotfire. Emerging BI vendors are typically younger than other categories and offer unique and often innovative business models, technologies and/or services. This category includes: Birst, idashboards Jaspersoft, Jedox, and Yellowfin. 13
Executive Summary 14
Executive Summary Small and Mid-Sized Enterprises (SMEs) have a shorter experience with Business Intelligence than large enterprise counterparts. Nearly all organizations sampled indicate some history of experience with Business Intelligence, but about one-third of Small and more than 20 percent of Mid-Sized Enterprises have a year s experience or less. More than 30 percent of Small and Mid-Sized enterprises sampled are already engaging with hosted Business Intelligence solutions from public cloud providers (compared to fewer than 10 percent of Large Enterprises). However, a majority of SMEs say they have no current plans for Cloud Computing past 2014. Compared to 2012, SMEs reported that Mobile Device Support, Software as a Service and Dashboards were areas of growing interest, while Open Source Software (OSS) declined as a priority. Newer topical areas of Big Data and Complex Event Processing (CEP) also had a lower priority than in 2012. SMEs have a greater emphasis on Software as a Service/Cloud Computing and Mobile Device Support than Large Enterprises; predictably, SME interest in Data Warehousing is somewhat lower. Compared to Large Enterprises, SME Business Intelligence initiatives are even more likely to be driven by Executive Management and more likely to be driven from the Sales function. Making better decisions was the most-sought outcome of Business Intelligence, but Small and Mid-Sized Enterprises show an even higher regard for revenue growth and competitive advantage stemming from Business Intelligence than their larger peers. They are slightly less concerned with operational efficiency. User penetration of Business Intelligence is highest in Small organizations. Both Small and Mid-sized organizations have higher expectations for penetration in the next 12 months than their larger counterparts. The smallest organizations are the most likely to agree completely that their Business Intelligence experiences have been successful. Mid-Sized organizations of 100-1000 employees are more likely to somewhat agree. Overall, more than 80 percent of all organizations claim partial or complete success with BI initiatives. 15
About 60 percent of SMEs use only one or two tools for Business Intelligence in their organizations and are more likely to know how many tools are in use. 16
Study Demographics The respondents studied in this SME survey provide a cross-section of data by geography, function, organization size and vertical industries. We believe this supports a representative sample and indicator of true market dynamics. Cross-tab analyses have been constructed using these demographics to identify and illustrate important industry trends. Geography Sixty-one percent of SME survey respondents are located in North America; 24 percent represent EMEA (35 countries); and 11 percent come from APAC regions (15 countries). Although North America represents the largest group, it is in itself diverse representing five Canadian provinces, 43 US states and the Commonwealth of Puerto Rico (Figure 2). Geographies of SMEs Studied Latin America 5% Asia Pacific 11% Europe, Middle East, & Africa 24% North America 61% Figure 2 - Geographic Distribution 17
Functions One-third of SME respondents to the survey represent IT, and more than a quarter come from management. Of 13 percent who say they represent the BICC, we believe those respondents likely represent dedicated Business Intelligence resources, if not a formal organizational department (Figure 3). This distribution across functions has enabled us to develop analyses comparing and contrasting the plans and priorities of the different departments within organizations. Functions in SMEs Studied Other 7% Sales 5% Marketing 5% Information Technology (IT) 33% Operations 5% Finance 6% Business Intelligence Competency Center 13% Executive Management 26% Figure 3 - Functions Represented 18
Vertical Industries Vertical industry distribution among SMEs represents a cross-section of Technology, Health Care, Financial Services and Manufacturing along with other private and public institutions. To better capture the individual perspectives of brick-and-mortar respondents, we excluded surveys submitted by consultants from our sample base (Figure 4). SME Vertical Industries Health Care 9% Technology 23% Financial Services 9% Manufacturing 7% Other 12% Business Services 6% Telecommunications 3% Education 4% Retail & Wholesale 6% Not for profit 3% Advertising 3% Transportation 3% Insurance 4% Food, Beverage & Tobacco 4% Government 4% Figure 4 - Vertical Industries 19
Analysis & Trends 20
Analysis & Trends This report describes the Small and Mid-Sized Enterprise market for Business Intelligence by its own characteristics, drivers and trends, and also by how it compares to the large enterprise market. For 2013 we have data in multiple areas of user trends. For SMEs we were first interested to understand their history of experience with Business Intelligence, their uptake of cloud BI providers, and changing priorities year over year. As in the larger Wisdom of Crowds study, we collected and analyzed data for SMEs surrounding functions driving Business Intelligence, goals/objectives for BI, targeted user roles, current penetration and future plans for Business Intelligence deployment and organizational success. We have provided and highlighted some additional correlative findings from granular data not shown in the charts and figures in this report as * Additional Findings. These notes refer to how different variable movements are related to one another within subtopics across organizations of different size. 21
How SMEs are Different Length of Experience The advent of Business Intelligence is a relatively recent phenomenon according to respondents to the 2013 Wisdom of Crowds survey. Fewer than 10 percent of all organizations claim experience with BI going back more than 10 years (Figure 5). Though Large Enterprises with their history of data management practices led early adoption, the uptake of Business Intelligence by organizations of different sizes over time tells its own story. As the test beds of enterprise class Business Intelligence, Large Enterprises report the lengthiest experience. That began to change six to 10 years ago when interest and demand among Small and Mid-Sized organizations for relevant Business Intelligence products and services began to grow rapidly. 35% BI Length of Experience by Organization Size 30% 25% 20% 15% 1-100 101-1,000 1,000 or more 10% 5% 0% Less than 1 year 1-2 years 3-5 years 6-10 years More than 10 years Figure 5 - Length of experience with Business Intelligence 22
In the last five years, initial adoption and experience has grown significantly in Small and Mid-Sized organizations while the Large Enterprise market has become more fully penetrated. Nearly all the organizations sampled indicate some history of experience with Business Intelligence. Still, about one-third of Small and more than 20 percent of Mid-Sized Enterprises have a year or less experience with Business Intelligence, reflecting a young market and a significant opportunity for software and service providers. Adoption of Cloud-Based Business Intelligence More than 30 percent of Small and Mid-Sized Enterprises sampled are already engaging with Public Cloud Business Intelligence solutions. That figure should reach nearly 40 percent by the end of 2013 (Figure 6). About 20 percent of Mid-Sized Enterprises will be engaged with Public Cloud BI by the end of 2013. This compares to fewer than 10 percent of Large Enterprises engaging Public Cloud. (Dresner Advisory Services defines Public Cloud Business Intelligence as the technologies, tools and solutions that employ off-premise public or institutional cloud deployment models.) About 10 percent of all Small and Mid-Sized Enterprises have plans to adopt Cloudbased Business Intelligence in 2013 or 2014, and though SMEs are more likely to adopt in the near future, a majority of enterprises of all size say they have no immediate plans to do so. 23
90% Plans for Public Cloud BI by Organization Size 80% 70% 60% 50% 40% 1-100 101-1,000 1000 or more 30% 20% 10% 0% Using Today Will adopt in 2013 Will adopt in 2014 No Plans Figure 6 - Plans for Public Cloud by Organizational Size *Additional Findings: When discussing Cloud Business Intelligence plans, Mid-Sized Enterprises more strongly correlate Advanced Visualization tools with Ad-Hoc Query and Self-Service than Large or Small Enterprises. Mid-Sized Enterprises discussing Cloud plans are less likely than Large Enterprises to combine interest in Data Quality and ETL tools with Relational or Multidimensional Database Support. This could suggest an expectation that standalone analysis solutions are (or are becoming) available for unique users of localized data, short of a broad Business Intelligence rollout. 24
Technology Priorities Changing Across the entire survey, only three technologies related to Business Intelligence increased in importance over 2012: Software-as-a-Service (Cloud BI), Dashboards and Mobile Device Support (Figure 7). All other related technologies decreased in importance compared to 2012. Small and Mid-Sized Enterprises reflect this year-over-year shift. Mobile Device Support, Software as a Service, and Dashboards were areas of growing interest, while Open Source Software (OSS) declined as a priority. Newer topical areas of Big Data and Complex Event Processing (CEP) also found less prioritization than in 2012, possibly as enterprises examined technologies and reshuffled their immediate needs. Compared to larger enterprises, SMEs show relatively more interest in Mobile Device Support and comparatively less interest in Ability to Write to Transactional Systems and OSS. 8% 6% 4% 2% 0% -2% -4% -6% -8% -10% -12% -14% Technology Priority Changes from 2012- SME vs. Overall Sample SME Overall Figure 7 Technology Priority Changes among All Organizations 2012-2013 25
Departments/Functions Driving Business Intelligence The 2013 survey looks at the functions that are driving Business Intelligence initiatives within the organization. For each function, respondents were asked to specify whether it drives Business Intelligence always, often, sometimes, rarely or never. We used this to create a weighted average on a zero to 5 scale. Departmental Drivers At SMEs, Executive Management, Sales, Finance, Strategic Planning, Operations and IT are most likely to drive Business Intelligence initiatives and projects; Manufacturing, Human Resources and Supply Chain functions are the least likely (Figure 8). Small Enterprises of one to 100 employees are the most likely of all to see Business Intelligence driven by Executive Management (which might describe CEO, CFO, COO or other titles) and are more likely to be driven from the Sales function. 4.50 Functional Drivers of BI by Organization Size 4.00 3.50 3.00 2.50 2.00 1.50 1.00 0.50 0.00 1-100 101-1,000 1,001 and larger Figure 8 Functional Drivers of Business Intelligence by Organization Size (Weighted Mean) 26
*Additional Findings: As drivers of Business Intelligence, Mid-Sized Organizations most highly correlate Executive Management with the Strategic Planning Function. Compared to Mid-Sized and Large Enterprises, Small Enterprises look at Sales and Marketing as relatively unlinked and separate functions. 27
User Roles Targeted for Business Intelligence This year we asked which functions/roles are being targeted for automation with Business Intelligence solutions. Respondents were able to designate roles as either Primary, Secondary or Not Applicable. Among all organizations sampled, the majority prioritized (in order) Executives, Middle Managers, Line Managers, Individuals, Customers and then Suppliers last. The smallest organizations focus on organizational leaders and customers more than Mid-Sized peers. SMEs of one to 1,000 employees targeted Senior Executives and Customers, while large enterprises had greater focus on Middle and Line managers, which may reflect the architectures of smaller organizations with thinner management ranks. 5.00 4.50 4.00 3.50 3.00 2.50 2.00 1.50 1.00 0.50 Targets for Business Intelligence by Organization Size 0.00 Executives Middle Managers Line Managers Individual Contributors & Professionals Customers Suppliers 1-100 101-1,000 1,001 and larger Figure 9 - SME Targeted Users for Business Intelligence 28
Objectives for Business Intelligence As an overall and philosophical approach, Better Decision-Making has long been used to describe the most desired outcome of Business Intelligence. That attitude continues today, though organizations also identify with specific objectives for Revenue Growth, Operational Efficiency, Customer Support, and Competitive Advantage. SMEs hold the same regard for better decision-making (Figure 10) as the overall sample. But Small and Mid-Sized Enterprises show an even higher regard than Large organizations for revenue growth and competitive advantage stemming from Business Intelligence. SMEs are more concerned with customers and slightly less concerned with operational efficiencies than large enterprises. 5 BI Objectives Organization Size 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Better decisionmaking Growth in revenues Improved operational efficiency Enhanced customer service Increased competitive advantage 1-100 101-1,000 1,001 and larger Figure 10 - Business Intelligence Objectives by Organization Size (Weighted Mean) *Additional Findings: Small Enterprises most strongly correlate Enhanced Customer Service with Increased Competitive Advantage. Large Enterprises most strongly correlate Growth in Revenues with Increased Competitive Advantage. 29
Business Intelligence Objectives by Function We also asked SMEs to prioritize goals from different functional perspectives. While all continued to rally around better decision-making, goals by function appear to follow expectations. SME respondents in IT and Finance were more interested in Operational Efficiency; Marketing and the BI Competency Center expressed more interest in Competitive Advantage; and Sales had the highest affinity to Growth in Revenue (Figure 11). Marketing and the BI Competency Center also expressed more interest in serving their respective customer bases. 5 SME BI Objectives by Function 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Marketing Information Technology (IT) Sales Finance Business Intelligence Competency Center Better decision-making Improved operational efficiency Increased competitive advantage Growth in revenues Enhanced customer service Figure 11 SME BI Objectives by Function (Weighted Mean) 30
Penetration of Business Intelligence Business Intelligence adoption continues to be strongest in both the smallest and the largest of organizations. The smallest organizations invest in BI to level the competitive playing field. With greater agility, smaller organizations can deploy more quickly and more extensively than their larger counterparts. The largest organizations have strong intent and ample resources to deploy Business Intelligence, but are slowed in broad penetration by organizational compartmentalization and rigid processes. In contrast, Mid-Sized organizations lack the agility of Small Enterprises and the resources of the largest. Hence, by comparison, their deployment has been limited. Although penetration of Business Intelligence (as a percentage of numbers of employees) has been on the rise, progress has been modest. Our latest data suggests that, in most organizations, only a minority of employees have access to Business Intelligence (Figure 12). 50% Current BI Penetration by Organization Size 45% 40% 35% 30% 25% 20% 15% 1-100 101-1,000 1,001 and larger 10% 5% 0% Under 10% 11-20% 21-40% 41-60% 61-80% 81% or more Today Figure 12 - Penetration of Business Intelligence Solutions Today 31
Among organizations with 80 percent or greater penetration, the smallest enterprises are the largest segment. Small organizations are also less likely to have less than 10 percent penetration than all larger peers. (We note later that Small organizations are also most likely to be aware of the number of BI deployments in their organization.) Expectations for BI penetration at both Small and Mid-Sized organizations in the coming 12 months are noticeably high (Figure 13). Small organizations expect the greatest (81- plus percent) penetration in the coming 36 months while Mid-Sized organizations expect middle digit overall penetration. 45% SME BI User Penetration 2013-2016 - by Organization Size 40% 35% 30% 25% 20% 15% 10% Under 10% 11-20% 21-40% 41-60% 61-80% 81% or more 5% 0% 1-100 101-1,000 1-100 101-1,000 1-100 101-1,000 1-100 101-1,000 Today In 12 months In 24 months In 36 months Figure 13 Current and Planned SME User Penetration 2013-2016 by Org Size 32
SME Success with Business Intelligence Overall, organizations say their Business Intelligence initiatives have been a success. Among SMEs, more than 50 percent of Small Enterprises and 40 percent of Mid-Sized Enterprises completely agree that their Business Intelligence experience has been a success (Figure 14). Responses were to the question: My organization considers our Business Intelligence initiatives a success. In discussing this with SME leaders, we find two important reasons for this success: 1) Executive Management ownership of the BI initiative and 2) relative ease/speed of deployment and associated realization of business value. Though complete SME satisfaction with Business Intelligence is noticeably greater than it is at Large Enterprises, broad satisfaction overall is remarkably high: more than 80 percent of organizations of all sizes report complete or partial success. 70% Success with Business Intelligence by Organization Size 60% 50% 40% 30% 20% 10% 0% Completely agree Agree Somewhat Disagree Somewhat Disagree 1-100 101-1,000 1,001 and greater Figure 14 -Success with Business Intelligence by Organization Size (Weighted Mean) 33
Number of Business Intelligence Tools in Use Among enterprises of all sizes, the use of multiple Business Intelligence tools is reported, though at SMEs, it s more typical to see one or two tools as being used. Typically though, as the size of an organization increases, so do the number of tools in use. More than one-third of SMEs report that they use one tool for Business Intelligence; more than 60 percent of SMEs use one or two Business Intelligence tools (Figure 15). SME respondents are three times as likely as large enterprise respondents to know how many tools are in use. This might reflect more likely vendor lock-in but also more awareness to the uses, success or deficiency in BI tools and solutions in smaller organizations. 40% Number of BI Tools - SME vs. Large Enterprises 35% 30% 25% 20% 15% LGE SME 10% 5% 0% Don't know 1 2 3 4 5 6 7 8 9 10 or more Figure 15 - Number of Business Intelligence Tools in Use SME vs. Large Enterprises 34
SME Key Related Technologies / Initiatives This year we expanded our study to include more technologies and initiatives deemed strategic to respondents Business Intelligence efforts. In all, we asked about 19 areas (versus 16 in 2012), as noted in Figure 16. This year we added Embedded BI, Search- Based Interface, and Data Discovery. For 2013, top technologies related to BI included: Dashboards, End User Self-Service, Advanced Visualization and Data Warehousing. SMEs broadly mirror their Large Enterprise counterparts across a span of technical priorities though, as noted in our introduction, have noticeably greater emphasis on Software as a Service/Cloud Computing and Mobile Device Support (Figure 16). Predictably, SME interest in Data Warehousing is somewhat less than at Large Enterprises. Technology Priorities: SME vs. Large Enterprises Dashboards End user "self service" Advanced visualization Data Warehousing Mobile Device Support Integration with Operational Processes Data Discovery "Embedded" BI (contained within an Data Mining, Advanced Algorithms, Predictive In-memory analysis Software-as-a-Service and "Cloud" Computing Search-based interface Collaborative Support for Group-based Analysis Ability to write to transactional applications Big Data (e.g., Hadoop) Text Analytics Social media Analysis (SocialBI) Open Source Software Complex Event Processing (CEP) SME LGE 1.00 1.50 2.00 2.50 3.00 3.50 4.00 4.50 Figure 16 - Tech Priorities: Small and Mid-Sized versus Large Enterprises *Additional Findings: When discussing the value of different technologies, Mid-Sized Enterprises most strongly correlate Social Media Analysis with Big Data. Mid-Sized 35
Enterprises also link Search-based Interface and Collaborative Support for Group- Based Analysis in their technology priorities. Outside of Data Warehousing, the smallest organizations express slightly more interest in all categories of Business Intelligence sampled than mid-sized counterparts. As noted, interest in Cloud-Based and SaaS tend to increase inversely with organization size. 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Tech Priorities: Small versus Mid-Sized Enterprises 1-100 101-1,000 Rating Average Figure 17 Tech Priorities: Small versus Mid-Sized Enterprises 36
SME Vendor Rankings 37
SME Vendor Stacked Rankings In this section we offer stacked rankings of Business Intelligence software vendors supporting Small and Mid-Sized Enterprises. Vendors were ranked using 33 different criteria, on a 5-point scale for each. Criteria covered Sales /Acquisition experience (8 criteria), Value for price paid (1), Quality and Usefulness of Product (12), Quality of Technical Support (5), Quality and Value of Consulting Services (5), whether vendor is Recommended (1) and Integrity (1). The result is a stacked ranking with an average score for every one of the seven categories and an overall average score for each vendor. As we begin to explore vendor performance in more detail, it s important to understand the scale that we used in scoring the industry and vendors: 5.0 = Excellent 4.0 = Very Good 3.0 = Adequate 2.0 = Poor 1.0 = Very Poor As in 2012, market segments include the Titans, Established Pure-Play, Emerging and High Growth vendors. For 2013 we have added a Specialized category. Within each segment, vendors have similar traits and, as a result, similar score-average ranges. So, while comparisons can (and no doubt will) be made between these subsegment peer groups, it s not always a reasonable comparison. Based on our scoring methodology, all vendors performed at a level that is considered more than adequate for all categories of criteria. *Please note that Average Score is the mathematical mean of all items included in vendor ratings. Each column in the chart represents a scale consisting of varying numbers of items (for example "Sales" is a scale consisting of 8 items, while "Value" for price is 1 single item). As such, each column is weighted differently (based upon the number of items represented and the number of respondents rating those items) in calculating the overall Average rating. The Average Score cannot be calculated by simply averaging across the subscale scores. 38
Business Intelligence Titans SME Titans (Table 1) are the largest vendors, with extensive product and service offerings including Business Intelligence. In all cases these vendors have acquired Business Intelligence vendors. Included in this category are: IBM/Cognos, Infor, Microsoft, Oracle and SAP/BusinessObjects. Table 1 - Business Intelligence Titans - Stacked Rankings Vendor Sales Avg Value Product Support Consult Integrity Recommend Final Score Microsoft 3.59 3.88 3.77 3.70 3.60 3.93 4.84 3.90 Oracle 3.72 3.69 3.67 3.90 3.53 3.87 4.50 3.84 IBM/Cognos 3.82 3.53 3.65 3.64 3.71 4.12 3.82 3.75 Infor 3.46 3.50 3.18 3.57 3.68 3.50 4.67 3.65 SAP/ BusinessObjects 3.13 3.12 3.29 3.12 3.41 3.36 4.08 3.36 Large Established Pure-Play Business Intelligence Vendors Large Established Pure-Play vendors (Table 2) are focused primarily upon Business Intelligence software and services and have typically been in business for 15 + years with well-established customer bases. Some are publicly held. These include Actuate, Information Builders, and QlikTech. MicroStrategy and The SAS Institute, covered in the more broadly focused 2013 Wisdom of Crowds Business Intelligence Market Study, have been excluded from this report for lack of reporting SME customers. Table 2 Large Established Pure-Play Business Intelligence - Stacked Rankings Vendor Sales Avg Value Product Support Consult Integrity Recommend Final Score Information 4.53 4.44 4.44 4.43 4.58 4.75 5.00 4.60 Builders Actuate 3.96 4.09 4.07 4.22 4.29 4.20 4.64 4.21 QlikTech 3.82 4.17 4.19 3.83 3.92 4.21 5.00 4.16 39
High Growth Business Intelligence Vendors High Growth vendors (Table 3) are those that have achieved critical mass in the market and are growing at an extremely high rate well above the industry average. This includes Logi Analytics, Pentaho, Tableau and Tibco Spotfire. Table 3 - High Growth Business Intelligence Vendors Stacked Rankings Sales Value Product Support Consult Integrity Recommend Final Score Tibco 4.39 4.38 4.25 4.46 4.41 4.85 5.00 4.53 Spotfire Pentaho 4.16 4.35 3.60 4.37 4.37 4.35 4.80 4.28 Tableau 3.80 4.25 4.29 4.02 3.87 4.42 4.80 4.21 Logi Analytics 3.94 4.07 3.95 4.05 3.83 4.21 4.86 4.13 Specialized Business Intelligence Vendors Specialized Business Intelligence vendors (Table 4) are those have been in existence for a number of years, have successfully focused on a particular sub-segment of the market (e.g., vertical industry) and are modest in size. Dimensional Insight, Dundas, Panopticon, and Phocas are included in this segment. Table 4 - Specialized Business Intelligence Vendors Stacked Rankings Vendor Sales Value Product Support Consult Integrity Recommend Final Score Dimensional 4.68 4.70 4.48 4.79 4.82 4.89 5.00 4.77 Insight Panopticon 4.49 4.15 4.28 4.43 4.36 4.54 5.00 4.46 Phocus 4.23 4.33 4.10 4.09 4.37 4.60 5.00 4.39 Dundas 4.27 4.29 4.11 4.45 4.24 4.52 4.62 4.36 40
Emerging Business Intelligence Vendors Emerging vendors (Table 5) are typically younger than the other categories and offer unique and often innovative business models, technologies and/or services. This category includes: Birst, idashboards, Jaspersoft, Jedox and Yellowfin. Table 5 - Business Intelligence Emerging Vendors Stacked Rankings Vendor Sales Value Product Support Consult Integrity Recommend Final Avg Score Yellowfin 4.62 4.79 4.47 4.70 4.68 4.92 5.00 4.74 Birst 4.38 4.32 4.19 4.49 4.43 4.53 5.00 4.48 idashboards 4.45 4.07 3.99 4.50 4.39 4.52 4.87 4.40 Jedox 4.22 4.24 4.11 4.35 4.11 4.44 4.84 4.33 Jaspersoft 3.86 4.17 3.93 3.88 4.14 4.29 4.67 4.13 After you have reviewed the stacked rankings of vendors, carefully examine the detailed, vendor-specific rankings for a more complete perspective and deeper understanding of individual vendors strengths and weaknesses. 41
Detailed SME Vendor Scores In this section, we offer detailed vendor scores, in alphabetical order by vendor. Using our 33 criteria evaluation model, we compare each vendor s performance to their direct peer group and to the average for all vendors (all records in the study population). Because this is the first year we have broken out SMEs from the overall study, we cannot offer year over year performance specific to SMEs. The detailed criteria are below. We have added clock position information to assist in locating specific scores: Table 6 - Detailed Vendor Rating Criteria - Sales/acquisition experience (Sales) (12 2 o clock) o o o Understanding business/needs o Responsiveness o Flexibility/Accommodation o Business Practices o Contractual terms and conditions o Follow up after the sale - Value for price (Value) (3 o clock) - Quality and usefulness of product (Product) (3 7 o clock) o Robustness/sophistication of technology o Completeness of functionality o Reliability of technology o Scalability o Integration of components within product o Integration with 3rd party technologies o Overall Usability o Ease of installation o Ease of administration - Quality and usefulness of product (continued) o Customization and Extensibility o Ease of upgrade/migration to new versions o Online forums and documentation - - Quality of technical support (Technical Support) (8 9 o clock) o o o Responsiveness o Continuity of personnel o Time to resolve problems - Quality and value of consulting services (Consulting) (9 10 o clock) o o o Experience o Continuity o Value - Integrity (11 o clock) - Whether vendor is recommended (Recommended) (12 o clock) 42
Actuate Detailed Score for SME Actuate Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Pureplay Avg Overall Sample Actuate Figure 18 Actuate/BIRT Detailed SME Score In the Large Established Pure-Play category, Actuate was generally in line with or somewhat below peer scores among SMEs for most measures. It was best in class for Product: Completeness of Functionality. 43
Birst Detailed SME Score Birst Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Emerging Avg Overall Sample Birst Figure 19 Birst Detailed SME Score A first time entry in the Emerging segment, Birst generally exceeded peer and overall SME averages. It was best in class for Product: Reliability and Ease of Upgrade/Migration to new versions and had a perfect Recommend score. 44
Dimensional Insight Detailed SME Score Dimensional Insight Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Specialty Avg Overall Sample Dimins Figure 17 Dimensional Insight Detailed SME Score Dimensional Insight was the leader in the Specialized category and was best in class among peers for virtually all measures in all categories. 45
Dundas Detailed SME Score Dundas Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Specialty Avg Overall Sample Dundas Figure 18 Dundas Detailed SME Score Dundas, a new entrant into the Specialized market segment, performed generally in line with or slightly below peer average categories. 46
IBM Detailed SME Score IBM Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Titan Avg Overall Sample IBM Figure 19 IBM/Cognos Detailed SME Ranking IBM was generally above peer averages for most measures amongst Titans and was best in class for most Sales measures and for Product: Robustness/Sophistication of Technology, Completeness of Functionality, Integration of Components Within Product, Technical Support: Continuity of Personnel, Consulting: Experience and Continuity and Integrity. 47
idashboards Detailed SME Score idashboards Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Emerging Avg Overall Sample idashboards Figure 23 idashboards Detailed SME Score In the Emerging market segment, idashboards was generally in line with or above peer averages for most measures. 48
Infor Detailed SME Score Infor Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Titan Avg Overall Sample Infor Figure 20 Infor Detailed SME Score A new entry to the Titan market segment, Infor scored lower among SME than large customers, where it was the 2013 segment leader. It was best in class for Consulting: and Value. 49
Information Builders Detailed SME Score Information Builders Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Pureplay Avg Overall Sample InfoBuilders Figure 2521 Information Builders Detailed SME Score Information Builders led the SME Large Established Pure-Play market segment and was best in class for virtually every category. It also received a perfect Recommend score. 50
Jaspersoft Detailed SME Score Jaspersoft Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Emerging Avg Overall Sample Jasper Figure 22 Jaspersoft Detailed SME Score In the Emerging category of vendors, Jaspersoft s performance trailed its 2013 Large Enterprise reviews and among SME peers it trailed in most measures. 51
Jedox Detailed SME Score Jedox Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Emerging Avg Overall Sample Jedox Figure 23 Jedox/Palo Detailed SME Score A member of the Emerging market segment, Jedox trailed peers in most categories. 52
Logi Analytics Detailed SME Score LogiAnalytics Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Growth Avg Overall Sample LogiAnalytics Figure 28 Logi Analytics Detailed SME Score A new entry in the High Growth market segment, Logi Analytics was in line or trailing in peer averages. It was best in class for Sales: Contractual Terms and Conditions. 53
Microsoft Detailed SME Score MicroSoft Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Titan Avg Overall Sample Microsoft Figure 29 Microsoft Detailed SME Score In the Titan SME market segment, Microsoft was best in class and led peers in overall Value, Product and Recommend categories. 54
Oracle Detailed SME Score Oracle Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Titan Avg Overall Sample Oracle Figure 24 Oracle Detailed SME Score Another Titan, Oracle, performed mostly in line with its peer group in serving SMEs. It was best in class for several Sales and Product measures and overall Technical Support. 55
Panopticon Detailed SME Score Panopticon Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Specialty Avg Overall Sample Panopticon Figure 25 Panopticon Detailed SME Score Panopticon scored generally above peer averages with SMEs, placing second in the Specialized category of vendors. It also garnered a perfect Recommend score. 56
Pentaho Detailed SME Score Pentaho Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Growth Avg Overall Sample Pentaho Figure 32 Pentaho Detailed SME Score In the High Growth segment, Pentaho was in line with SME-facing peers in many categories but fell short on several product dimensions. It was best in class for overall Sales, Technical Support: Responsiveness and Consulting: and Value. 57
Phocas Detailed SME Score Phocus Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Specialty Avg Overall Sample Phocus Figure 33 Phocas Detailed SME Score Phocas was a new entry in the Specialized market segment for 2013 and performed in line or trailed peers among the SME audience. It did receive a perfect Recommend score. 58
QlikTech Detailed SME Score QlikTech Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Pureplay Avg Overall Sample QlikTech Figure 26 QlikTech Detailed SME Score In the Large Established Pure Play SME market segment QlikTech was in line or trailing in most peer categories. It was best in class for Product: Overall Usability, Ease of Installation, Ease of Administration and Ease of Upgrade/Migration to New Versions. 59
SAP/BusinessObjects Detailed SME Score SAP Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Titan Avg Overall Sample SAP Figure 35 SAP BusinessObjects Detailed SME Score In the Titan market segment, SAP/BusinessObjects trailed peer SME sample averages in most categories. 60
Tableau Detailed SME Score Tableau Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Growth Avg Overall Sample Tableau Figure 27 Tableau Detailed SME Score Tableau was generally in line with or below peer averages. Tableau performed best in class for Product: Robustness/Sophistication of Technology, Reliability of Technology, Ease of Installation, Ease of Upgrade and Online Training. 61
Tibco Spotfire Detailed SME Score Tibco/Spotfire Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Growth Avg Overall Sample TibcoSpotfire Figure 37 Tibco Spotfire Detailed SME Score The leader in the High Growth market segment for SME, Tibco Spotfire was best in class for overall Value, Product, Technical Support, Consulting and Integrity. It earned a perfect Recommend score. 62
Yellowfin Detailed SME Score Yellowfin Time to resolve problems Continuity of personnel Continuity Experience Recommend Integrity Value 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Understanding our Responsiveness Flexibility/Accommodation Business Practices Contractual terms and conditions Follow up after the sale Value Robustness/sophistication of Responsiveness Online training, forums and Ease of upgrade/migration to Customization and Extensibility Ease of administration Completeness of functionality Reliability of technology Scalability Integration of components Integration with 3rd party Overall Usability Ease of installation Emerging Avg Overall Sample Yellowfin Figure 38 Yellowfin Detailed SME Score In the Emerging market segment, Yellowfin widely led its class in all categories. It was best in class for virtually all measures in all categories and had a perfect Recommend score. 63
SME Business Intelligence Buyer s Guide In this section, we present an SME Business Intelligence buyer s guide organized by key platforms: Traditional enterprise, Cloud and Mobile and 19 different capabilities which vendors contributed to during our 2013 Wisdom of Crowds data collection process. An indicates a feature that was available in the vendor s product in Q1 2013. Traditional Platform Support - Vendors (A D) Actuate Corp Birst Dimensional Insight Dundas Data Visualization, Inc. Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 64
Traditional Platform Support - Vendors (I) IBM idashboards Infor Information Builders Inc. Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-packaged Vertical/Functional Analytical Applications Production reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 65
Traditional Platform Support - Vendors (J M) Jaspersoft Corporation Jedox AG Logi Analytics Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 66
Traditional Platform Support - Vendors (O P) Oracle Panopticon Software Pentaho Phocas Ltd Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 67
Traditional Platform Support - Vendors (Q T) QlikTech SAP Tableau Software Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 68
Traditional Platform Support - Vendors (T Z) TIBCO Software Inc. Yellowfin Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 69
Cloud Platform Support - Vendors (A D) Actuate Corp Birst Dimensional Insight Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service"" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 70
Cloud Platform Support - Vendors (I) IBM idashboards Infor Information Builders Inc. Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 71
Cloud Platform Support - Vendors (J-M) Jaspersoft Corporation Logi Analytics Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 72
Cloud Platform Support - Vendors (P-S) Pentaho Phocas Ltd QlikTech SAP Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 73
Cloud Platform Support - Vendors (S-Z) Tableau Software TIBCO Software Inc. Yellowfin Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data QualityTools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 74
Mobile Platform Support - Vendors (A-D) Actuate Corp Birst Dimensional Insight Dundas Data Visualization, Inc. Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service"" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 75
Mobile Platform Support - Vendors (I) Ability to Write to Transactional Applications Ad-Hoc Query IBM idashboards Infor Information Builders Inc. Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 76
Mobile Platform Support - Vendors (J-M) Jaspersoft Corporation Jedox AG Logi Analytics Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 77
Mobile Platform Support - Vendors (Q-P) Oracle Panopticon Software Pentaho Phocas Ltd Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 78
Mobile Platform Support - Vendors (Q-T) QlikTech SAP Tableau Software Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 79
Mobile Platform Support - Vendors (T-Z) TIBCO Software Inc. Yellowfin Ability to Write to Transactional Applications Ad-Hoc Query Advanced Visualization Big Data (e.g., Hadoop) Support Collaborative Support for Group-based Analysis Complex Event Processing (CEP) Data Mining and Advanced Algorithms Data Visualization End User "Self Service" In-Memory Support Interactive Analysis Personalized Dashboards Pre-Packaged Vertical/Functional Analytical Applications Production Reporting Social Media Analysis (SocialBI) Text Analytics Data Integration/Data Quality Tools/ETL "Embedded" BI (contained within an application, portal, etc.) Search-based Interface 80
Appendix - The 2013 Wisdom of Crowds Business Intelligence Market Survey Instrument 81
82
83
84
85
86
87
88