1 WAVE 6 MARKET DYNAMICS CLOUD COMPUTING STUDY Designed for IT professionals, this report captures highlights from the complete study, and provides business intelligence in the form of technological roadmaps, budget trends, voice of the customer narratives and plans with cloud computing providers. Cloud Computing: The Road to Hybrid Cloud Is Private
2 TheInfoPro s Wave 6 Cloud Computing Study TheInfoPro s Cloud Computing Study takes an in-depth look at key industry trends and tracks the performance of individual vendors. Now in its fourth year, this study was finalized in December 2013 and is based on 118 interviews. TheInfoPro s methodology uses extensive interviews with a proprietary network of IT professionals and key decision-makers at large and midsize enterprises. Each interview explores several fundamental areas, including the implementation and spending plans for technologies, evaluations of vendors observed from business and product perspectives, macro IT influences transforming the sector, and factors affecting decision processes. Results are collated into comprehensive research reports providing business intelligence in the form of technological roadmaps, budget trends and vendor spending plans and performance ratings. EXAMPLES OF VENDORS COVERED IN THE STUDY Amazon Web Services BMC Software CenturyLink Chef Cisco Citrix Cognizant Dell Eucalyptus Hewlett-Packard IBM Juniper Networks Microsoft NetApp Oracle Rackspace Red Hat salesforce.com ServiceNow VMware Workday ABOUT THE AUTHOR This report was written by Peter ffoulkes, Research Director for Servers and Virtualization and Cloud Computing. Peter ffoulkes has more than 25 years of diversified international experience in enterprise and high-performance computing, including positions in management, business and product strategy development, product marketing, sales and training with leading international information technology companies. His most recent positions were vice president of marketing at Adaptive Computing, director of outbound marketing at ClearSpeed Technology, director of marketing for high-performance computing at Sun Microsystems and director and principal analyst for the Worldwide Workstation Computing program at Gartner Dataquest Research, LLC and/or its Affiliates. All Rights Reserved. Reproduction and distribution of this publication, in whole or in part, in any form without prior written permission is forbidden. The information contained herein has been obtained from sources believed to be reliable. 451 Research disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although 451 Research may discuss legal issues related to the information technology business, 451 Research does not provide legal advice or services and their research should not be construed or used as such. 451 Research shall have no liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. The reader assumes sole responsibility for the selection of these materials to achieve its intended results. The opinions expressed herein are subject to change without notice. TheInfoPro and logo are registered trademarks and property of 451 Research, LLC Research, LLC. All Rights Reserved. 20 West 37th Street, 3rd Floor, New York, NY P F E
3 CLOUD COMPUTING STUDY 3 Table of Contents EXECUTIVE SUMMARY CLOUD COMPUTING OUTLOOK 6 BUDGETS 6 PROJECTS 8 PAIN POINTS 9 ROADBLOCKS 10 DEPLOYMENT METHOD CHOICES 11 USAGE OF DIGITAL INFRASTRUCTURE AND CLOUD TECHNOLOGIES AND SERVICES 11 PRIMARY DEPLOYMENT METHOD AND REASONS FOR PLACING WORKLOADS IN THE CLOUD IN THE NEXT TWO YEARS 13 CUSTOMER-FACING ENTERPRISE APPLICATIONS 13 BACK-OFFICE ENTERPRISE APPLICATIONS 13 BATCH COMPUTING APPLICATIONS 14 E-BUSINESS HOSTING 14 COLLABORATIVE APPLICATIONS 14 TEST AND DEVELOPMENT OF APPLICATIONS 14 CLOUD-NATIVE APPLICATIONS 14 PUBLIC CLOUD PROVIDER ADOPTION 15 TECHNOLOGY ROADMAP 18 ADOPTION PLANS 18 SPENDING AND WHAT S HOT? 19 EXCITING VENDORS, TECHNOLOGIES AND INITIATIVES 22 HOT, MAINSTREAM AND NOT READY FOR PRIME TIME TECHNOLOGIES BY CLOUD DEPLOYMENT CATEGORY 23 CLOUD MANAGEMENT, AUTOMATION AND WORKLOAD TECHNOLOGY ROADMAP 25 HOSTING AND COLOCATION TECHNOLOGY ROADMAP 26 PUBLIC CLOUD SERVICES TECHNOLOGY ROADMAP 26 PAYING FOR IT: A GUIDE FOR CLOUD PROVIDERS BY THEIR CLIENTS 28 SUMMARY AND CONCLUSIONS 30 APPENDIX A: DEMOGRAPHICS 31 APPENDIX B: METHODOLOGY AND SCOPE 32 APPENDIX C: HOW TO INTERPRET THE DATA 33 APPENDIX D: ADDITIONAL INFORMATION ABOUT CHART FOOTNOTES 33
4 Executive Summary THE WAVE 6 CLOUD COMPUTING STUDY: THE ROAD TO HYBRID CLOUD IS PRIVATE From the project perspective, enterprise IT organizations are increasingly focusing on the transformation to cloud computing in one form or another as being the IT delivery model of the future. A quarter or more of respondents are engaged in pure cloud-oriented projects, with internal private cloud projects leading the pack at 3. Security continues to be the paramount pain point, cited by 3 of respondents, up from 30% in the previous survey. This is consistent with increased public awareness from the Edward Snowden events and other highly publicized hacking/security lapses throughout the year, all of which strengthen the risks and headwinds toward increased public cloud adoption. More than two-thirds (7) of respondents are being held back by non-it roadblocks, which is more than three times the percentage facing IT-related roadblocks. The percentage of respondents citing buy-in/resistance to change as a roadblock increased to 2 from 1 in the previous survey. The transition from traditional IT architectures to a cloud-based future will be executed over multiple years. Respondents indicated that 6 of IT services were currently implemented on traditional on-premises, noncloud digital infrastructure. On-premises, private cloud accounted for 19% of IT services. Two years from now the landscape will have changed considerably, but not substantially for off-premises cloud providers. On-premises, Internal private cloud projects lead the pack at 3. Security is the primary pain point. Over two-thirds (7) are being held back by non-it roadblocks. Growing from 10% to between 2013 and 2015, hybrid cloud is becoming the dominant cloud deployment model. For the majority of workloads, private cloud is the preferred option in the next two years, followed closely by hybrid cloud. Two technologies are critical for success: cloud platforms and cloud performance management and monitoring. From the provider perspective, the most frequent mentions are for VMware, Microsoft and Amazon Web Services. From the exciting provider perspective, Amazon Web Services still holds the lead in a close heat with VMware and OpenStack. As large organizations become sophisticated in cloud, the costs and risks of going external may balance the benefits of outsourcing to a public cloud provider. private cloud implementations will have grown by 11 percentage points to 30% of IT services. Hybrid cloud looks like the game changer, with adoption growing from 10% to between 2013 and 2015, and is showing signs of becoming the dominant cloud deployment model over time. When looking at the preferred workload deployment venues in the next two years, private cloud is the preferred option for the majority of workload types, followed closely by hybrid cloud deployments. Collaborative and cloud-native applications stand out as the largest opportunity for public cloud service providers.
5 EXECUTIVE SUMMARY, THE WAVE 6 CLOUD COMPUTING STUDY As enterprises move toward private cloud implementations, we are seeing trends in technology adoption emerge. Leading the pack for first-time deployment in the next two years and beyond are two technologies critical for successful cloud implementations: cloud platforms at 3 and cloud performance management and monitoring at 3. The cloud computing market is evolving rapidly, and it s clear that a greater diversity of cloud service provider types will proliferate, each eventually finding their place and share of the opportunity. For cloud infrastructure (XaaS) service providers, online service providers such as Amazon, Microsoft and others are in use to some extent by 6 of respondents currently, and this is expected to rise to 9 two years from now. Telecommunications providers rate second in adoption at 40%, growing to 5 in two years. Hosting providers and datacenter operators share the action with 3 and 2 adoption respectively, rising to 4 and 30% two years from now. As the adoption of public cloud services grows, it becomes increasingly important for cloud service providers to understand how they are being assessed. Current evaluation methods are more subjective than scientific in nature. As large organizations become more sophisticated and efficient in their internal cloud deployments with the economies of scale that are available to them, the costs and risks of going external may balance the benefits of outsourcing to a public cloud provider.
6 CLOUD COMPUTING STUDY Cloud Computing Outlook BUDGETS There are many definitions of cloud computing, but perhaps the most encompassing is based on the delivery of IT as a service. From the budget perspective, enterprise IT organizations are increasingly focusing on the transformation to cloud computing in one form or another as being the IT delivery model of the future. IT organizations need to navigate one of the largest industry transformations that has occurred in the past 30 years, which was originally fomented by the introduction of the IBM PC and created the market in which distributed computing models prospered. Taking its first tentative steps in the guise of client-server computing and flirting with the concepts of grid computing and application service providers, the industry has almost come full circle with a twist to a clientservice model. In comparison to our previous survey six months earlier wherein 3 of respondents cited separate budgets for cloud computing initiatives, that number had shrunk to just of respondents in the Wave 6 Cloud Computing Study, with 7 including cloud computing projects as part of normal IT spending. For the smaller group with separate cloud budgets, spending has also shifted, indicating a less irregular distribution. The minimum budget has increased from $25,000 to $100,000, and the maximum shrank from $125m to $75m. Median and mean levels of spending have also begun to coalesce, with the median rising from $675,000 to $1m, and the mean dropping from $8.2m to $4.7m, further showing a normalization of cloud computing budget trends. Cloud-specific Budget Do you, or can you, separate specific cloud-related spending from other IT initiatives? What is your total cloud computing budget in 2013, including capex and opex? Left Chart, n=116; Right Chart, n=27. Separate Cloud Spending Total Cloud Budget Summary Stats No 7 > $10M $5M-$9.99M 1 Minimum Summary $100,000 Stats Mean Min. $4,707,852 $100,000 Median Mean $4,707,852 $1,000,000 Median Maximum $1,000,000 $75,000,000 Max $75,000,000 $1M-$4.99M 3 Yes $500K-$999.99K Don't Know $100K-$499.99K 4 < $100K Left Chart: Q. Do you, or can you, separate specific cloud-related spending from other IT initiatives? n=116; Right Chart: Q. What is your total cloud computing budget in 2013, including capex and opex? n=27.
7 CLOUD COMPUTING STUDY OUTLOOK 7 Further in support of the thesis that spending on cloud computing is normalizing while steadily increasing, those respondents who have separate cloud budgets are showing consistency for future spending plans across our surveys. In the previous survey, 69% planned increased spending in While this has now risen to 7, those planning reduced spending are about the same as previously, at 1, the difference being made up of those expecting to remain flat. COMMENTATOR QUOTES Don t know costs it s a POC at this point. Not very much in the five figures, not six figures. In 2012, we looked at stuff; in 2013, we re buying licenses several thousand percent more in In 2014, it depends how the POCs go. It will be between two and five times higher. LE, Energy/Utilities $8m to implement Workday alone, but this is capex. MSE, Public Sector Cloud Computing Budget Trends 2013 vs. 2012, n=26; 2014 vs. 2013, n=27. Cloud Computing Budget Trends Cloud Computing Budget Change 2014 vs > 50% More 2013 vs (2H '13) 9-50% More 1-2 More -10% More 7 plan increased spending < More 1 plan stable spending < Less 2014 vs (2H '13) % Less 1-2 Less -50% Less 1 plan decreased spending > 50% Less Decreasing No Change Increasing -50%-40%-30%-20%-10% 0% 10% 20% 30% 40% 50% 2013 vs. 2012, n=26; 2014 vs. 2013, n=27.
8 CLOUD COMPUTING STUDY OUTLOOK 8 PROJECTS From the project perspective, the transformation of IT to a client-service model is notable. While projects that support this transformation come in various forms, a quarter or more of respondents are engaged in pure cloudoriented projects, with internal private cloud projects leading the pack at 3. During this survey there has been a pull-back on public cloud activity vs. the previous survey. While these projects still outweigh traditional IT or cloudreadiness projects at a similar level, there has been a small but noticeable shift in activity toward private vs. public cloud project activity. COMMENTATOR QUOTES We haven t even started. Over the next six months we will start our implementation of our first dive into it [cloud]. Primarily infrastructure as a service for private cloud. We ll see how it fits and then over the next months we ll look at using private cloud as production mechanism for deploying servers, applications, etc. LE, Energy/Utilities Just built an internal private cloud still rolling this out to various parts of the company. LE, Consumer Goods/Retail Looking at Microsoft Office 365, but haven t made any firm decisions or investment. LE, Education Considering internal cloud functionality, and if we can get it right, expanding it out into a hybrid. LE, Consumer Goods/Retail Want to deploy OpenStack I have a cluster using Oracle that I will migrate to OpenStack in LE, Education Setting up our governance and guidance around using external cloud. LE, Financial Services Cloud Computing Projects Time Series of Top Categories Cloud Computing Projects Time Series of Top Categories What are your organization s top cloud computing-related projects in the next 12 months? Select up to three. 1H 13, n=98; 2H 13, n=117. Internal Private Cloud Cloud Provider Assessments/Strategy Planning SaaS IaaS Technology Refresh PaaS 10% 10% % 3 Cloud Storage Security Business Continuity/Disaster Recovery VDI Self Service Cloud Monitoring and Governance 9% 1H '13 2H '13 Q. What are your organization s top cloud computing-related projects in the next 12 months? Select up to three. Select up to three. 1H 13, n=98; 2H 13, n=117.
9 CLOUD COMPUTING STUDY OUTLOOK 9 PAIN POINTS Security continues to be the paramount pain point, cited by 3 of respondents, up from 30% in the previous survey. This is consistent with increased public awareness from the Edward Snowden events and other highly publicized hacking/security lapses throughout the year, all of which strengthen the risks and headwinds toward increased public cloud adoption. While there are many other pain points cited, most are decreasing as familiarity with cloud deployment models increases. The exceptions that are worth noting are compliance and contractual issues. COMMENTATOR QUOTES Perennially it s security, how do we guarantee security. We operate with Rackspace, and they are remarkably diligent. But the last thing we d ever want to see would be a breach in our infrastructure. LE, Consumer Goods/Retail Compliance! LE, Financial Services Cost-transparency, lack thereof everyone thinks it s free internally, and everyone thinks the cloud is cheaper, which we know it is not. LE, Financial Services Change of the organization cultural shift. LE, Materials/Chemicals Cloud Computing Pain Points Time Series of Top Categories What are your top cloud computing-related pain points? Select up to three. 1H 13, n=100; 2H 13, n=117. Cloud Computing Pain Points Time Series of Top Categories Security 30% 3 Pricing/Budget/Cost 1 1 Organizational Challenges 1 Network 1 1 Migration/Integration 1 1 Perception and Internal Resistance 1 Internal Resources/Expertise 1 1 Lack of Internal Process Compliance Technology Immaturity 10% 9% 1 1H '13 2H '13 Service-level Management 1 Management Contractual/Legal Issues Q. What are your top information security-related pain points? Select up to three. 1H 13, n=100; 2H 13, n=117.
10 CLOUD COMPUTING STUDY OUTLOOK 10 ROADBLOCKS Confirming our results from prior surveys, over twothirds (7) are being held back by non-it roadblocks, which is more than three times the percentage facing IT-related roadblocks. The percentage of respondents citing buy-in/resistance to change as a roadblock increased to 2 from 1 in the previous survey. COMMENTATOR QUOTES Cost is number one. They claim it reduces cost and TCO, but it doesn t, because we run stuff five and six years. Integration we ve been trying to move into hybrid O365 and Exchange and have had some cost concerns and integration issues. Have had some issues around ID and SSO as well. LE, Consumer Goods/Retail For external, it goes back to the criticality of the business process, the ability to secure the data, and the maturity of the vendors. How much risk are you willing to take on? LE, Healthcare/Pharmaceuticals Mindset and cultural shift are key. We bump into standards for security and data security that can be inhibiting. The standards need to shift for the cloud, given that you don t have physical hardware. LE, Services: Business/Accounting/Engineering Roadblocks to Cloud Evolution Time Series Are there any roadblocks inhibiting you from reaching the next phase of your cloud computing initiatives? Roadblocks Roadblocks to Cloud to Cloud Evolution Evolution Time Series Time Series If yes, please explain. 1H 13, n=100; 2H 13, n=118. Roadblocks Roadblocks to Reaching to Next Reaching PhaseNext Phase Specific Roadblocks Specific Roadblocks Non-IT Roadblocks Non-IT Roadblocks Buy-in/Resistance Buy-in/Resistance to Change to Change 1 Vendor Selection/Offerings/Cost Vendor Selection/Offerings/Cost Models Models 1 People/Time People/Time Organization/Budget Organization/Budget IT Roadblocks IT Roadblocks 19% 1 19% Security Policies Security Policies Regulation/Compliance Regulation/Compliance Technology Immaturity Technology Immaturity Data Management/Control Data Management/Control 1 No Roadblocks No Roadblocks 1 1 1H '13 1 2H '13 1H '13 2H '13 Trust (Visibility Trust and (Visibility Reliability) and Reliability) 10% Legacy Systems/Applications Legacy Systems/Applications Internal Organizational Internal Organizational Issues Issues 10% 1H '13 2H '13 1H '13 2H '13 Cloud Performance Cloud Performance Issues Issues hart: Q. Are Left there Chart: any Q. roadblocks Are there inhibiting any roadblocks you from inhibiting reaching you the from next reaching phase of the your next cloud phase computing of your cloud computing tives? 1H 13, initiatives? n=100; 2H 1H 13, n=118. n=100; Right 2H 13, Chart: n=118. Q. If Right yes, please Chart: Q. explain. If yes, 1H please 13, n=100; explain. 2H 1H 13, n=118. n=100; 2H 13, n=118.
11 CLOUD COMPUTING STUDY 11 Deployment Method Choices USAGE OF DIGITAL INFRASTRUCTURE AND CLOUD TECHNOLOGIES AND SERVICES Despite the hype in the marketplace, the transition from traditional IT architectures to a cloud-based future is a slow and stately dance that will be executed over multiple years, as has been indicated over our past several surveys. Respondents indicated that 6 of IT services were currently implemented on traditional on-premises, non-cloud digital infrastructure. On-premises, private cloud accounted for 19% of IT services, with 1 being delivered by traditional off-premises outsourcing services. In this study we asked explicitly about hybrid cloud, which may become the eventual deployment model for most organizations, but only 10% claim to be exploiting some instantiation of the methodology currently, although expect to be doing so by A mere of IT services are currently being delivered by off-premises SaaS and XaaS offerings. Precise terminology is an extremely important aid to understanding, and the cloud computing environment is overflowing with jargon words for which there are multiple competing interpretations. Hybrid cloud is one of most frequently discussed concepts and one that also has a very large number of definitions, many of which are promoted by vendors in a self-serving manner. 451 Research defines hybrid cloud as a delivery model that consists of two or more distinct cloud infrastructures that remain unique entities, all coordinated by standardized or proprietary technology, and interoperate to deliver seamless business functions. Two years from now the landscape will have changed considerably, but not substantially for off-premises cloud providers. Non-cloud, on-premises IT services will have experienced a decline of more than 20 percentage points to just 4 of IT service delivery, while on-premises, private cloud implementations will have grown by 11 percentage points to 30% of IT services. Hybrid cloud looks like the game changer, with adoption growing from 10% to between 2013 and 2015, and is showing signs of becoming the dominant cloud deployment model over time.
12 CLOUD COMPUTING STUDY DEPLOYMENT METHODS 12 Usage of Digital Infrastructure and Cloud Technologies and Services For each of the major digital infrastructure deployment methods below, how are your IT services (percentage of applications/workloads delivered) distributed today? For these same deployment methods, what do you expect this distribution to be two years from now? Hybrid Cloud (2H 13), 2013=115; 2015, n=113; All Other Data Points (1H 13), n=88. Usage of Digital Infrastructure and Cloud Technologies and Services Internal, On-premises, Non-cloud Digital Infrastructure (Physical or Virtualized) 4 6 Internal, On-premises, Private Cloud-based Digital Infrastructure 19% 30% Off-premises IT Outsourcing, Dedicated/Managed Hosting/Multi-tenant Colocation Services 1 1 Hybrid Cloud 10% Off-premises Public Cloud Services (SaaS) Off-premises Public Cloud Services (Other Than SaaS) 9% Other Deployment Method For off-premises deployments, there is a small increase, but nothing substantial. Traditional off-premises outsourcing services remain steady, growing from 1 to All Other 1. Data Off-premises Points (1H 13), n=88. public cloud services, SaaS and XaaS, see notable increases to 9% and of IT services respectively, but these are not the kind of wholesale changes that alter the fortunes of established companies materially. Q. For each of the major digital infrastructure deployment methods below, how are your IT services (percentage of applications/workloads delivered) distributed today? For these same deployment methods, what do you expect this distribution to be two years from now? Hybrid Cloud (2H 13), 2013=115;2015, n=113; The primary takeaway is that the move to cloud computing is continuing with considerable momentum in the fashion of a deep ocean current, and the effects will likely take half a decade or more to unfold. COMMENTATOR QUOTES Ninety percent (90%) of the policy writing and claims environment is through hybrid, but that s 70% overall. We shouldn t have much change in that number in the next two years either. MSE, Financial Services Amazon will not likely be in use in two years, and if so, for burst deployment only. LE, Education We see internal infrastructure expanding into that hybrid model. LE, Financial Services
13 CLOUD COMPUTING STUDY DEPLOYMENT METHODS 13 PRIMARY DEPLOYMENT METHOD AND REASONS FOR PLACING WORKLOADS IN THE CLOUD IN THE NEXT TWO YEARS Respondents were asked about their preferred deployment methods for a number of workload categories in the next two years, selecting from internal private cloud, hybrid cloud, external public cloud and SaaS, and the reasons for those choices. When looking at the preferred workload deployment venues in the next two years, private cloud is the preferred option for the majority of workload types, followed closely by hybrid cloud deployments. Collaborative and cloudnative applications stand out as the largest opportunity for public cloud service providers. Best Workload Execution Venue by Cloud Type For each of the following categories of workload/business functions, what is your primary deployment method likely to be in the next two years (internal private cloud, external public cloud, hybrid cloud, or SaaS)? n = 28 to 53. Best Workload Execution Venue by Cloud Type Test and Development of Applications E-business Hosting % Customer-facing Enterprise Applications Collaborative Applications Cloud-native Applications Batch Computing Applications Back-office Enterprise Applications % Internal Private Cloud Hybrid Cloud External Public Cloud and SaaS CUSTOMER-FACING ENTERPRISE APPLICATIONS Q. For each of the following categories of workload/business functions, what is your primary deployment For method customer-facing likely be the next two enterprise years (internal applications, private cloud, external internal public cloud, private hybrid cloud, cloud or SaaS)? is the preferred deployment model for 5 of n = 28 to 53. respondents, followed by hybrid cloud at 2, external public cloud at 1 and SaaS at. The top reasons cited for the selections were cost and agility, control/management issues, security issues, data sensitivity/ip risk and cost. For internal private cloud, the primary selection reasons were control/management issues, data sensitivity/ip risk and security issues. For hybrid cloud, the primary reason cited was cost. BACK-OFFICE ENTERPRISE APPLICATIONS For back-office enterprise applications, internal private cloud is the preferred deployment model for 5 of respondents, followed by SaaS at 20%, hybrid cloud at 1 and external public cloud at 9%. The top reasons cited for the selections were cost, cost and agility, control/management issues, and security issues. For internal private cloud, the primary selection reasons were security issues, cost and agility and cost. For SaaS the primary reason cited by 3 of respondents was cost.
14 CLOUD COMPUTING STUDY DEPLOYMENT METHODS 14 BATCH COMPUTING APPLICATIONS For batch computing applications, internal private cloud is the dominant deployment model for 6 of respondents, followed by hybrid and external public cloud at 1 each. The top reasons cited for the selections were control/ management issues and cost. For internal private cloud, the primary selection reason was control/management issues, cited by 29%, with 2 stating they had no external cloud plans for batch processing applications. E-BUSINESS HOSTING For e-business hosting applications, hybrid cloud is the preferred methodology for 4 followed by external public cloud for, with internal private cloud at 1 and SaaS at 1. The top reasons cited for the selections were equally security issues, cost and agility, cost, control/management issues, and agility. For hybrid cloud, the primary selection reason was control/management issues, cited by, while limited data sensitivity/ip risk was the reason cited by 3 choosing external public cloud. COLLABORATIVE APPLICATIONS For collaborative applications, internal private cloud is the preferred methodology for 3, followed by external public cloud for 2, with SaaS at 19% and hybrid cloud at 1. The top reasons cited for the selections were good fit for public cloud, functionality/ease of use and cost. For internal private cloud, the primary selection reasons were security issues and data sensitivity/ip risk, while good fit for public cloud and cost were the top two reasons cited for choosing external public cloud. TEST AND DEVELOPMENT OF APPLICATIONS For test and development of applications internal private cloud is the preferred methodology for 4, followed by hybrid and external public cloud at 2 each. The top reasons cited for the selections were data sensitivity/ip risk and cost and agility. For internal private cloud the primary selection reasons were cost and agility, cost and compliance/governance. Data sensitivity/ip risk was the primary reason for selecting hybrid cloud, with cost and agility the main reason for choosing external public cloud. CLOUD-NATIVE APPLICATIONS For cloud-native applications, external public cloud is the preferred methodology for 3, followed by SaaS for 29%, hybrid cloud for 2 and internal private cloud for just 1 of respondents. The top reasons cited for the selections were existing SaaS workloads, good fit for public cloud, functionality/ease of use and cost and agility. For external public cloud, the primary selection reasons were equally good fit for public cloud and cost and agility. Good fit for public cloud and existing SaaS workloads were the primary reasons for selecting SaaS followed by functionality/ ease of use.
15 CLOUD COMPUTING STUDY 15 Public Cloud Provider Adoption As the cloud computing market evolves, it is clear that a greater diversity of cloud service provider types will proliferate, each eventually finding their place and share of the opportunity. The cloud marketplace is too immature to reliably measure which categories of providers will create and achieve a sustainable share of the market from a capacity or revenue perspective, but we are able to gauge future potential by exploring the current and future rates of adoption of differing provider types. External Public Cloud Provider Adoption for Infrastructure Services by Provider Type n=118. External Public Cloud Provider Adoption for Infrastructure Services by Provider Type See Appendix for more details about the questions and data representation. Online Service Providers Telecommunications Provider Hosting Provider Datacenter Operator ISV Traditional Systems Integrator With Hardware Assets System Integrator or Asset-light Provider Value-added Reseller Pure SaaS Provider Consolidated Service Provider ISaaS Provider 40% % 2 20% % 10% 6 9 Current Provider Future Provider (in Two Years) For cloud infrastructure (XaaS) service providers, defined as IaaS, PaaS and ISaaS but not SaaS, online service providers See Appendix such for as more Amazon, details about Microsoft the questions and and data others representation. are in use to some extent by 6 of respondents currently, and this is n=118. expected to rise to 9 two years from now. Telecommunications providers rate second in adoption at 40%, growing to 5 in two years. Hosting providers and datacenter operators share the action with 3 and 2 adoption respectively, rising to 4 and 30% two years from now. In the growing cloud service market, there is opportunity for other categories of providers, with the strongest growth potential for ISaaS providers, starting with just current adoption and expected adoption growing to two years from now.
16 CLOUD COMPUTING STUDY PROVIDER ADOPTION 16 External Public Cloud Cloud Provider Provider Adoption Adoption of Software of as Software a Service as by Provider a Service Type by Provider n=118. Type See Appendix for more details about the questions and data representation. Pure SaaS Provider Online Service Providers ISaaS Provider ISV Hosting Provider Telecommunications Provider System Integrator or Asset-light Provider Value-added Reseller Datacenter Operator Traditional Systems Integrator With Hardware Assets Consolidated Service Provider 1 20% 1 20% 3 40% 9 99% Current Provider Future Provider (in Two Years) For software as a service providers, pure SaaS providers are used to some extent by 9 of respondents currently and will achieve close to ubiquitous adoption (99%) in two years. Other categories of cloud providers will be able to bid n=118. for a piece of the pie, primarily online service providers, ISaaS providers and independent software vendors. For See Appendix for more details about the questions and data representation. the rest, the upside opportunity is very limited. Over the next two years, respondents expect adoption of SaaS from online service providers to grow from a current 3 to 40%, for ISaaS providers from 1 to 20% and for ISVs from 1 to 20%. The market for cloud services is expected to grow substantially in the coming years, creating substantial opportunity for and competition between vendors of all types. While established vendors such as Microsoft, Amazon Web Services and salesforce.com are expected to continue prospering, a plethora of other well-known companies are expected to grab a piece of the pie including AT&T, Verizon, ServiceNow, Google, IBM, CenturyLink, HP, Rackspace and many others.
17 CLOUD COMPUTING STUDY PROVIDER ADOPTION 17 Combined External Public Cloud Provider Adoption for Infrastructure and Software Services n=118. See Appendix for more details about the questions and data representation. Microsoft Amazon Web Svcs salesforce.com AT&T Verizon ServiceNow Google IBM CenturyLink HP Rackspace Oracle Accenture Equinix SAP Dell CDW BT Workday Concur Tech Box Cisco BMC Sftw SunGard CSC FIS EMC % % 1 9% 10% 9% 9% 9% Current Provider Future Provider (in Two Years).
18 CLOUD COMPUTING STUDY 18 Technology Roadmap ADOPTION PLANS As enterprises move beyond server virtualization to on-premises, private cloud implementations, we are beginning to see some trends in technology adoption emerge. As might be expected as we move into the era of the softwaredefined datacenter, automated server provisioning is widely adopted, and leads the pack for in-use technologies at 4, with planning first-time deployments and just 29% having no plans at this time. Leading the pack for first-time deployment in the next two years and beyond are two technologies critical for successful cloud implementations, cloud platforms at 3 and cloud performance management and monitoring at 3. Both of these technologies place second equal for current adoption at 3, with just 2 and 3 having no plans. From the greenfield upside opportunity perspective, metering and billing comes in third place at 2, with just 2 of respondents citing current use. Given the early stages of cloud technology adoption, for most situations the future opportunity is greater than the significance of in-use technologies. While the data in the cloud computing technology roadmap chart below is identical in structure to our more regular format, it has been simplified and prioritized to highlight the greenfield opportunity for first time use of a technology in the next two years and beyond, followed by in-use adoption and finally to indicate where no plans for deployment exist. Cloud Computing Technology Roadmap: Priority for Next Two-plus Years What is your status of implementation for this technology? n=118. Cloud Computing Technology Roadmap: Priority for Next Two-plus Years Cloud Platform Cloud Performance Management/Monitoring Self-service Catalog Cloud Governance Metering and Billing Automated Server Provisioning Automated Storage Provisioning Cloud Storage Services Automated Network Provisioning Enterprise Application Store Infrastructure as a Service (Virtual Private Cloud) Cloud Software Appliance Unified Cloud Management Console Platform as a Service Infrastructure Software as a Service Public Cloud Performance Mgmt/Monitoring Automated Middleware Provisioning Cloud Broker Colocation Services in a Multi-tenant Datacenter Information Technology Outsourcing Infrastructure as a Service (Fully Shared) On-ramp Services Software as a Service Managed or Dedicated Server Hosting % 19% 20% % % 2 19% % In Use Priority for Next Two-plus Years Not in Plan Don't Know 3 3 9% 8 79% 7 69% 69% % % 1 Q. What is your status of implementation for this technology? n=118.
19 CLOUD COMPUTING STUDY TECHNOLOGY ROADMAP 19 For public cloud, most enterprises already have some form of software as a service in use, cited by 8 of respondents. Despite the wide variety of SaaS offerings available that could imply further upside opportunity, just are planning new usage in the next two years and beyond. SPENDING AND WHAT S HOT? The shift in focus toward cloud computing is noticeable, with respondents planning significant increased spending across the board going into 2014 compared with the period a year earlier vs Spending Change for Cloud Computing Technologies How will your spending on this technology change in 2014 as compared to 2013? 2014 vs Spending Change for Cloud Computing Technologies n= 112 to 118. Data from respondents not using the technology or that don t know about spending are hidden. Cloud Platform Software as a Service Infrastructure as a Service (Virtual Private Cloud) Cloud Storage Services Automated Server Provisioning Cloud Performance Management/Monitoring Self-service Catalog Automated Storage Provisioning Metering and Billing Colocation Services in a Multi-tenant Datacenter Cloud Governance Cloud Software Appliance Platform as a Service Infrastructure as a Service (Fully Shared) Information Technology Outsourcing Public Cloud Performance Management/Monitoring Enterprise Application Store Infrastructure Software as a Service Automated Network Provisioning Managed or Dedicated Server Hosting Unified Cloud Management Console Automated Middleware Provisioning On-ramp Services Cloud Broker % 39% % % 1 19% % 10% % 9% 9% Less Spending About the Same More Spending Q. How will your spending on this technology change in 2014 as compared to 2013? n= 112 to 118. Data from respondents not using the technology or that don't know about spending are hidden.
20 CLOUD COMPUTING STUDY TECHNOLOGY ROADMAP 20 Comparing TheInfoPro s Heat and Adoption Index values, which indicate user demand and growth potential vs. aggregate investment and established use for specific technologies, automated server provisioning, cloud performance management and monitoring and cloud platforms take the top position for upside opportunity in the next two years and beyond. Cloud Computing Technologies: Heat Index vs. Adoption Index n=118. Heat Rank Technology Heat Score Adoption Score Heat Rank Technology Heat Score From the technology provider perspective, there are many players vying for position across the entire cloud technology spectrum, but the most frequent mentions are for VMware, Microsoft and Amazon Web Services. VMware tops the list for both in-plan and in-use mentions. Microsoft comes second for in-plan, pushing Amazon Web Services into third place. AWS comes second for in-use status but appears to be losing traction for future consideration to Microsoft and VMware. Adoption Score 1 Automated Server Provisioning Cloud Storage Services Cloud Performance Management/Monitoring Platform as a Service Cloud Platform Cloud Software Appliance Automated Storage Provisioning Metering and Billing Automated Network Provisioning Infrastructure as a Service (Fully Shared) Cloud Governance Infrastructure Software as a Service Unified Cloud Management Console Colocation Services in a Multi-tenant Datacenter Public Cloud Performance Management/ Monitoring Cloud Broker Self-service Catalog Managed or Dedicated Server Hosting Infrastructure as a Service (Virtual Private Cloud) On-ramp Services Software as a Service Automated Middleware Provisioning Enterprise Application Store Information Technology Outsourcing 0 15 Technology Heat Index : measures user demand for a technology based on several factors including: usage or planned usage, changes in planned spending, an organization s budget for the relevant IT sector, and future changes in the organization s budget. A high score means a technology is expected to see significant growth. A! vendor has at least twice the number of selections as the closest competitor. Technology Adoption Index: measures aggregate investment in a technology based on several factors including: usage or planned usage, changes in planned spending, and an organization s budget for the relevant IT sector. A high score means the technology is already experiencing healthy adoption.
Servers and Virtualization: Wave 13 Servers and Virtualization Software Technology Roadmap Capturing IT professionals adoption plans, projected spending and vendor short lists, the in-depth roadmap covers
Servers and Virtualization Study: Wave 14 Big Data and Business Analytics This report captures IT professionals adoption plans, projected spending, vendor short-lists and considerations in decision-making
Servers and Virtualization Study: Wave 12 Servers and Virtualization Hardware Technology Roadmap Capturing server and virtualization professionals adoption plans, projected spending and vendor shortlists,
COMPETITIVE ANALYSIS Worldwide Cloud Systems Management Software 2013 Vendor Shares Mary Johnston Turner IDC OPINION In 2013, the worldwide cloud systems management software competitive market showed very
Research Publication Date: 23 November 2010 ID Number: G00209000 Private Cloud Computing: An Essential Overview Thomas J. Bittman Private cloud computing requires strong leadership and a strategic plan
Brochure Fast-track to advanced hybrid cloud HP Helion CloudSystem Accelerate your journey to the cloud Why choose HP Helion CloudSystem? The industry s most complete, integrated, and open solution for
Hosting and Colocation Regional Strategies for Growth April 2015 Key Findings Location is becoming increasingly important for colocation and hosting providers alike, with a growing need by those providing
Private Cloud Expected to Grow at Twice the Rate of Public Cloud In This Paper Security, privacy concerns about the cloud remain SaaS is the most popular cloud service model in use today Microsoft, Google
EXECUTIVE OVERVIEW MANAGED INFRASTRUCTURE MARKET OVERVIEW 2013 Global Perspectives KEY FINDINGS Managed hosting as a subset of managed infrastructure remains the overwhelming bulk of the market opportunity
Hybrid Cloud Strategies: Backup and Beyond Henry Baltazar Research Director, Storage 1 Today s Presenter Henry Baltazar- Research Director, Storage Henry Baltazar is the Research Director of Storage for
EXECUTIVE OVERVIEW THE AWS PARTNER NETWORK IMPACT ON THE INTERNET INFRASTRUCTURE SERVICES BUSINESS KEY FINDINGS The IaaS market is currently about 20% the size of the managed hosting market; however, it
Charting the Journey into the Cloud An Info-Tech Indaba White Paper Prepared for OnX by Info-Tech Research Group, Indaba Division Sponsored by Cisco, EMC, and VMware 2 Introduction Page 3 Cloud Overview
Cloud Computing in the Enterprise An Overview For INF 5890 IT & Management Ben Eaton 24/04/2013 Cloud Computing in the Enterprise Background Defining the Cloud Issues of Cloud Governance Issue of Cloud
I D C V E N D O R S P O T L I G H T W o r k l o a d Management Enables Big Data B u s i n e s s Process Optimization November 2015 Adapted from Worldwide Workload Management Software Market Shares, 2014:
Storage Outlook for the Data Center Marco Coulter VP, TheInfoPro (a Service of 451 Research) METRICS Budget ($Million) Mean Storage Budget: 2011-2013 by Size of Enterprise Average budget continues to decline
Empowering IT-as-a-Service with Cloud and OpenStack Technology Innovation Jim Wittry HP Cloud Partner Business Manager Jim.email@example.com http://www8.hp.com/us/en/cloud/helion-overview.html Copyright 2014
Accenture Cloud Platform Unlocks Agility and Control 2 Accenture Cloud Platform Unlocks Agility and Control The Accenture Cloud Platform is at the heart of today s leading-edge, enterprise cloud solutions.
2014 Enterprise End User Trends Report Fourth Annual Survey of Enterprise Linux Users December 2014 A Linux Foundation Publication www.linuxfoundation.org Executive Summary: Cloud Computing and Security
HP officially launches Cloud Services key to its vision of hybrid IT service delivery Analyst: Carl Brooks William Fellows 13 Jun, 2012 Hewlett-Packard has taken the wraps off Cloud Services its portfolio
WHITEPAPER RED HAT OPENSTACK PLATFORM A COST-EFFECTIVE PRIVATE CLOUD FOR YOUR BUSINESS INTRODUCTION The cloud is more than a marketing concept. Cloud computing is an intentional, integrated architecture
STATE OF OPENSTACK ADOPTION REPORT Industry Survey Results February 2016 Why Another OpenStack Report? The open source cloud computing project, OpenStack, has come a long way since NASA and Rackspace launched
The Cloud Management Scenario Donna Scott Gartner is a registered trademark of Gartner, Inc. or its affiliates. This publication may not be reproduced or distributed in any form without Gartner's prior
Brochure More information from http://www.researchandmarkets.com/reports/3069769/ Cloud Management: Solutions Assessment and Market Outlook 2015 Description: The Cloud Management ecosystem is rapidly transforming
IDC VENDOR SPOTLIGHT T h e S h i f t t o H yb r i d C l o u d : I T a n d L i nes of B u s i n e s s B oth Stand to Benefit November 2015 Adapted from: The Journey to the Cloud Is Not Either/Or: Exploring
Research Publication Date: 22 October 2009 ID Number: G00171807 Q&A: The Many Aspects of Private Cloud Computing Thomas J. Bittman Cloud computing is at the Peak of Inflated Expectations on the Gartner
A Gentle Introduction to Cloud Computing Source: Wikipedia Platform Computing, Inc. Platform Clusters, Grids, Clouds, Whatever Computing The leader in managing large scale shared environments o 18 years
Transforming Business Processes with Agile Integrated Platforms SPRING 2015 Sponsored by SAP Technology Business Research, Inc. Technology changes, but the needs of business do not. Integration is essential
Solution White Paper Build the Right Cloud, Quickly BMC Express Cloud Table of Contents 1 THE PROMISE OF CLOUD COMPUTING Getting Started 2 SUCCEEDING WITH CLOUD COMPUTING 3 INTRODUCING BMC EXPRESS CLOUD
Outsmart Your Competitors Current Reality: A Look at Cloud Opportunities Beyond the Hype May 17 and 18, 2011 Presented by: Jeremiah Caron, Vice President - Analysis Amy DeCarlo, Principal Analyst Security
Wikibon.com - http://wikibon.com by David Floyer - 30 September 2013 http://wikibon.com/vmware-dominant-in-multi-hypervisor-data-centers/ 1 / 17 Executive Summary Virtualization has moved beyond an approach
WHITE PAPER Executive Summary... 2 Methodology... 3 Survey Sample... 3 About Zenoss, Inc.... 3 The State of the Open Source Cloud... 4 1. The Who, What & Where of Survey Respondents... 4 2. Virtualization
The future Cloud Computing? Peter H. Moser, Jr. Manager, Portfolio Architects & Account CTOs 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without
COMPETITIVE ANALYSIS Worldwide Cloud Systems Management Software 2012 Vendor Shares Mary Johnston Turner IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015
HP CLOUDSYSTEM A single platform for private, public, and hybrid clouds Simply the most complete cloud system for enterprises and service providers Solution brief It s a fact of life: cloud computing is
Customer Needs and Strategies U.S. IT Buyer Survey Shows Outsourcers Bring Strength to Cloud David Tapper This is an IDC Excerpt developed for IBM IN THIS EXCERPT The content for this excerpt was taken
THE CHANGING LINUX LANDSCAPE The cloud, community distributions and devops are dramatically impacting the market Trends such as cloud computing and devops whereby application development and deployment
Whitepaper Red Hat Enterprise Linux OpenStack Platform A Cost-Effective Private Cloud for Your Business Introduction The cloud is more than a marketing concept. Cloud computing is an intentional, integrated
PUBLIC, PRIVATE, OR HYBRID: WHICH CLOUD IS BEST FOR YOUR APPLICATIONS? Public cloud offerings have proliferated, and private cloud has become mainstream. It s now a question of how to harness the potential
HRG Assessment: Cloud Computing Provider Perspective In the fall of 2009 Harvard Research Group (HRG) interviewed selected Cloud Computing companies including SaaS (software as a service), PaaS (platform
red hat open hybrid cloud Whitepaper Maximize strategic flexibility by building an open hybrid cloud Gordon Haff EXECUTIVE SUMMARY Choosing how to build a cloud is perhaps the biggest strategic decision
Accenture cloud application migration services A smarter way to get to the cloud Cloud computing can help make your apps extraordinarily agile and scalable. You know this. Your competitors know this. And
PREVIEW 2016 Trends in Storage DEC 2015 Henry Baltazar, Research Director Though storage is far from dead, change is coming in the shape of new form factors such as hyperconverged infrastructures and disruptive
HP OpenStack & Automation Where we are heading Thomas Goh Cloud Computing Cloud Computing Cloud computing is a model for enabling ubiquitous network access to a shared pool of configurable computing resources.
Benefitting from OpenStack Momentum By Syed Raza OpenStack is a four-year-old open source infrastructure-as-a-service (IaaS) project that has grown into one of the largest collaborative development platforms
Cloud Computing: Current Market Trends and Future Opportunities by Martin Tantow, Editor-in-Chief, CloudTimes.org Commodity Infrastructure as a Service Cloud computing continues to gain more mainstream
Market Share Worldwide Cloud Systems Management Software Market Shares, 2015: Year of Continued Expansion Mary Johnston Turner IDC MARKET SHARE FIGURE FIGURE 1 Worldwide Cloud Systems Management Software
2014 Cloud Computing Exclusive Research from Cloud Computing Continues to Make Inroads Companies are expanding their use of cloud as they work through implementation and organizational challenges Cloud
The Smell of Security, the Roar of the Cloud When buzzwords start getting thrown around with reckless abandon, the results can be polarizing. Vendor market figures only show half the picture; our interviews
Swiftly Deploy Private and Hybrid Clouds with a Single Pane of Glass View into Cloud Infrastructure Enable Fast, Easy, and Robust Cloud Computing with RightScale and Eucalyptus Overview As organizations
I D C T E C H N O L O G Y S P O T L I G H T U n i fied Cloud Management Increases IT- as- a - S e r vi c e Ag i l i t y November 2013 Adapted from VMware Unifies Cloud Management Portfolio with a Focus
Issue 1 Why Should Your Cloud Be Designed With Open And Hybrid in Mind? How an open, hybrid cloud architecture is critical to your cloud success 2 Why the future of cloud is open 4 From the Gartner Files:
Clouding the issue Why a mix of on-premises, public and private cloud-based solutions could be the future 2 Financial services providers need to choose carefully when it comes to cloud computing It s fair
MARKET MAP Cloud Management Platform Market Map 2016 MAY 2016 William Fellows, Research Vice President A cloud management platform should operate like a cloud Uber app for IT consumption and delivery that
GET CLOUD EMPOWERED. SEE HOW THE CLOUD CAN TRANSFORM YOUR BUSINESS. Cloud computing is as much a paradigm shift in data center and IT management as it is a culmination of IT s capacity to drive business
Datacenter Management and Virtualization Microsoft Corporation June 2010 The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the
Ensuring High Service Levels for Public Cloud Deployments Keys to Effective Service Management Table of Contents Executive Summary... 3 Introduction: Cloud Deployment Models... 3 Private Clouds...3 Public
VALUE PROPOSITION FOR SERVICE PROVIDERS Helping Service Providers accelerate adoption of the cloud Partnership with Service Providers Enabling Your Cloud Services in Complex Environments Today s challenge
RACKSPACE THE OPEN CLOUD COMPANY WITH EMC STORAGE TODAY S ENTERPRISE IT LEADERS ARE FACED WITH TREMENDOUS CHALLENGES: They must provide an IT infrastructure that reliably supports the multitude of applications
REPORT REPRINT On the journey to cloud, the Accenture-AWS deal is an important signpost WILLIAM FELLOWS 22 OCT 2015 Last week s Accenture-AWS deal has become a touchstone for interest in how quickly public
Platform as a Service: The IBM point of view Don Boulia Vice President Strategy, IBM and Private Cloud Contents 1 Defining Platform as a Service 2 The IBM view of PaaS 6 IBM offerings 7 Summary 7 For more
Overview The purpose of this paper is to introduce the reader to the basics of cloud computing or the cloud with the aim of introducing the following aspects: Characteristics and usage of the cloud Realities
MARKET FORECAST APR 2016 Software-Defined Network Architectures Find High Customer Value When Applied to the WAN Peter Christy, Research Director, Networks EXECUTIVE OVERVIEW Networking has evolved rapidly
PREVIEW 2016 Trends in Service Providers NOV 2015 Al Sadowski, Research Director Liam Eagle, Senior Analyst Carl Brooks, Analyst Jim Davis, Senior Analyst Selling generic technology resources is no way
Cloud Computing: It s In Your Future What You Need to Know about Logicalis and Cloud Computing Cloud computing is a transition that is changing the way you will buy, build, operate and consume information,
Cloud: What an Enterprise Must Know What You Will Learn This document is addressed to business and technology leaders at enterprises worldwide, with the expectation that the reader has a basic understanding
Issue 1 Why Should Your Cloud Be Designed With Open And Hybrid in Mind? How an open, hybrid cloud architecture is critical to your cloud success 2 Why the future of cloud is open Welcome 4 From the Gartner
Analyzing the Business of Enterprise IT Innovation DATACENTER INFRASTRUCTURE MANAGEMENT SOFTWARE Monitoring, Managing and Optimizing the Datacenter As datacenters become bigger, denser and more complex,
VMware on VMware: Private Cloud Case Study Customer Presentation 2009 VMware Inc. All rights reserved Agenda VMware IT landscape Motivations for the Cloud Private Cloud Stack Impact of moving to the Cloud
G00246304 Selecting a Mobile App Development Vendor Published: 27 December 2012 Analyst(s): Ken Parmelee Ensuring that mobile app development vendors meet requirements and are viable requires an understanding
Private Cloud for the Enterprise: Platform ISF A Neovise Vendor Perspective Report 2009 Neovise, LLC. All Rights Reserved. Background Cloud computing is a model for enabling convenient, on-demand network
Will You Become a Cloud Hostage? Preserving Flexibility and Mobility by Avoiding Cloud Provider Lock-in Scott Jeschonek Director, Product Management, Avere Systems October 2014 2014 Avere Systems, Inc.
Top five lessons learned from enterprise hybrid cloud projects Top performer highlights More than half of top performers give users access to selfservice provisioning across both private and public cloud
Cloud Services for DevOps: Next-gen PaaS Through MBaaS September 2013 Presented by: Brad Shimmin Research Director, Business Technology and Software firstname.lastname@example.org Charlotte Dunlap Sr. Analyst,