Survey Results and Vendor Panel Worlds Collide: Big Data, Where Enterprise Meets HPC

Transcription

1 Survey Results and Vendor Panel Worlds Collide: Big Data, Where Enterprise Meets HPC Addison Snell

2 278 total respondents New Survey Data 178 Technical (HPCwire and HPC500 user group) 100 Enterprise (Gabriel Consulting) 165 commercial, 67 academic, 46 government Surveys completed April August 2013 Builds on original survey from early 2012 End users discuss their environments, challenges, solutions, and satisfaction gaps in addressing Big Data challenges

3 Technical vs. Enterprise Computing Technical Computing Top-line missions: Find the oil Design the minivan Cure the disease Driven by price/ performance Fast adoption of new technologies, algorithms, and approaches Enterprise Computing Keeps business running Communicate/collaborate Market and sell the product Accounting, HR, finance, Driven by RAS: reliability, availability, serviceability Slow adoption of new technologies, algorithms, and approaches

4 Insight #1: Big Data, Big Opportunity What percent of your organization's IT budget in 2013 will be related to Big Data? Money is being spent on Big Data 60% of those responding will spend more than 10% of the IT budget relate to Big Data Use caution in describing the Big Data market

5 Insight #2: Not Just Hadoop In 2012, only 17% of respondents mentioned Hadoop when describing their Big Data applications. In 2013, this went down, driven by Enterprise respondents. Deployments might be based on Hadoop, but the majority of Big Data implementations are on in-house applications and algorithms. Most common source of data is also in-house. ISV software for Big Data is thinly scattered.

6 Insight #3: Performance Counts Metrics of performance show up as key factors in Enterprise as well as Technical Big Data will be a driver for expanded usage of HPC, IF they can still meet enterprise requirements

7 For More Information and Results Keynote, SNIA SDC/ABDS: Technology Vendors: You can buy it. Reasonable prices. See me. HPC Users: Join our HPC user group, HPC500, to get free access to research studies. We will ask you to participate in surveys We will keep your organizations anonymous if desired

8 Big Data Vendor Panel Discussion Thomas Keil, SAS Bernard Doering, Intel Stefan Sigg, SAP Stefan Weidner, SGI Frank Herold, Quantum

9 Panel Question 1 What is your company's view of Big Data, and how do you approach providing solutions for Big Data problems?

10 Panel Question 1A What is your company's view of Big Data, and how do you approach providing solutions for Big Data problems? How pervasive is Hadoop in providing real Big Data solutions? When is Hadoop appropriate or inappropriate?

11 Panel Question 1B What is your company's view of Big Data, and how do you approach providing solutions for Big Data problems? Where are we today on the hype vs. reality curve for Big Data?

12 Panel Question 1C What is your company's view of Big Data, and how do you approach providing solutions for Big Data problems? Most Big Data deployments rely on in-house applications or algorithms. Is this a good thing? What tools can help organizations create and scale their Big Data software environments?

13 Panel Question 2 Big Data is an enterprise IT problem with the performance and scalability challenges of HPC applications. To what extent are Big Data deployments standard IT infrastructure, versus a special investment?

14 Panel Question 2A To what extent are Big Data deployments standard IT infrastructure, versus a special investment? Are there any high-performance technologies that are not currently enterprise standards that will gain greater adoption because of the requirements of Big Data?

15 Panel Question 2B To what extent are Big Data deployments standard IT infrastructure, versus a special investment? The previous conference this week was ISC Cloud. What do you see as the areas of overlap for Cloud and Big Data?

16 Panel Question 3 Does Big Data change how we think about enterprise IT? Enterprise computing? Enterprise storage?

17 Panel Question 3A Does Big Data change how we think about enterprise IT? Enterprise computing? Enterprise storage? What are the specific areas of development your company is making because of Big Data trends?

18 Panel Question 3B Does Big Data change how we think about enterprise IT? Enterprise computing? Enterprise storage? How will Big Data continue to evolve?

19 Thank You, Panelists Thomas Keil, SAS Bernard Doering, Intel Stefan Sigg, SAP Stefan Weidner, SGI Frank Herold, Quantum Addison Snell, Intersect360