Cloud Computing and Big Data That s Why! Ray Walshe 14 th March 2013

Transcription

1 Cloud Computing and Big Data That s Why! Ray Walshe 14 th March 2013

2 Data Centre Growth We need more data centres??? (c) Ray Walshe

3 By 2015 By 2015, about 24% of all new business software purchases will be of service-enabled software SaaS delivery being 13.1% of worldwide software spending. (c) Ray Walshe

4 By 2015 By of every 6 spent on packaged software 1 of every 5 spent on applications will be consumed via the SaaS model (c) Ray Walshe

5 Size matters! 10 Terabytes: The printed collection of the US Library of Congress 2 Petabytes: All US academic research libraries 5 Exabytes: All words ever spoken by human beings World Storage Capacity 295 exabytes in billion CD-ROMs create a stack from the earth to the moon and a quarter of this distance beyond (c) Ray Walshe

6 By 2015 Annual global data center traffic will reach 4.8 zettabytes Global data center traffic will reach 402 exabytes per month (402 x ) Global data center traffic will increase fourfold over the next 5 years (33% compound annual growth) (c) Ray Walshe

7 By 2020 U.S. Federal Cloud Computing Market into double-digit growth phase at about 16% CAGR over the period Annual federal cloud computing market to hit $10 billion landmark by Gartner (c) Ray Walshe

8 By 2020 Forrester predicts SaaS market reach $132.5 billion The PaaS market growth $820 million to $11.9 billion ( ) IaaS growth $2.94 billion to $5.4 billion ( ) (c) Ray Walshe

9 By 2020 Cloud computing industry as a whole growing annually by 24% Deloitte is predicting cloud-based applications 14.49% of enterprise IT spending in 2020 (c) Ray Walshe

10 (c) Ray Walshe

11 Big Data Trend 35 Zettabytes of data to be generated annually by % growth in unstructured data 60% Growth in all data annually (c) Ray Walshe

12 Facebook Twitter Ads (c) Ray Walshe

13 Big Data in Today s Business and Technology Environment 2.7 Zettabytes in the digital universe today (IBM) 235 Terabytes of data collected by U.S. Library of Congress (SocialStudies) The Obama administration investing $200 million in big data projects. (Wikibon) IDC estimates by 2020,business transactions will reach 450 billion per day. (Wikibon) (c) Ray Walshe

14 Big Data in Today s Business and Technology Environment Facebook contains 30+ Petabytes of user generated data. (Wikibon) Akamai analyzes 75 million events per day. (Wikibon) 94% of Hadoop users perform big-data analytics; 88% analyse in greater detail; while 82% can now retain more of their data. (syscon) Walmart handles more than 1 million customer transactions every hour, (2.5 petabytes of data) (SAS) (c) Ray Walshe

15 Big Data in Today s Business and Technology Environment More than 5 billion people are using mobile phones worldwide. (SAS) Decoding the human genome originally took 10 years to process; now it can be achieved in one week. (Economist) In 2008, Google was processing 20,000 terabytes of data (20 petabytes) a day. (Techcrunch) The largest AT&T database contains 312 terabytes and the second largest number of rows in a unique database at 1.9 trillion (focus) (c) Ray Walshe

16 Growth in Unstructured Data YouTube users upload 48 hours of new video every minute of the day. 571 new websites are created every minute of the day. Brands and organizations on Facebook receive 34,722 Likes every minute of the day. 100 terabytes of data uploaded daily to Facebook (Wikibon) (c) Ray Walshe

17 Growth in Unstructured Data Twitter s sees roughly 175 million tweets every day, and has more than 465 million accounts. (mediapost) 30 Billion pieces of content shared on Facebook every month. (McKinsey) Data production will be 44 times greater in 2020 than it was in (Wikibon) In 2011, IDC Digital Universe published a report indicating that some 1.8 zettabytes of data created that year. (Silicon Republic) (c) Ray Walshe

18 Zettabyte? (2009) The entire World Wide Web close to 500 exabytes or half a zettabyte 1,000,000,000,000,000,000,000 bytes (c) Ray Walshe

19 Growth in Unstructured Data In other words, the amount of data in the world today is equal to: Every person in the US tweeting three tweets per minute for 26,976 years. Every person in the world having more than 215m high-resolution MRI scans a day. More than 200bn HD movies which would take a person 47m years to watch. (c) Ray Walshe

20 The Market Challenge with Big Data Big Data will be a $50 billion business by (Wikibon) IDC has released a new forecast that shows the big data market is expected to grow from $3.2 billion (2010) to $16.9 billion in (StatsSpotting) (c) Ray Walshe

21 The Market Challenge with Big Data Government savings of 100 billion in operational efficiency (McKinsey) Poor data across businesses and the government costs the U.S. economy $3.1 trillion dollars a year. Too few people with deep analytical skills to fill the demand of Big Data jobs in the U.S. by (McKinsey) (c) Ray Walshe

22 The Market Challenge with Big Data 14.9 % of marketers polled in Crain s BtoB Magazine are still wondering What is Big Data? (Forbes) 39 % say that their data is collected too infrequently or not real-time enough. (PRNewsWire) 29 % have too little or no consumer data. Data collected often not appropriate to real-time decision making. (PRNewsWire) (c) Ray Walshe

23 Big Data & Real Business The volume of business data worldwide, across all companies, doubles every 1.2 years. (WPCarey) Poor data can cost businesses 20% 35% of their operating revenue. (FathomDelivers) Bad data or poor data quality costs US businesses $600 billion annually. (FathomDelivers) (c) Ray Walshe

24 Big Data & Real Business Data is putting a strain on IT infrastructure. 55% reporting a slowdown of IT systems and 47% say data security problems (Avanade) Executives at companies (fewer than 1,000 employees) are 10% more likely to view data as strategic differentiator than large enterprises. (Avanade) (c) Ray Walshe

25 Big Data & Real Business 76 % of decision makers anticipate significant impacts in the domain of storage systems (BTPlc) 25% predict that data volumes in their companies will rise 60 % by the end of 2014 (BTPlc) 40% projected growth in global data generated per year vs. 5% growth in global IT spending. (McKinsey) (c) Ray Walshe

26 Big Storage Big data is proving to be a tall order for storage. Over the next decade, the number of servers worldwide both virtual and physical will grow 10- fold. The amount of information managed by enterprise data centers 50-fold, and the number of files the data center will manage, 75-fold, The big question for any business that stores, manages, and delivers data is: Can we keep up? Teresa Worth, senior product marketing manager with Seagate Technology (c) Ray Walshe

27 Big Storage One-third of companies are now storing data in their archive systems for more than 7 years (company policy or compliance mandated) Of 611 data managers - 12% of respondents say they now hang on to all data forever. Unisphere Research among members of the Independent Oracle Users Group (IOUG) (c) Ray Walshe

28 Big Jobs Big data, is becoming an engine of job creation as businesses discover ways to turn data into revenue (Gartner) By 2015, it is expected to create 4.4 million IT jobs globally, of which 1.9 million will be in the U.S. Gartner expects that each big data IT job added to the economy will create employment for three more people outside the tech industry in the U.S., adding six million jobs to the economy. Caveat -a third of the big data jobs will be filled (c) Ray Walshe

29 EU view Cloud Computing Could Contribute up to 250 Billion to EU GDP in 2020 and 3.8 Million Jobs Policy actions aimed at removing barriers can increase the value of spending on public clouds from 35 billion (No Intervention scenario) to almost 80 billion (Policy-driven scenario) by (c) Ray Walshe

30 EU Public Cloud Market (c) Ray Walshe

31 EU Recommendations Removing Regulatory Barriers Building Trust in the Market Protect Consumers Rights to Data Insuring Data Access and Portability Promoting Standardisation and Interoperability Building the Business Case for Cloud Adoption Contributing to the Business Case for High-speed Broadband Infrastructures Quantitative Estimates of the Demand for Cloud Computing in Europe and the Likely Barriers to Uptake SMART 2011/0045 (c) Ray Walshe

32 Why are Data Centres important? Cloud Computing Big Data High Performance Computing Medical/Health Financial Manufacturing.. (c) Ray Walshe

33 Thank You! ie.linkedin.com/in/raywalshe/ (c) Ray Walshe