Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data Marc Hamilton Hyperscale Business Unit HP Enterprise Group March, 2013

Transcription

1 Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data Marc Hamilton Hyperscale Business Unit HP Enterprise Group March, 2013

2 Big Data is Accelerating Innovation & Change kaggle Pandora Music SolidFire Scribd. SmugMug ihandy Amazon Finance SuperCam salesforce.com AppFog Joyent Plex Systems Travel Snapfish Urban DCC Google Xactly Facebook Parse Product SAP ebay Dragon Diction GoGrid PingMe LinkedIn Reference HP Configurator CCC CRM Hosting.com UPS Mobile Tata Communications Bromium Atlassian Bills of Material buzzd Lifestyle Engineering Ariba NetReach Amazon Web Services SCM Inventory Quickbooks Splunk Sport Quality Control NetDocuments Zoho Scanner Pro LimeLight EMC box.net ScaleXtreme Burroughs HCM Alterian Foursquare Datapipe Qvidian Taleo Education Pinterest Hitachi Cost Management OpenText Hyland IBM Manufacturing Projects MRM Workscape Unisys Sage NetSuite Order Entry Mainframe Client/Server The Internet Mobile, Social, Big Data & The Cloud 347,000 tweets 23,148 apps downloaded 400,710 ads requests every 60 seconds New technology access methods Cash Management CyberShift PaperHost DocuSign CloudSigma NEC Bull Yandex ERP HCM Hootsuite Games Baidu Xerox Yahoo! Fijitsu Time and Expense Microsoft Serif nebula YouTube Accounts Fixed Assets HP eprint Atlassian Costing OpSource SLI Systems Workbrain Zynga Navigation Receivable Avid Elemica Workday Mixi Billing ischedule cloudability ADP VirtualEdge Yandex Payroll Photo & Video Activity PLM Corel SCM Khan Academy Twitter Heroku Management Adobe CyberShift Zillabyte Yammer Training Renren Entertainment Sales tracking & Yahoo SuccessFactors Viber Time & Rostering Kinaxis Marketing Microsoft SugarCRM News Atlassian Answers.com Attendance Service Saba Social Networking Commissions PPM BrainPOP RightScale Sonar6 Database Quadrem CYworld Claim Processing Kenexa Sonar6 MobileFrame.com Saba Business Jive Software myhomework Data Warehousing Softscape NetSuite Tumblr. Qzone Intacct Fring Toggl Amazon dotcloud Cornerstone ondemand Exact Online Cookie Doodle Xing Mozy FinancialForce.com New Relic Softscape MailChimp PingMe Utilities Zynga Ah! Fasion Girl IntraLinks Volusion Associatedcontent BeyondCore SmugMug MobilieIron Fed Ex Mobile Productivity Rackspace Flickr Twitter Paint.NET TripIt 2000 lyrics played on Tunewiki 1,500 pings sent on PingMe 34,597 people are using Zinio 208,333 minutes Angry Birds played Change how technology is consumed & value it can bring Open up new business models Remove current inhibitors & unleash power of innovation 2

3 Anywhere, anytime demand increases opportunities Hyperscale workloads growing significantly faster than overall market Hyperscale to be 35% of x86 market Customer demand for content Device proliferation Competitive edge $45.0 $40.0 $35.0 $30.0 $25.0 $20.0 HPC, $5.2 HPC, $6.4 27% 35% Hosting, $2.4 Hosting, $3.3 SP, $2.8 SP, $4.2 Driving the need for new and purpose built products! $15.0 $10.0 Enterprise $28.0 Enterprise $26.0 $5.0 $

4 Mice, Elephants, and Turtles

5 Mice and Elephants The elephant in the room Not all big data comes from mouse clicks Hadoop becoming ubiquitous - good or bad? Is storing 3 full copies of data really efficient or just easy? Are Hadoop management tools ready for the enterprise? 5

6 Breaking The Application Triangle As more and more data is stored in HDFS, disruptive innovation becomes difficult you can t break the APIs So how can you drive disruptive innovation? Users select widely available platforms to solve their business problems Vendors pursue sustaining innovation of 2-socket x86 systems for Hadoop Hadoop originally ran on commonly available 2-socket x86 systems 6

7 SSDs are Turtles SSDs usage with Hadoop growing Disk protocols too slow for SSD/Flash Better hardware is available (PCIeGen3, etc.) Flash nearing end of life just in time for new NVRAM Now its time to address the software bottlenecks HDFS on top, but what s inside? 7

8 HP Insight Cluster Management Utility 8 8

9 Dimes and Dollars

10 Dimes and Dollars Are HPC compute nodes getting too powerful for big data use? Relative performance of mobile processors increasing quicker than server processors Typical HPC compute node today, 300 watts, $300/year power Nvidia Tegra 5 mobile processor will be the size of a dime, run CUDA and OpenGL apps 60 5-watt mobile processors = $300/year power 10

11 Relative perforamance (Higher is better) Relative Performance Good Xeon performance ratios Good ARM /Atom performance ratios

12 Relative performance/watt (higher is better) Relative Performance per Watt Good ARM /Atom performance/ watt ratios

13 Relative performance (higher is better) 2H 13 HP Projections: big leap in mobile performance

14 HP Project Moonshot

15 Project Moonshot: A new era of extreme scale computing Redefining server infrastructure for rapid application optimization Application-driven designs Space Energy Costs Project Moonshot 1,000s of servers per rack Workload - tuned servers Federated infrastructure scales seamlessly with additional servers Device agnostic architecture scales from extreme low energy CPUs to high performance GPGPUs 15

16 16 Supercomputers That Reuse Energy? DOE s National Renewable Energy Lab purchases $10M HP Supercomputer - New ProLiant server platform will delivery 1 Pflop of Intel IvyBridge and Xeon Phi Power and warm water cooling system co-designed to work with NREL s new $100M Energy Systems Integration Facility (pictured below) - Waste heat used to heat office space & melt snow in winter 16

17 National Renewable Energy Lab 200 TF Linpack Feb 27,

18 Expanding the purpose-built portfolio for big data High-end nodes ProLiant SL Core Customer specific Accelerators Big Data SL270 SL250 SL230 High-efficiency computing SL Solutions

19 Thank you