IDC Update on How Big Data Is Redefining High Performance Computing Earl Joseph Steve Conway
|
|
- Sheryl Sims
- 8 years ago
- Views:
Transcription
1 IDC Update on How Big Data Is Redefining High Performance Computing Earl Joseph Steve Conway Chirag Dekate Bob Sorensen
2 IDC Has Over 1,000 Analysts In 62 Countries
3 Agenda A Short HPC Market Update Big Data Challenges and Short Comings The High End of Big Data Examples of Very Large Big Data Examples of How Big Data is Redefining High Performance Computing
4 HPC Market Update
5 What Is HPC? IDC uses these terms to cover all technical servers used by scientists, engineers, financial analysts and others: HPC HPTC Technical Servers Highly computational servers HPC covers all servers that are used for computational or data intensive tasks From a $5,000 deskside server up to over $550 million dollar supercomputer
6 Top Trends in HPC 2013 declined overall by $800 million For a total of $10.3 billion Mainly due to a few very large systems sales in 2012 that weren t repeated in 2013 We expect growth in 2015 to 2018 Software issues continue to grow The worldwide Petascale Race is at full speed GPUs and accelerators are hot new technologies Big data combined with HPC is creating new solutions in new areas
7 IDC HPC Competitive Segments: 2013 HPC Servers $10.3B Supercomputers (Over $500K) $4.0B Workgroup (under $100K) $1.6B Divisional ($250K - $500K) $1.4B Departmental ($250K - $100K) $3.4B
8 HPC WW Market Trends: A 17 Year Perspective C
9 HPC Market Forecasts
10 HPC Forecasts Forecasting a 7.4% yearly growth from 2013 to should reach $14.7 billion
11 HPC Forecasts: By Industry/Applications
12 The Broader HPC Market
13 Big Data Challenges And Shortcomings
14 Defining Big Data
15 HPDA Market Drivers More input data (ingestion) More powerful scientific instruments/sensor networks More transactions/higher scrutiny (fraud, terrorism) More output data for integration/analysis More powerful computers More realism More iterations in available time The need to pose more intelligent questions Smarter mathematical models and algorithms Real time, near-real time requirements Catch fraud before it hits credit cards Catch terrorists before they strike Diagnose patients before they leave the office Provide insurance quotes before callers leave the phone
16 Top Drivers For Implementing Big Data
17 Organizational Challenges With Big Data: Government Compared To All Others
18 Big Data Meets HPC And Advanced Simulation
19 High Performance Data Analysis Needs HPC resources High complexity (algorithms) High time-criticality High variability (On premise or in cloud) Simulation & analytics Search, pattern discovery Iterative methods Established HPC users + new commercial users Data of all kinds The 4 V s: volume, variety, velocity, value Structured, unstructured Partitionable, non-partitionable Regular, irregular patterns
20 HPC Adoption Timeline (Examples)
21 Very Large Big Data Examples
22 NASA
23 Square Kilometre Arrary Radio Astronomy for Astrophysics
24 CERN LHC: the world s leading accelerator -- Multiple Nobel Prizes for particle physics work Innovation driven by the need to distribute massive data sets and the accompanying applications Altas, one of CERN s two detectors, generates 1PB of data per second when running! (Not all of this is distributed). Private cloud distribution to scientists in 20 EU member states plus observer states (single largest user is the U.S.) Today: only % of the data is used
25 NOAA
26
27
28 HPC Will Be Used More for Managing Mega-IT Infrastructures
29 Examples of Big Data Redefining HPC
30 Use Case: PayPal Fraud Detection The Problem Finding suspicious patterns that we don t even know exist in related data sets
31 What Kind of Volume? PayPal s Data Volumes And HPDA Requirements
32 Where Paypal Used HPC
33 The Results $710 million saved in fraud that they wouldn t have been able to detect before (in the first year)
34 There Are New Technologies That Will Likely Cause A Mass Explosion In Data Requiring HPDA Solutions
35 GEICO: Real-Time Insurance Quotes Problem: Need accurate automated phone quotes in 100ms. They couldn t do these calculations nearly fast enough on the fly. Solution: Each weekend, use a new HPC cluster to pre-calculate quotes for every American adult and household (60 hour run time)
36 Something To Think About -- GEICO: Changing The Way One Approaches Solving a Problem Instead of processing each event one-at-a-time, process it for everyone on a regular basis It can be dramatically cheaper, faster and offers additional ways to be more accurate But most of all it can create new and more powerful capabilities Examples: For home loan applications calculate for every adult in the US and every home in the US For health insurance fraud track every procedure done on every US person by every doctor and find patterns
37 Something To Think About -- GEICO: Changing The Way One Approaches Solving a Problem Future Examples (continued): If you add-in large scale data collection via sensors like GPS, drones and RFID tags: New car insurance rules The insurance company doesn t have to pay if you break the law -- like speeding and having an accident You could track every car at all times then charge $2 to see where the in-laws are in traffic if they are late for a wedding Google maps could show in real-time where every letter and package is located But crooks could also use it in many ways e.g. watching ATM machines, looking for when guards are on break,
38 U.S. Postal Service
39 U.S. Postal Service
40 U.S. Postal Service MCDB = memory-centric database
41 CMS: Government Health Care Fraud 5 separate databases for the big USG health care programs under Centers for Medicare and Medicaid Services (CMS) Estimated fraud: $150B-$450B <$5B caught today) ORNL, SDSC have evaluation contracts to unify the databases and perform fraud detection on various architectures
42 Schrödinger: Cloud-based Lead Discovery for Drug Design NOVARTIS/SCHROEDINGER: Pharmaceutical company Novartis increased resolution of drug discovery algorithm 10x and wanted to use it to test 21 million small molecules as drug candidates Novartis used the Schroedinger drug discovery app in AWS public cloud, with the help of Cycle Computing Initial run used 51,000 AWS cores and took $14,000 and <4 hours and its getting cheaper Later run used 156,000 AWS cores with comparable costs and time
43 Schrödinger: Cloud-based Lead Discovery for Drug Design
44 Global Financial Services: Company X One of the most respected firms in the global financial services industry updates detailed information daily on several million companies around the world. Clients use the firm's credit ratings and other company information in making lending decisions and for other planning, marketing, and business decision making. The firm uses statistical models to develop a company's scores and ratings, and for years, the ratings have been prepared and analyzed locally in near real time by the firm's personnel around the world. This practice is a major competitive advantage but resulted in the creation of hundreds of distinct databases and more than a dozen scoring environments. Several years ago, the company established a goal of centralizing these resources and chose SAS as the centralization mechanism, including SAS Grid Manager as part of the software stack.
45 Global Financial Services: Company X The centralized IT infrastructure created using SAS preserves the advantages of the company's locally created ratings and reports. The new infrastructure provides an effective environment for analytics development and accommodates multiple testing, debt, and production environments in a single stack. It is flexible enough to allow dynamic prioritization among these environments, according to a company executive. With help from SAS Grid Manager, the company can maximize the use of its computing resources. The software automatically assigns jobs to server nodes with available capacity, instead of having users wait in queue for time on fully utilized nodes. The company executive estimates that it might cost 30% more to purchase servers with enough capacity to handle these peak workloads on their own.
46 Global Financial Services: Company X Several million clients use the firm s credit ratings to help make lending decisions Goal: increase efficiency for updating ratings Result: HPC multi-cluster grid boosted efficiency 30% -- no need to buy additional clusters yet.
47 Real Estate Worldwide vacation exchange & rental leader Goal: Update property valuations several times per day (not possible with enterprise servers) Results: HPC technology enabled all updates in 8-9 hours Avoided move to heuristics Allowed company to focus on rental side
48 Outcomes-Based Medical Diagnosis and Treatment Planning Enter the patient s history and symptomology. While the patient is still in the office, sift through millions of archived patient records for relevant outcomes. Provider considers the efficacies of various treatments for similar patients (but is not bound by the findings). Ergo, this functions as a powerful decision-support tool. Benefits: better outcomes + rein in costly outlier practices.
49
50 Digital Television Services A global leader with 30 million subscribers Goal: maximize revenue & customer satisfaction during high-growth period Result: HPC has added 7.5 million in annual revenue while increasing satisfaction
51 IDC HPDA Server Forecast Fast growth from a small starting point: $933 M HPDA ecosystem >$2.6B in 2018
52 IDC HPDA Storage Forecast Storage is the fastest-growing HPC market (9% CAGR) And HPDA storage will grow even faster (26.5% CAGR)
53 In Summary
54 Summary: HPDA Market Opportunity HPDA: simulation + newer highperformance analytics IDC predicts fast growth from a small starting point HPC and high-end commercial analytics are converging Algorithmic complexity is the common denominator Economically important use cases are emerging No single HPC solution is best for all problems
55 HPDA User Talks: HPC User Forums, UK, Germany, France, China and U.S. HPC in Evolutionary Biology, Andrew Meade, University of Reading HPC in Pharmaceutical Research: From Virtual Screening to All-Atom Simulations of Biomolecules, Jan Kriegl, Boehringer- Ingelheim European Exascale Software Initiative, Jean-Yves Berthou, Electricite de France Real-time Rendering in the Automotive Industry, Cornelia Denk, RTT-Munich Data Analysis and Visualization for the DoD HPCMP, Paul Adams, ERDC Why HPCs Hate Biologists, and What We're Doing About It, Titus Brown, Michigan State University Scalable Data Mining and Archiving in the Era of the Square Kilometre Array, the Square Kilometre Array Telescope Project, Chris Mattmann, NASA/JPL Big Data and Analytics in HPC: Leveraging HPC and Enterprise Architectures for Large Scale Inline Transactional Analytics in Fraud Detection at PayPal, Arno Kolster, PayPal, an ebay Company Big Data and Analytics Vendor Panel: How Vendors See Big Data Impacting the Markets and Their Products/Services, Panel Moderator: Chirag Dekate, IDC Data Analysis and Visualization of Very Large Data, David Pugmire, ORNL The Impact of HPC and Data-Centric Computing in Cancer Research, Jack Collins, National Cancer Institute Urban Analytics: Big Cities and Big Data, Paul Muzio, City University of New York Stampede: Intel MIC And Data-Intensive Computing, Jay Boisseau, Texas Advanced Computing Center Big Data Approaches at Convey, John Leidel Cray Technical Perspective On Data-Intensive Computing, Amar Shan Data-intensive Computing Research At PNNL, John Feo, Pacific Northwest National Laboratory Trends in High Performance Analytics, David Pope, SAS Processing Large Volumes of Experimental Data, Shane Canon, LBNL SGI Technical Perspective On Data-Intensive Computing, Eng Lim Goh, SGI Big Data and PLFS: A Checkpoint File System For Parallel Applications, John Bent, EMC HPC Data-intensive Computing Technologies, Scott Campbell, Platform/IBM The CEA-GENCI-Intel-UVSQ Exascale Computing Research Centre, Marie-Christine Sawley, Intel
56 Questions?
57 Big Data Software Shortcomings -- Today
58 Big Data Software:
59 Big Data Software Technology Stack
High-Performance Data Analysis: HPC Meets Big Data
High-Performance Data Analysis: HPC Meets Big Data Steve Conway IDC Research VP, HPC sconway@idc.com Chirag DeKate IDC Research Manager, HPC cdekate@idc.com HPDA User Talks: HPC User Forums, UK, Germany,
More informationHPC Trends, Big Data And The Emerging Market For High Performance Data Analysis (HPDA)
HPC Trends, Big Data And The Emerging Market For High Performance Data Analysis (HPDA) Salishan April 2013 Earl Joseph, IDC ejoseph@idc.com www.hpcuserforum.com Copyright 2013 IDC. Reproduction is forbidden
More informationHPC Market Update, HPC Trends In the Oil/Gas Sector and IDC's Top 10 Predictions for 2014. Earl Joseph, HPC Program Vice President ejoseph@idc.
HPC Market Update, HPC Trends In the Oil/Gas Sector and IDC's Top 10 Predictions for 2014 Earl Joseph, HPC Program Vice President ejoseph@idc.com IDC Has >1,000 Analysts In 52 Countries 2 IDC s HPC Team
More informationHPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK
HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK Barry Davis, General Manager, High Performance Fabrics Operation Data Center Group, Intel Corporation Legal Disclaimer Today s presentations contain
More informationHow does Big Data disrupt the technology ecosystem of the public cloud?
How does Big Data disrupt the technology ecosystem of the public cloud? Copyright 2012 IDC. Reproduction is forbidden unless authorized. All rights reserved. Agenda Market trends 2020 Vision Introduce
More informationIDC HPC Update at ISC 14. Earl Joseph ejoseph@idc.com Steve Conway sconway@idc.com Chirag Dekate cdekate@idc.com Lloyd Cohen lcohen@idc.
IDC HPC Update at ISC 14 Earl Joseph ejoseph@idc.com Steve Conway sconway@idc.com Chirag Dekate cdekate@idc.com Lloyd Cohen lcohen@idc.com IDC Has Over 1,000 Analysts In 62 Countries IDC s HPC Team Earl
More informationBig Data jako součást našeho života. Zdenek Panec: June, 2015
Big Data jako součást našeho života Zdenek Panec: June, 2015 Agenda Big Data talk.. Primary Big Data Scenarios Big Data as Chance & Risk SAP HANA Platform 2013 SAP AG or an SAP affiliate company. All rights
More informationThe Fusion of Supercomputing and Big Data. Peter Ungaro President & CEO
The Fusion of Supercomputing and Big Data Peter Ungaro President & CEO The Supercomputing Company Supercomputing Big Data Because some great things never change One other thing that hasn t changed. Cray
More informationBig Workflow: More than Just Intelligent Workload Management for Big Data
Big Workflow: More than Just Intelligent Workload Management for Big Data Michael Feldman White Paper February 2014 EXECUTIVE SUMMARY Big data applications represent a fast-growing category of high-value
More informationData Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems
More informationA New Era Of Analytic
Penang egovernment Seminar 2014 A New Era Of Analytic Megat Anuar Idris Head, Project Delivery, Business Analytics & Big Data Agenda Overview of Big Data Case Studies on Big Data Big Data Technology Readiness
More informationData-intensive HPC: opportunities and challenges. Patrick Valduriez
Data-intensive HPC: opportunities and challenges Patrick Valduriez Big Data Landscape Multi-$billion market! Big data = Hadoop = MapReduce? No one-size-fits-all solution: SQL, NoSQL, MapReduce, No standard,
More informationBUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS
BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS ESSENTIALS Executive Summary Big Data is placing new demands on IT infrastructures. The challenge is how to meet growing performance demands
More informationIDC s Top 10 HPC Market Predictions for 2010
IDC s Top 10 HPC Market Predictions for 2010 Earl Joseph, Ph.D. Steve Conway Jie Wu February 17, 2010 Copyright 2009 IDC. Reproduction is forbidden unless authorized. All rights reserved. IDC s HPC Team
More informationBIG DATA-AS-A-SERVICE
White Paper BIG DATA-AS-A-SERVICE What Big Data is about What service providers can do with Big Data What EMC can do to help EMC Solutions Group Abstract This white paper looks at what service providers
More informationMake the Most of Big Data to Drive Innovation Through Reseach
White Paper Make the Most of Big Data to Drive Innovation Through Reseach Bob Burwell, NetApp November 2012 WP-7172 Abstract Monumental data growth is a fact of life in research universities. The ability
More informationStrategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014
Strategic Decisions Supported by SAP Big Data Solutions Angélica Bedoya / Strategic Solutions GTM Mar /2014 What critical new signals Might you be missing? Use Analytics Today 10% 75% Need Analytics by
More informationSeagate HPC /Big Data Business Tech Talk. December 2014
Seagate HPC /Big Data Business Tech Talk December 2014 Safe Harbor Statement This document contains forward-looking statements within the meaning of Section 27A of the Securities Act of 1933, and Section
More informationBuilding a Scalable Big Data Infrastructure for Dynamic Workflows
Building a Scalable Big Data Infrastructure for Dynamic Workflows INTRODUCTION Organizations of all types and sizes are looking to big data to help them make faster, more intelligent decisions. Many efforts
More informationFUJITSU Integrated System PRIMEFLEX for HPC
FUJITSU Integrated System PRIMEFLEX for HPC Integrated HPC Cluster Solutions Optimized for specific Applications 0 2015 FUJITSU Why High Performance Computing? Wouldn t it be great if you could quickly
More informationIntel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013
Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache
More informationHPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk
HPC and Big Data EPCC The University of Edinburgh Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk EPCC Facilities Technology Transfer European Projects HPC Research Visitor Programmes Training
More informationHigh-Performance Analytics
High-Performance Analytics David Pope January 2012 Principal Solutions Architect High Performance Analytics Practice Saturday, April 21, 2012 Agenda Who Is SAS / SAS Technology Evolution Current Trends
More informationSurfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics
Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,
More informationMike Maxey. Senior Director Product Marketing Greenplum A Division of EMC. Copyright 2011 EMC Corporation. All rights reserved.
Mike Maxey Senior Director Product Marketing Greenplum A Division of EMC 1 Greenplum Becomes the Foundation of EMC s Big Data Analytics (July 2010) E M C A C Q U I R E S G R E E N P L U M For three years,
More informationDanny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
More informationBig Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect
on AWS Services Overview Bernie Nallamotu Principle Solutions Architect \ So what is it? When your data sets become so large that you have to start innovating around how to collect, store, organize, analyze
More informationRegional Vision and Strategy The European HPC Strategy
Regional Vision and Strategy The European HPC Strategy BDEC 29 January 2015 Augusto BURGUEÑO ARJONA Head of Unit einfrastructure - DG CONNECT European Commission @ABurguenoEU aburguenoeu.wordpress.com
More informationBig Data. George O. Strawn NITRD
Big Data George O. Strawn NITRD Caveat auditor The opinions expressed in this talk are those of the speaker, not the U.S. government Outline What is Big Data? NITRD's Big Data Research Initiative Big Data
More informationWhite Paper: SAS and Apache Hadoop For Government. Inside: Unlocking Higher Value From Business Analytics to Further the Mission
White Paper: SAS and Apache Hadoop For Government Unlocking Higher Value From Business Analytics to Further the Mission Inside: Using SAS and Hadoop Together Design Considerations for Your SAS and Hadoop
More informationCisco, Big Data and the Internet of Everything. Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center
Cisco, Big Data and the Internet of Everything Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center BILLIONS OF DEVICES Increasingly Everything will be Connected to Everything The Internet of
More informationHere comes the flood Tools for Big Data analytics. Guy Chesnot -June, 2012
Here comes the flood Tools for Big Data analytics Guy Chesnot -June, 2012 Agenda Data flood Implementations Hadoop Not Hadoop 2 Agenda Data flood Implementations Hadoop Not Hadoop 3 Forecast Data Growth
More informationWith DDN Big Data Storage
DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The Big
More informationBig Data. Fast Forward. Putting data to productive use
Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize
More informationForecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014
Forecast of Big Data Trends Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Big Data transforms Business 2 Data created every minute Source http://mashable.com/2012/06/22/data-created-every-minute/
More informationScaling from Workstation to Cluster for Compute-Intensive Applications
Cluster Transition Guide: Scaling from Workstation to Cluster for Compute-Intensive Applications IN THIS GUIDE: The Why: Proven Performance Gains On Cluster Vs. Workstation The What: Recommended Reference
More informationModern IT Operations Management. Why a New Approach is Required, and How Boundary Delivers
Modern IT Operations Management Why a New Approach is Required, and How Boundary Delivers TABLE OF CONTENTS EXECUTIVE SUMMARY 3 INTRODUCTION: CHANGING NATURE OF IT 3 WHY TRADITIONAL APPROACHES ARE FAILING
More informationWorking Together to Promote Business Innovations with Grid Computing
IBM and SAS Working Together to Promote Business Innovations with Grid Computing A SAS White Paper Table of Contents Executive Summary... 1 Grid Computing Overview... 1 Benefits of Grid Computing... 1
More informationTHE REAL-TIME OPERATIONAL VALUE OF BIG DATA MATT DAVIES SPLUNK @MATTDAVIES_UK
THE REAL-TIME OPERATIONAL VALUE OF BIG DATA MATT DAVIES SPLUNK @MATTDAVIES_UK THANK YOU FOR HAVING ME 2 WHY I LOVE SWEDEN #1 IT WAS HOME I LIVED IN STOCKHOLM FOR 3 MONTHS WHY I LOVE SWEDEN #2 FROZEN HAIR
More informationI D C T E C H N O L O G Y S P O T L I G H T. B i g D a t a a n d E C M : Making Smarter Decisions
I D C T E C H N O L O G Y S P O T L I G H T B i g D a t a a n d E C M : Making Smarter Decisions October 2013 Adapted from Worldwide Big Data Technology and Services 2012 2016 Forecast, Melissa Webster
More informationSAP Makes Big Data Real Real Time. Real Results.
SAP Makes Big Data Real Real Time. Real Results. MAKE BIG DATA REAL WITH SAP SOLUTIONS: ACCELERATE. APPLY. ACHIEVE Accelerate, Apply, and Achieve Big Results from Your Big Data Big Data represents an opportunity
More informationBig Data lisää älyä tiedosta
2011 Tieto Corporation Big Data lisää älyä tiedosta ebusiness Forum 21.5.2013 Ilkka Korkiakoski VP Financial Services Agenda Megatrends and needs for Big Data What is the value of Big Data? Use scenarios
More informationNITRD and Big Data. George O. Strawn NITRD
NITRD and Big Data George O. Strawn NITRD Caveat auditor The opinions expressed in this talk are those of the speaker, not the U.S. government Outline What is Big Data? Who is NITRD? NITRD's Big Data Research
More informationAPPROACHABLE ANALYTICS MAKING SENSE OF DATA
APPROACHABLE ANALYTICS MAKING SENSE OF DATA AGENDA SAS DELIVERS PROVEN SOLUTIONS THAT DRIVE INNOVATION AND IMPROVE PERFORMANCE. About SAS SAS Business Analytics Framework Approachable Analytics SAS for
More informationBMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation
BMW11: Dealing with the Massive Data Generated by Many-Core Systems Dr Don Grice IBM Systems and Technology Group Title: Dealing with the Massive Data Generated by Many Core Systems. Abstract: Multi-core
More informationAccelerating Innovation
Accelerating Innovation Trends for Scalable HPC and Big Data in the Cloud David Pellerin, Business Development Principal AWS High Performance Computing August, 2015 Motivators for Cloud Agility: React
More informationPRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
More informationData Centric Computing Revisited
Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data
More informationDr. John E. Kelly III Senior Vice President, Director of Research. Differentiating IBM: Research
Dr. John E. Kelly III Senior Vice President, Director of Research Differentiating IBM: Research IBM Research Priorities Impact on IBM and the Marketplace Globalization and Leverage Balanced Research Agenda
More informationBig Data Analytics: Today's Gold Rush November 20, 2013
Copyright 2013 Vivit Worldwide Big Data Analytics: Today's Gold Rush November 20, 2013 Brought to you by Copyright 2013 Vivit Worldwide Hosted by Bernard Szymczak Vivit Leader Ohio Chapter TQA SIG Copyright
More informationBuild Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015
Build Your Competitive Edge in Big Data with Cisco Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015 Big Data Trends Increasingly Everything will be Connected to Everything Massive
More informationModern Financial Markets and Data Intensive Science: Leveraging 35 Years of Federal Research
Modern Financial Markets and Data Intensive Science: Leveraging 35 Years of Federal Research Wes Bethel and David Leinweber Presentation to CFTC Technical Advisory Committee Washington, D.C. December 13,
More informationBig Data Challenges in Bioinformatics
Big Data Challenges in Bioinformatics BARCELONA SUPERCOMPUTING CENTER COMPUTER SCIENCE DEPARTMENT Autonomic Systems and ebusiness Pla?orms Jordi Torres Jordi.Torres@bsc.es Talk outline! We talk about Petabyte?
More informationWhite Paper. Version 1.2 May 2015 RAID Incorporated
White Paper Version 1.2 May 2015 RAID Incorporated Introduction The abundance of Big Data, structured, partially-structured and unstructured massive datasets, which are too large to be processed effectively
More informationInnovation that Matters an IBM story
Dr. Shiva Kumar Vice President, Enterprise Performance and Industry Analytics Innovation that Matters an IBM story IBM Research IBM Research: Global and Vertically Oriented analytics services tools China
More informationThe Future of Data Management
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
More informationPersonalized Medicine and IT
Personalized Medicine and IT Data-driven Medicine in the Age of Genomics www.intel.com/healthcare/bigdata Ketan Paranjape General Manager, Life Sciences Intel Corp. @Portlandketan 1 The Central Dogma of
More informationAGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW
AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this
More informationHow Big Data is Different
FALL 2012 VOL.54 NO.1 Thomas H. Davenport, Paul Barth and Randy Bean How Big Data is Different Brought to you by Please note that gray areas reflect artwork that has been intentionally removed. The substantive
More informationBig Data Technologies Compared June 2014
Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development
More informationHybrid Cluster Management: Reducing Stress, increasing productivity and preparing for the future
Hybrid Cluster Management: Reducing Stress, increasing productivity and preparing for the future Clement Lau, Ph. D. Sales Director, APJ Bright Computing Agenda 1.Reduce 2.IncRease 3.PrepaRe Reduce System
More informationPDF PREVIEW EMERGING TECHNOLOGIES. Applying Technologies for Social Media Data Analysis
VOLUME 34 BEST PRACTICES IN BUSINESS INTELLIGENCE AND DATA WAREHOUSING FROM LEADING SOLUTION PROVIDERS AND EXPERTS PDF PREVIEW IN EMERGING TECHNOLOGIES POWERFUL CASE STUDIES AND LESSONS LEARNED FOCUSING
More informationW o r l d w i d e B u s i n e s s A n a l y t i c s S o f t w a r e 2 0 1 3 2 0 1 7 F o r e c a s t a n d 2 0 1 2 V e n d o r S h a r e s
Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com M A R K E T A N A L Y S I S W o r l d w i d e B u s i n e s s A n a l y t i c s S o f t w a r e 2
More informationBusin i ess I n I t n e t ll l i l g i e g nce c T r T e r nds For 2013
Business Intelligence Trends For 2013 10 Trends The last few years the change in Business Intelligence seems to accelerate under the pressure of increased business demand and technology innovations. Here
More informationHur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER
Hur hanterar vi utmaningar inom området - Big Data Jan Östling Enterprise Technologies Intel Corporation, NER Legal Disclaimers All products, computer systems, dates, and figures specified are preliminary
More informationPBS Works: The Trusted Suite for HPC Workload Management
PBS Works: The Trusted Suite for HPC Workload Management Victor Wright, HPC Account Specialist April 7, 2014 Overview Founded... In 1985 as a product design consulting company $270M Est. Today... A global
More information5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014
5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for
More informationFrom Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012
From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012 Safe Harbor Statement Forward Looking Statements The following information contains, or may be deemed to contain,
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationGRID COMPUTING: A NEW DIMENSION OF THE INTERNET
GRID COMPUTING: A NEW DIMENSION OF THE INTERNET Wolfgang Gentzsch, Director Grid Computing, Sun Microsystems, Palo Alto, USA Abstract: The Grid is a distributed computing architecture for accessing Computing,
More informationDecision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010
Decision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010 Ernst van Waning Senior Sales Engineer May 28, 2010 Agenda SPSS, an IBM Company SPSS Statistics User-driven product
More informationI D C V E N D O R S P O T L I G H T. S t o r a g e Ar c h i t e c t u r e t o Better Manage B i g D a t a C hallenges
I D C V E N D O R S P O T L I G H T S t o r a g e Ar c h i t e c t u r e t o Better Manage B i g D a t a C hallenges September 2012 Adapted from Worldwide File-Based Storage 2011 2015 Forecast: Foundation
More informationScale-out NAS Unifies the Technical Enterprise
Scale-out NAS Unifies the Technical Enterprise Panasas Inc. White Paper July 2010 Executive Summary Tremendous effort has been made by IT organizations, and their providers, to make enterprise storage
More informationHPC Software in 2014 September 2014. Christopher G. Willard, Ph.D., Chief Research Officer chris@intersect360.com
HPC Software in 2014 September 2014 Christopher G. Willard, Ph.D., Chief Research Officer chris@intersect360.com Where We Find HPC High Performance Technical Computing (HPTC) Applications in science and
More informationTop 10 Automotive Manufacturer Makes the Business Case for OpenStack
Top 10 Automotive Manufacturer Makes the Business Case for OpenStack OPENSTACK WHITE PAPER Contributors: SOLINEA: Francesco Paola, CEO Seth Fox, Vice President Operations Brad Vaughan, Vice President Service
More informationBig Data Executive Survey
Big Data Executive Full Questionnaire Big Date Executive Full Questionnaire Appendix B Questionnaire Welcome The survey has been designed to provide a benchmark for enterprises seeking to understand the
More informationThe data explosion is transforming science
Talk Outline The data tsunami and the 4 th paradigm of science The challenges for the long tail of science Where is the cloud being used now? The app marketplace SMEs Analytics as a service. What are the
More informationGovernment Technology Trends to Watch in 2014: Big Data
Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require
More informationOptimized Hadoop for Enterprise
Optimized Hadoop for Enterprise Smart Big data Platform provides Reliability, Security, and Ease of Use + Big Data, Valuable Resource for Forecasting the Future of Businesses + Offers integrated and end-to-end
More informationTechnology and Trends for Smarter Business Analytics
Don Campbell Chief Technology Officer, Business Analytics, IBM Technology and Trends for Smarter Business Analytics Business Analytics software Where organizations are focusing Business Analytics Enhance
More informationEnterprise Data Integration
Enterprise Data Integration Access, Integrate, and Deliver Data Efficiently Throughout the Enterprise brochure How Can Your IT Organization Deliver a Return on Data? The High Price of Data Fragmentation
More informationVIEWPOINT. High Performance Analytics. Industry Context and Trends
VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations
More informationIntroduction to Red Hat Storage. January, 2012
Introduction to Red Hat Storage January, 2012 1 Today s Speakers 2 Heather Wellington Tom Trainer Storage Program Marketing Manager Storage Product Marketing Manager Red Hat Acquisition of Gluster What
More informationGlobal Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com
Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com INSIGHT Base One: Grid Computing for Database-Centric Applications Earl Joseph, Ph. D. IDC OPINION
More informationSGI HPC Systems Help Fuel Manufacturing Rebirth
SGI HPC Systems Help Fuel Manufacturing Rebirth Created by T A B L E O F C O N T E N T S 1.0 Introduction 1 2.0 Ongoing Challenges 1 3.0 Meeting the Challenge 2 4.0 SGI Solution Environment and CAE Applications
More informationCreate and Drive Big Data Success Don t Get Left Behind
Create and Drive Big Data Success Don t Get Left Behind The performance boost from MapR not only means we have lower hardware requirements, but also enables us to deliver faster analytics for our users.
More informationThe Power of Pentaho and Hadoop in Action. Demonstrating MapReduce Performance at Scale
The Power of Pentaho and Hadoop in Action Demonstrating MapReduce Performance at Scale Introduction Over the last few years, Big Data has gone from a tech buzzword to a value generator for many organizations.
More informationI D C T E C H N O L O G Y S P O T L I G H T
I D C T E C H N O L O G Y S P O T L I G H T C r a y T r a n s f o r m a tion Mines Core Strengths to Ad d r e s s N e w Markets October 2013 By Steve Conway, Earl C. Joseph, Ph.D., and Chirag Dekate, Ph.D.
More informationHow To Handle Big Data With A Data Scientist
III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution
More informationLeveraging Information For Smarter Business Outcomes With IBM Information Management Software
Leveraging Information For Smarter Business Outcomes With IBM Information Management Software Tony Mignardi WW Information Management Sales IBM Software Group April 1 2009 Agenda Our Smarter Planet and
More informationHPC on AWS. Hiroshi Kobayashi, Dev./Lab. IT System HGST Japan, Ltd. Jun 3, 2015
HPC on AWS Hiroshi Kobayashi, Dev./Lab. IT System HGST Japan, Ltd. Jun 3, 2015 1 HPC on AWS HPC = High Performance Computing AWS = Amazon Web Service 2 Agenda HGST Why choose Cloud? Performance Flexibility
More informationHPC Trends and Directions in the Earth Sciences Per Nyberg nyberg@cray.com Sr. Director, Business Development
HPC Trends and Directions in the Earth Sciences Per Nyberg nyberg@cray.com Sr. Director, Business Development Cray Solutions for the Earth Sciences Why Cray? Cray solutions support: Range of modeling capabilities
More informationFrom Big Data to Smart Data Thomas Hahn
Siemens Future Forum @ HANNOVER MESSE 2014 From Big to Smart Hannover Messe 2014 The Evolution of Big Digital data ~ 1960 warehousing ~1986 ~1993 Big data analytics Mining ~2015 Stream processing Digital
More informationA Hurwitz white paper. Inventing the Future. Judith Hurwitz President and CEO. Sponsored by Hitachi
Judith Hurwitz President and CEO Sponsored by Hitachi Introduction Only a few years ago, the greatest concern for businesses was being able to link traditional IT with the requirements of business units.
More informationAccelerating Innovation with Self- Service HPC
Accelerating Innovation with Self- Service HPC Thomas Goepel Director Product Management Hewlett-Packard BOEING is a trademark of Boeing Management Company Copyright 2014 Boeing. All rights reserved. Copyright
More informationIntegrating a Big Data Platform into Government:
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
More informationDAMA NY DAMA Day October 17, 2013 IBM 590 Madison Avenue 12th floor New York, NY
Big Data Analytics DAMA NY DAMA Day October 17, 2013 IBM 590 Madison Avenue 12th floor New York, NY Tom Haughey InfoModel, LLC 868 Woodfield Road Franklin Lakes, NJ 07417 201 755 3350 tom.haughey@infomodelusa.com
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationBig Data at Cloud Scale
Big Data at Cloud Scale Pushing the limits of flexible & powerful analytics Copyright 2015 Pentaho Corporation. Redistribution permitted. All trademarks are the property of their respective owners. For
More informationInformation Visualization WS 2013/14 11 Visual Analytics
1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and
More information