IDC Update on How Big Data Is Redefining High Performance Computing Earl Joseph Steve Conway

Size: px
Start display at page:

Download "IDC Update on How Big Data Is Redefining High Performance Computing Earl Joseph ejoseph@idc.com Steve Conway sconway@idc."

Transcription

1 IDC Update on How Big Data Is Redefining High Performance Computing Earl Joseph Steve Conway Chirag Dekate Bob Sorensen

2 IDC Has Over 1,000 Analysts In 62 Countries

3 Agenda A Short HPC Market Update Big Data Challenges and Short Comings The High End of Big Data Examples of Very Large Big Data Examples of How Big Data is Redefining High Performance Computing

4 HPC Market Update

5 What Is HPC? IDC uses these terms to cover all technical servers used by scientists, engineers, financial analysts and others: HPC HPTC Technical Servers Highly computational servers HPC covers all servers that are used for computational or data intensive tasks From a $5,000 deskside server up to over $550 million dollar supercomputer

6 Top Trends in HPC 2013 declined overall by $800 million For a total of $10.3 billion Mainly due to a few very large systems sales in 2012 that weren t repeated in 2013 We expect growth in 2015 to 2018 Software issues continue to grow The worldwide Petascale Race is at full speed GPUs and accelerators are hot new technologies Big data combined with HPC is creating new solutions in new areas

7 IDC HPC Competitive Segments: 2013 HPC Servers $10.3B Supercomputers (Over $500K) $4.0B Workgroup (under $100K) $1.6B Divisional ($250K - $500K) $1.4B Departmental ($250K - $100K) $3.4B

8 HPC WW Market Trends: A 17 Year Perspective C

9 HPC Market Forecasts

10 HPC Forecasts Forecasting a 7.4% yearly growth from 2013 to should reach $14.7 billion

11 HPC Forecasts: By Industry/Applications

12 The Broader HPC Market

13 Big Data Challenges And Shortcomings

14 Defining Big Data

15 HPDA Market Drivers More input data (ingestion) More powerful scientific instruments/sensor networks More transactions/higher scrutiny (fraud, terrorism) More output data for integration/analysis More powerful computers More realism More iterations in available time The need to pose more intelligent questions Smarter mathematical models and algorithms Real time, near-real time requirements Catch fraud before it hits credit cards Catch terrorists before they strike Diagnose patients before they leave the office Provide insurance quotes before callers leave the phone

16 Top Drivers For Implementing Big Data

17 Organizational Challenges With Big Data: Government Compared To All Others

18 Big Data Meets HPC And Advanced Simulation

19 High Performance Data Analysis Needs HPC resources High complexity (algorithms) High time-criticality High variability (On premise or in cloud) Simulation & analytics Search, pattern discovery Iterative methods Established HPC users + new commercial users Data of all kinds The 4 V s: volume, variety, velocity, value Structured, unstructured Partitionable, non-partitionable Regular, irregular patterns

20 HPC Adoption Timeline (Examples)

21 Very Large Big Data Examples

22 NASA

23 Square Kilometre Arrary Radio Astronomy for Astrophysics

24 CERN LHC: the world s leading accelerator -- Multiple Nobel Prizes for particle physics work Innovation driven by the need to distribute massive data sets and the accompanying applications Altas, one of CERN s two detectors, generates 1PB of data per second when running! (Not all of this is distributed). Private cloud distribution to scientists in 20 EU member states plus observer states (single largest user is the U.S.) Today: only % of the data is used

25 NOAA

26

27

28 HPC Will Be Used More for Managing Mega-IT Infrastructures

29 Examples of Big Data Redefining HPC

30 Use Case: PayPal Fraud Detection The Problem Finding suspicious patterns that we don t even know exist in related data sets

31 What Kind of Volume? PayPal s Data Volumes And HPDA Requirements

32 Where Paypal Used HPC

33 The Results $710 million saved in fraud that they wouldn t have been able to detect before (in the first year)

34 There Are New Technologies That Will Likely Cause A Mass Explosion In Data Requiring HPDA Solutions

35 GEICO: Real-Time Insurance Quotes Problem: Need accurate automated phone quotes in 100ms. They couldn t do these calculations nearly fast enough on the fly. Solution: Each weekend, use a new HPC cluster to pre-calculate quotes for every American adult and household (60 hour run time)

36 Something To Think About -- GEICO: Changing The Way One Approaches Solving a Problem Instead of processing each event one-at-a-time, process it for everyone on a regular basis It can be dramatically cheaper, faster and offers additional ways to be more accurate But most of all it can create new and more powerful capabilities Examples: For home loan applications calculate for every adult in the US and every home in the US For health insurance fraud track every procedure done on every US person by every doctor and find patterns

37 Something To Think About -- GEICO: Changing The Way One Approaches Solving a Problem Future Examples (continued): If you add-in large scale data collection via sensors like GPS, drones and RFID tags: New car insurance rules The insurance company doesn t have to pay if you break the law -- like speeding and having an accident You could track every car at all times then charge $2 to see where the in-laws are in traffic if they are late for a wedding Google maps could show in real-time where every letter and package is located But crooks could also use it in many ways e.g. watching ATM machines, looking for when guards are on break,

38 U.S. Postal Service

39 U.S. Postal Service

40 U.S. Postal Service MCDB = memory-centric database

41 CMS: Government Health Care Fraud 5 separate databases for the big USG health care programs under Centers for Medicare and Medicaid Services (CMS) Estimated fraud: $150B-$450B <$5B caught today) ORNL, SDSC have evaluation contracts to unify the databases and perform fraud detection on various architectures

42 Schrödinger: Cloud-based Lead Discovery for Drug Design NOVARTIS/SCHROEDINGER: Pharmaceutical company Novartis increased resolution of drug discovery algorithm 10x and wanted to use it to test 21 million small molecules as drug candidates Novartis used the Schroedinger drug discovery app in AWS public cloud, with the help of Cycle Computing Initial run used 51,000 AWS cores and took $14,000 and <4 hours and its getting cheaper Later run used 156,000 AWS cores with comparable costs and time

43 Schrödinger: Cloud-based Lead Discovery for Drug Design

44 Global Financial Services: Company X One of the most respected firms in the global financial services industry updates detailed information daily on several million companies around the world. Clients use the firm's credit ratings and other company information in making lending decisions and for other planning, marketing, and business decision making. The firm uses statistical models to develop a company's scores and ratings, and for years, the ratings have been prepared and analyzed locally in near real time by the firm's personnel around the world. This practice is a major competitive advantage but resulted in the creation of hundreds of distinct databases and more than a dozen scoring environments. Several years ago, the company established a goal of centralizing these resources and chose SAS as the centralization mechanism, including SAS Grid Manager as part of the software stack.

45 Global Financial Services: Company X The centralized IT infrastructure created using SAS preserves the advantages of the company's locally created ratings and reports. The new infrastructure provides an effective environment for analytics development and accommodates multiple testing, debt, and production environments in a single stack. It is flexible enough to allow dynamic prioritization among these environments, according to a company executive. With help from SAS Grid Manager, the company can maximize the use of its computing resources. The software automatically assigns jobs to server nodes with available capacity, instead of having users wait in queue for time on fully utilized nodes. The company executive estimates that it might cost 30% more to purchase servers with enough capacity to handle these peak workloads on their own.

46 Global Financial Services: Company X Several million clients use the firm s credit ratings to help make lending decisions Goal: increase efficiency for updating ratings Result: HPC multi-cluster grid boosted efficiency 30% -- no need to buy additional clusters yet.

47 Real Estate Worldwide vacation exchange & rental leader Goal: Update property valuations several times per day (not possible with enterprise servers) Results: HPC technology enabled all updates in 8-9 hours Avoided move to heuristics Allowed company to focus on rental side

48 Outcomes-Based Medical Diagnosis and Treatment Planning Enter the patient s history and symptomology. While the patient is still in the office, sift through millions of archived patient records for relevant outcomes. Provider considers the efficacies of various treatments for similar patients (but is not bound by the findings). Ergo, this functions as a powerful decision-support tool. Benefits: better outcomes + rein in costly outlier practices.

49

50 Digital Television Services A global leader with 30 million subscribers Goal: maximize revenue & customer satisfaction during high-growth period Result: HPC has added 7.5 million in annual revenue while increasing satisfaction

51 IDC HPDA Server Forecast Fast growth from a small starting point: $933 M HPDA ecosystem >$2.6B in 2018

52 IDC HPDA Storage Forecast Storage is the fastest-growing HPC market (9% CAGR) And HPDA storage will grow even faster (26.5% CAGR)

53 In Summary

54 Summary: HPDA Market Opportunity HPDA: simulation + newer highperformance analytics IDC predicts fast growth from a small starting point HPC and high-end commercial analytics are converging Algorithmic complexity is the common denominator Economically important use cases are emerging No single HPC solution is best for all problems

55 HPDA User Talks: HPC User Forums, UK, Germany, France, China and U.S. HPC in Evolutionary Biology, Andrew Meade, University of Reading HPC in Pharmaceutical Research: From Virtual Screening to All-Atom Simulations of Biomolecules, Jan Kriegl, Boehringer- Ingelheim European Exascale Software Initiative, Jean-Yves Berthou, Electricite de France Real-time Rendering in the Automotive Industry, Cornelia Denk, RTT-Munich Data Analysis and Visualization for the DoD HPCMP, Paul Adams, ERDC Why HPCs Hate Biologists, and What We're Doing About It, Titus Brown, Michigan State University Scalable Data Mining and Archiving in the Era of the Square Kilometre Array, the Square Kilometre Array Telescope Project, Chris Mattmann, NASA/JPL Big Data and Analytics in HPC: Leveraging HPC and Enterprise Architectures for Large Scale Inline Transactional Analytics in Fraud Detection at PayPal, Arno Kolster, PayPal, an ebay Company Big Data and Analytics Vendor Panel: How Vendors See Big Data Impacting the Markets and Their Products/Services, Panel Moderator: Chirag Dekate, IDC Data Analysis and Visualization of Very Large Data, David Pugmire, ORNL The Impact of HPC and Data-Centric Computing in Cancer Research, Jack Collins, National Cancer Institute Urban Analytics: Big Cities and Big Data, Paul Muzio, City University of New York Stampede: Intel MIC And Data-Intensive Computing, Jay Boisseau, Texas Advanced Computing Center Big Data Approaches at Convey, John Leidel Cray Technical Perspective On Data-Intensive Computing, Amar Shan Data-intensive Computing Research At PNNL, John Feo, Pacific Northwest National Laboratory Trends in High Performance Analytics, David Pope, SAS Processing Large Volumes of Experimental Data, Shane Canon, LBNL SGI Technical Perspective On Data-Intensive Computing, Eng Lim Goh, SGI Big Data and PLFS: A Checkpoint File System For Parallel Applications, John Bent, EMC HPC Data-intensive Computing Technologies, Scott Campbell, Platform/IBM The CEA-GENCI-Intel-UVSQ Exascale Computing Research Centre, Marie-Christine Sawley, Intel

56 Questions?

57 Big Data Software Shortcomings -- Today

58 Big Data Software:

59 Big Data Software Technology Stack

High-Performance Data Analysis: HPC Meets Big Data

High-Performance Data Analysis: HPC Meets Big Data High-Performance Data Analysis: HPC Meets Big Data Steve Conway IDC Research VP, HPC sconway@idc.com Chirag DeKate IDC Research Manager, HPC cdekate@idc.com HPDA User Talks: HPC User Forums, UK, Germany,

More information

HPC Trends, Big Data And The Emerging Market For High Performance Data Analysis (HPDA)

HPC Trends, Big Data And The Emerging Market For High Performance Data Analysis (HPDA) HPC Trends, Big Data And The Emerging Market For High Performance Data Analysis (HPDA) Salishan April 2013 Earl Joseph, IDC ejoseph@idc.com www.hpcuserforum.com Copyright 2013 IDC. Reproduction is forbidden

More information

HPC Market Update, HPC Trends In the Oil/Gas Sector and IDC's Top 10 Predictions for 2014. Earl Joseph, HPC Program Vice President ejoseph@idc.

HPC Market Update, HPC Trends In the Oil/Gas Sector and IDC's Top 10 Predictions for 2014. Earl Joseph, HPC Program Vice President ejoseph@idc. HPC Market Update, HPC Trends In the Oil/Gas Sector and IDC's Top 10 Predictions for 2014 Earl Joseph, HPC Program Vice President ejoseph@idc.com IDC Has >1,000 Analysts In 52 Countries 2 IDC s HPC Team

More information

HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK

HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK Barry Davis, General Manager, High Performance Fabrics Operation Data Center Group, Intel Corporation Legal Disclaimer Today s presentations contain

More information

How does Big Data disrupt the technology ecosystem of the public cloud?

How does Big Data disrupt the technology ecosystem of the public cloud? How does Big Data disrupt the technology ecosystem of the public cloud? Copyright 2012 IDC. Reproduction is forbidden unless authorized. All rights reserved. Agenda Market trends 2020 Vision Introduce

More information

IDC HPC Update at ISC 14. Earl Joseph ejoseph@idc.com Steve Conway sconway@idc.com Chirag Dekate cdekate@idc.com Lloyd Cohen lcohen@idc.

IDC HPC Update at ISC 14. Earl Joseph ejoseph@idc.com Steve Conway sconway@idc.com Chirag Dekate cdekate@idc.com Lloyd Cohen lcohen@idc. IDC HPC Update at ISC 14 Earl Joseph ejoseph@idc.com Steve Conway sconway@idc.com Chirag Dekate cdekate@idc.com Lloyd Cohen lcohen@idc.com IDC Has Over 1,000 Analysts In 62 Countries IDC s HPC Team Earl

More information

Big Data jako součást našeho života. Zdenek Panec: June, 2015

Big Data jako součást našeho života. Zdenek Panec: June, 2015 Big Data jako součást našeho života Zdenek Panec: June, 2015 Agenda Big Data talk.. Primary Big Data Scenarios Big Data as Chance & Risk SAP HANA Platform 2013 SAP AG or an SAP affiliate company. All rights

More information

Big Workflow: More than Just Intelligent Workload Management for Big Data

Big Workflow: More than Just Intelligent Workload Management for Big Data Big Workflow: More than Just Intelligent Workload Management for Big Data Michael Feldman White Paper February 2014 EXECUTIVE SUMMARY Big data applications represent a fast-growing category of high-value

More information

The Fusion of Supercomputing and Big Data. Peter Ungaro President & CEO

The Fusion of Supercomputing and Big Data. Peter Ungaro President & CEO The Fusion of Supercomputing and Big Data Peter Ungaro President & CEO The Supercomputing Company Supercomputing Big Data Because some great things never change One other thing that hasn t changed. Cray

More information

A New Era Of Analytic

A New Era Of Analytic Penang egovernment Seminar 2014 A New Era Of Analytic Megat Anuar Idris Head, Project Delivery, Business Analytics & Big Data Agenda Overview of Big Data Case Studies on Big Data Big Data Technology Readiness

More information

Data Centric Systems (DCS)

Data Centric Systems (DCS) Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems

More information

IDC s Top 10 HPC Market Predictions for 2010

IDC s Top 10 HPC Market Predictions for 2010 IDC s Top 10 HPC Market Predictions for 2010 Earl Joseph, Ph.D. Steve Conway Jie Wu February 17, 2010 Copyright 2009 IDC. Reproduction is forbidden unless authorized. All rights reserved. IDC s HPC Team

More information

BIG DATA-AS-A-SERVICE

BIG DATA-AS-A-SERVICE White Paper BIG DATA-AS-A-SERVICE What Big Data is about What service providers can do with Big Data What EMC can do to help EMC Solutions Group Abstract This white paper looks at what service providers

More information

Strategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014

Strategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014 Strategic Decisions Supported by SAP Big Data Solutions Angélica Bedoya / Strategic Solutions GTM Mar /2014 What critical new signals Might you be missing? Use Analytics Today 10% 75% Need Analytics by

More information

Big Data. Fast Forward. Putting data to productive use

Big Data. Fast Forward. Putting data to productive use Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize

More information

Data-intensive HPC: opportunities and challenges. Patrick Valduriez

Data-intensive HPC: opportunities and challenges. Patrick Valduriez Data-intensive HPC: opportunities and challenges Patrick Valduriez Big Data Landscape Multi-$billion market! Big data = Hadoop = MapReduce? No one-size-fits-all solution: SQL, NoSQL, MapReduce, No standard,

More information

BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS

BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS ESSENTIALS Executive Summary Big Data is placing new demands on IT infrastructures. The challenge is how to meet growing performance demands

More information

Make the Most of Big Data to Drive Innovation Through Reseach

Make the Most of Big Data to Drive Innovation Through Reseach White Paper Make the Most of Big Data to Drive Innovation Through Reseach Bob Burwell, NetApp November 2012 WP-7172 Abstract Monumental data growth is a fact of life in research universities. The ability

More information

Seagate HPC /Big Data Business Tech Talk. December 2014

Seagate HPC /Big Data Business Tech Talk. December 2014 Seagate HPC /Big Data Business Tech Talk December 2014 Safe Harbor Statement This document contains forward-looking statements within the meaning of Section 27A of the Securities Act of 1933, and Section

More information

Building a Scalable Big Data Infrastructure for Dynamic Workflows

Building a Scalable Big Data Infrastructure for Dynamic Workflows Building a Scalable Big Data Infrastructure for Dynamic Workflows INTRODUCTION Organizations of all types and sizes are looking to big data to help them make faster, more intelligent decisions. Many efforts

More information

Mike Maxey. Senior Director Product Marketing Greenplum A Division of EMC. Copyright 2011 EMC Corporation. All rights reserved.

Mike Maxey. Senior Director Product Marketing Greenplum A Division of EMC. Copyright 2011 EMC Corporation. All rights reserved. Mike Maxey Senior Director Product Marketing Greenplum A Division of EMC 1 Greenplum Becomes the Foundation of EMC s Big Data Analytics (July 2010) E M C A C Q U I R E S G R E E N P L U M For three years,

More information

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013

Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013 Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache

More information

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk HPC and Big Data EPCC The University of Edinburgh Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk EPCC Facilities Technology Transfer European Projects HPC Research Visitor Programmes Training

More information

FUJITSU Integrated System PRIMEFLEX for HPC

FUJITSU Integrated System PRIMEFLEX for HPC FUJITSU Integrated System PRIMEFLEX for HPC Integrated HPC Cluster Solutions Optimized for specific Applications 0 2015 FUJITSU Why High Performance Computing? Wouldn t it be great if you could quickly

More information

High-Performance Analytics

High-Performance Analytics High-Performance Analytics David Pope January 2012 Principal Solutions Architect High Performance Analytics Practice Saturday, April 21, 2012 Agenda Who Is SAS / SAS Technology Evolution Current Trends

More information

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,

More information

Cisco, Big Data and the Internet of Everything. Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center

Cisco, Big Data and the Internet of Everything. Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center Cisco, Big Data and the Internet of Everything Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center BILLIONS OF DEVICES Increasingly Everything will be Connected to Everything The Internet of

More information

Forecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014

Forecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Forecast of Big Data Trends Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Big Data transforms Business 2 Data created every minute Source http://mashable.com/2012/06/22/data-created-every-minute/

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

THE REAL-TIME OPERATIONAL VALUE OF BIG DATA MATT DAVIES SPLUNK @MATTDAVIES_UK

THE REAL-TIME OPERATIONAL VALUE OF BIG DATA MATT DAVIES SPLUNK @MATTDAVIES_UK THE REAL-TIME OPERATIONAL VALUE OF BIG DATA MATT DAVIES SPLUNK @MATTDAVIES_UK THANK YOU FOR HAVING ME 2 WHY I LOVE SWEDEN #1 IT WAS HOME I LIVED IN STOCKHOLM FOR 3 MONTHS WHY I LOVE SWEDEN #2 FROZEN HAIR

More information

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect

Big Data on AWS. Services Overview. Bernie Nallamotu Principle Solutions Architect on AWS Services Overview Bernie Nallamotu Principle Solutions Architect \ So what is it? When your data sets become so large that you have to start innovating around how to collect, store, organize, analyze

More information

Big Data lisää älyä tiedosta

Big Data lisää älyä tiedosta 2011 Tieto Corporation Big Data lisää älyä tiedosta ebusiness Forum 21.5.2013 Ilkka Korkiakoski VP Financial Services Agenda Megatrends and needs for Big Data What is the value of Big Data? Use scenarios

More information

Regional Vision and Strategy The European HPC Strategy

Regional Vision and Strategy The European HPC Strategy Regional Vision and Strategy The European HPC Strategy BDEC 29 January 2015 Augusto BURGUEÑO ARJONA Head of Unit einfrastructure - DG CONNECT European Commission @ABurguenoEU aburguenoeu.wordpress.com

More information

Big Data. George O. Strawn NITRD

Big Data. George O. Strawn NITRD Big Data George O. Strawn NITRD Caveat auditor The opinions expressed in this talk are those of the speaker, not the U.S. government Outline What is Big Data? NITRD's Big Data Research Initiative Big Data

More information

With DDN Big Data Storage

With DDN Big Data Storage DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The Big

More information

White Paper: SAS and Apache Hadoop For Government. Inside: Unlocking Higher Value From Business Analytics to Further the Mission

White Paper: SAS and Apache Hadoop For Government. Inside: Unlocking Higher Value From Business Analytics to Further the Mission White Paper: SAS and Apache Hadoop For Government Unlocking Higher Value From Business Analytics to Further the Mission Inside: Using SAS and Hadoop Together Design Considerations for Your SAS and Hadoop

More information

Here comes the flood Tools for Big Data analytics. Guy Chesnot -June, 2012

Here comes the flood Tools for Big Data analytics. Guy Chesnot -June, 2012 Here comes the flood Tools for Big Data analytics Guy Chesnot -June, 2012 Agenda Data flood Implementations Hadoop Not Hadoop 2 Agenda Data flood Implementations Hadoop Not Hadoop 3 Forecast Data Growth

More information

Scaling from Workstation to Cluster for Compute-Intensive Applications

Scaling from Workstation to Cluster for Compute-Intensive Applications Cluster Transition Guide: Scaling from Workstation to Cluster for Compute-Intensive Applications IN THIS GUIDE: The Why: Proven Performance Gains On Cluster Vs. Workstation The What: Recommended Reference

More information

APPROACHABLE ANALYTICS MAKING SENSE OF DATA

APPROACHABLE ANALYTICS MAKING SENSE OF DATA APPROACHABLE ANALYTICS MAKING SENSE OF DATA AGENDA SAS DELIVERS PROVEN SOLUTIONS THAT DRIVE INNOVATION AND IMPROVE PERFORMANCE. About SAS SAS Business Analytics Framework Approachable Analytics SAS for

More information

Working Together to Promote Business Innovations with Grid Computing

Working Together to Promote Business Innovations with Grid Computing IBM and SAS Working Together to Promote Business Innovations with Grid Computing A SAS White Paper Table of Contents Executive Summary... 1 Grid Computing Overview... 1 Benefits of Grid Computing... 1

More information

PRIMERGY server-based High Performance Computing solutions

PRIMERGY server-based High Performance Computing solutions PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating

More information

Modern IT Operations Management. Why a New Approach is Required, and How Boundary Delivers

Modern IT Operations Management. Why a New Approach is Required, and How Boundary Delivers Modern IT Operations Management Why a New Approach is Required, and How Boundary Delivers TABLE OF CONTENTS EXECUTIVE SUMMARY 3 INTRODUCTION: CHANGING NATURE OF IT 3 WHY TRADITIONAL APPROACHES ARE FAILING

More information

Build Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015

Build Your Competitive Edge in Big Data with Cisco. Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015 Build Your Competitive Edge in Big Data with Cisco Rick Speyer Senior Global Marketing Manager Big Data Cisco Systems 6/25/2015 Big Data Trends Increasingly Everything will be Connected to Everything Massive

More information

I D C T E C H N O L O G Y S P O T L I G H T. B i g D a t a a n d E C M : Making Smarter Decisions

I D C T E C H N O L O G Y S P O T L I G H T. B i g D a t a a n d E C M : Making Smarter Decisions I D C T E C H N O L O G Y S P O T L I G H T B i g D a t a a n d E C M : Making Smarter Decisions October 2013 Adapted from Worldwide Big Data Technology and Services 2012 2016 Forecast, Melissa Webster

More information

SAP Makes Big Data Real Real Time. Real Results.

SAP Makes Big Data Real Real Time. Real Results. SAP Makes Big Data Real Real Time. Real Results. MAKE BIG DATA REAL WITH SAP SOLUTIONS: ACCELERATE. APPLY. ACHIEVE Accelerate, Apply, and Achieve Big Results from Your Big Data Big Data represents an opportunity

More information

Personalized Medicine and IT

Personalized Medicine and IT Personalized Medicine and IT Data-driven Medicine in the Age of Genomics www.intel.com/healthcare/bigdata Ketan Paranjape General Manager, Life Sciences Intel Corp. @Portlandketan 1 The Central Dogma of

More information

NITRD and Big Data. George O. Strawn NITRD

NITRD and Big Data. George O. Strawn NITRD NITRD and Big Data George O. Strawn NITRD Caveat auditor The opinions expressed in this talk are those of the speaker, not the U.S. government Outline What is Big Data? Who is NITRD? NITRD's Big Data Research

More information

Accelerating Innovation

Accelerating Innovation Accelerating Innovation Trends for Scalable HPC and Big Data in the Cloud David Pellerin, Business Development Principal AWS High Performance Computing August, 2015 Motivators for Cloud Agility: React

More information

BMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation

BMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation BMW11: Dealing with the Massive Data Generated by Many-Core Systems Dr Don Grice IBM Systems and Technology Group Title: Dealing with the Massive Data Generated by Many Core Systems. Abstract: Multi-core

More information

PDF PREVIEW EMERGING TECHNOLOGIES. Applying Technologies for Social Media Data Analysis

PDF PREVIEW EMERGING TECHNOLOGIES. Applying Technologies for Social Media Data Analysis VOLUME 34 BEST PRACTICES IN BUSINESS INTELLIGENCE AND DATA WAREHOUSING FROM LEADING SOLUTION PROVIDERS AND EXPERTS PDF PREVIEW IN EMERGING TECHNOLOGIES POWERFUL CASE STUDIES AND LESSONS LEARNED FOCUSING

More information

Busin i ess I n I t n e t ll l i l g i e g nce c T r T e r nds For 2013

Busin i ess I n I t n e t ll l i l g i e g nce c T r T e r nds For 2013 Business Intelligence Trends For 2013 10 Trends The last few years the change in Business Intelligence seems to accelerate under the pressure of increased business demand and technology innovations. Here

More information

How Big Data is Different

How Big Data is Different FALL 2012 VOL.54 NO.1 Thomas H. Davenport, Paul Barth and Randy Bean How Big Data is Different Brought to you by Please note that gray areas reflect artwork that has been intentionally removed. The substantive

More information

Data Centric Computing Revisited

Data Centric Computing Revisited Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data

More information

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014 5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for

More information

Dr. John E. Kelly III Senior Vice President, Director of Research. Differentiating IBM: Research

Dr. John E. Kelly III Senior Vice President, Director of Research. Differentiating IBM: Research Dr. John E. Kelly III Senior Vice President, Director of Research Differentiating IBM: Research IBM Research Priorities Impact on IBM and the Marketplace Globalization and Leverage Balanced Research Agenda

More information

W o r l d w i d e B u s i n e s s A n a l y t i c s S o f t w a r e 2 0 1 3 2 0 1 7 F o r e c a s t a n d 2 0 1 2 V e n d o r S h a r e s

W o r l d w i d e B u s i n e s s A n a l y t i c s S o f t w a r e 2 0 1 3 2 0 1 7 F o r e c a s t a n d 2 0 1 2 V e n d o r S h a r e s Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com M A R K E T A N A L Y S I S W o r l d w i d e B u s i n e s s A n a l y t i c s S o f t w a r e 2

More information

Big Data Analytics: Today's Gold Rush November 20, 2013

Big Data Analytics: Today's Gold Rush November 20, 2013 Copyright 2013 Vivit Worldwide Big Data Analytics: Today's Gold Rush November 20, 2013 Brought to you by Copyright 2013 Vivit Worldwide Hosted by Bernard Szymczak Vivit Leader Ohio Chapter TQA SIG Copyright

More information

HPC Software in 2014 September 2014. Christopher G. Willard, Ph.D., Chief Research Officer chris@intersect360.com

HPC Software in 2014 September 2014. Christopher G. Willard, Ph.D., Chief Research Officer chris@intersect360.com HPC Software in 2014 September 2014 Christopher G. Willard, Ph.D., Chief Research Officer chris@intersect360.com Where We Find HPC High Performance Technical Computing (HPTC) Applications in science and

More information

Modern Financial Markets and Data Intensive Science: Leveraging 35 Years of Federal Research

Modern Financial Markets and Data Intensive Science: Leveraging 35 Years of Federal Research Modern Financial Markets and Data Intensive Science: Leveraging 35 Years of Federal Research Wes Bethel and David Leinweber Presentation to CFTC Technical Advisory Committee Washington, D.C. December 13,

More information

From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012

From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012 From Petabytes (10 15 ) to Yottabytes (10 24 ), & Before 2020! Steve Barber, CEO June 27, 2012 Safe Harbor Statement Forward Looking Statements The following information contains, or may be deemed to contain,

More information

Big Data Challenges in Bioinformatics

Big Data Challenges in Bioinformatics Big Data Challenges in Bioinformatics BARCELONA SUPERCOMPUTING CENTER COMPUTER SCIENCE DEPARTMENT Autonomic Systems and ebusiness Pla?orms Jordi Torres Jordi.Torres@bsc.es Talk outline! We talk about Petabyte?

More information

White Paper. Version 1.2 May 2015 RAID Incorporated

White Paper. Version 1.2 May 2015 RAID Incorporated White Paper Version 1.2 May 2015 RAID Incorporated Introduction The abundance of Big Data, structured, partially-structured and unstructured massive datasets, which are too large to be processed effectively

More information

Innovation that Matters an IBM story

Innovation that Matters an IBM story Dr. Shiva Kumar Vice President, Enterprise Performance and Industry Analytics Innovation that Matters an IBM story IBM Research IBM Research: Global and Vertically Oriented analytics services tools China

More information

The Future of Data Management

The Future of Data Management The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class

More information

Government Technology Trends to Watch in 2014: Big Data

Government Technology Trends to Watch in 2014: Big Data Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require

More information

Big Data Technologies Compared June 2014

Big Data Technologies Compared June 2014 Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development

More information

Enterprise Data Integration

Enterprise Data Integration Enterprise Data Integration Access, Integrate, and Deliver Data Efficiently Throughout the Enterprise brochure How Can Your IT Organization Deliver a Return on Data? The High Price of Data Fragmentation

More information

Create and Drive Big Data Success Don t Get Left Behind

Create and Drive Big Data Success Don t Get Left Behind Create and Drive Big Data Success Don t Get Left Behind The performance boost from MapR not only means we have lower hardware requirements, but also enables us to deliver faster analytics for our users.

More information

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this

More information

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com INSIGHT Base One: Grid Computing for Database-Centric Applications Earl Joseph, Ph. D. IDC OPINION

More information

Hur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER

Hur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER Hur hanterar vi utmaningar inom området - Big Data Jan Östling Enterprise Technologies Intel Corporation, NER Legal Disclaimers All products, computer systems, dates, and figures specified are preliminary

More information

Hybrid Cluster Management: Reducing Stress, increasing productivity and preparing for the future

Hybrid Cluster Management: Reducing Stress, increasing productivity and preparing for the future Hybrid Cluster Management: Reducing Stress, increasing productivity and preparing for the future Clement Lau, Ph. D. Sales Director, APJ Bright Computing Agenda 1.Reduce 2.IncRease 3.PrepaRe Reduce System

More information

PBS Works: The Trusted Suite for HPC Workload Management

PBS Works: The Trusted Suite for HPC Workload Management PBS Works: The Trusted Suite for HPC Workload Management Victor Wright, HPC Account Specialist April 7, 2014 Overview Founded... In 1985 as a product design consulting company $270M Est. Today... A global

More information

I D C T E C H N O L O G Y S P O T L I G H T

I D C T E C H N O L O G Y S P O T L I G H T I D C T E C H N O L O G Y S P O T L I G H T C r a y T r a n s f o r m a tion Mines Core Strengths to Ad d r e s s N e w Markets October 2013 By Steve Conway, Earl C. Joseph, Ph.D., and Chirag Dekate, Ph.D.

More information

Are You Ready for Big Data?

Are You Ready for Big Data? Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?

More information

Accelerating Complex Event Processing with Memory- Centric DataBase (MCDB)

Accelerating Complex Event Processing with Memory- Centric DataBase (MCDB) Accelerating Complex Event Processing with Memory- Centric DataBase (MCDB) A FedCentric Technologies White Paper January 2008 Executive Summary Events happen in real-time; orders are taken, calls are placed,

More information

Decision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010

Decision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010 Decision Support Optimization through Predictive Analytics - Leuven Statistical Day 2010 Ernst van Waning Senior Sales Engineer May 28, 2010 Agenda SPSS, an IBM Company SPSS Statistics User-driven product

More information

Demystifying Big Data Government Agencies & The Big Data Phenomenon

Demystifying Big Data Government Agencies & The Big Data Phenomenon Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed

More information

A new era for the Life Sciences industry

A new era for the Life Sciences industry A new era for the Life Sciences industry Cloud computing changes the game Michael Whitworth Director, Clinical Data Strategy Accenture Accelerated R&D Services Michael.whitworth@accenture.com Agenda: Accenture

More information

Real World Application and Usage of IBM Advanced Analytics Technology

Real World Application and Usage of IBM Advanced Analytics Technology Real World Application and Usage of IBM Advanced Analytics Technology Anthony J. Young Pre-Sales Architect for IBM Advanced Analytics February 21, 2014 Welcome Anthony J. Young Lives in Austin, TX Focused

More information

Top 10 Automotive Manufacturer Makes the Business Case for OpenStack

Top 10 Automotive Manufacturer Makes the Business Case for OpenStack Top 10 Automotive Manufacturer Makes the Business Case for OpenStack OPENSTACK WHITE PAPER Contributors: SOLINEA: Francesco Paola, CEO Seth Fox, Vice President Operations Brad Vaughan, Vice President Service

More information

Data Storage At the Heart of any Information System. Ken Claffey, VP/GM - June 2015

Data Storage At the Heart of any Information System. Ken Claffey, VP/GM - June 2015 Data Storage At the Heart of any Information System Ken Claffey, VP/GM - June 2015 Seagate: A Unique Vantage Point on the Data Centre Evolution of the world s digital information End-to-end cloud solutions:

More information

Scale-out NAS Unifies the Technical Enterprise

Scale-out NAS Unifies the Technical Enterprise Scale-out NAS Unifies the Technical Enterprise Panasas Inc. White Paper July 2010 Executive Summary Tremendous effort has been made by IT organizations, and their providers, to make enterprise storage

More information

NetApp Big Content Solutions: Agile Infrastructure for Big Data

NetApp Big Content Solutions: Agile Infrastructure for Big Data White Paper NetApp Big Content Solutions: Agile Infrastructure for Big Data Ingo Fuchs, NetApp April 2012 WP-7161 Executive Summary Enterprises are entering a new era of scale, in which the amount of data

More information

I D C V E N D O R S P O T L I G H T. S t o r a g e Ar c h i t e c t u r e t o Better Manage B i g D a t a C hallenges

I D C V E N D O R S P O T L I G H T. S t o r a g e Ar c h i t e c t u r e t o Better Manage B i g D a t a C hallenges I D C V E N D O R S P O T L I G H T S t o r a g e Ar c h i t e c t u r e t o Better Manage B i g D a t a C hallenges September 2012 Adapted from Worldwide File-Based Storage 2011 2015 Forecast: Foundation

More information

Big Data Executive Survey

Big Data Executive Survey Big Data Executive Full Questionnaire Big Date Executive Full Questionnaire Appendix B Questionnaire Welcome The survey has been designed to provide a benchmark for enterprises seeking to understand the

More information

The data explosion is transforming science

The data explosion is transforming science Talk Outline The data tsunami and the 4 th paradigm of science The challenges for the long tail of science Where is the cloud being used now? The app marketplace SMEs Analytics as a service. What are the

More information

Technology and Trends for Smarter Business Analytics

Technology and Trends for Smarter Business Analytics Don Campbell Chief Technology Officer, Business Analytics, IBM Technology and Trends for Smarter Business Analytics Business Analytics software Where organizations are focusing Business Analytics Enhance

More information

EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS

EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS Marcia Kaufman, Principal Analyst, Hurwitz & Associates Dan Kirsch, Senior Analyst, Hurwitz & Associates Steve Stover, Sr. Director, Product Management, Predixion

More information

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform David Lawler, Oracle Senior Vice President, Product Management and Strategy Paul Kent, SAS Vice President, Big Data What

More information

Open Cloud Computing A Case for HPC CRO NGI Day Zagreb, Oct, 26th

Open Cloud Computing A Case for HPC CRO NGI Day Zagreb, Oct, 26th Open Cloud Computing A Case for HPC CRO NGI Day Zagreb, Oct, 26th Philippe Trautmann HPC Business Development Manager Global Education @ Research Sun Microsystems, Inc. 1 The Cloud HPC and Cloud: any needs?

More information

Introduction to Red Hat Storage. January, 2012

Introduction to Red Hat Storage. January, 2012 Introduction to Red Hat Storage January, 2012 1 Today s Speakers 2 Heather Wellington Tom Trainer Storage Program Marketing Manager Storage Product Marketing Manager Red Hat Acquisition of Gluster What

More information

SGI HPC Systems Help Fuel Manufacturing Rebirth

SGI HPC Systems Help Fuel Manufacturing Rebirth SGI HPC Systems Help Fuel Manufacturing Rebirth Created by T A B L E O F C O N T E N T S 1.0 Introduction 1 2.0 Ongoing Challenges 1 3.0 Meeting the Challenge 2 4.0 SGI Solution Environment and CAE Applications

More information

Optimized Hadoop for Enterprise

Optimized Hadoop for Enterprise Optimized Hadoop for Enterprise Smart Big data Platform provides Reliability, Security, and Ease of Use + Big Data, Valuable Resource for Forecasting the Future of Businesses + Offers integrated and end-to-end

More information

VIEWPOINT. High Performance Analytics. Industry Context and Trends

VIEWPOINT. High Performance Analytics. Industry Context and Trends VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations

More information

HPC Trends and Directions in the Earth Sciences Per Nyberg nyberg@cray.com Sr. Director, Business Development

HPC Trends and Directions in the Earth Sciences Per Nyberg nyberg@cray.com Sr. Director, Business Development HPC Trends and Directions in the Earth Sciences Per Nyberg nyberg@cray.com Sr. Director, Business Development Cray Solutions for the Earth Sciences Why Cray? Cray solutions support: Range of modeling capabilities

More information

Leveraging Information For Smarter Business Outcomes With IBM Information Management Software

Leveraging Information For Smarter Business Outcomes With IBM Information Management Software Leveraging Information For Smarter Business Outcomes With IBM Information Management Software Tony Mignardi WW Information Management Sales IBM Software Group April 1 2009 Agenda Our Smarter Planet and

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

SAP Thought Leadership Paper. Helping the U.S. Government Serve the American People Better

SAP Thought Leadership Paper. Helping the U.S. Government Serve the American People Better SAP Thought Leadership Paper Helping the U.S. Government Serve the American People Better Helping the U.S. Government Serve the American People Better innovating with less: the cornerstone of the Digital

More information

The Power of Pentaho and Hadoop in Action. Demonstrating MapReduce Performance at Scale

The Power of Pentaho and Hadoop in Action. Demonstrating MapReduce Performance at Scale The Power of Pentaho and Hadoop in Action Demonstrating MapReduce Performance at Scale Introduction Over the last few years, Big Data has gone from a tech buzzword to a value generator for many organizations.

More information