HPC Trends and Directions in the Earth Sciences Per Nyberg Sr. Director, Business Development
|
|
- Jasmin Phillips
- 2 years ago
- Views:
Transcription
1 HPC Trends and Directions in the Earth Sciences Per Nyberg Sr. Director, Business Development
2 Cray Solutions for the Earth Sciences Why Cray? Cray solutions support: Range of modeling capabilities Research and operational environments Shortened research to operations Experience in delivering and operating the world s largest and most complex systems Commitment to long-term partnerships Market Presence Cray systems are used in a wide range of areas and configurations: NWP and Climate Used as model development platforms for extreme scale architectures Compute and storage sizes range from Terascale to Petascale What s Next? Continued emphasis on system-wide approach to scalability hardware and software Impact of latency sensitive big and fast data Impact of analytics workloads on HPC architectures Ultimately integrated HPC environments are the capability that will turn data in to insight and discovery. 2
3 Cray Announcements in Weather, Climate and Oceanography over the Last Two Years Feb 2014 Oct 2014 June 2013 June 2014 Sept 2013 June 2014 June 2013 April 2014 Jan 2013 April
4 Cray XC Design Areas for Weather and Climate Tightly integrated hardware and software stack designed for Sustained Application Performance and Scalability: Uniquely capable of both large scale high resolution deterministic and ensemble workloads Highly tuned software stack maximizes the cycles to the application Operational workloads and environments Investment Protection Upgradable by Design: Key system elements (CPUs, memory) can be easily upgraded as faster and more capable components become available Systems can be easily expanded with additional blades / cabinets Programming Environment designed for application life and portability User Productivity 4
5 Trends and Market Drivers 5
6 Data and Computational Drivers Today s science is: Data-intensive Data-driven Compute-intensive Multi-disciplinary Multi-scale, multi-physics Driven by multiple dimensions. Data Tsunami is defying standard approaches to interpretation Volume and complexity of data are too much for either humans or current technologies for effective analysis Creating necessity to reexamine current applications and develop new applications domains Fidelity / Resolution Data and Compute Resources Requires multi-dimensional technology stack hardware, system software and applications Figure adopted from Computing Issues for WCRP Weather and Climate Modeling, James Kinter and Michael Wehner 6
7 The Current Wave of Big Data. Complex, unstructured, created by sensors,. Data driven discovery and advanced analytics are rapidly becoming a competitive differentiators providing insight and predictive capabilities 7
8 Simulation was the first big data market -- IDC Isotropic/anisotropic FWI elastic modeling/rtm Elastic FWI visco elastic modeling Visco elastic FWI petro-elastic inversion Identify all protein sequences using public resources and metagenomics data, and systematic modelling of proteins belonging to the family Aero Optimisation & CFD-CSM Improving the prediction of protein structure by coupling new bioinformatics algorithm and massive molecular dynamics simulation approaches Full multidisciplinary design optimization Systematic identification of biological partners of proteins. CFD-based noise simulation Coupled AGCMs at 50km atmosphere and 1 deg ocean Earth System Models at 10 km atmosphere and 1/10 deg ocean Full earth system models with carbon feedback cycle at 1km atmosphere and 1/100 deg ocean Terascale Petascale Exascale Major changes to applications and algorithms to address complexity and extend scalability 8
9 The Evolving HPC Workload: Simulation, data driven discovery and advanced analytics Largest ever hurricane simulation at an urban scale resolution of 500m Large-scale engine bay airflow optimization to improve vehicle fuel consumption Highest-definition sub-surface images of oil fields improving development and production efficiencies Healthcare fraud detection across disparate databases Cyberattack detection through the discovery of relationships from multiple sources in billion point graphs Viewer sentiment analysis to optimize television guest appearances Predictive models to determine optimal athlete performance and likelihood of injury Large, dynamic and complex analytics for portfolio risk analysis 9
10 The Evolving HPC Workload: Economics of emerging use-cases will take part in driving architectures across all areas The Demand Side Healthcare Fraud Detection (Source: IDC) 5 separate databases for the big USG health care programs under Centers for Medicare and Medicaid Services (CMS) Estimated fraud: $150B ~ $450B <$5B caught today) ORNL, SDSC have evaluation contracts to unify the databases and perform fraud detection on various architectures. Sports Analytics (Source: Vince Genarro) Player, field of play and consumer data has exploded The stakes have grown dramatically $50 $100 million decisions are commonplace Winning Drives Profitability Largest ever hurricane simulation at an urban scale resolution of 500m Large-scale engine bay airflow optimization to improve vehicle fuel consumption Highest-definition sub-surface images of oil fields improving development and production efficiencies Health fraud detection across disparate databases Cyberattack detection through the discovery of relationships from multiple sources in billion point graphs Viewer sentiment analysis to optimize television guest appearances Predictive models to determine optimal athlete performance and likelihood of injury Large, dynamic and complex analytics for portfolio risk analysis 10
11 Growth in Data Science: Monsanto Example Background What do they do? In Oct 2013 Monsanto acquired The Climate Corporation for ~$1B. The Climate Corporation s expertise is in data science. Use a wide range of information to provde insights and recommendations for farmers, such as planting and irrigation schedules. offering <farmers> novel options in the way they manage risk on farm including weather, which is the single biggest risk farmers face on an annual basis. Based on a Hadoop implementation that creates weather projections for the next two years at every 2.5 by 2.5 kilometer grid across the U.S. Mapped out the most likely 10,000 outcomes per location using different variations of likely patterns to create a probabilistic view of weather. Goal Goal is to help farmers understand the risks of their practices and to help them reduce those risks by changing their practices and by helping underwrite weather insurance against adverse effects. Sources: 11
12 Emergence of Latency-Sensitive Analytics Low-latency applications require performance optimizations Memory-storage hierarchies Fast interconnects Response time frames <30ms 30ms 10min streaming data tweets event logs IoT SQL/ad hoc queries BI visualization exploration Low-Latency Hadoop tomorrow Streaming data / Data in motion >10min summarization aggregation indexing ETL Batch Hadoop today Stationary data 12
13 Enabling More Complexity & Capability Big Data à Fast Data Global Memory + Fast Interconnects Fast Data Supercomputers & Analytic Appliances SAN Interconnects Big Data LAN/WAN Interconnects Public Clouds Enterprise Data (structured) CLOUD GRID 13
14 System Architecture Differences Supercomputing Scalable computing w/high BW, low-latency, global memory architectures Tightly integrated processor-memory-interconnect & network storage Minimize data movement load the mesh into memory Move data for loading, check-pointing or archiving Basketball court sized systems Large-Scale Data Analytics Distributed computing at largest scale Divide-and-conquer approaches on Service Orientated Architectures Maximize data movement-- scan/sort/stream all the data all the time Lowest cost processor-memory-interconnect & local storage Warehouse sized private and public clouds 14
15 The Fusion of Supercomputing with Large Scale Data Analytics The cost per FLOP is dropping dramatically Cost of moving data dominates performance and energy consumption Key Trends New levels of memory and storage hierarchy are emerging Effective Parallelism of O(Million ~ Billion) Analytic application needs for memory size and IO performance are insatiable! Future systems are being influenced by the converged infrastructure of compute & storage Converged infrastructure of Hyperscale demands management capability of O(10000) nodes 15
16 Changing Needs The Fusion of Supercomputing and Big & Fast Data Modeling The World Cray Supercomputers solving grand challenges in science, engineering and analytics Math Models Modeling and simulation augmented with data to provide the highest fidelity virtual reality results Data-Intensive Processing High throughput event processing & data capture from sensors, data feeds and instruments Data Models Integration of datasets and math models for search, analysis, predictive modeling and knowledge discovery COMPUTE STORE ANALYZE 16
17 Cray Integrated Environments for Simulation and Discovery Compute Store Analyze Supercomputers Flexible Clusters Hybrid Architectures Integrated Storage & Data Management Tiered Storage Archive Data Discovery Advanced Analytics C O M P U T E S T O R E A N A L Y Z E 10/30/14 ECMWF HPC Workshop
18 Recently Announced: Urika-XA Platform Turnkey Advanced Analytics Platform Next-Generation System Architecture Engineered for Performance Hadoop and Spark ecosystem Emerging analytic workloads Open platform for current and future frameworks Single pane of glass for system management Innovative use of storage technologies Battle-tested on cutting-edge government/scientific analytic applications Ready for the enterprise Dense footprint: over 1,500 cores, 6TB memory 38TB SSD and 120TB POSIXcompliant high-performance storage InfiniBand Cray Adaptive Runtime for Hadoop Scale out to multi-rack configurations 18
19 Recent Cray XC40 Announcement What is it? Follow-on to highly successful Cray XC30 Already received orders for over 70,000 sockets Much of which is already installed What s New? DataWarp applications I/O accelerator New tier of high performance flash SSD directly connected to the Cray XC40 compute nodes. Delivers a balanced and cohesive end-toend system architecture Support for Intel Xeon processor E v3 product family, formerly code named Haswell, Comes in small packages too the Cray XC40-AC Cray s core technologies in a smaller package Same Powerful and Productive Software Ecosystem Same Aries Infrastructure Same DataWarp I/O Options Only the cooling is different. C O M P U T E S T O R E A N A L Y Z E 10/30/14 ECMWF HPC Workshop
20 Trends in the Memory/Storage Subsystem CPU On Node Off Node CPU Memory (DRAM) Storage (HDD) Distant Storage (WAN/Tape) Near Memory (HBM/HMC) Far Memory (DRAM) Near Storage (NVDIMM) Mid Storage (SSD) Far Storage (HDD) On Node Off Node Distant Storage (Object/WAN/Tape) Today Future 20
21 Two Recent Large XC Orders that will Impact Future Technologies and Applications Throughout the Community Los Alamos / Sandia Trinity 42 Pflop system Heterogeneous System Haswell + KNL 3PB SSD DataWarp Capability NERSC8 Installation Date: 2Q 2016 Self-hosted KNL System ~28 Pflops Peak Transitioning user base to many-core processing NERSC Exascale Science Applications Program (NESAP) 21
22 NERSC Exascale Science Applications Program (NESAP) Collaboration with Cray and Intel to prepare for Cori, the Cray XC to be deployed at NERSC in NESAP was launched to ensure that the highly diverse workloads of the DOE science community continue to be supported as over 5,000 users make the transition to Cori. Application areas: Fusion Energy Sciences, High Energy Physics, Nuclear Physics, Biological and Environmental Research: ESM Global Climate Modeling, John Dennis (NCAR) High-Resolution Global Coupled Climate Simulation Using The Accelerated Climate Model for Energy (ACME), Hans Johansen (LBNL) Multi-Scale Ocean Simulation for Studying Global to Regional Climate Change, Todd Ringler (LANL) Large number of community models are involved. 22
23 Moving Forwards: Adapting to Simulation and Data-Intensive Workloads by Adding Value at the Edge of the Network Configurable Injection and Global Bandwidth Data Processors x86 Many-core / GPU Multi-threaded Flexible compute for specialized functions System Software High throughput scheduling Adaptive runtimes / Adaptive routing Compilers, Auto-tuning, Programming models Middleware stack to support simulation and analytics workflows Memory Pools Storage I/O Network I/O DRAM Active NVRAM/NVDIMM HMC/HBM Tiered Storage from SSD s to Disk to Tape Tightly coupled Software Stack for RAID Very Low Latency Intelligent I/O & Protocol Load Balancing Specialized Data Ingest Policy Based Data Movement/Software Defined Network System-wide approach to workflow performance 23
24 Summary Weather, climate and ocean modeling is a key community within Cray s customer base. Data driven discovery and advanced analytics are rapidly becoming a competitive differentiators in both traditional and non-traditional HPC areas. The HPC workload is evolving and is driving the need for advanced architectures. Cray s vision is that the fusion of Supercomputing and Big & Fast Data is the capability that will turn data into insight and discovery. 24
25 Thank you for your attention 25
The Fusion of Supercomputing and Big Data. Peter Ungaro President & CEO
The Fusion of Supercomputing and Big Data Peter Ungaro President & CEO The Supercomputing Company Supercomputing Big Data Because some great things never change One other thing that hasn t changed. Cray
The Fusion of Supercomputing and Big Data: The Role of Global Memory Architectures in Future Large Scale Data Analytics
HPC 2014 High Performance Computing FROM clouds and BIG DATA to EXASCALE AND BEYOND An International Advanced Workshop July 7 11, 2014, Cetraro, Italy Session III Emerging Systems and Solutions The Fusion
Cray s Storage History and Outlook Lustre+ Jason Goodman, Cray LUG 2015 - Denver
Cray s Storage History and Outlook Lustre+ Jason Goodman, Cray - Denver Agenda Cray History from Supercomputers to Lustre Where we are Today Cray Business OpenSFS Flashback to the Future SSDs, DVS, and
Data Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems
Supercomputing and Big Data: Where are the Real Boundaries and Opportunities for Synergy?
HPC2012 Workshop Cetraro, Italy Supercomputing and Big Data: Where are the Real Boundaries and Opportunities for Synergy? Bill Blake CTO Cray, Inc. The Big Data Challenge Supercomputing minimizes data
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes Anthony Kenisky, VP of North America Sales About Appro Over 20 Years of Experience 1991 2000 OEM Server Manufacturer 2001-2007
Jean-Pierre Panziera Teratec 2011
Technologies for the future HPC systems Jean-Pierre Panziera Teratec 2011 3 petaflop systems : TERA 100, CURIE & IFERC Tera100 Curie IFERC 1.25 PetaFlops 256 TB ory 30 PB disk storage 140 000+ Xeon cores
Hadoop on the Gordon Data Intensive Cluster
Hadoop on the Gordon Data Intensive Cluster Amit Majumdar, Scientific Computing Applications Mahidhar Tatineni, HPC User Services San Diego Supercomputer Center University of California San Diego Dec 18,
Data management challenges in todays Healthcare and Life Sciences ecosystems
Data management challenges in todays Healthcare and Life Sciences ecosystems Jose L. Alvarez Principal Engineer, WW Director Life Sciences jose.alvarez@seagate.com Evolution of Data Sets in Healthcare
HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk
HPC and Big Data EPCC The University of Edinburgh Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk EPCC Facilities Technology Transfer European Projects HPC Research Visitor Programmes Training
PACE Predictive Analytics Center of Excellence @ San Diego Supercomputer Center, UCSD. Natasha Balac, Ph.D.
PACE Predictive Analytics Center of Excellence @ San Diego Supercomputer Center, UCSD Natasha Balac, Ph.D. Brief History of SDSC 1985-1997: NSF national supercomputer center; managed by General Atomics
Cray: Enabling Real-Time Discovery in Big Data
Cray: Enabling Real-Time Discovery in Big Data Discovery is the process of gaining valuable insights into the world around us by recognizing previously unknown relationships between occurrences, objects
The Future of Data Management
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK
HPC & Big Data THE TIME HAS COME FOR A SCALABLE FRAMEWORK Barry Davis, General Manager, High Performance Fabrics Operation Data Center Group, Intel Corporation Legal Disclaimer Today s presentations contain
Flash Memory Arrays Enabling the Virtualized Data Center. July 2010
Flash Memory Arrays Enabling the Virtualized Data Center July 2010 2 Flash Memory Arrays Enabling the Virtualized Data Center This White Paper describes a new product category, the flash Memory Array,
Dell* In-Memory Appliance for Cloudera* Enterprise
Built with Intel Dell* In-Memory Appliance for Cloudera* Enterprise Find out what faster big data analytics can do for your business The need for speed in all things related to big data is an enormous
Infrastructure Matters: POWER8 vs. Xeon x86
Advisory Infrastructure Matters: POWER8 vs. Xeon x86 Executive Summary This report compares IBM s new POWER8-based scale-out Power System to Intel E5 v2 x86- based scale-out systems. A follow-on report
MaxDeploy Ready. Hyper- Converged Virtualization Solution. With SanDisk Fusion iomemory products
MaxDeploy Ready Hyper- Converged Virtualization Solution With SanDisk Fusion iomemory products MaxDeploy Ready products are configured and tested for support with Maxta software- defined storage and with
Well packaged sets of preinstalled, integrated, and optimized software on select hardware in the form of engineered systems and appliances
INSIGHT Oracle's All- Out Assault on the Big Data Market: Offering Hadoop, R, Cubes, and Scalable IMDB in Familiar Packages Carl W. Olofson IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA
Impact of Big Data growth On Transparent Computing
Impact of Big Data growth On Transparent Computing Michael A. Greene Intel Vice President, Software and Services Group, General Manager, System Technologies and Optimization 1 Transparent Computing (TC)
Data Centric Computing Revisited
Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data
Outline. High Performance Computing (HPC) Big Data meets HPC. Case Studies: Some facts about Big Data Technologies HPC and Big Data converging
Outline High Performance Computing (HPC) Towards exascale computing: a brief history Challenges in the exascale era Big Data meets HPC Some facts about Big Data Technologies HPC and Big Data converging
Big Workflow: More than Just Intelligent Workload Management for Big Data
Big Workflow: More than Just Intelligent Workload Management for Big Data Michael Feldman White Paper February 2014 EXECUTIVE SUMMARY Big data applications represent a fast-growing category of high-value
Achieving Performance Isolation with Lightweight Co-Kernels
Achieving Performance Isolation with Lightweight Co-Kernels Jiannan Ouyang, Brian Kocoloski, John Lange The Prognostic Lab @ University of Pittsburgh Kevin Pedretti Sandia National Laboratories HPDC 2015
HPC and Large Scale Data Analytics. SOS17 Conference Jekyll Island, Georgia
HPC and Large Scale Data Analytics SOS17 Conference Jekyll Island, Georgia Bill Blake CTO Cray Inc March 26, 2013 HPC and Large-scale Data Analytics Divergence or Convergence? Supercomputing Highest performance
Interactive data analytics drive insights
Big data Interactive data analytics drive insights Daniel Davis/Invodo/S&P. Screen images courtesy of Landmark Software and Services By Armando Acosta and Joey Jablonski The Apache Hadoop Big data has
Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory
Customer Success Story Los Alamos National Laboratory Panasas High Performance Storage Powers the First Petaflop Supercomputer at Los Alamos National Laboratory June 2010 Highlights First Petaflop Supercomputer
Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED
Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory 21 st Century Research Continuum Theory Theory embodied in computation Hypotheses tested through experiment SCIENTIFIC METHODS
InfiniBand Update Addressing new I/O challenges in HPC, Cloud, and Web 2.0 infrastructures. Brian Sparks IBTA Marketing Working Group Co-Chair
InfiniBand Update Addressing new I/O challenges in HPC, Cloud, and Web 2.0 infrastructures Brian Sparks IBTA Marketing Working Group Co-Chair Page 1 IBTA & OFA Update IBTA today has over 50 members; OFA
SW and HW System Architecture For Big Data CHPC 2013 Conference Cape Town, SA
SW and HW System Architecture For Big Data CHPC 2013 Conference Cape Town, SA Giri Chukkapalli, Ph.D Principal Engineer, CTO Office, William Blake, CTO, Cray Inc Dec 05, 2013 Topics Whats all the fuss
Einsatzfelder von IBM PureData Systems und Ihre Vorteile.
Einsatzfelder von IBM PureData Systems und Ihre Vorteile demirkaya@de.ibm.com Agenda Information technology challenges PureSystems and PureData introduction PureData for Transactions PureData for Analytics
Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage
White Paper Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage A Benchmark Report August 211 Background Objectivity/DB uses a powerful distributed processing architecture to manage
Oracle Big Data SQL Technical Update
Oracle Big Data SQL Technical Update Jean-Pierre Dijcks Oracle Redwood City, CA, USA Keywords: Big Data, Hadoop, NoSQL Databases, Relational Databases, SQL, Security, Performance Introduction This technical
Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services
Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the
BMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation
BMW11: Dealing with the Massive Data Generated by Many-Core Systems Dr Don Grice IBM Systems and Technology Group Title: Dealing with the Massive Data Generated by Many Core Systems. Abstract: Multi-core
Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15
Running Oracle s PeopleSoft Human Capital Management on Oracle SuperCluster T5-8 O R A C L E W H I T E P A P E R L A S T U P D A T E D J U N E 2 0 15 Table of Contents Fully Integrated Hardware and Software
Software-defined Storage Architecture for Analytics Computing
Software-defined Storage Architecture for Analytics Computing Arati Joshi Performance Engineering Colin Eldridge File System Engineering Carlos Carrero Product Management June 2015 Reference Architecture
Dell s SAP HANA Appliance
Dell s SAP HANA Appliance SAP HANA is the next generation of SAP in-memory computing technology. Dell and SAP have partnered to deliver an SAP HANA appliance that provides multipurpose, data source-agnostic,
Storage, Cloud, Web 2.0, Big Data Driving Growth
Storage, Cloud, Web 2.0, Big Data Driving Growth Kevin Deierling Vice President of Marketing October 25, 2013 Delivering the Highest ROI Across all Markets HPC Web 2.0 DB/Enterprise Cloud Financial Services
HyperQ Hybrid Flash Storage Made Easy White Paper
HyperQ Hybrid Flash Storage Made Easy White Paper Parsec Labs, LLC. 7101 Northland Circle North, Suite 105 Brooklyn Park, MN 55428 USA 1-763-219-8811 www.parseclabs.com info@parseclabs.com sales@parseclabs.com
Sun Constellation System: The Open Petascale Computing Architecture
CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc. 25 Years of Technical
Pentaho High-Performance Big Data Reference Configurations using Cisco Unified Computing System
Pentaho High-Performance Big Data Reference Configurations using Cisco Unified Computing System By Jake Cornelius Senior Vice President of Products Pentaho June 1, 2012 Pentaho Delivers High-Performance
Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack
Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack HIGHLIGHTS Real-Time Results Elasticsearch on Cisco UCS enables a deeper
The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays
The Evolution of Microsoft SQL Server: The right time for Violin flash Memory Arrays Executive Summary Microsoft SQL has evolved beyond serving simple workgroups to a platform delivering sophisticated
Kriterien für ein PetaFlop System
Kriterien für ein PetaFlop System Rainer Keller, HLRS :: :: :: Context: Organizational HLRS is one of the three national supercomputing centers in Germany. The national supercomputing centers are working
Overview: X5 Generation Database Machines
Overview: X5 Generation Database Machines Spend Less by Doing More Spend Less by Paying Less Rob Kolb Exadata X5-2 Exadata X4-8 SuperCluster T5-8 SuperCluster M6-32 Big Memory Machine Oracle Exadata Database
Barry Bolding, Ph.D. VP, Cray Product Division
Barry Bolding, Ph.D. VP, Cray Product Division 1 Corporate Overview Trends in Supercomputing Types of Supercomputing and Cray s Approach The Cloud The Exascale Challenge Conclusion 2 Slide 3 Seymour Cray
Amazon EC2 Product Details Page 1 of 5
Amazon EC2 Product Details Page 1 of 5 Amazon EC2 Functionality Amazon EC2 presents a true virtual computing environment, allowing you to use web service interfaces to launch instances with a variety of
News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren
News and trends in Data Warehouse Automation, Big Data and BI Johan Hendrickx & Dirk Vermeiren Extreme Agility from Source to Analysis DWH Appliances & DWH Automation Typical Architecture 3 What Business
Wrangler: A New Generation of Data-intensive Supercomputing. Christopher Jordan, Siva Kulasekaran, Niall Gaffney
Wrangler: A New Generation of Data-intensive Supercomputing Christopher Jordan, Siva Kulasekaran, Niall Gaffney Project Partners Academic partners: TACC Primary system design, deployment, and operations
Unified Computing Systems
Unified Computing Systems Cisco Unified Computing Systems simplify your data center architecture; reduce the number of devices to purchase, deploy, and maintain; and improve speed and agility. Cisco Unified
ECMWF HPC Workshop: Accelerating Data Management
October 2012 ECMWF HPC Workshop: Accelerating Data Management Massively-Scalable Platforms and Solutions Engineered for the Big Data and Cloud Era Glenn Wright Systems Architect, DDN Data-Driven Paradigm
HadoopTM Analytics DDN
DDN Solution Brief Accelerate> HadoopTM Analytics with the SFA Big Data Platform Organizations that need to extract value from all data can leverage the award winning SFA platform to really accelerate
Clusters: Mainstream Technology for CAE
Clusters: Mainstream Technology for CAE Alanna Dwyer HPC Division, HP Linux and Clusters Sparked a Revolution in High Performance Computing! Supercomputing performance now affordable and accessible Linux
IT Platforms for Utilization of Big Data
Hitachi Review Vol. 63 (2014), No. 1 46 IT Platforms for Utilization of Big Yasutomo Yamamoto OVERVIEW: The growing momentum behind the utilization of big in social and corporate activity has created a
Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013
Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache
Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks
WHITE PAPER July 2014 Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks Contents Executive Summary...2 Background...3 InfiniteGraph...3 High Performance
LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance
11 th International LS-DYNA Users Conference Session # LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance Gilad Shainer 1, Tong Liu 2, Jeff Layton 3, Onur Celebioglu
Dell Cloudera Syncsort Data Warehouse Optimization ETL Offload
Dell Cloudera Syncsort Data Warehouse Optimization ETL Offload Drive operational efficiency and lower data transformation costs with a Reference Architecture for an end-to-end optimization and offload
SGI UV 300, UV 30EX: Big Brains for No-Limit Computing
SGI UV 300, UV 30EX: Big Brains for No-Limit Computing The Most ful In-memory Supercomputers for Data-Intensive Workloads Key Features Scales up to 64 sockets and 64TB of coherent shared memory Extreme
Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise
Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise Introducing Unisys All in One software based weather platform designed to reduce server space, streamline operations, consolidate
NERSC Data Efforts Update Prabhat Data and Analytics Group Lead February 23, 2015
NERSC Data Efforts Update Prabhat Data and Analytics Group Lead February 23, 2015-1 - A little bit about myself Computer Scien.st Brown, IIT Delhi Real- 3me Graphics, Virtual Reality, HCI Computa3onal
The Open Cloud Near-Term Infrastructure Trends in Cloud Computing
The Open Cloud Near-Term Infrastructure Trends in Cloud Computing Markus Leberecht BELNET Networking Conference 25-Oct-2012 1 Growth & IT Challenges Drive Need for Cloud Computing IT Pros Growth IT Challenges
HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK
HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK Steve Oberlin CTO, Accelerated Computing US to Build Two Flagship Supercomputers SUMMIT SIERRA Partnership for Science 100-300 PFLOPS Peak Performance
With DDN Big Data Storage
DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The Big
Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database
Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database Built up on Cisco s big data common platform architecture (CPA), a
ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013
ONE platform for ALL YOUR DATA Radim Petrzela February 26 th, 2013 POWER OF HITACHI Founded in 1910 US$118B FY11 900 subsidiaries 324,000 employees More than 760 PhDs INFORMATION and TELECOMMU- NICATIONS
High-Throughput Computing for HPC
Intelligent HPC Workload Management Convergence of high-throughput computing (HTC) with high-performance computing (HPC) Table of contents 3 Introduction 3 The Bottleneck in High-Throughput Computing 3
4 th Workshop on Big Data Benchmarking
4 th Workshop on Big Data Benchmarking MPP SQL Engines: architectural choices and their implications on benchmarking 09 Oct 2013 Agenda: Big Data Landscape Market Requirements Benchmark Parameters Benchmark
SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON
SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON 2 The V of Big Data Velocity means both how fast data is being produced and how fast the data must be processed to meet demand. Gartner The emergence
ECDF Infrastructure Refresh - Requirements Consultation Document
Edinburgh Compute & Data Facility - December 2014 ECDF Infrastructure Refresh - Requirements Consultation Document Introduction In order to sustain the University s central research data and computing
Integrated Grid Solutions. and Greenplum
EMC Perspective Integrated Grid Solutions from SAS, EMC Isilon and Greenplum Introduction Intensifying competitive pressure and vast growth in the capabilities of analytic computing platforms are driving
Big Data Web Analytics Platform on AWS for Yottaa
Big Data Web Analytics Platform on AWS for Yottaa Background Yottaa is a young, innovative company, providing a website acceleration platform to optimize Web and mobile applications and maximize user experience,
Summit and Sierra Supercomputers:
Whitepaper Summit and Sierra Supercomputers: An Inside Look at the U.S. Department of Energy s New Pre-Exascale Systems November 2014 1 Contents New Flagship Supercomputers in U.S. to Pave Path to Exascale
Hur hanterar vi utmaningar inom området - Big Data. Jan Östling Enterprise Technologies Intel Corporation, NER
Hur hanterar vi utmaningar inom området - Big Data Jan Östling Enterprise Technologies Intel Corporation, NER Legal Disclaimers All products, computer systems, dates, and figures specified are preliminary
Accelerating Server Storage Performance on Lenovo ThinkServer
Accelerating Server Storage Performance on Lenovo ThinkServer Lenovo Enterprise Product Group April 214 Copyright Lenovo 214 LENOVO PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND, EITHER
Cisco Solutions for Big Data and Analytics
Cisco Solutions for Big Data and Analytics Tarek Elsherif, Solutions Executive November, 2015 Agenda Major Drivers & Challengs Data Virtualization & Analytics Platform Considerations for Big Data & Analytics
SC15 SYNOPSIS FOR FEDERAL GOVERNMENT
SC15 SYNOPSIS FOR FEDERAL GOVERNMENT SC15 Synopsis for Federal Government As a service to our clients, Engility offers a few notes from the Supercomputing Conference 2015 (SC15). Engility recently attended
The Flash-Transformed Financial Data Center. Jean S. Bozman Enterprise Solutions Manager, Enterprise Storage Solutions Corporation August 6, 2014
The Flash-Transformed Financial Data Center Jean S. Bozman Enterprise Solutions Manager, Enterprise Storage Solutions Corporation August 6, 2014 Forward-Looking Statements During our meeting today we will
WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression
WHITE PAPER Improving Storage Efficiencies with Data Deduplication and Compression Sponsored by: Oracle Steven Scully May 2010 Benjamin Woo IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA
2009 Oracle Corporation 1
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material,
HPC data becomes Big Data. Peter Braam peter.braam@braamresearch.com
HPC data becomes Big Data Peter Braam peter.braam@braamresearch.com me 1983-2000 Academia Maths & Computer Science Entrepreneur with startups (5x) 4 startups sold Lustre emerged Held executive jobs with
www.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING VISUALISATION GPU COMPUTING
www.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING GPU COMPUTING VISUALISATION XENON Accelerating Exploration Mineral, oil and gas exploration is an expensive and challenging
BigData & Analytics Research and Developement at Petrobras
III Fórum HBR BRASIL Big Data & Analytics BigData & Analytics Research and Developement at Petrobras Ismael H F Santos, DSc CENPES/PDEP/TOOL ismaelh@petrobras.com.br Agosto 2014 Agenda BigData and Scientific
System Architecture. In-Memory Database
System Architecture for Are SSDs Ready for Enterprise Storage Systems In-Memory Database Anil Vasudeva, President & Chief Analyst, Research 2007-13 Research All Rights Reserved Copying Prohibited Contact
Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk
WHITE PAPER Deploying Flash- Accelerated Hadoop with InfiniFlash from SanDisk 951 SanDisk Drive, Milpitas, CA 95035 2015 SanDisk Corporation. All rights reserved. www.sandisk.com Table of Contents Introduction
SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform
SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform David Lawler, Oracle Senior Vice President, Product Management and Strategy Paul Kent, SAS Vice President, Big Data What
Get More Scalability and Flexibility for Big Data
Solution Overview LexisNexis High-Performance Computing Cluster Systems Platform Get More Scalability and Flexibility for What You Will Learn Modern enterprises are challenged with the need to store and
ioscale: The Holy Grail for Hyperscale
ioscale: The Holy Grail for Hyperscale The New World of Hyperscale Hyperscale describes new cloud computing deployments where hundreds or thousands of distributed servers support millions of remote, often
How to Leverage Big Data in the Cloud to Gain Competitive Advantage
How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics
REAL-TIME STREAMING ANALYTICS DATA IN, ACTION OUT
REAL-TIME STREAMING ANALYTICS DATA IN, ACTION OUT SPOT THE ODD ONE BEFORE IT IS OUT flexaware.net Streaming analytics: from data to action Do you need actionable insights from various data streams fast?
Driving Revenue Growth Across Multiple Markets
Driving Revenue Growth Across Multiple Markets Kevin Deierling Vice President, Marketing October 24, 2014 Multiple Growing Market Segments Key Markets Driving Growth High-Performance Computing Web 2.0
præsentation oktober 2011
Johnny Olesen System X presale præsentation oktober 2011 2010 IBM Corporation 2 Hvem er jeg Dagens agenda Server overview System Director 3 4 Portfolio-wide Innovation with IBM System x and BladeCenter
Data Analytics at NERSC. Joaquin Correa JoaquinCorrea@lbl.gov NERSC Data and Analytics Services
Data Analytics at NERSC Joaquin Correa JoaquinCorrea@lbl.gov NERSC Data and Analytics Services NERSC User Meeting August, 2015 Data analytics at NERSC Science Applications Climate, Cosmology, Kbase, Materials,
Cisco UCS B420 M3 Blade Server
Data Sheet Cisco UCS B420 M3 Blade Server Product Overview The Cisco Unified Computing System (Cisco UCS ) combines Cisco UCS B-Series Blade Servers and C-Series Rack Servers with networking and storage
Microsoft Intelligent Cloud
Microsoft Intelligent Cloud Ulrich (Uli) Homann Distinguished Architect Microsoft Cloud and Enterprise Engineering ulrichh@microsoft.com Why Cloud for transformation? #MSCloudRoadshow Azure IoT Suite Azure
Maximum performance, minimal risk for data warehousing
SYSTEM X SERVERS SOLUTION BRIEF Maximum performance, minimal risk for data warehousing Microsoft Data Warehouse Fast Track for SQL Server 2014 on System x3850 X6 (95TB) The rapid growth of technology has
Building a Scalable Big Data Infrastructure for Dynamic Workflows
Building a Scalable Big Data Infrastructure for Dynamic Workflows INTRODUCTION Organizations of all types and sizes are looking to big data to help them make faster, more intelligent decisions. Many efforts
PRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
Introducing the Singlechip Cloud Computer
Introducing the Singlechip Cloud Computer Exploring the Future of Many-core Processors White Paper Intel Labs Jim Held Intel Fellow, Intel Labs Director, Tera-scale Computing Research Sean Koehl Technology