Wissenschaftliches Rechnen im Paderborner Umfeld

Size: px
Start display at page:

Download "Wissenschaftliches Rechnen im Paderborner Umfeld"

Transcription

1 Wissenschaftliches Rechnen im Paderborner Umfeld ZKI Arbeitskreis Supercomputing 14. März 2013 Prof. Dr. Holger Karl, Dr. Jens Simon paderborn.de, paderborn.de 3/18/2013 1

2 Paderborn University Students total: BA: 7.390, MA: 1.746, Lehramt: 6.767, PhD candidates: 815 Staff total: Professors: 196, Scientific.: 919, Non Scientific: 634 Budget: 180 Mio. Third party funding (2011): 37,8 Mio. 3/18/ Status 2012

3 Paderborn University Faculties Faculty of Arts and Humanities Faculty of Business Administration, Economics and Business Computing Faculty of Science Faculty of Mechanical Engineering Faculty of Computer Science, Electrical Engineering and Mathematics Research 9 central research institutes 3 DFG collaborative research centers (SFB) 1 DFG research group 6 graduate colleges / schools 2 Fraunhofer institutes Status /18/2013 3

4 Computer UPB Informatik (2012) Students total: Starters (only BA): 164 Bachelor /Master graduates: 146 Professors: 21 Scientific Staff: 100 Third party funding: ca. 7 Mio. Rankings of the last years DFG (national science foundation): 7/129 in approval of science funds CHE ranking: leading position among 77 universities regarding 3rd party funds, teaching, infrastructure, research reputation ACM: best German institution for software engineering 3/18/2013 4

5 IT Organization Structure IMT PC² ITD General infrastructure Networks (WAN, LAN, WLAN, VoIP, ) Servers ( , Web, hosts, VMs, ) Storage (Backup, Archive,..) IT security Digital media (recording and live streaming of lectures) Scientific, high performance, high throughput computing Path finding (together with Informatik) IT services for university administration 3/18/2013 5

6 Paderborn Center for Parallel Computing PC² Regional competence center for parallel and distributed data processing in research and application Founded in 1991 Scientific institute of the Paderborn University Goal: Foster and explore efficient use of parallel and distributed systems Funding from regional and federal government, industrial and EUprojects 3/18/

7 PC2 Service & Research An infrastructure provider and service center for highperformance computing Main customers: UPB members and surrounding universities Engineering and natural sciences communities A research institute, working on high performance computing and cloud computing topics In collaboration with several chairs of computer science 3/18/2013 7

8 Compute Center Located in building O, 2 nd floor, main campus Facility available since 2011, shared by IMT and PC² Ca. 400 m 2 floor space (200 m² dedicated to HPC) Electrical Power Up to 550 KW for HPC Up to 200 KW for basic IT services and server hosting 2 x 200 KW UPS (batteries) and 1.6 MW Diesel Generator Cooling Air cooling (1/3) Grad Celsius room temperatures, Cold Aisle Containments Water cooling (2/3) 20/26 Grad Celsius, inrow cooling/backdoors (new HPC system) 3/18/2013 8

9 Compute Center Physical protection Security gate (two doors) with key card access Early fire detection system Nitrogen induction fire suppression system Certification possible (not done yet) Network security Hierarchical Firewall structure for PC² Availability Redundancy of servers for important services, data backup 3/18/2013 9

10 Resources of PC² Cluster OCuLUS [612 compute nodes, >200TFLOPS] (03/2013) Arminius+ [60 compute nodes] PLING2 [57 compute nodes] BIS Grid [8 compute nodes] High Throughput [varying compute nodes] Cloud Green PAD [54 nodes Paderborn, 38 nodes Mainz] Scientific Cloud [38 nodes] Misc 32 nvidia K20, 8 Intel Xeon Phi 2*Maxler FPGA compute nodes, 1* Convey HC FPGA Storage ISILON IQ9000x NAS 50 TB ISILON x400 NAS 800 TB (05/2013) FhGFS parallel filesystem 450TB SMP RX600 with 4 proc. sockets, 24 cores, 128GB 2 x Dell R820 with 4 proc. sockets, 32 cores, 1TB 3/18/

11 OWL Cluster OCuLUS processor cores, 200 TFLOPS, 45 TByte main memory 612 compute nodes, each 2 x Intel E (2.6GHz) 552 nodes with 64 GByte main memory 20 nodes with 256 GByte 32 nodes with 64 GByte and accelerator Nvidia Tesla GK110 8 nodes with 64 GByte and accelerator Intel Xeon Phi 5110P 2 SMP nodes, each 4 x Intel E (2.7GHz) and 1 TByte main memory Parallel Storage System 500 TByte disk capacity Fraunhofer FhGFS 7 Storage nodes and 2 Meta data nodes InfiniBand Interconnect 40 Gbit/s Mellanox HCA and switches Half bisectional bandwidth Redundant Login nodes for Linux and Windows Wikimedia Commons 3/18/

12 Research Topics On going Resource management: Own system, planning based (OpenCCS) Integrating hardware accelerators into HPC (e.g., FPGA) Energy efficient HPC (e.g., project GreenPAD) Near future Support for big data workloads in HPC clusters (e.g., Hadoop, Map/Reduce jobs), supported by resource management Support for software defined networking (SDN) in clusters Mid term SDN and big data workloads jointly integrated in & supported by a cluster resource management system Leverages new Isilon based storage infrastructure 3/18/

13 Research Projects Computer Architecture Custom Computing EPiCS: Engineering Proprioception in Computing Systems (EU) Enhance: Enabling heterogeneous hardware acceleration using novel programming and scheduling models (BMWF) Gomputer: Accelerate Computer Go (Gomputer) (Industry) Middleware & System Software Infrastructure for On the Fly Computing (SFB 901) GreenPAD: Energieoptimierte IKT für regionale Wirtschafts und Wissenscluster (BMWi) Simba: Simulationsplattform für die Automobilentwicklung (BMWi ZIM) Data Center Management: Virtualization technology (Industry) OpenCCS: Resource management system (Long term project) SCALUS: Scalable, Ubiquitous Storage (EU) Data Center 3/18/

14 Collaborative Research Centre On-The-Fly Computing Individualized IT-Services in Dynamic Markets Heinz Nixdorf Institut, Universität Paderborn Friedhelm Meyer auf der Heide GIBU 2012 (Schloss Dagstuhl)

15 The Vision of On-The-Fly Computing Nearly automatic configuration and execution of individual IT services, which are constructed out of base services traded in worldwide available markets Organization of these markets of services Heinz Nixdorf Institut, Universität Paderborn configuration execution SoA Cloud Computing GIBU 2012 (Schloss Dagstuhl) market support Distributed Comp. market organization Mechanism Design

16 The actors in the On-The-Fly Computing markets User/Client OTF Provider Supplier OTF Compute Center OTF Software Provider Heinz Nixdorf Institut, Universität Paderborn Provision of IT services GIBU 2012 (Schloss Dagstuhl) Market organization

17 Challenges for the provision of IT services User/Client s OTF Provider Supplier OTF Compute Center OTF Software Provider How to configure IT services out of base services? Project Area B: Modeling, Composition and Quality Analysis of Services Heinz Nixdorf Institut, Universität Paderborn How to ensure the correct, reliable, and efficient execution of configured services? GIBU 2012 (Schloss Dagstuhl) Project Area C: Reliable Runtime Environments & Application Scenarios

18 Challenges with the market organization How can interactions in large dynamic markets be supported and protected? How can an efficient functionality of the market be guaranteed with strategic behavior of the participants? Project Area A: Algorithmic and Economic Foundations Heinz Nixdorf Institut, Universität Paderborn How can the usefulness of our concept be demonstrated? GIBU 2012 (Schloss Dagstuhl) Project Area C: Reliable Runtime Environments & Application Scenarios

19 SFB 901: Structural Overview Project Area A Algorithmic and Economic Foundations A1: Local Strategies in Dynamic Networks (Meyer auf der Heide, Scheideler) A2: Overlays over Physical Networks (Frey, Karl) A3: Market of Services (Briest, Frick, Haake) Project Area B Modeling, Composition & Quality Analysis of Services B1: Parametric Service Specifications (Engels, Schäfer) B2: Configuration & Rating (Kleine Büning, Kleinjohann) B3: Composition Analysis in Uncertain Contexts (Becker, Wehrheim) B4: Proof-Carrying Services (Platzner, Wehrheim) Heinz Nixdorf Institut, Universität Paderborn Project Area C Reliable Runtime Environments & Application Scenarios C1: Robustness & Security (Blömer, Scheideler, Sorge) C2: On-The-Fly Compute Centers (Meyer auf der Heide, Platzner, Plessl) C3: Modeling of Optimization Problems (Koberstein, Suhl) GIBU 2012 (Schloss Dagstuhl)

20 Entwicklung, Erprobung und Transfer eines energieoptimalen IKT Infrastrukturmodells für regionales Wirtschafts- und Wissenschaftscluster Laufzeit: bis

21 GreenPAD Idee: Regionaler WWC Bündelung der IKT-Infrastruktur an einem Standort (RZ der Uni) (economy of scale -> Energie-Optimierung) Entwicklung attraktiver Service-Modelle für die regionale Wirtschaft (nicht nur, aber auch Cloud-Services -> IaaS, PaaS, SaaS) Zielgruppe in der Projektphase: StartUps, KMU, Pilotkunden vorrangig im Technologiepark und Zukunftsmeile Entwicklung von Übergangsmodellen von regionalen in einen überregionalen Cluster Lastverteilungsverfahren in Abhängigkeit von vorhandener regional erzeugter regenerativer Energien Projektverbund GreenPAD

22 GreenPAD Energiesparpotential Beschaffung Produktion Absatz Energie regionales RZ E.ON IMT Uni/ÖA FUJITSU Technologie und Lösungen PC 2 Unilab HPC Kunden Technologie Park / KMU Smart Grid Konzept Energieeffiziente Komponenten Energieeffizientes RZ (Cloud, Ressourcen Management) Green Office Thin / Zero Clients Energiesparpotential (Maßnahmen kumuliert) Projektverbund GreenPAD

23 Multi Site Cloud Computing Scenario Thousands of Cloud Center Locations Distributed applications (multi tier, P2P,..) Problems Select Cloud Center Matching applications requirements Maximize Service Level Quality Minimize expenses Research Deployment of applications with respect to the geographical distribution 3/18/

24 OpenFlow in Data Centers OpenFlow: centrally computed routing/switching tables Distributed to switches on demand, on per flow basis Possible benefits: Fine grained control, e.g., load balancing Support for data patterns of complex applications Goal: Integrate network configuration with resource management and application knowlegde

25 OpenCCS Planning based Shows planned start times Deadline scheduling Advance reservations usable by multiple groups / users Custom resources Time varying limitations and validities of users / groups Group x gets not more than 4 GPUs on Monday and Friday between 14:00 and 17:30 PBS Pro like resource description 248:ncpus=7:vmem=20g:phi=true+128:ncpus=8:mem=48g, place=scatter:excl Submission rate up to 100Hz Planned Features Management of Virtual Machines Give me 5 Linux and 2 Windows VMs in a separate VLAN using these images Hierarchical Resources User can specify resource (sub )classes: Give me an accelerator whatever available 3/18/

26 OpenCCS on OCuLUS $ccsinfo --allocatable Resource Amount Description Name Used/Avail/Max ====================================== ncpus 0/9840/9856 Cores mem 0/44.8t/45t Phys. Memory vmem 0/54.4t/54.6t Virt. Memory arch - Architecture ib_qdr - Infiniband QDR phi - Intel Xeon Phi tesla - Tesla GK110 $ccsinfo - allocatable - classes Name Class #Hosts Avail/Max ============================ ncpus / /2 mem 64g 592/592 1t 2/2 256g 19/20 vmem 80g 592/592 1t 2/2 264g 19/20 arch SL /614 ib_qdr true 613/614 phi false 605/606 true 8/8 tesla false 581/582 true 32/32 3/18/

27 3/18/

28 And after OCuLUS? Traditional clusters: Performance only relevant metric Today: Performance efficiency E.g., power consumption Tomorrow: Usage efficiency? Sacrifice how much performance to increase usability by how much? To broaden the user base how wide? Number of relevant computations as metric? Convenience Performance

29 3/18/

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC HPC Architecture End to End Alexandre Chauvin Agenda HPC Software Stack Visualization National Scientific Center 2 Agenda HPC Software Stack Alexandre Chauvin Typical HPC Software Stack Externes LAN Typical

More information

High Performance Computing within the AHRP http://www.ahrp.info http://www.ahrp.info

High Performance Computing within the AHRP http://www.ahrp.info http://www.ahrp.info High Performance Computing within the AHRP http://www.ahrp.info http://www.ahrp.info The Alliance for HPC Rhineland-Palatinate! History, Goals and Tasks! Organization! Access to Resources! Training and

More information

Building a Top500-class Supercomputing Cluster at LNS-BUAP

Building a Top500-class Supercomputing Cluster at LNS-BUAP Building a Top500-class Supercomputing Cluster at LNS-BUAP Dr. José Luis Ricardo Chávez Dr. Humberto Salazar Ibargüen Dr. Enrique Varela Carlos Laboratorio Nacional de Supercómputo Benemérita Universidad

More information

The PHI solution. Fujitsu Industry Ready Intel XEON-PHI based solution. SC2013 - Denver

The PHI solution. Fujitsu Industry Ready Intel XEON-PHI based solution. SC2013 - Denver 1 The PHI solution Fujitsu Industry Ready Intel XEON-PHI based solution SC2013 - Denver Industrial Application Challenges Most of existing scientific and technical applications Are written for legacy execution

More information

Evoluzione dell Infrastruttura di Calcolo e Data Analytics per la ricerca

Evoluzione dell Infrastruttura di Calcolo e Data Analytics per la ricerca Evoluzione dell Infrastruttura di Calcolo e Data Analytics per la ricerca Carlo Cavazzoni CINECA Supercomputing Application & Innovation www.cineca.it 21 Aprile 2015 FERMI Name: Fermi Architecture: BlueGene/Q

More information

Theoretical Aspects of Storage Systems Autumn 2009

Theoretical Aspects of Storage Systems Autumn 2009 Theoretical Aspects of Storage Systems Autumn 2009 Chapter 1: RAID André Brinkmann University of Paderborn Personnel Students: ~13.500 students Professors: ~230 Other staff: ~600 scientific, ~630 non-scientific

More information

Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales

Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes Anthony Kenisky, VP of North America Sales About Appro Over 20 Years of Experience 1991 2000 OEM Server Manufacturer 2001-2007

More information

Intel Cluster Ready Appro Xtreme-X Computers with Mellanox QDR Infiniband

Intel Cluster Ready Appro Xtreme-X Computers with Mellanox QDR Infiniband Intel Cluster Ready Appro Xtreme-X Computers with Mellanox QDR Infiniband A P P R O I N T E R N A T I O N A L I N C Steve Lyness Vice President, HPC Solutions Engineering slyness@appro.com Company Overview

More information

HPC Growing Pains. Lessons learned from building a Top500 supercomputer

HPC Growing Pains. Lessons learned from building a Top500 supercomputer HPC Growing Pains Lessons learned from building a Top500 supercomputer John L. Wofford Center for Computational Biology & Bioinformatics Columbia University I. What is C2B2? Outline Lessons learned from

More information

MEGWARE HPC Cluster am LRZ eine mehr als 12-jährige Zusammenarbeit. Prof. Dieter Kranzlmüller (LRZ)

MEGWARE HPC Cluster am LRZ eine mehr als 12-jährige Zusammenarbeit. Prof. Dieter Kranzlmüller (LRZ) MEGWARE HPC Cluster am LRZ eine mehr als 12-jährige Zusammenarbeit Prof. Dieter Kranzlmüller (LRZ) LRZ HPC-Systems at the End of the UNIX-Era (Years 2000-2002) German national supercomputer Hitachi SR800

More information

PRIMERGY server-based High Performance Computing solutions

PRIMERGY server-based High Performance Computing solutions PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating

More information

Cloud Computing through Virtualization and HPC technologies

Cloud Computing through Virtualization and HPC technologies Cloud Computing through Virtualization and HPC technologies William Lu, Ph.D. 1 Agenda Cloud Computing & HPC A Case of HPC Implementation Application Performance in VM Summary 2 Cloud Computing & HPC HPC

More information

www.thinkparq.com www.beegfs.com

www.thinkparq.com www.beegfs.com www.thinkparq.com www.beegfs.com KEY ASPECTS Maximum Flexibility Maximum Scalability BeeGFS supports a wide range of Linux distributions such as RHEL/Fedora, SLES/OpenSuse or Debian/Ubuntu as well as a

More information

Amazon Cloud Performance Compared. David Adams

Amazon Cloud Performance Compared. David Adams Amazon Cloud Performance Compared David Adams Amazon EC2 performance comparison How does EC2 compare to traditional supercomputer for scientific applications? "Performance Analysis of High Performance

More information

Cloud Computing. Alex Crawford Ben Johnstone

Cloud Computing. Alex Crawford Ben Johnstone Cloud Computing Alex Crawford Ben Johnstone Overview What is cloud computing? Amazon EC2 Performance Conclusions What is the Cloud? A large cluster of machines o Economies of scale [1] Customers use a

More information

Thematic Unit of Excellence on Computational Materials Science Solid State and Structural Chemistry Unit, Indian Institute of Science

Thematic Unit of Excellence on Computational Materials Science Solid State and Structural Chemistry Unit, Indian Institute of Science Thematic Unit of Excellence on Computational Materials Science Solid State and Structural Chemistry Unit, Indian Institute of Science Call for Expression of Interest (EOI) for the Supply, Installation

More information

Virtualization of a Cluster Batch System

Virtualization of a Cluster Batch System Virtualization of a Cluster Batch System Christian Baun, Volker Büge, Benjamin Klein, Jens Mielke, Oliver Oberst and Armin Scheurer Die Kooperation von Cluster Batch System Batch system accepts computational

More information

CHAPTER 8 CLOUD COMPUTING

CHAPTER 8 CLOUD COMPUTING CHAPTER 8 CLOUD COMPUTING SE 458 SERVICE ORIENTED ARCHITECTURE Assist. Prof. Dr. Volkan TUNALI Faculty of Engineering and Natural Sciences / Maltepe University Topics 2 Cloud Computing Essential Characteristics

More information

High-Performance Computing and Big Data Challenge

High-Performance Computing and Big Data Challenge High-Performance Computing and Big Data Challenge Dr Violeta Holmes Matthew Newall The University of Huddersfield Outline High-Performance Computing E-Infrastructure Top500 -Tianhe-II UoH experience: HPC

More information

High Performance Computing in CST STUDIO SUITE

High Performance Computing in CST STUDIO SUITE High Performance Computing in CST STUDIO SUITE Felix Wolfheimer GPU Computing Performance Speedup 18 16 14 12 10 8 6 4 2 0 Promo offer for EUC participants: 25% discount for K40 cards Speedup of Solver

More information

COMP/CS 605: Intro to Parallel Computing Lecture 01: Parallel Computing Overview (Part 1)

COMP/CS 605: Intro to Parallel Computing Lecture 01: Parallel Computing Overview (Part 1) COMP/CS 605: Intro to Parallel Computing Lecture 01: Parallel Computing Overview (Part 1) Mary Thomas Department of Computer Science Computational Science Research Center (CSRC) San Diego State University

More information

Mitgliederversammlung OdA ICT Bern. Kurzreferat Cloud Computing. 26. April 2012 Markus Nufer

Mitgliederversammlung OdA ICT Bern. Kurzreferat Cloud Computing. 26. April 2012 Markus Nufer Mitgliederversammlung OdA ICT Bern Kurzreferat Cloud Computing 26. April 2012 Markus Nufer 1 Cloud Computing ist die grosse Veränderung in der ICT Cloud Computing ist in aller Munde: als neuartige Technologie,

More information

Parallel Computing. Benson Muite. benson.muite@ut.ee http://math.ut.ee/ benson. https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage

Parallel Computing. Benson Muite. benson.muite@ut.ee http://math.ut.ee/ benson. https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage Parallel Computing Benson Muite benson.muite@ut.ee http://math.ut.ee/ benson https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage 3 November 2014 Hadoop, Review Hadoop Hadoop History Hadoop Framework

More information

Smart Campus Management with Cloud Services

Smart Campus Management with Cloud Services UNIVERSITY TRANSILVANIA OF BRAŞOV FACULTY OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE DEPARTMENT OF AUTOMATION, ELECTRONICS AND COMPUTER SCIENCE Sorin-Aurel Moraru, prof.dr.eng. Department Director

More information

High Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/2015. 2015 CAE Associates

High Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/2015. 2015 CAE Associates High Performance Computing (HPC) CAEA elearning Series Jonathan G. Dudley, Ph.D. 06/09/2015 2015 CAE Associates Agenda Introduction HPC Background Why HPC SMP vs. DMP Licensing HPC Terminology Types of

More information

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation

Boas Betzler. Planet. Globally Distributed IaaS Platform Examples AWS and SoftLayer. November 9, 2015. 20014 IBM Corporation Boas Betzler Cloud IBM Distinguished Computing Engineer for a Smarter Planet Globally Distributed IaaS Platform Examples AWS and SoftLayer November 9, 2015 20014 IBM Corporation Building Data Centers The

More information

Hadoop on the Gordon Data Intensive Cluster

Hadoop on the Gordon Data Intensive Cluster Hadoop on the Gordon Data Intensive Cluster Amit Majumdar, Scientific Computing Applications Mahidhar Tatineni, HPC User Services San Diego Supercomputer Center University of California San Diego Dec 18,

More information

HPC Cloud. Focus on your research. Floris Sluiter Project leader SARA

HPC Cloud. Focus on your research. Floris Sluiter Project leader SARA HPC Cloud Focus on your research Floris Sluiter Project leader SARA Why an HPC Cloud? Christophe Blanchet, IDB - Infrastructure Distributing Biology: Big task to port them all to your favorite architecture

More information

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 Agenda v Mapping clients needs to cloud technologies v Addressing your pain

More information

Recent Advances in HPC for Structural Mechanics Simulations

Recent Advances in HPC for Structural Mechanics Simulations Recent Advances in HPC for Structural Mechanics Simulations 1 Trends in Engineering Driving Demand for HPC Increase product performance and integrity in less time Consider more design variants Find the

More information

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance 11 th International LS-DYNA Users Conference Session # LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance Gilad Shainer 1, Tong Liu 2, Jeff Layton 3, Onur Celebioglu

More information

Mississippi State University High Performance Computing Collaboratory Brief Overview. Trey Breckenridge Director, HPC

Mississippi State University High Performance Computing Collaboratory Brief Overview. Trey Breckenridge Director, HPC Mississippi State University High Performance Computing Collaboratory Brief Overview Trey Breckenridge Director, HPC Mississippi State University Public university (Land Grant) founded in 1878 Traditional

More information

Cloud Data Center Acceleration 2015

Cloud Data Center Acceleration 2015 Cloud Data Center Acceleration 2015 Agenda! Computer & Storage Trends! Server and Storage System - Memory and Homogenous Architecture - Direct Attachment! Memory Trends! Acceleration Introduction! FPGA

More information

Managing Traditional Workloads Together with Cloud Computing Workloads

Managing Traditional Workloads Together with Cloud Computing Workloads Managing Traditional Workloads Together with Cloud Computing Workloads Table of Contents Introduction... 3 Cloud Management Challenges... 3 Re-thinking of Cloud Management Solution... 4 Teraproc Cloud

More information

SMB Direct for SQL Server and Private Cloud

SMB Direct for SQL Server and Private Cloud SMB Direct for SQL Server and Private Cloud Increased Performance, Higher Scalability and Extreme Resiliency June, 2014 Mellanox Overview Ticker: MLNX Leading provider of high-throughput, low-latency server

More information

Sun Constellation System: The Open Petascale Computing Architecture

Sun Constellation System: The Open Petascale Computing Architecture CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc. 25 Years of Technical

More information

HPC Update: Engagement Model

HPC Update: Engagement Model HPC Update: Engagement Model MIKE VILDIBILL Director, Strategic Engagements Sun Microsystems mikev@sun.com Our Strategy Building a Comprehensive HPC Portfolio that Delivers Differentiated Customer Value

More information

A Gentle Introduction to Cloud Computing

A Gentle Introduction to Cloud Computing A Gentle Introduction to Cloud Computing Source: Wikipedia Platform Computing, Inc. Platform Clusters, Grids, Clouds, Whatever Computing The leader in managing large scale shared environments o 18 years

More information

Scaling from Workstation to Cluster for Compute-Intensive Applications

Scaling from Workstation to Cluster for Compute-Intensive Applications Cluster Transition Guide: Scaling from Workstation to Cluster for Compute-Intensive Applications IN THIS GUIDE: The Why: Proven Performance Gains On Cluster Vs. Workstation The What: Recommended Reference

More information

ECDF Infrastructure Refresh - Requirements Consultation Document

ECDF Infrastructure Refresh - Requirements Consultation Document Edinburgh Compute & Data Facility - December 2014 ECDF Infrastructure Refresh - Requirements Consultation Document Introduction In order to sustain the University s central research data and computing

More information

GTC Presentation March 19, 2013. Copyright 2012 Penguin Computing, Inc. All rights reserved

GTC Presentation March 19, 2013. Copyright 2012 Penguin Computing, Inc. All rights reserved GTC Presentation March 19, 2013 Copyright 2012 Penguin Computing, Inc. All rights reserved Session S3552 Room 113 S3552 - Using Tesla GPUs, Reality Server and Penguin Computing's Cloud for Visualizing

More information

Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage

Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage White Paper Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage A Benchmark Report August 211 Background Objectivity/DB uses a powerful distributed processing architecture to manage

More information

HPC-related R&D in 863 Program

HPC-related R&D in 863 Program HPC-related R&D in 863 Program Depei Qian Sino-German Joint Software Institute (JSI) Beihang University Aug. 27, 2010 Outline The 863 key project on HPC and Grid Status and Next 5 years 863 efforts on

More information

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk

HPC and Big Data. EPCC The University of Edinburgh. Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk HPC and Big Data EPCC The University of Edinburgh Adrian Jackson Technical Architect a.jackson@epcc.ed.ac.uk EPCC Facilities Technology Transfer European Projects HPC Research Visitor Programmes Training

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

Kriterien für ein PetaFlop System

Kriterien für ein PetaFlop System Kriterien für ein PetaFlop System Rainer Keller, HLRS :: :: :: Context: Organizational HLRS is one of the three national supercomputing centers in Germany. The national supercomputing centers are working

More information

Introduction to Cloud Computing

Introduction to Cloud Computing Introduction to Cloud Computing Cloud Computing II (Qloud) 15 319, spring 2010 3 rd Lecture, Jan 19 th Majd F. Sakr Lecture Motivation Introduction to a Data center Understand the Cloud hardware in CMUQ

More information

Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant

<Insert Picture Here> Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant The following is intended to outline our general product direction.

More information

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads

IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads 89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com @EdisonGroupInc 212.367.7400 IBM Spectrum Scale vs EMC Isilon for IBM Spectrum Protect Workloads A Competitive Test and Evaluation Report

More information

Parallel Programming Survey

Parallel Programming Survey Christian Terboven 02.09.2014 / Aachen, Germany Stand: 26.08.2014 Version 2.3 IT Center der RWTH Aachen University Agenda Overview: Processor Microarchitecture Shared-Memory

More information

Last time. Data Center as a Computer. Today. Data Center Construction (and management)

Last time. Data Center as a Computer. Today. Data Center Construction (and management) Last time Data Center Construction (and management) Johan Tordsson Department of Computing Science 1. Common (Web) application architectures N-tier applications Load Balancers Application Servers Databases

More information

High Performance Computing in Aachen

High Performance Computing in Aachen High Performance Computing in Aachen Samuel Sarholz sarholz@rz.rwth aachen.de Center for Computing and Communication RWTH Aachen University HPC unter Linux Sep 15, RWTH Aachen Agenda o Hardware o Development

More information

Cooling and thermal efficiently in

Cooling and thermal efficiently in Cooling and thermal efficiently in the datacentre George Brown HPC Systems Engineer Viglen Overview Viglen Overview Products and Technologies Looking forward Company Profile IT hardware manufacture, reseller

More information

Microsoft Private Cloud Fast Track Reference Architecture

Microsoft Private Cloud Fast Track Reference Architecture Microsoft Private Cloud Fast Track Reference Architecture Microsoft Private Cloud Fast Track is a reference architecture designed to help build private clouds by combining Microsoft software with NEC s

More information

Emerging Technology for the Next Decade

Emerging Technology for the Next Decade Emerging Technology for the Next Decade Cloud Computing Keynote Presented by Charles Liang, President & CEO Super Micro Computer, Inc. What is Cloud Computing? Cloud computing is Internet-based computing,

More information

Clusters: Mainstream Technology for CAE

Clusters: Mainstream Technology for CAE Clusters: Mainstream Technology for CAE Alanna Dwyer HPC Division, HP Linux and Clusters Sparked a Revolution in High Performance Computing! Supercomputing performance now affordable and accessible Linux

More information

Estonian Scientific Computing Infrastructure (ETAIS)

Estonian Scientific Computing Infrastructure (ETAIS) Estonian Scientific Computing Infrastructure (ETAIS) Week #7 Hardi Teder hardi@eenet.ee University of Tartu March 27th 2013 Overview Estonian Scientific Computing Infrastructure Estonian Research infrastructures

More information

State of the Art Cloud Infrastructure

State of the Art Cloud Infrastructure State of the Art Cloud Infrastructure Motti Beck, Director Enterprise Market Development WHD Global I April 2014 Next Generation Data Centers Require Fast, Smart Interconnect Software Defined Networks

More information

What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1

What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1 What is the real cost of Commercial Cloud provisioning? Thursday, 20 June 13 Lukasz Kreczko - DICE 1 SouthGrid in numbers CPU [cores] RAM [TB] Disk [TB] Manpower [FTE] Power [kw] 5100 10.2 3000 7 1.5 x

More information

On Cloud Computing Technology in the Construction of Digital Campus

On Cloud Computing Technology in the Construction of Digital Campus 2012 International Conference on Innovation and Information Management (ICIIM 2012) IPCSIT vol. 36 (2012) (2012) IACSIT Press, Singapore On Cloud Computing Technology in the Construction of Digital Campus

More information

Study of virtual data centers for cost savings and management

Study of virtual data centers for cost savings and management 1 Study of virtual data centers for cost savings and management María Virtudes López López School of Industrial Engineering and Information Technology Master s Degree in Cybernetics Research León, Spain

More information

Accelerating Simulation & Analysis with Hybrid GPU Parallelization and Cloud Computing

Accelerating Simulation & Analysis with Hybrid GPU Parallelization and Cloud Computing Accelerating Simulation & Analysis with Hybrid GPU Parallelization and Cloud Computing Innovation Intelligence Devin Jensen August 2012 Altair Knows HPC Altair is the only company that: makes HPC tools

More information

Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise

Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise Unisys ClearPath Forward Fabric Based Platform to Power the Weather Enterprise Introducing Unisys All in One software based weather platform designed to reduce server space, streamline operations, consolidate

More information

System Models for Distributed and Cloud Computing

System Models for Distributed and Cloud Computing System Models for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Classification of Distributed Computing Systems

More information

CMS Tier-3 cluster at NISER. Dr. Tania Moulik

CMS Tier-3 cluster at NISER. Dr. Tania Moulik CMS Tier-3 cluster at NISER Dr. Tania Moulik What and why? Grid computing is a term referring to the combination of computer resources from multiple administrative domains to reach common goal. Grids tend

More information

Technical Brief: Egenera Taps Brocade and Fujitsu to Help Build an Enterprise Class Platform to Host Xterity Wholesale Cloud Service

Technical Brief: Egenera Taps Brocade and Fujitsu to Help Build an Enterprise Class Platform to Host Xterity Wholesale Cloud Service Technical Brief: Egenera Taps Brocade and Fujitsu to Help Build an Enterprise Class Platform to Host Xterity Wholesale Cloud Service ... Egenera needed an enterprise class platform to host their wholesale

More information

White paper 200 Camera Surveillance Video Vault Solution Powered by Fujitsu

White paper 200 Camera Surveillance Video Vault Solution Powered by Fujitsu White paper 200 Camera Surveillance Video Vault Solution Powered by Fujitsu SoleraTec Surveillance Video Vault provides exceptional video surveillance data capture, management, and storage in a complete

More information

Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing

Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing Heterogeneous Workload Consolidation for Efficient Management of Data Centers in Cloud Computing Deep Mann ME (Software Engineering) Computer Science and Engineering Department Thapar University Patiala-147004

More information

Globus Striped GridFTP Framework and Server. Raj Kettimuthu, ANL and U. Chicago

Globus Striped GridFTP Framework and Server. Raj Kettimuthu, ANL and U. Chicago Globus Striped GridFTP Framework and Server Raj Kettimuthu, ANL and U. Chicago Outline Introduction Features Motivation Architecture Globus XIO Experimental Results 3 August 2005 The Ohio State University

More information

Overview of HPC systems and software available within

Overview of HPC systems and software available within Overview of HPC systems and software available within Overview Available HPC Systems Ba Cy-Tera Available Visualization Facilities Software Environments HPC System at Bibliotheca Alexandrina SUN cluster

More information

Seeking Opportunities for Hardware Acceleration in Big Data Analytics

Seeking Opportunities for Hardware Acceleration in Big Data Analytics Seeking Opportunities for Hardware Acceleration in Big Data Analytics Paul Chow High-Performance Reconfigurable Computing Group Department of Electrical and Computer Engineering University of Toronto Who

More information

NVIDIA GPUs in the Cloud

NVIDIA GPUs in the Cloud NVIDIA GPUs in the Cloud 4 EVOLVING CLOUD REQUIREMENTS On premises Off premises Hybrid Cloud Connecting clouds New workloads Components to disrupt 5 GLOBAL CLOUD PLATFORM Unified architecture enabled by

More information

JUROPA Linux Cluster An Overview. 19 May 2014 Ulrich Detert

JUROPA Linux Cluster An Overview. 19 May 2014 Ulrich Detert Mitglied der Helmholtz-Gemeinschaft JUROPA Linux Cluster An Overview 19 May 2014 Ulrich Detert JuRoPA JuRoPA Jülich Research on Petaflop Architectures Bull, Sun, ParTec, Intel, Mellanox, Novell, FZJ JUROPA

More information

Computing in clouds: Where we come from, Where we are, What we can, Where we go

Computing in clouds: Where we come from, Where we are, What we can, Where we go Computing in clouds: Where we come from, Where we are, What we can, Where we go Luc Bougé ENS Cachan/Rennes, IRISA, INRIA Biogenouest With help from many colleagues: Gabriel Antoniu, Guillaume Pierre,

More information

A parallel file system made in Germany Tiered Storage and HSM

A parallel file system made in Germany Tiered Storage and HSM A parallel file system made in Germany Tiered Storage and HSM Mai 7th 2012 HLRS Stuttgart Franz-Josef Pfreundt Competence Center for HPC Sven Breuner Fraunhofer Institut for Industrial Mathematics Mathematical

More information

Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED

Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory. The Nation s Premier Laboratory for Land Forces UNCLASSIFIED Dr. Raju Namburu Computational Sciences Campaign U.S. Army Research Laboratory 21 st Century Research Continuum Theory Theory embodied in computation Hypotheses tested through experiment SCIENTIFIC METHODS

More information

HPC Cluster Decisions and ANSYS Configuration Best Practices. Diana Collier Lead Systems Support Specialist Houston UGM May 2014

HPC Cluster Decisions and ANSYS Configuration Best Practices. Diana Collier Lead Systems Support Specialist Houston UGM May 2014 HPC Cluster Decisions and ANSYS Configuration Best Practices Diana Collier Lead Systems Support Specialist Houston UGM May 2014 1 Agenda Introduction Lead Systems Support Specialist Cluster Decisions Job

More information

On-Demand Research Computing

On-Demand Research Computing On-Demand Research Computing Infrastructure as a Service Software as a Service Cloud Storage Solutions David A. Lifka Cornell Center for Advanced Computing lifka@cac.cornell.edu www.cac.cornell.edu 1 Cornell

More information

Impact of Big Data growth On Transparent Computing

Impact of Big Data growth On Transparent Computing Impact of Big Data growth On Transparent Computing Michael A. Greene Intel Vice President, Software and Services Group, General Manager, System Technologies and Optimization 1 Transparent Computing (TC)

More information

Outline. High Performance Computing (HPC) Big Data meets HPC. Case Studies: Some facts about Big Data Technologies HPC and Big Data converging

Outline. High Performance Computing (HPC) Big Data meets HPC. Case Studies: Some facts about Big Data Technologies HPC and Big Data converging Outline High Performance Computing (HPC) Towards exascale computing: a brief history Challenges in the exascale era Big Data meets HPC Some facts about Big Data Technologies HPC and Big Data converging

More information

Cluster Implementation and Management; Scheduling

Cluster Implementation and Management; Scheduling Cluster Implementation and Management; Scheduling CPS343 Parallel and High Performance Computing Spring 2013 CPS343 (Parallel and HPC) Cluster Implementation and Management; Scheduling Spring 2013 1 /

More information

SURFsara HPC Cloud Workshop

SURFsara HPC Cloud Workshop SURFsara HPC Cloud Workshop doc.hpccloud.surfsara.nl UvA workshop 2016-01-25 UvA HPC Course Jan 2016 Anatoli Danezi, Markus van Dijk cloud-support@surfsara.nl Agenda Introduction and Overview (current

More information

Performance Tools for System Monitoring

Performance Tools for System Monitoring Center for Information Services and High Performance Computing (ZIH) 01069 Dresden Performance Tools for System Monitoring 1st CHANGES Workshop, Jülich Zellescher Weg 12 Tel. +49 351-463 35450 September

More information

Manual for using Super Computing Resources

Manual for using Super Computing Resources Manual for using Super Computing Resources Super Computing Research and Education Centre at Research Centre for Modeling and Simulation National University of Science and Technology H-12 Campus, Islamabad

More information

No matter what you need for Managed IT services, High-Performance Storage, you can count on us for low cost, fast and effective service.

No matter what you need for Managed IT services, High-Performance Storage, you can count on us for low cost, fast and effective service. No matter what you need for Managed IT services, High-Performance Storage, you can count on us for low cost, fast and effective service. I.T. SOLUTIONS FROM PROFESSIONAL SERVICES Expert advice from conception

More information

IT of SPIM Data Storage and Compression. EMBO Course - August 27th! Jeff Oegema, Peter Steinbach, Oscar Gonzalez

IT of SPIM Data Storage and Compression. EMBO Course - August 27th! Jeff Oegema, Peter Steinbach, Oscar Gonzalez IT of SPIM Data Storage and Compression EMBO Course - August 27th Jeff Oegema, Peter Steinbach, Oscar Gonzalez 1 Talk Outline Introduction and the IT Team SPIM Data Flow Capture, Compression, and the Data

More information

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform

SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform SAS and Oracle: Big Data and Cloud Partnering Innovation Targets the Third Platform David Lawler, Oracle Senior Vice President, Product Management and Strategy Paul Kent, SAS Vice President, Big Data What

More information

LSKA 2010 Survey Report Job Scheduler

LSKA 2010 Survey Report Job Scheduler LSKA 2010 Survey Report Job Scheduler Graduate Institute of Communication Engineering {r98942067, r98942112}@ntu.edu.tw March 31, 2010 1. Motivation Recently, the computing becomes much more complex. However,

More information

High Performance Applications over the Cloud: Gains and Losses

High Performance Applications over the Cloud: Gains and Losses High Performance Applications over the Cloud: Gains and Losses Dr. Leila Ismail Faculty of Information Technology United Arab Emirates University leila@uaeu.ac.ae http://citweb.uaeu.ac.ae/citweb/profile/leila

More information

CLOUD COMPUTING. When It's smarter to rent than to buy

CLOUD COMPUTING. When It's smarter to rent than to buy CLOUD COMPUTING When It's smarter to rent than to buy Is it new concept? Nothing new In 1990 s, WWW itself Grid Technologies- Scientific applications Online banking websites More convenience Not to visit

More information

Purchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers

Purchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers Information Technology Purchase of High Performance Computing (HPC) Central Compute Resources by Northwestern Researchers Effective for FY2016 Purpose This document summarizes High Performance Computing

More information

Comparing Cloud Computing Resources for Model Calibration with PEST

Comparing Cloud Computing Resources for Model Calibration with PEST Comparing Cloud Computing Resources for Model Calibration with PEST CWEMF Annual Meeting March 10, 2015 Charles Brush Modeling Support Branch, Bay-Delta Office California Department of Water Resources,

More information

HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK

HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK HETEROGENEOUS HPC, ARCHITECTURE OPTIMIZATION, AND NVLINK Steve Oberlin CTO, Accelerated Computing US to Build Two Flagship Supercomputers SUMMIT SIERRA Partnership for Science 100-300 PFLOPS Peak Performance

More information

Cluster Scalability of ANSYS FLUENT 12 for a Large Aerodynamics Case on the Darwin Supercomputer

Cluster Scalability of ANSYS FLUENT 12 for a Large Aerodynamics Case on the Darwin Supercomputer Cluster Scalability of ANSYS FLUENT 12 for a Large Aerodynamics Case on the Darwin Supercomputer Stan Posey, MSc and Bill Loewe, PhD Panasas Inc., Fremont, CA, USA Paul Calleja, PhD University of Cambridge,

More information

A PERFORMANCE COMPARISON USING HPC BENCHMARKS: WINDOWS HPC SERVER 2008 AND RED HAT ENTERPRISE LINUX 5

A PERFORMANCE COMPARISON USING HPC BENCHMARKS: WINDOWS HPC SERVER 2008 AND RED HAT ENTERPRISE LINUX 5 A PERFORMANCE COMPARISON USING HPC BENCHMARKS: WINDOWS HPC SERVER 2008 AND RED HAT ENTERPRISE LINUX 5 R. Henschel, S. Teige, H. Li, J. Doleschal, M. S. Mueller October 2010 Contents HPC at Indiana University

More information

WebLogic on Oracle Database Appliance: Combining High Availability and Simplicity

WebLogic on Oracle Database Appliance: Combining High Availability and Simplicity WebLogic on Oracle Database Appliance: Combining High Availability and Simplicity Frances Zhao-Perez Alexandra Huff Oracle CAF Product Management Simon Haslam Technical Director O-box Safe Harbor Statement

More information

A National Computing Grid: FGI

A National Computing Grid: FGI A National Computing Grid: FGI Vera Hansper, Ulf Tigerstedt, Kimmo Mattila, Luis Alves 3/10/2012 FGI Grids in Finland : a short history 3/10/2012 FGI In the beginning, we had M-Grid Interest in Grid technology

More information

Fujitsu PRIMERGY Servers Portfolio

Fujitsu PRIMERGY Servers Portfolio Fujitsu Servers Portfolio Complete server solutions that drive your success shaping tomorrow with you Higher IT efficiency and reduced total cost of ownership Fujitsu Micro and Tower Servers MX130 S2 TX100

More information

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks WHITE PAPER July 2014 Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks Contents Executive Summary...2 Background...3 InfiniteGraph...3 High Performance

More information

Supercomputing Resources in BSC, RES and PRACE

Supercomputing Resources in BSC, RES and PRACE www.bsc.es Supercomputing Resources in BSC, RES and PRACE Sergi Girona, BSC-CNS Barcelona, 23 Septiembre 2015 ICTS 2014, un paso adelante para la RES Past RES members and resources BSC-CNS (MareNostrum)

More information