Supercomputer Center Management Challenges. Branislav Jansík
|
|
|
- Lewis Ford
- 10 years ago
- Views:
Transcription
1 Supercomputer Center Management Challenges Branislav Jansík
2 PhD at KTH Stockholm Molecular properties for heavy element compounds Density Functional Theory for Molecular Properties PostDoc at CNR Pisa Computational X-ray spectroscopy Two Photon Circular Dichroism
3 PostDoc at Aarhus University Development of numerical algorithms of linear scaling complexity Researcher at Aarhus University Development of algorithms for optimization of self-consistent field states. Development and applications in molecular orbital localization methodology Development of Divide-Expand-Consolidate method for linear-scaling Coupled-cluster calculations. Leading parallelization of computationally demanding programs using OMP and MPI technology More than 30 published papers h-index 12
4 Experience Executing large parallel jobs Building and running small cluster Programming complex parallel applications Designing and Leading implementation of complex parallel algorithms Number of various supercomputers (clusters and SMPs) in Sweden, Denmark, Norway, Finland, Italy, Spain and USA Computational Grants in CEA and ORNL (5Mh) Computer security approaches User support models User scheduling policies Variety of requirements put on supercomputers by their users
5 Visions - The Goal Supercomputer Center research environment that is on par (or better) to established supercomputer centers worldwide
6 Visions - Client experience Supercomputer center from client perspective User support Operations Client expectations Simple, accurate website documenting hardware, software and usage Fast and highly qualified communication from the support personnel Swift implementation of support changes/ideas Receptiveness and pro-activeness
7 Visions - Client experience Supercomputer center from client perspective User support Operations Client expectations Simple, accurate website documenting hardware, software and usage Fast and highly qualified communication from the support personnel Swift implementation of support changes/ideas Receptiveness and pro-activeness
8 Management challenges Procurement process management Human resource management Computational resources management
9 Procurement process Supercomputer - extremely complex subject to procure ICT Infrastructure Support Infrastructure Supercomputer center building Must form functional ensemble Must be well balanced and energy efficient Time sync between parts
10 Procurement process Emerging technologies Processor architectures Accelerator architectures Interconnect technologies Direct warm water cooling for high energy efficiency Warm water cooling Innovative Green and efficient Cost efficient Unexplored and Complex
11 Procurement process Governed by Law no. 137/2006 Sb. 11 volumes of implementation guidelines Rules and guidelines of OP VaVpI Process properties Complex multi-step Metastable Stochastic Risks Utilization of funds Ineligible expenses Overrun of deadlines ÚOHZ Restart
12 Procurement process strategy and status Small cluster bridging the construction gap Competitive dialogue The supercomputer cluster 3 complete and valid offers Competitive dialogue Under evaluation by Preliminary announcement committee invoked Workshop for potential suppliers on Support infrastructure Open selection procedure Design and specifications under way Design team visited LRZ center, the #1 in Europe
13 Human resources management Organizational structure requirements Flexible and adaptable Easy Knowledge and skill sharing Allow cross center awareness Allow cross center user support Properties towards employees Empowered employees Encourage professional growth Allow mutual substitutability
14 Matrix organizational structure: R&D Task leader 1 Task leader 2 Task leader 3 HW Director SW Quality & Adm Team 1 Team 2 Team 3 User support
15 Research and development at SCC IT4I Mission Research into flexible and innovative utilization of available resources Exploration of novel approaches, opportunities and directions Output Internal publications, buildup of knowledge base Best practices guides White papers Publications in peer-reviewed journals
16 Computational resources management Resources Core hours Storage (TB) Software licences (hours) Allocation Internal IT4I grant competition Open IT4I grant competition PRACE Directors discretion
17 Computational resources management IT4I grant competition Call for proposals, 2x (4x) per year Duration 6 months Content: Description of research, Computational preparedness, Resources requested Evaluation: Internal and/or external Directors discretion Any time Duration 6 months Content: Same as above Purpose: Commercial allocations, Strategic importance, Startup, scalability and productivity enh.
18 Conclusions Procurement process is the major challenge, due to complexity of modern supercomputer centers and due to governing legal framework Human resources will be organized in matrix structure to deliver high standard of services. Computational resources available to general academic community will allocated in competition of scientific and technical quality
Cosmological simulations on High Performance Computers
Cosmological simulations on High Performance Computers Cosmic Web Morphology and Topology Cosmological workshop meeting Warsaw, 12-17 July 2011 Maciej Cytowski Interdisciplinary Centre for Mathematical
Las Tecnologías de la Información y de la Comunicación en el HORIZONTE 2020
Las Tecnologías de la Información y de la Comunicación en el HORIZONTE 2020 A Coruña, 2 de Diciembre de 2013 Luis Rodríguez-Roselló ex-jefe de Unidad Network Technologies European Commission - DG CONNECT
International High Performance Computing. Troels Haugbølle Centre for Star and Planet Formation Niels Bohr Institute PRACE User Forum
International High Performance Computing Troels Haugbølle Centre for Star and Planet Formation Niels Bohr Institute PRACE User Forum Why International HPC? Large-scale science projects can require resources
The PHI solution. Fujitsu Industry Ready Intel XEON-PHI based solution. SC2013 - Denver
1 The PHI solution Fujitsu Industry Ready Intel XEON-PHI based solution SC2013 - Denver Industrial Application Challenges Most of existing scientific and technical applications Are written for legacy execution
How To Build A Supermicro Computer With A 32 Core Power Core (Powerpc) And A 32-Core (Powerpc) (Powerpowerpter) (I386) (Amd) (Microcore) (Supermicro) (
TECHNICAL GUIDELINES FOR APPLICANTS TO PRACE 7 th CALL (Tier-0) Contributing sites and the corresponding computer systems for this call are: GCS@Jülich, Germany IBM Blue Gene/Q GENCI@CEA, France Bull Bullx
COMPANY PRESENTATION. SOS International
SOS International The claims experience is a make or break event for insurers * Strategic top priorities** 94 % 96 % REDUCING OVERALL COSTS ENHANCING THE CUSTOMER S CLAIMS EXPERIENCE *Accenture, Claims
EIT ICT Labs The ICT Innovation Catalyst for Europe
Start-Chart EIT ICT Labs The ICT Innovation Catalyst for Europe Prof. Dr. Willem Jonker CEO [email protected] EIT ICT Labs mission is to turn Europe into a global leader in ICT Innovation Breed
Data Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric Systems
EFFECTS+ Clustering of Trust and Security Research Projects, Identifying Results, Impact and Future Research Roadmap Topics
EFFECTS+ Clustering of Trust and Security Research Projects, Identifying Results, Impact and Future Research Roadmap Topics Frances CLEARY 1, Keith HOWKER 2, Fabio MASSACCI 3, Nick WAINWRIGHT 4, Nick PAPANIKOLAOU
Kriterien für ein PetaFlop System
Kriterien für ein PetaFlop System Rainer Keller, HLRS :: :: :: Context: Organizational HLRS is one of the three national supercomputing centers in Germany. The national supercomputing centers are working
Scalability and Classifications
Scalability and Classifications 1 Types of Parallel Computers MIMD and SIMD classifications shared and distributed memory multicomputers distributed shared memory computers 2 Network Topologies static
Part I Courses Syllabus
Part I Courses Syllabus This document provides detailed information about the basic courses of the MHPC first part activities. The list of courses is the following 1.1 Scientific Programming Environment
Building Platform as a Service for Scientific Applications
Building Platform as a Service for Scientific Applications Moustafa AbdelBaky [email protected] Rutgers Discovery Informa=cs Ins=tute (RDI 2 ) The NSF Cloud and Autonomic Compu=ng Center Department
Supercomputing Resources in BSC, RES and PRACE
www.bsc.es Supercomputing Resources in BSC, RES and PRACE Sergi Girona, BSC-CNS Barcelona, 23 Septiembre 2015 ICTS 2014, un paso adelante para la RES Past RES members and resources BSC-CNS (MareNostrum)
HPC enabling of OpenFOAM R for CFD applications
HPC enabling of OpenFOAM R for CFD applications Towards the exascale: OpenFOAM perspective Ivan Spisso 25-27 March 2015, Casalecchio di Reno, BOLOGNA. SuperComputing Applications and Innovation Department,
PRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
NITRD: National Big Data Strategic Plan. Summary of Request for Information Responses
NITRD: National Big Data Strategic Plan Summary of Request for Information Responses Introduction: Demographics Summary of Responses Next generation Capabilities Data to Knowledge to Action Access to Big
IMPORTANT PROJECT OF COMMON EUROPEAN INTEREST (IPCEI)
IMPORTANT PROJECT OF COMMON EUROPEAN INTEREST (IPCEI) ON HIGH PERFORMANCE COMPUTING AND BIG DATA ENABLED APPLICATIONS (IPCEI-HPC-BDA) European Strategic Positioning Paper Luxembourg, France, Italy (& Spain)
IT Service Continuity Management
Service Continuity Management Service Continuity Components and Approach to the Activities Roberto Giaffreda, Service Continuity Manager CISA, CISM, CISSP, ISO27001LA, BS25999LA, ILv2 Pisa, 22 Maggio 2009
Network for Sustainable Ultrascale Computing (NESUS) www.nesus.eu
Network for Sustainable Ultrascale Computing (NESUS) www.nesus.eu Objectives of the Action Aim of the Action: To coordinate European efforts for proposing realistic solutions addressing major challenges
Poisson Equation Solver Parallelisation for Particle-in-Cell Model
WDS'14 Proceedings of Contributed Papers Physics, 233 237, 214. ISBN 978-8-7378-276-4 MATFYZPRESS Poisson Equation Solver Parallelisation for Particle-in-Cell Model A. Podolník, 1,2 M. Komm, 1 R. Dejarnac,
Service Desk Level 1 Service Description
Service Desk Level 1 Service Description Copyright Copyright Atea Group. All rights reserved. This document may not be reproduced, in whole or in part, in any form or any language, except for the client
Router Architectures
Router Architectures An overview of router architectures. Introduction What is a Packet Switch? Basic Architectural Components Some Example Packet Switches The Evolution of IP Routers 2 1 Router Components
Pedraforca: ARM + GPU prototype
www.bsc.es Pedraforca: ARM + GPU prototype Filippo Mantovani Workshop on exascale and PRACE prototypes Barcelona, 20 May 2014 Overview Goals: Test the performance, scalability, and energy efficiency of
ICT 10: Software Technologies
Technologies Software related activities in WP2016-17 Innovating in software: topics which have generic software concepts and methodologies as the core R&I activities E.g. generic and advanced research
LS-DYNA Scalability on Cray Supercomputers. Tin-Ting Zhu, Cray Inc. Jason Wang, Livermore Software Technology Corp.
LS-DYNA Scalability on Cray Supercomputers Tin-Ting Zhu, Cray Inc. Jason Wang, Livermore Software Technology Corp. WP-LS-DYNA-12213 www.cray.com Table of Contents Abstract... 3 Introduction... 3 Scalability
PROGRAMME DESCRIPTION FOR THE PhD PROGRAMME IN INDUSTRIAL ECONOMICS AND TECHNOLOGY MANAGEMENT 2015/2016
PROGRAMME DESCRIPTION FOR THE PhD PROGRAMME IN INDUSTRIAL ECONOMICS AND TECHNOLOGY MANAGEMENT 2015/2016 Objective of the PhD programme in Industrial Economics and Technology Management Vision and Goals
High Performance Computing. Course Notes 2007-2008. HPC Fundamentals
High Performance Computing Course Notes 2007-2008 2008 HPC Fundamentals Introduction What is High Performance Computing (HPC)? Difficult to define - it s a moving target. Later 1980s, a supercomputer performs
Future and Emerging Technologies (FET) in H2020. Ales Fiala Future and Emerging Technologies DG CONNECT European Commission
Future and Emerging Technologies (FET) in H2020 51214 Ales Fiala Future and Emerging Technologies DG CONNECT European Commission H2020, three pillars Societal challenges Excellent science FET Industrial
Parallel Computing. Benson Muite. [email protected] http://math.ut.ee/ benson. https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage
Parallel Computing Benson Muite [email protected] http://math.ut.ee/ benson https://courses.cs.ut.ee/2014/paralleel/fall/main/homepage 3 November 2014 Hadoop, Review Hadoop Hadoop History Hadoop Framework
ICT 10: Software Technologies
Technologies Jorge GASOS DG CONNECT [email protected] Odysseas I. Pyrovolakis DG CONNECT [email protected] Software related activities in WP2016-17 Innovating in software: topics
European Market for Computerized Physician Order Entry (CPOE) Systems. M634-48 March 2011
European Market for Computerized Physician Order Entry (CPOE) Systems M634-48 March 2011 Table of Contents Executive Summary Research Scope and Methodology Market Overview 10 17 23 Industry Challenges
How To Compare Amazon Ec2 To A Supercomputer For Scientific Applications
Amazon Cloud Performance Compared David Adams Amazon EC2 performance comparison How does EC2 compare to traditional supercomputer for scientific applications? "Performance Analysis of High Performance
High Performance Computing in Horizon 2020. February 26-28, 2014 Fukuoka Japan
High Performance Computing in Horizon 2020 Big Data and Extreme Scale Computing Workshop 51214 February 26-28, 2014 Fukuoka Japan Excellence in Science DG CONNECT European Commission Jean-Yves Berthou
Who We Are. Denis Thiery Chairman and Chief Executive Officer
Who We Are Denis Thiery Chairman and Chief Executive Officer Founded in 1924, Neopost has grown to become a global leader in mailing solutions and a major player in digital communications and shipping
TOWARDS PUBLIC PROCUREMENT KEY PERFORMANCE INDICATORS. Paulo Magina Public Sector Integrity Division
TOWARDS PUBLIC PROCUREMENT KEY PERFORMANCE INDICATORS Paulo Magina Public Sector Integrity Division 10 th Public Procurement Knowledge Exchange Platform Istanbul, May 2014 The Organization for Economic
...DYNAMiC INTERNET SOLUTiONS >> Reg.No. 1995/020215/23
GamCo Managed Dedicated Virtual Hosting Business growth in the number of users, application and data has left many organisations with sprawling servers, storage and supporting infrastructure crammed into
The University of Texas at Austin - Portugal An international partnership in graduate education, research, and technology commercialization
The University of Texas at Austin - Portugal An international partnership in graduate education, research, and technology commercialization Technical Appendix to the Memorandum of Understanding toward
A discussion of information integration solutions November 2005. Deploying a Center of Excellence for data integration.
A discussion of information integration solutions November 2005 Deploying a Center of Excellence for data integration. Page 1 Contents Summary This paper describes: 1 Summary 1 Introduction 2 Mastering
Hadoop Cluster Applications
Hadoop Overview Data analytics has become a key element of the business decision process over the last decade. Classic reporting on a dataset stored in a database was sufficient until recently, but yesterday
PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN
1 PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN Introduction What is cluster computing? Classification of Cluster Computing Technologies: Beowulf cluster Construction
Current Status of FEFS for the K computer
Current Status of FEFS for the K computer Shinji Sumimoto Fujitsu Limited Apr.24 2012 LUG2012@Austin Outline RIKEN and Fujitsu are jointly developing the K computer * Development continues with system
STRATEGIC POLICY FORUM ON DIGITAL ENTREPRENEURSHIP. Fuelling Digital Entrepreneurship in Europe. Background paper
EUROPEAN COMMISSION ENTERPRISE AND INDUSTRY DIRECTORATE-GENERAL Service Industries Key Enabling Technologies and Digital Economy Introduction STRATEGIC POLICY FORUM ON DIGITAL ENTREPRENEURSHIP Fuelling
Service Desk Level 2 Service Description
Service Desk Level 2 Service Description Copyright Copyright Atea Group. All rights reserved. This document may not be reproduced, in whole or in part, in any form or any language, except for the client
Partnership for Progress Factories of the Future. December 2013 Maurizio Gattiglio Chairman
Partnership for Progress Factories of the Future December 2013 Maurizio Gattiglio Chairman Factories of the Future Manufacturing: Key to our Economy Since some years the important of manufacturing has
Best Practice Facilities Management Procurement Donald Macdonald- Senior Consultant, SW19 17 th November 2015
Best Practice Facilities Management Procurement Donald Macdonald- Senior Consultant, SW19 17 th November 2015 Agenda Me a potted biography What is Facilities Management (FM)? Industry Trends Features of
LS DYNA Performance Benchmarks and Profiling. January 2009
LS DYNA Performance Benchmarks and Profiling January 2009 Note The following research was performed under the HPC Advisory Council activities AMD, Dell, Mellanox HPC Advisory Council Cluster Center The
Clouds vs Grids KHALID ELGAZZAR GOODWIN 531 [email protected]
Clouds vs Grids KHALID ELGAZZAR GOODWIN 531 [email protected] [REF] I Foster, Y Zhao, I Raicu, S Lu, Cloud computing and grid computing 360-degree compared Grid Computing Environments Workshop, 2008.
ASSET. Unlock the power of your Digital Asset
Unlock the power of your Digital Asset What is the Digital Asset? The Digital Asset is the information core of every project and facility. It is the unification of the trusted information that flows through
Distributed communication-aware load balancing with TreeMatch in Charm++
Distributed communication-aware load balancing with TreeMatch in Charm++ The 9th Scheduling for Large Scale Systems Workshop, Lyon, France Emmanuel Jeannot Guillaume Mercier Francois Tessier In collaboration
Concept and Project Objectives
3.1 Publishable summary Concept and Project Objectives Proactive and dynamic QoS management, network intrusion detection and early detection of network congestion problems among other applications in the
Big Data :: Big Demand
Big Data :: Big Demand Introductions John Martin Director Information Management Children s Hospital of Philadelphia [email protected] William Nieczpiel Analytics Development Manager Children s
Sun Constellation System: The Open Petascale Computing Architecture
CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc. 25 Years of Technical
Ericsson Introduces a Hyperscale Cloud Solution
Ericsson Introduces a Hyperscale Cloud Solution The Ericsson HDS 8000 delivers a complete datacenter and cloud platform based on Intel Rack Scale Architecture Solution Brief Ericsson HDS 8000, part of
International Summer School
International Summer School 2016 www.summerschoolbicocca.com 5 th to 10 th SEPTEMBER 2016 RAMSES: Advanced School on Critical Raw Materials Substitution for Energetics and Photonics The Advanced School
OUR COMPANY. Autolog is a world-class optimization and process control systems manufacturer. TECHNOLOGY QUALITY CUSTOMER EXPERIENCE
OUR COMPANY Autolog is a world-class optimization and process control systems manufacturer. TECHNOLOGY QUALITY CUSTOMER EXPERIENCE OUR COMPANY Autolog is a world-class optimization and process control
A bachelor of science degree in electrical engineering with a cumulative undergraduate GPA of at least 3.0 on a 4.0 scale
What is the University of Florida EDGE Program? EDGE enables engineering professional, military members, and students worldwide to participate in courses, certificates, and degree programs from the UF
High-Performing Information Systems Aligned With Utility Business Strategy [Project #4316]
High-Performing Information s Aligned With Utility Business Strategy [Project #4316] ORDER NUMBER: 4316 DATE AVAILABLE: June 2013 PRINCIPAL INVESTIGATORS: David W. Harris, Esteban Azagra, Rod van Buskirk,
Efficient and Faster PLC Software Development Process for Automotive industry. Demetrio Cortese IVECO Embedded Software Design
Efficient and Faster PLC Software Development Process for Automotive industry Demetrio Cortese IVECO Embedded Software Design 13-06-2013 Automotive OEM Mandatory Requirement Delivery the new vehicle in
So#ware Tools and Techniques for HPC, Clouds, and Server- Class SoCs Ron Brightwell
So#ware Tools and Techniques for HPC, Clouds, and Server- Class SoCs Ron Brightwell R&D Manager, Scalable System So#ware Department Sandia National Laboratories is a multi-program laboratory managed and
Introducing Oracle Exalytics In-Memory Machine
Introducing Oracle Exalytics In-Memory Machine Jon Ainsworth Director of Business Development Oracle EMEA Business Analytics 1 Copyright 2011, Oracle and/or its affiliates. All rights Agenda Topics Oracle
ivoice Networks Pte Ltd
ivoice Networks Pte Ltd 1 North Bridge Road, #19-04/05 High Street Centre, Singapore 179094 Phone: +65 31080707 - Fax: +65 68264115 www.ivoice.sg Company Highlights Name of Company: Registration No: SBO
Regional Vision and Strategy The European HPC Strategy
Regional Vision and Strategy The European HPC Strategy BDEC 29 January 2015 Augusto BURGUEÑO ARJONA Head of Unit einfrastructure - DG CONNECT European Commission @ABurguenoEU aburguenoeu.wordpress.com
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes. Anthony Kenisky, VP of North America Sales
Appro Supercomputer Solutions Best Practices Appro 2012 Deployment Successes Anthony Kenisky, VP of North America Sales About Appro Over 20 Years of Experience 1991 2000 OEM Server Manufacturer 2001-2007
SSketch: An Automated Framework for Streaming Sketch-based Analysis of Big Data on FPGA *
SSketch: An Automated Framework for Streaming Sketch-based Analysis of Big Data on FPGA * Bita Darvish Rouhani, Ebrahim Songhori, Azalia Mirhoseini, and Farinaz Koushanfar Department of ECE, Rice University
IT PROJECT GOVERNANCE GUIDE
IT PROJECT GOVERNANCE GUIDE P1133-ITGG-NNA V1.2 04/24/06 UCLA Office of Information Technology UCLA IT GOVERNANCE TABLE OF CONTENTS 1 IT GOVERNANCE OVERVIEW...1 1.1 STEP 1- PROJECT IDENTIFICATION...1
ORGANISATION FOR ECONOMIC CO-OPERATION AND DEVELOPMENT
2 OECD RECOMMENDATION OF THE COUNCIL ON THE PROTECTION OF CRITICAL INFORMATION INFRASTRUCTURES ORGANISATION FOR ECONOMIC CO-OPERATION AND DEVELOPMENT The OECD is a unique forum where the governments of
CNE Progress Chart (CNE Certification Requirements and Test Numbers) (updated 18 October 2000)
Novell Education CNE Progress Chart (CNE Certification Requirements and Test Numbers) (updated 18 October 2000) Prerequisite for all certifications In order to receive a Novell certification the candidate
Computing our Future Computer programming and coding in schools in Europe. Anja Balanskat, Senior Manager European Schoolnet
Computing our Future Computer programming and coding in schools in Europe Anja Balanskat, Senior Manager European Schoolnet ABOUT THE SURVEY What do Ministries currently think about the topic? Curricula
Clusters: Mainstream Technology for CAE
Clusters: Mainstream Technology for CAE Alanna Dwyer HPC Division, HP Linux and Clusters Sparked a Revolution in High Performance Computing! Supercomputing performance now affordable and accessible Linux
ICT Priorities in Pharmaceuticals
ICT Priorities in Pharmaceuticals Enterprise ICT investment plans December 2013 TABLE OF CONTENTS 1 1 Enterprise ICT investment trends... 5 1.1 Introduction... 5 1.2 Survey demographics... 5 1.3 ICT budget
Energy Efficient Storage - Multi- Tier Strategies For Retaining Data
Energy and Space Efficient Storage: Multi-tier Strategies for Protecting and Retaining Data NOTICE This White Paper may contain proprietary information protected by copyright. Information in this White
Introduction to Cloud Computing
Introduction to Cloud Computing Parallel Processing I 15 319, spring 2010 7 th Lecture, Feb 2 nd Majd F. Sakr Lecture Motivation Concurrency and why? Different flavors of parallel computing Get the basic
