ISC- HPC I/O in the Datacentre. I/O in an Industrial Scientific Computing Environment. Gerd Büttner. July 2015

Transcription

1 ISC- HPC I/O in the Datacentre Gerd Büttner I/O in an Industrial Scientific Computing Environment

2 Airbus is a global aircraft manufacturer 55,000 40billion 9yrs 400 Passion - Our global workforce is united by a passion for aviation and restless desire to create better ways to fly Employees Annual revenue* Backlog Operators Data to end 2014 *Annual Revenue 2013

3 Our aircraft are a familiar sight around the world Presence - An Airbus takes off or lands every 2 seconds 15, , ,200+ Aircraft sold Produced monthly Delivered Daily flights Data to end 2014

4 Innovation is in our DNA and has been for over 4 decades 600 patents per year 3D Printing - Image shows the 1 st flying 3D printed metal part Industry FIRSTS 1 st twin-engine widebody aircraft, A300 1 st full fly-by-wire commercial airliner 1 st double decker airliner, A380 1 st manufacturer to make extensive use of composites

5 The most global aerospace player close to our customers worldwide The numbers - 11 Production sites 4 Assembly line locations 5 Training centres 4 Engineering centres 3 Customer support centres 10 Materials & logistics centres* Data to end 2014 *Satair Group

6 Global Storage Architecture Scientific Computing Unified Planning Shopfloor PLM MS- Exchange LAN SAN SAN Array NAS- Filer NAS- Filer NAS- Filer SAN Array

7 Global Scientific Computing Architecture AIRBUS GRID SERVICE Bremen HPC Service Hamburg Airbus Group Innovation: Suresne Ottobrunn Hamburg Filton Toulouse India Filton Suresne Donauwörth Ottobrunn Airbus Group Innovation GRID SERVICE Getafe Toulouse HPC Service Marignane Airbus Group Helicopter GRID SERVICE AECI Bangalore HPC Service Page 7

8 Challenges for Best Design of a HPC Requirements from Applications Application profile (CPU, Memory, I/O, Communication) EndUser locations System Distribution Constrains Data distribution Budget Existing environment Company harmonisation Best is a well balanced System

9 Scientific Computing Architecture Is to build mathematical models, analyze them to simulate the reality. This requires graphic capabilities, huge data flows and massive amounts of calculations on distributed computing platforms 2D remote display SGD Session Service FD-Backbone StorageServices 3D remote display HP-RGS Linux desktop, CotS 2d, 3D, light batch ~ 500 Linux server Data Storage License Service HPC Heavy Batch Mid Term Storage Catia Server Application Storage

10 HPC Capacity Airbus HPC capacity incrementing according to needs Code Use Case Cores Number of run in 24h a half full b standard opti c scalable

11 HPC4 Global Architecture

12 HPC4 Functional Architecture View Toulouse Hamburg 10 Gb Ethernet 56 Gb Infiniband 8 x 10 Gb 4 x 10 Gb Admin Nodes Grid Nodes Transfer Nodes Visu Nodes Login Nodes Admin Nodes Grid Nodes Transfer Nodes Visu Nodes Login Nodes SCRATCH Infiniband MIDTERM Storage SCRATCH Infiniband MIDTERM Storage Type1 Nodes Type2 Nodes Catia Nodes Type1 Nodes Type2 Nodes Catia Nodes Page 12

13 Storage design in HPC4 Airbus Backbone Compute Nodes Dev/Val Compute Nodes Production TLS Production Ham FDR 10GB FDR 10GB

14 Thoughts System reliability/stability At least 2 Locations Electricity Network Load Multiple Enduser locations Enable full service contract Reduce number of interface points Split between Batch (HPC) & Interactive Environment Large NFS Mount table slow down the system No direct access to standard storage enviroment Sizing on given Application portefolio Application inventory with the Customer Agree on a load forecast

15 Conclusion The right system has to be balanced based on requirements and constrains There no Best System or optimal solution for every one I/O is one important perimeter of design I/O is often forgotten in design I/O can slow down /limit the whole system Check the design with your own application portefolio

16 Scientific Computing

17 Airbus Operations GmbH. All rights reserved. Confidential and proprietary document. This document and all information contained herein is the sole property of Airbus Operations GmbH. No intellectual property rights are granted by the delivery of this document or the disclosure of its content. This document shall not be reproduced or disclosed to a third party without the express written consent of Airbus Operations GmbH. This document and its content shall not be used for any purpose other than that for which it is supplied. The statements made herein do not constitute an offer. They are based on the mentioned assumptions and are expressed in good faith. Where the supporting grounds for these statements are not shown, Airbus Operations GmbH will be pleased to explain the basis thereof. AIRBUS, its logo, A300, A310, A318, A319, A320, A321, A330, A340, A350, A380, A400M are registered trademarks.