PRACE hardware, software and services. David Henty, EPCC,

Transcription

1 PRACE hardware, software and services David Henty, EPCC,

2 Why? Weather, Climatology, Earth Science degree of warming, scenarios for our future climate. understand and predict ocean properties and variations weather and flood events Astrophysics, Elementary particle physics, Plasma physics systems, structures which span a large range of different length and time scales quantum field theories like QCD, ITER Material Science, Chemistry, Nanoscience understanding complex materials, complex chemistry, nanoscience the determination of electronic and transport properties Life Science system biology, chromatin dynamics, large scale protein dynamics, protein association and aggregation, supramolecular systems, medicine Engineering complex helicopter simulation, biomedical flows, gas turbines and internal combustion engines, forest fires, green aircraft, virtual power plant 2

3 Supercomputing Drives Science through Simulation Environment Weather/ Climatology Pollution / Ozone Hole Ageing Society Medicine Biology Materials/ Inf. Tech Spintronics Nano-science Energy Plasma Physics Fuel Cells 3

4 Sum of Performance per Country (TOP500) 4

5 Rationale Europe must maintain its high standards in computational science and engineering Europe has to guarantee independent access to HPCsystems of the highest performance class for all computational scientists in its member states Scientific Excellence requires peer review on European scale to foster best ideas and groups User requirements as to variety of architectures requires coordinated procurement EU and national governments have to establish robust and persistent funding scheme 5

6 HPC on ESFRI Roadmap 2006 First comprehensive definition of RIs at European level RIs are major pillars of the European Research Area A European HPC service strategic competitiveness attractiveness for researchers access based on excellence supporting industrial development 6

7 capability The ESFRI Vision for a European HPC service European HPC-facilities at the top of an HPC provisioning pyramid Tier-0: 3-6 European Centres for Petaflop Tier-0:? European Centres for Exaflop Tier-1: National Centres Tier-2: Regional/University Centres Creation of a European HPC ecosystem Scientific and industrial user communities HPC service providers on all tiers Grid Infrastructures The European HPC hard- and software industry Tier-0 Tier-1 Tier-2 PRACE DEISA/PRACE # of systems 7

8 PRACE in Europe 8

9 PRACE Timeline HPCEUR HET PRACE MoU PRACE Preparatory EU-Grant: INFSO-RI , 10 Mio. Phase PRACE Operation PRACE Implementation Phase (1IP, 2IP) PRACE (AISBL), a legal entity with (current) seat location in Brussels 9

10 Purpose of Workshop Introduce you to DECI-7 process Get you logged on to Tier-1 machines Make sure you can compile and run simple codes Inform you of the applications support available Get you started on your own codes 10

11 Timetable 13:30-13:45 Welcome and Introduction to SARA 13:45-14:30 PRACE hardware, software and services 14:30-15:30 Use of Certificates, Using gsi-ssh and gridftp 15:30-16:00 Coffee Break 16:00-17:30 Hands on session (practical examples) 09:30-10:15 PRACE support for the DECI projects 10:15-10:30 Remote Visualization 10:30-11:00 Hands on Sessions (users own application codes) 11:00-11:30 Coffee Break 11:30-12:30 Hands on Sessions (users own application codes) 12:30-13:30 Lunch 13:30-15:30 One-to-one sessions (optional) 11

12 Access to PRACE resources Regular calls for proposals see Successful projects allocated a maximum number of CPU hours given access for a limited period of time Linked calls can apply for Tier-0 or Tier-1 Tier-1 access is via DECI (continuation of DEISA scheme) active projects (you!) are DECI-7 call already open for DECI-8 starting May

13 Tier-0 Systems IBM Blue Gene/P JUGENE Germany) Bull Bullx cluster CURIE France) Cray XE6 HERMIT Germany) SuperMUC Germany) MareNostrum (BSC, Spain) FERMI (CINECA, Italy) 13

14 Tier-1 Systems: specialist Cray XT4/5/6 and Cray XE6 EPCC (UK) KTH (Sweden) CSC (Finland) IBM Blue Gene/P IDRIS (France) RZG (Germany) NCSA (Bulgaria) IBM Power 6 RZG (Germany) SARA (The Netherlands) CINECA (Italy) 14

15 Tier-1 Systems: clusters FZJ (Germany, Bull Nehalem cluster) LRZ (Germany, Xeon cluster) HLRS (Germany, NEC Nehalem cluster plus GP/GPU cluster) CINES (France, SGI ICE 8200) BSC (Spain, IBM PowerPC) CINECA (Italy, Westmere plus GP/GPU cluster) PSNC (Poland, Bullx plus GP/GPU cluster and HP cluster) ICHEC (Ireland, SGI ICE 8200). 15

16 DECI Terminology Every project has a single HOME site one or more EXECUTION sites Home site main point of contact you will have a named person responsible for login accounts etc. Execution sites where you run your jobs 16

17 Accounts HOME site must apply for an account here you supply a certificate from your national Certificate Authority automatically propagated to execution site(s) may be additional info needed based on local arrangements e.g. signing up to codes of conduct EXECUTION sites same user name as home site recommended access is via gsissh. some sites may support ssh 17

18 Security Infrastructure Standard public/private key setup private key: only owner knows public key: known to everyone one encrypts, other decrypts: authentication and privacy figure by Borja Sotomayor, tutorial/multiplehtml/ch09s03.html from J. Schopf, Globus Alliance

19 Certificates Similar to passport or driver s licence All PRACE users have an X509 Certificate certified by their national certificate authority have special temporary certificates for training sessions Enables secure authentication figure by Rachana Ananthakrishnan (from J. Schopf, Globus Alliance)

20 Managing certificates Certificate must be installed on your local machine protected by a private password/passphrase List of user certificates is held by PRACE central LDAP database Lightweight Directory Access Protocol PRACE sites synchronise with the LDAP at regular intervals Ask your home site if you have problems!

21 CPU accounted in standard core-hours e.g. conversion factors for DEISA were: CPU normalisation AMD I2 1.1 Intel 1.4 Intel 1.6 Intel 2.8 Intel 3 Intel Westmere 2.7 Intel Westmere 2.6 Intel Westmere 2.7 NEC SX8 6 NEC SX9 36 P4+@ [email protected] 3 PPC@ X2 4 XE6 12C@ XEON X5560@ XEON X5570@ XT5 CSCS 1.2 XT5 DC@ XT5 DC@ XT

22 Current status Tier-1 systems new to PRACE DECI-7 is the first PRACE DECI integration may not be complete for all sites Training accounts we provide temporary accounts for today pr1utrxx (XX = 11, 12,, 35) notional home site is EPCC (HECToR) temporary certificate from ECMWF CA execution sites are at SARA, CSC and CINECA chosen to span a range of architectures 22

23 DECI-7 Statistics 54 applications for 200 million standard core-hours 35 successful projects allocated 90 million standard core-hours Start date: 1 st November 2011 End date: 31 st October 2012 you MUST use your CPU allocation in this period Final reports must be submitted due within 3 months of project completion 23

24 Useful resources Documentation currently provided via DEISA site migrating to Reporting problems Trouble Ticket System will be opened up to users in the future Monitoring CPU usage done via DART tool home site can advise on installing this 24

25 Run a graphical client on local machine uniform interface to different HPC systems support for data transfer, workflows etc. 25

26 Meal Brasserie Harkema 26