Workshop Agenda Feb 25th 2015

Transcription

1 Workshop Agenda Feb 25th 2015 Time Presenter Title 09:30 T. König Talk bwhpc Concept & bwhpc-c5 - Federated User Support Activities 09:45 R. Walter Talk bwhpc architecture (bwunicluster, bwforcluster JUSTUS, ForHLR Phase I) 10:00 A. Fuchs Talk Cluster: Access, Data Transfer and Storage, GUI 10:30 Break 10:45 R. Barthel Talk File System, Software System (modulefiles), Batch System 11:10 A. Fuchs Tutorial bwunicluster: Access, Data Transfer, Compiling, Modulefiles, Batch Job Scripting 11:50 Lunch Break 13:00 R. Barthel Talk Advanced Bash Scripting 13:30 R. Barthel Tutorial Advanced (Batch) Job Scripting 14:15 14:30 1 Break A. Fuchs Tutorial Compiling, Makefile, Parallelising 15:15 User Forum Solving User Cases 16:00 End

2 High performance computing in Baden-Württemberg and support activities: bwhpc concept, bwhpc-c5, federated user support activities Tobias König (KIT) 2

3 To be answered: This presentation: What is bwhpc? What is bwhpc-c5? Where do I get support / What kind of support? Brief answer: Federated HPC 3 Federated HPC Support

4 More detailed answer Website: General info: in English and German Best-practices-guide (documentation on clusters): in English Publications: SCC News 02/2013, page 6: SCC NEWS 02/2014, page

5 1. bwhpc concept 5

6 Introduction Introduction What is bwhpc/bwhpc-c5? bw = Baden-Würtemberg bwhpc = Strategy for high perfomance computing in BW from 2013 to 2018, in particular for Tier 3 = bwhpc-c5 = User and IT support for bwhpc Cooporated activities 6

7 Introduction Introduction HPC Tier classification / bwhpc European Highperformance Computing Centers (Tier 0) National Highperformance Computing Centers (Tier 1) Supraregional, state-wide HPC-Centers (Tier 2) Regional HPC-Enablers (Tier 3) bwhpc: Differentiation of Tier 3 7

8 bwhpc: Tier-3 ( ) MA/HD: bwforcluster = BW science cluster KA: bwunicluster = BW university/universal cluster Mannheim Heideberg TU: bwforcluster = BW science cluster Karlsruhe Tübingen Ulm Freiburg FR: bwforcluster = BW science cluster 8 UL: bwforcluster = BW science cluster

9 bwhpc: currently covered research areas Economics & social science, General sciences supply Molecular life science Bioinformatics Mannheim Heideberg Karlsruhe Neurosciences Astrophysics Tübingen Ulm Freiburg Micro systems engineering Elementary particle physics Computational chemistry Independent of location, users of research area X use science cluster X 9

10 Federated tier 3 (1) bwunicluster: Co-financed by Baden-Württemberg's ministry of science, research and arts and the shareholders: Freiburg, Tübingen, KIT, Heidelberg, Ulm, Hohenheim, Konstanz, Mannheim, Stuttgart Usage: Free of charge General purpose, teaching & education Technical computing (sequential & weak parallel) & parallel computing Access / limitations: For all members of shareholder's university in BW For all members of the universities of applied sciences in BW 10

11 Federated tier 3 (2) bwforcluster: For science communities according the DFG proposal Financed by German Research Society (DFG) Access: All university members in Baden-Württemberg Usage, limitations: Free of charge Access only to science cluster matching own science community Access requires approval of compute proposal 11

12 2. bwhpc-c5 / Federated user support 12

13 Location of bwhpc-c5 project partners Uni Heidelberg Uni Mannheim Uni Stuttgart HFT Stuttgart Karlsruhe Institute of Technology Uni Hohenheim HS Esslingen Uni Tübingen Uni Freiburg Uni Konstanz 13 Uni Ulm

14 What is bwhpc-c5? C5 = Coordinated compute cluster competence centers CC = Competence Center For Users: Support requests are not sent to cluster operators but to competence centers via trouble ticket system CC are not local, but distributed over whole BW CC are community specific HPC infrastructure For BW: Bridging Science & HPC Bridging HPC tiers Embedding services 14 bw services Science bwhpc-c5

15 bwhpc-c5: federated science support 4. 4.Umsetzung Umsetzung HPC competence centers Establish state wide experts-pool (community specific, parallel software development) Coordination of high level support teams (tiger teams) Build up best practices repository Identify of user key topics Org. Economics & social science, Molecular life science Computational chemistry Org. Org. General sciences supply Neuroscience,,Micro systems engineering, Elementary particle physics Org. Bioinformatics, Astrophysics Coordination of teaching activities 15

16 bwhpc-c5: What kind of support? Information HPC seminars and workshops Documentation + best practices repository Providing/maintaining/developing: simplified access to bwhpc resources software trouble ticket system cluster information system Migration support: code adaptation, e.g. MPI or OpenMP parallelisation code porting (from desktop / old HPC cluster) to tier 2 and 1 16

17 bwhpc-c5: Service integration & development bwhpc access + security e.g. bwidm integr. Support Portal (trouble ticket system) Cluster information system (CIS) 17 Large Data integration: bwfilestorage

18 BwFileStorage = central storage for HPC users Central online storage for HPC users BwFileStorage (general transfer protocols: FTP, SFTP, SCP, HTTPS) User documentation (registration, user guide,...) Federated user authentification bwidm mechanisms (Shibboleth) 18

19 LNA-BW: Scientific Steering Committee LNA-BW = Landesnutzerausschuss-BW: Scientific steering of bwhpc and bwdata Website: Tasks: Committee of representatives of HPC user interests One representative for each BW-university Representative for KIT: Prof. Dr. Johannes Orphal, Institute for Metereology and Climate Research (IMK-ASF) Set bwhpc access formalities Assessment of bwhpc workload Regulation of bwhpc cluster expansion Assignment of science communities to science clusters Representation of HPC users interests concerning: resource demands, HPC technologies and software licences, adjustment of resource quota 19

20 Summary 20

21 bwhpc / bwhpc-c5: Summary bwhpc: tier 3 = HPC enabler, science specific infrastructure To get access: HPC infras. bw services bwunicluster: very short proposal ->ZAS website bwforcluster: short proposal ->ZAS website Science bwhpc-c5 bwhpc-c5 your support team for HPC : HPC competence centers, which coordinate: federated HPC support (help: code migration, parallelisation etc.) contact via Support Portal your developer team Implementation & development of bw services Evaluation & Integration of new HPC technology LNA-BW: representatives of HPC user interests 21

22 Acknowlegment Ministry of Science, Research and Arts Baden-Württemberg All contributors and co-authors of bwhpc-c5: Uni Ulm Uni Konstanz Uni Freiburg HFT Stuttgart Uni Stuttgart HS Esslingen Uni Hohenheim Uni Tübingen Uni Mannheim Uni Heidelberg KIT 22

23 Thank you for your attention! Questions? 23

24 HPC Tier classification / bwhpc European Highperformance Computing Centers (Tier 0) National Highperformance Computing Centers (Tier 1) Supraregional, state-wide HPC-Centers (Tier 2) Regional HPC-Enablers (Tier 3) Next presentation Introduction bwhpc-cluster: architecture bwunicluster, bwforcluster and ForHLR 24