Mitglied der Helmholtz-Gemeinschaft UNICORE. Uniform Access to JSC Resources. Michael Rambadt, 20.

Transcription

1 Mitglied der Helmholtz-Gemeinschaft UNICORE Uniform Access to JSC Resources 20. Mai 2014 Michael Rambadt,

2 Outline Introduction Features UNICORE Portal UNICORE Rich Client UNICORE Command Line Client Links and documentation 20. Mai 2014 Slide 2

3 Introduction Moab/Torque -> msub, LoadLeveler -> llsubmit, 20. Mai 2014 Slide 3

4 Introduction Supercomputers are managed by Resource Management Systems (RMSs) that handle the scheduling JUQUEEN: IBM LoadLeveler JUROPA: Moab/Torque Different job description languages (# of nodes, memory requirements, ) 20. Mai 2014 Slide 4

5 Introduction Supercomputers are managed by Resource Management Systems (RMS) that handle the scheduling JUQUEEN: IBM LoadLeveler JUROPA: Moab/Torque Different job description languages (# of nodes, memory requirements, ) To unify and simplify the supercomputer access 20. Mai 2014 Slide 5

6 Why UNICORE? Advantages One interface to create, submit and monitor jobs Seamless, secure, and intuitive access to distributed resources and data No need to learn system specific commands Remote access to the JSC supercomputers from anywhere Open Source software 20. Mai 2014 Slide 6

7 Why UNICORE? Advantages (cont.) Easy to install and to configure clients Linux, Windows, MacOS versions available Integrated data management Integrated resource management 20. Mai 2014 Slide 7

8 UNICORE Clients Clients: Portal Client: Web based client to use with a browser Rich Client: Eclipse-based graphical client UCC: Command line client 20. Mai 2014 Slide 8

9 UNICORE Portal Prerequisites: Web Browser (User certificate) 20. Mai 2014 Slide 9

10 UNICORE Portal Mai 2014 Slide 10

11 UNICORE Portal Home View 20. Mai 2014 Slide 11

12 UNICORE Portal Grid Browser 20. Mai 2014 Slide 12

13 UNICORE Portal Where are my sites? 20. Mai 2014 Slide 13

14 UNICORE Portal New Job 20. Mai 2014 Slide 14

15 UNICORE Portal Job Browser 20. Mai 2014 Slide 15

16 UNICORE Portal - Show my Jobs 20. Mai 2014 Slide 16

17 UNICORE Portal File Transfer 20. Mai 2014 Slide 17

18 UNICORE Client Installation und Configuration Prerequisites: Java Runtime Environment (JRE) 1.6 Personal user certificate Approved account on JUROPA, JUDGE and/or JUQUEEN Download the client from Access the Testgrid: Testgrid Registry: FZJ Registry: Mai 2014 Slide 18

19 UNICORE Security Security model based on X509 public key infrastructure No userid and password authentication Credential consists of a public and a private key Trusted certificates provided by the national European Grid Certification Authorities (e.g. DFN Grid CA) Each user has her own private key JSC is DFN-Registry provider Support: unicore-info@fz-juelich.de 20. Mai 2014 Slide 19

20 Welcome Screen First steps instructions 20. Mai 2014 Slide 20

21 UNICORE Rich Client 20. Mai 2014 Slide 21

22 UNICORE Features - Extended Workflow capacity 20. Mai 2014 Slide 22

23 UNICORE Command Line Client Run jobs, get status, get output, transfer files Administrative use : list jobs, clean up, etc. Extensible: add commands 20. Mai 2014 Slide 23

24 UCC UNICORE Command Line Client - 2 Basic commands ucc help ucc connect [ -v ] ucc list-sites ucc run [-a] <job> ucc batch <dir> ucc get-status ucc list-jobs ucc put-file ucc get-file get help information connect to a Grid list the available target systems submit a job script [asynchronously] submit all jobs stored in <dir> query job status get list of your jobs copy local file to remote copy remote file to local 20. Mai 2014 Slide 24

25 Preferences Set keystore and passphrase Enter Registry URL Select default output directory for files For convenience: options (e.g. verbose, recursive) # passphrase for the keystore password=xxxxx #URL of the UNICORE Registry to use registry= #default output directory for files output=/tmp 20. Mai 2014 Slide 25

26 Basic usage of UCC Connect to UNICORE site: > ucc connect You can access 2 target system (s). For every ucc command, you can use -v for verbose output: > ucc connect -v Getting help: > ucc help Help for each ucc command with -h: > ucc connect -h 20. Mai 2014 Slide 26

27 UNICORE Summary Platform-independent Java application Web portal Uniform access to JUQEEN, JUROPA (and other European and US Supercomputers) Job submission, monitoring and control SSH support File management 20. Mai 2014 Slide 27

28 Links and documentation Download FZJ production UNICORE release and manuals Getting Grid certificates from DFN FZJ) Access UNICORE documentation, e.g. tutorials, manuals, FAQs UNICORE Testgrid (Access via portal) Questions, troubles, or suggestions? contact unicore-info@fz-juelich.de 20. Mai 2014 Slide 28