Advanced Computing. for large DESY. Volker Guelzow IT-Gruppe Hamburg, Oct 29th, 2014

Size: px

Start display at page:

Download "Advanced Computing. for large Experiments @ DESY. Volker Guelzow IT-Gruppe Hamburg, Oct 29th, 2014"

Susanna Cannon
10 years ago
Views:

1 Advanced Computing for large DESY Volker Guelzow IT-Gruppe Hamburg, Oct 29th, 2014

2 Management for Beamlines: Visualization (Linux, Windows) Analysis (Linux, Windows) 8 Admin NSD, NFS SMB 3 4a 4b NFS or NSD Local Researcher Detector Acquisition (Message Passing) 1 Local Cache 2 Central Storage (& Cache) 10 NFS, SMB 5 6 TBD (Linux, Windows, MacOS) Remote Researcher Detector Acquisition (Message Passing) 9 NFS 7 On-Site Archive (dcache) (Linux, Windows, MacOS) Detector Hall Campus Network Center Local Office, Remote Sites Matchmaking Workshop DESY-IT V. Gülzow Seite 2

(Linux, Windows, MacOS) Remote Researcher Detector Acquisition (Message Passing) 9 NFS 7 On-Site Archive (dcache) (Linux,

3 Detectors and rates Type Frame size Frame rate Peak rate Os Avail. Medipix n x 256 x 256 x 2 SL6 Now PerkinElmer 2048 x 2048 x 2 15 Hz 1.9Gb/s + 8kb/s (log) Windows-7 Now Pilatus300k 487 x 619 x 4 ~200 Hz 1.56Gb/s Suse-10 Now Pilatus1M 981 x 1043 x 4 25 Hz 0.8Gb/s Suse-10 Now Pilatus 6M 2463 x 2527 x 4 25 Hz 4.6Gb/s Ubuntu 10 Now AGIPD 128 x 512 x 2 x 2 x Hz 55 Gb/s SL Eiger 1k x 1k x 2 3 khz 50 Gb/s RHEL6 now Lambda-Si 3 x 1536 x 512 x 2 2 khz 60 Gb/s SL PCO Edge 2560 x Hz 5.6 Gb/s Windows-7 now Percival (1S) 4k x 4k x Hz 60 Gb/s (SL6) 2015 Percival (4S) 8k x 8k 120 Hz 240 Gb/s (SL6) late 2015 Matchmaking Workshop DESY-IT V. Gülzow Seite 3

8Gb/s Suse-10 Now Pilatus 6M 2463 x 2527 x 4 25 Hz 4.

4 takeing and Management Big ( Petabyte/year) in streaming and burst mode requesting: > Advanced (distributed) baseline storage solutions (f.i. high performance for ingest und access, ) > High performance filesystems > Advanced data management software solutions > Metadata handling > cloud solutions > compression techniques, erasure code, de duplication methods > preservation (extension of DPHEP) Matchmaking Workshop DESY-IT V. Gülzow Seite 4

5 Networking > UDP based communication software development on FPGAS on detector boards > Leading edge networking technology to link experiments to computer centre > Remote access solution, high perfomance firewalling > Security/AAI solutions Matchmaking Workshop DESY-IT V. Gülzow Seite 5

to computer centre > Remote access solution, high perfomance firewalling >

6 Management for Beamlines: Visualization (Linux, Windows) Analysis (Linux, Windows) 8 Admin NSD, NFS SMB 3 4a 4b NFS or NSD Local Researcher Detector Acquisition (Message Passing) 1 Local Cache 2 Central Storage (& Cache) 10 NFS, SMB 5 6 TBD (Linux, Windows, MacOS) Remote Researcher Detector Acquisition (Message Passing) 9 NFS 7 On-Site Archive (dcache) (Linux, Windows, MacOS) Detector Hall Campus Network Center Local Office, Remote Sites Matchmaking Workshop DESY-IT V. Gülzow Seite 6

7 Analysis Computing > Code development and optimization (NUMA) > Fast algorithms on parallel/gpu-systems > Cloud solutions (OpenStack, Helix Nebula, Dirac-like systems) > Management tools of an advanced computing facility. i.e. resource scheduling (GPU, parallel, green programming) in a federation > Virtualization (f.e. Docker) Matchmaking Workshop DESY-IT V. Gülzow Seite 7

8 dcache Big Cloud LOFAR antenna Huge amounts of data X-FEL (Free Electron Lasers) Fast Ingest Matchmaking Workshop DESY-IT V. Gülzow Seite 8

9 Visualization 3D-time dependent Pattern recognition Fast image analyis (f.i. through neural networks) Virtual reality (Cave) Matchmaking Workshop DESY-IT V. Gülzow Seite 9

10 Messungen bei DESY an PETRA III Köcherfliege (Limnephilus flacivornis) Kopf + Thorax Courtesy: Dr. F. Beckmann 10 PAGE 10 Volker Guelzow Big for Science

11 User interface layer > AAI: access to federated resources (adapting existing solutions from other projects like EduGain based solutions) > Security, policies, life cycle management (like how long? Ownership? Who has access? What kind of data?..) > Portals for scientific and industrial users > Open Access (like access to resources, virtual accounting, industrial usage,..) Matchmaking Workshop DESY-IT V. Gülzow Seite 11

12 Other issues > Management of scientific users, beamtimes, AAI s etc. > Management tools of an advanced computing facility (green computing, green programming) > NFC s for maintenance of devices in tunnels etc. > Preservation > Operational efficiency, scaling&automation > and much more.. Matchmaking Workshop DESY-IT V. Gülzow Seite 12

programming) > NFC s for maintenance of devices in tunnels etc.

How To Share Data With The Cloud On Dcache

How To Share Data With The Cloud On Dcache dcache, Sharing, Sync`ing Big Data and Cloud Strategies LSDMA Topics Meeting on Sharing data 2014, Jűlich Patrick Fuhrmann dcache Sharing Strategy LSDMA Topic Meeting: Sharing Patrick Fuhrmann 03 Apr 2014