Handling data for the European Spallation Source Sune Rastad Bahn Group Leader, Systems and Technologies www.europeanspallationsource.se 15-10-20
Outline Looking at the world through Neutron colored eyes What is European Spallation Source? DMSC: Handling all those data. 2
What do neutrons tell us? 3
Neutron Scattering & Science Neutron scattering as a technique can be used in the study of a wide variety of materials, o Soft Condensed Matter Self-assembled colloids Polymers Thin film devices o Life Sciences Macromolecular structures Solution of macromolecular complexes Bio-molecules o Magnetic phenomena High temperature superconductivity Quantum phenomena Molecular magnets o Chemistry In-Situ processing Catalysis Waste management o Energy research Fuel cells Gas storage materials New battery materials o Engineering sciences, environmental sciences & culture In-situ welding Cultural heritage o Fundamental physics Lifetime of the neutron Decay mechanisms europeanspallationsource.se/science-using-neutrons 4
European Research Infrastructure Consortium 375 employees 45 nationalities Construction budget: 1843 M Host countries: Sweden and Denmark 47,5% Construction Cash ~100% Partner Countries: 52,5% Construction IKC/Cash ~ 70% / 30%
Spallation Process 6
Source Characteristics
ESS looking towards MAX IV DMSC ESS
Work in progress.. o Construction on the ESS site began in 2014 o Accelerator + target & first neutrons in 2019 o Instrument rollout 2019 2025 (16 instruments) August 2015 www.europeanspallationsource.se/page/construction-site-webcams 9
Time of Flight Neutron Instruments NEUTRON OPTICS - IN MONOLITH GUIDE BEAM MONITOR Data Chain: o Instrument control position components o Data acquisition data (from detectors + sample) o Data reduction transformation from instrument coordinates to science coordinates CHOPPER 1 CHOPPER 2 NEUTRON OPTICS - GUIDE NEUTRON OPTICS - POLARIZER BEAM MONITOR NEUTRON OPTICS - COLLIMATION FLIGHT TANK SAMPLE ENVIRONMENT CHOPPER 3 BEAM MONITOR DETECTOR -ARRAY
Data Acquisition, Reduction & Control Generic Framework NEUTRON TECHNOLOGIES o Instrument Control o Data Acquisition o Data Reduction & Visualization Choppers Motion Control Sample Environment Fast Sample Environment Detectors & Monitors Timing Bulk Data Readout (Detector Group) INTEGRATED CONTROL SYSTEMS Control Box DATA MANAGEMENT & SOFTWARE CENTRE Data Aggregator & Streamer ( ) User Control Interface Live, Local & Remote Data Reduction Automated Data Reduction Automated Data Reduction Instrument Control Room Data Analysis Interfaces Lund Server Room Copenhagen Server Room 11
The ESS Organization ESS BOARD OF DIRECTORS DIRECTOR GENERAL/CEO INFRASTRUCTURE DIRECTORATE MACHINE DIRECTORATE SCIENCE DIRECTORATE PROJECT SUPPORT & ADMINISTRATION DIRECTORATE CONVENTIONAL FACILITIES ACCELERATOR NEUTRON INSTRUMENTS GENERAL SERVICES SAFETY, HEALTH & ENVITONMENT TARGET NEUTRON TECHNOLOGIES HUMAN RESOURCES ENERGY SYSTEMS ENGINEERING SCIENTIFIC ACTIVITIES FINANCE INTEGRATED CONTROL SYSTEM SCIENTIFIC PROJECTS COMMUNICATIONS & EXTERNAL RELATIONS INTEGRATION & DESIGN SUPPORT DATA MANAGEMENT SOFTWARE CENTRE INFORMATION TECHNOLOGY LEGAL SUPPLY, PROCUREMENT & LOGISTICS
Data Management and Software Centre DMSC Mark E. Hagen Administration Petra Aulin System & Technologies Sune Rastad Bahn Data Management Tobias Richter Instrument Data Jonathan Taylor Data Analysis and Modelling Thomas Holm Rod
Data Management and Software Centre (DMSC) o Mission: To use the techniques and methods of scientific computing to facilitate, enable and advance the scientific research to be carried out using the neutron beam instruments at the European Spallation Source. o Two campuses: ESS Lund & ESS Copenhagen (Universitetsparken, Københavns Universitet) 14
The Niels Bohr Institute DMSC should support the full workflow from-idea-to-publication
The user community is diverse even for each instrument Occasional user Dedicated or geeky user The Niels Bohr Institute 16
Data Analysis & Modeling o Data on disk is useless! It is published results from the data that makes progress o Need to ensure that ESS users have access to appropriate software packages for data analysis the necessary computational resources to exploit the software to obtain those results analysis software during experiment to influence the data taking strategies o Roll out in-sync with instruments Structure of Nanomaterials K. L. Krycka et al. Core Shell Magnetic Morphology of Structurally Uniform Magnetite Nanoparticles PRL 104, 207203 (2010) Polarized SANS demonstrated that these nanoparticles have uniform nuclear structure but core-shell magnetic structure. Required development of both data reduction and data analysis methods and tools. 17
Support development of programs A set of virtual machines has been deployed for the purpose of building SasView, McStas, and other programs Jenkins is set up to be used for managing build jobs External partners can access build environment Web pages and repositories hosted by ESS 18
Some numbers (subject to change) o o o o Network link between Lund and CPH: 100 Gbit/s Data storage: 5-50 PBytes/yr Computing power for data reduction & data analysis: 2048 cores Numerous miscellaneous servers: Remote Data Access Remote Data analysis Software development servers User Office servers etc. 19
Nice pictures www.mantidproject.org 20
To sum it up Neutrons allow for unique new insights across all natural sciences European Spallations Source is a pan-european effort hosted by Sweden and Denmark DMSC is a division responsible for enabling scientist get the most out of their data for the benefit of the public. Nice pictures 21