SGS System Requirements Review

Transcription

1 SGS System Requirements Review John Hoar Lausanne 09/06/2015

2 Quick recap The Science Ground Segment transforms measurements made by the Euclid instruments into data products ready for scientific use. This is achieved by a set of Processing Functions developed and run by Organisation Units and Science Data Centres This is supported by a set of smaller but still important tasks: Managing the Euclid Survey during the operations phase Ensuring that the instruments are operating correctly Archiving and distributing the Euclid data products The SGS is a collaboration between ESA and EC ESA provides the Science Operations Centre at ESAC, Madrid John Hoar Lausanne 09/06/2015 SRE-ODE Slide 2

3 SRR Overview The System Requirements Reviews was a major milestone for the SGS held by ESA Datapack: Full set of Processing Function requirements and validation plans Full set of SDC/SOC Development Plans Q: Is the SGS ready to start building the systems needed to meet its objectives? Review conducted between January and March documents delivered on-time All OUs and SDCs contributed First complete analysis of computing resources required based on OU input Full architectural description covering the whole SGS, with operations concepts Archive requirements and validation plans Revised Integration, Validation and Verification and Product Assurance Plans Revised management plans at SGS level John Hoar Lausanne 09/06/2015 SRE-ODE Slide 3

4 Key Facts Two panels (System and Science), 37 reviewers between these 2 panels, including experts from Euclid Science Team, ASI, CNES and CERN Review Item Discrepancy statistics: Major Minor Closed Closed with Action Total Science System Total The SGS is big, the data-pack was large and the panels were large There 67 documents and 37 reviewers: About 6 RIDs per document, 12 RIDs per reviewer. Issues for Review Board: Extrapolated LE3 computing resources greater than those foreseen (action taken: improve estimates, review requirements, review timeline for production/delivery) Use of LSST data unclear (closed: LSST use in SGS not in current baseline) Review successful; from 10 review objectives, 9 passed and 1 partially passed Work on-going to close actions John Hoar Lausanne 09/06/2015 SRE-ODE Slide 4

5 Science Operations Centre Status, Plans John Hoar on behalf of the ESAC Euclid team Lausanne 09/06/2015

6 SOC Role Scheduling Generate and manage the operational survey! Schedule instrument commanding requests from the Instrument Operations Teams! Monitor survey performance! MOC Interface Send pointing and instrument command requests to MOC! Receive science data and other mission products needed for the SGS from MOC! Data Archiving and Distribution Distribute Level 1 data to SDCs! Provide data processing support tools to EC! Provide exploration, visualisation and data access tools for astronomers! SOC Data Processing and Monitoring Generate Level 1 data products! Run quick analysis on the Level 1 data to check status of instruments and observations! Monitor trends of instrument performance! John Hoar Lausanne 09/06/2015 SRE-ODE Slide 6

7 SOC Status Scheduling Development of the Euclid Survey System (since 2013)! Mission planning concept being finalised with ESOC! Defining instrument commanding request scheme in line with instrument design! MOC Interface Advanced definition of the data exchange between the SGS and MOC! Participation in instrument and spacecraft, MOC reviews! Data Archiving and Distribution SOC Data Processing and Monitoring Prototype Archive system from SDC-NL installed at ESAC! Science archive development kickedoff (Tech demo during EAUG meeting this Wed, 14:30)! Next SGS Challenge involve Level 1 distribution from SOC! Development of Quick Look system started! Building experience through participation in test campaigns (e.g. NISP DM tests), detector working groups! John Hoar Lausanne 09/06/2015 SRE-ODE Slide 7

8 Key functions of the Euclid Archive The Euclid Archive provides: 1. Data product access and management for the EC community. 2. Community portal for scientific exploitation of the Euclid data. 3. Processing coordination tools for the SGS. 4. A distributed file system managing data across all SDCs and SOC. John Hoar Lausanne 09/06/2015 SRE-ODE Slide 8

9 Archive overview The EAS Data Processing System (DPS) stores the data product metadata including the locations of the data files.! It provides access to the data products to the EC members, including processing coordination, quality control and processing history tools.! DPS Euclid Archive System SAS The EAS Science Archive System (SAS) provides access to the Euclid data focused on the scientific use of the data.! Storage systems are provided by all the SDCs & SOC. All public data will be located at ESAC.!! DSS The EAS Distributed Storage System (DSS) is installed at all SDCs & SOC and manages the storage of and access to the data files generated by the pipelines.! Storage infrastructure located at SDCs/SOC John Hoar Lausanne 09/06/2015 SRE-ODE Slide 9

10 Major Archive users Euclid Archive System EC Data Processing Expert DPS SAS EC Astronomer DSS Astronomer Euclid pipeline: Computing infrastructure located at SDCs/SOC Storage infrastructure located at SDCs/SOC John Hoar Lausanne 09/06/2015 SRE-ODE Slide 10

11 Looking forward: Implementation Scheduling! Next release of Euclid Survey System with new Reference Survey! Define survey/instrument planning interfaces with the EC! Prototype implementation of the Commanding Request system! MOC Interface Detailed interface definition with MOC! Participation in MOC Requirements Review! Data Archiving and Distribution First release of EAS-DPS running at ESAC and ready to support SGS Challenges! First release of the EAS-SAS with test dataset! SOC Data Processing and Monitoring First release of the Quick Look system! Definition of Level 1 processing routines with instrument teams! Attendance/participation in relevant on-ground tests! John Hoar Lausanne 09/06/2015 SRE-ODE Slide 11

12 ESA Euclid Helpdesk A new helpdesk service is available for users of ESA services: Initial roll out to support problems accessing ESA sites: ESA Euclid Wiki (wiki.cosmos.esa.int/euclid) Subversion (euclid.esac.esa.int/svn) Euclid Mission Database viewer (euclid.esac.esa.int/epdb) Normally access to these resources comes with EC membership. No login required, just click Submit a Ticket and proceed John Hoar Lausanne 09/06/2015 SRE-ODE Slide 12

13 Thank You John Hoar Lausanne 09/06/2015 SRE-ODE Slide 13