Copernicus Space Component Ground Segment and Opera4ons Concept

Transcription

1 Copernicus Space Component Ground Segment and Opera4ons Concept G. Kohlhammer, P. Bargellini, E. Monjoux Ground Segment and Mission Opera=ons Department, Earth Observa=on Programmes Directorate, European Space Agency

2 Outline Opera=ons Phase Overview Opera=ons Strategy Ground Segment Architecture Sen=nels Collabora=ve Ground Segment Sen4nel- 1, - 2, - 3 Data Access

3 Copernicus Pre- Opera4ons Status Several Copernicus Core and Downstream services, and addi=onal EU Agencies applica=ons are today in Pre- Opera=ons The GMES Space Component Data Access (GSCDA) System provides since 2008 comprehensive and coordinated access to EO data products from mul=ple satellites to Copernicus space data users across Europe The key component of the GSCDA is the Coordinated Data Access System (CDS), ensuring Data Set construc=on and dissemina=on by coordina=ng the Copernicus Contribu=ng Missions (CCMs) produc=on and dissemina=on flows Sen=nel Space and Ground Segment development is on track for upcoming launch of the A units

4 Opera4ons Phase Defini4on The CSC Opera=ons Concept refers to the period from mid 2014 onwards An ini=al ramp- up phase is envisaged marking the transi=on towards the Full Opera=onal Capability This phase is characterised by a progressive integra=on of each Sen=nel spacecrav in the overall system A gradual evolu=on is foreseen in the performance ü of the availability of the overall system ü of the data throughput and =meliness ü of the services to users Increasing observa=on =me sensing minutes per orbit example of high bit rate instrument observa=on =me evolu=on S1A S1B 0 Mar- 14 Jul- 14 Nov- 14 Mar- 15 Jul- 15 Nov- 15 Mar- 16

5 Opera4ons Strategy Main objec4ves of the Sen4nels opera4ons strategy: Reliable provision of data to Copernicus users Ensure systema=c and rou=ne opera=onal ac=vi=es: with a high level of automa=on with pre- defined opera=ons to the maximum extent possible Sen4nels opera4ons approach: Sen=nels are operated via a pre- defined background observa=on and downlink plan: Scenario is updated on a regular basis (e.g. 6- months) taking into account user requirements evolu=on Generally no on- demand planning is allowed All Sen=nels acquired data is systema4cally downlinked and processed to generate a predefined list of core products within specific =meliness

6 Ground Segment Architecture Operating today

7 Core and Collabora4ve Ground Segment The Copernicus Space Component (CSC) Opera=ons Concept relies on a Ground Segment consis=ng of: A CSC (Core) Ground Segment, with CSC- funded Func=ons and Elements, providing : the primary access to Sen4nel Missions data as well as the coordina=ng access func=ons to Contribu4ng Missions data fulfilling the Sen=nels Mission Requirement Documents a Sen4nel Collabora4ve Ground Segment, with non CSC- funded Func=ons and Elements, providing: a supplementary access to Sen4nel Missions data, i.e. either through specific data acquisi=on services, or specific data products the frame for coopera=on

8 CSC Core Ground Segment Func4ons Main Facili4es include: Sen=nel Flight Opera=ons Segment (FOS) for spacecrav monitoring/control Sen=nel Data Acquisi=on and Near Real Time Product Genera=on Sen=nel Processing and Archiving Centres (PACs) Sen=nel Mission Performance Centres (MPCs) Sen=nel Precise Orbit Determina=on Service (POD) Sen=nel Payload Data Management Centre (PDMC) Coordinated Data Access Systems for Sen=nel and CCMs include: CSC Gap and EO data requirements analysis tools and systems CSC Mul=- Mission Mission Planning and scheduling CSC User Services, e.g. Registra=on, Helpdesk, Account Management CSC End to End Monitoring and Control including Repor=ng

9 Core Ground Segment Layout 4th Polar X- Band Sta4on Fight Opera4ons Segment (FOS) Svalbard X- Band sta4on & NRT Centre ESOC- EUM FOS Madrid POD Maspalomas X- Band sta4on & NRT Centre X- Band Sta4ons & Near Real Time Processing Centre (CGS) Payload Data Management Centre (PDMC) ESRIN PDMC Matera X- Band sta4on & NRT Centre Precise Orbit Determina4on Service (POD)

10 Core Ground Segment Layout Infoterra UK Farnborough CLS Brest CDB CDB CLS Toulouse Indra Madrid CDB Eumetsat Darmstadt CDB CDB ACRI Nice DLR CDB Oberpfaffenhofen Archive and Offline Processing Centre Mission Performance Centre (MC) CDB

11 Ground Circula4on and Dissemina4on Network Dissemination Network Internet Firewall & CPE User Circulation Network CDB Other services Mirror Sites, CDN, Cloud CDB Network Infrastructure highly scalable: 10 Gbps Poten4al access for specific opera4onal needs : e.g. Core Service or Coll. GS Element The PDGS core func=ons acquisi=on, produc=on, preserva=on do not impact the user access Complete dissemina=on includes the EUMETCAST broadcast services for S3 Marine products

12 Sen4nels Collabora4ve Ground Segment Ø Dissemina=on of data through collabora4ve agreements allows further valorising the development of opera=onal ground segment func=on complemen=ng the CSC Core Ground Segment Ø The collabora=on provides a frame for specialised solu4ons to further enhance the Sen=nels missions exploita=on in the area of: 1. Sen=nels data acquisi=on and Quasi/Near Real Time produc=on (Local sta=ons) 2. Complementary collabora=ve data products and algorithms defini=on 3. CSC data product dissemina=on and access (e.g. mirror sites) 4. Development of innova=ve tools and applica=ons 5. Complementary support to Calibra=on/Valida=on ac=vi=es Ø The collabora=on will rely on the defini=on of formal agreements as well as the implementa=on of dedicated opera=onal interfaces

13 ESA Member States Collabora4ve Ground Segment process Implementa=on of the Sen=nels collabora=ve GS within ESA member States is based on 3 main steps: 1. Defini4on of process and collec4on of collabora4on proposals Requirements collec=on: ques=onnaire for ESA Member States released in 2011 Enables ESA to make a preliminary assessment of the planned ini=a=ves 2. Proposal technical feasibility analysis Execu=on of simula=on scenarios. Iden=fica=on of poten=al conflicts Proposal refinement with collabora=ve partner 3. Formalisa4on of collabora4on Document the technical opera=onal interfaces Integrate, verify and validate the derived implementa=on Implementa=on of the collabora=ve GS with interna4onal partners will follow a similar process, lead by the European Commission supported technically by ESA

14 Sen4nels Core Products Sentinel-1 Sentinel-2 Sentinel-3 PDGS Core production for users dissemination & retrieval SAR L0 - - SAR L1 SLC MSI L1B OLCI L1 SAR L1 GRD MSI L1C SLSTR L1 SAR L2 OCN (waves, wind, radial velocity) (*) OLCI Water Color L2 OLCI Land L2 SLSTR Water L2 SLSTR Land L2 SRAL L2 Synergy/Vegetation L2 (*) Toolbox for atmospheric correc5ons provided to support users in L2 produc5on Corresponding average produc=on rate (24h/24h) Corresponding User products Sen=nel 1A * 150 Mb/s L0 & all L1 Sen=nel 2A * 200 Mb/s All the different L1 Sen=nel 3A 200 Mb/s L1 & L2 (*) based on average 15min downlink/orbit

15 Sen4nels- 1, - 2, - 3 Data Access Overview! P. Bargellini, E. Monjoux European Space Agency

16 Sen4nel Data Access A Collec4ve Vision September 2009: ESA Member States approve the Joint Principles for a Sen=nel Data Policy based on a free, full and open access to Sen4nel data July 2013: this data policy approach is confirmed by the European Commission through the issue of a dra^ Delegated Regula4on establishing registra=on and licensing condi=ons for Copernicus users and defining criteria for restric=ng access to Copernicus dedicated data and Copernicus Service informa=on Summer 2013: the European Commission agrees to elaborate and implement together with ESA a plan for serving not only the Copernicus Services but a wider user base, taking into account the diversity of the Sen=nel data user community and the objec=ves set in the EU Copernicus Regula=on A collec=ve Vision takes shape within and beyond Europe Maximise access and exploita4on of the Copernicus Space Component (CSC) data by the broad Regional, Na4onal, European and Interna4onal user community

17 Data Access Assembling the Puzzle The Copernicus Space Component (CSC) Data Access determines and is determined by: q Programma=c and financial framework è including co/mixed- funding, industrial policy, interna=onal agreements q Sen=nels and Copernicus Contribu=ng Missions Data Policies defini=on è Including ownership of data and derived knowledge, licencing condi=ons q User typologies è Including specific data needs, support requirements, priori=es q Space and Ground Segment architecture and technical constraints è Including design, implementa=on, interfaces, technology q Opera=onal Concept è Including observa=on scenario, data acquisi=on and processing approach, archiving and preserva=on, data quality and delivery =meliness Pieces of a jigsaw puzzle that are being assembled to ensure seamless access to CSC data by an heterogeneous user community

18 Programma4c Framework CSC data access funding q Development of the CSC data dissemina=on plaiorms is co- funded by the European Union and the European Space Agency q Opera=ons of the CSC overall and its data dissemina=on plaiorms are funded by the European Union (EU- ESA Agreement to be finalised in 2014) q Opera=ons of the CSC data access points in support of ESA s Member States Sen=nels Collabora=ve Ground Segment are funded by ESA MS Collaborative Agreements q ESA is establishing collabora=ve agreements with its MS as concerns Sen=nel data access q Similarly EU will lead the establishment of interna=onal collabora=ve agreements. ESA will provide technical support Sentinel data ownership q Sen=nels ownership, including data, is currently with ESA q Transfer of ownership to the EU is envisaged during the ini=al opera=ons phase

19 Copernicus Data Policy Regula4on Copernicus Data Policy is legally established in the related European Commission draft Delegated Regulation which defines: q Condi=ons for full and open access to informa4on produced by the Copernicus services and of data collected through the Copernicus dedicated infrastructure (e.g. Sen=nels spacecrav) q Criteria for restric4ng access to that informa=on and data q Condi=ons for user registra4on Users shall have free, full and open access to Copernicus dedicated Sentinel data and Copernicus service information

20 Copernicus Data Policy Regula4on q To access download services, users shall register online on the Copernicus dissemina=on plaiorms. Registra=on shall be free of charge. Registra=on is not required for discovery services and view services q Access to Copernicus dedicated data and Copernicus service informa=on shall be given for the purpose of the following use in so far as it is lawful: reproduc=on, distribu=on, communica=on to the public, adapta=on, modifica=on and combina=on with other data and informa=on q Specific restric=ons may be applied mainly where the open dissemina=on of Copernicus dedicated data and Copernicus service informa=on presents an unacceptable degree of risk to the security interests of the EU or its Member States q Where the requests for access exceed the capacity of the Copernicus dissemina=on plaiorms, access to Copernicus resources may be reserved to specific user typologies (e.g. public services, industry, research organisa=ons, )

21 Use Typologies Copernicus Core & Downstream Services Copernicus Services Other EU needs assimilated to Copernicus services e.g. EMSA, EEA, EUSC, JRC Science use EU MSs + Public Value Adding use Commercial Value Adding use Other use ESA Member States needs (Collaborative GS) ESA funded R&D projects International Agreements

22 Data Access A major undertaking A major European Earth Observation Ground Segment design challenge q Systema4c processing and availability of the complete mission within the day è corresponding to a sustained genera=on rate (24h/7d) of a con=nuous stream of 500Mb/s of user products (Sen=nel- 1,- 2,- 3 A series) q Distributed interconnected network of centres è ensuring a global redundant and balanced produc=on and archival approach q Local centre access capacity built on top of a powerful network backbone è 10Gb/s bandwidth with several Gb/s network access at single centres Successful thanks to efforts of European Industry q q Sen=nel- 1 Centres and produc=on capacity successfully deployed and tested to support the launch and commissioning campaign Sen=nel- 2 and Sen=nel- 3 ground segments under nominal development life- cycle

23 Sen4nel Data Access Different infrastructures adapted to different needs ESA Operated for S1, S2, S3 Land & EUMETSAT operated for S3 Marine access Produc=on Layer Data Access Layer Scien=fic / Other Use Infrastructure Sen=nel data made available thanks to the opera=ons of core produc=on, archiving and retrieval systems and facili=es Copernicus Services Infrastructure ESA Collabora=ve Infrastructure EU Interna=onal Agreements Infrastructure Na=onal Mirrors Na=onal Mirrors Na=onal (Inc local Mirrors sta=on) (Inc local sta=on) (Inc local sta=on) Operated by ESA MSs Interna=on Interna=onal al Mirrors Interna=onal Mirrors (Inc local Mirrors sta=on) (Inc local sta=on) Operated by int. partners Tailored data access infrastructures serving different user needs

24 Sen4nel Data Access Different infrastructures adapted to different user typologies Data Access Layer Scien=fic / Other Access Copernicus Services Access ESA Collabora=ve Access EU Interna=onal Agreements Infrastructure Operated by ESA MSs Operated by int. partners Copernicus Services Na=onal Mirrors Na=onal (Inc Mirrors local sta=on) (Inc Na=onal local sta=on) Mirrors Interna=on Interna=onal al Mirrors Interna=onal Mirrors (Inc local Mirrors sta=on) Scien=fic / Other users ESA MSs Collabora=ve Users ESA funded R&D projects Interna=onal users The Sentinel Data Policy and the funded operational accesses offer a dedicated access per user type potentially complemented by additional data retrieval points

25 Data Access Service Infrastructure Copernicus Services Copernicus Services Access Committed performances for Copernicus services operations (Operations based on service level agreements funded by EU Copernicus operations MFF budget) Registration based on a user request verified according to EU eligibility rules The free data access include: Access to NRT/24h and consolidated Sentinels products Access to the different Copernicus Contributing Missions data On-demand production Access via user available bandwidth to the Copernicus backbone with committed reliability performances EUMETCAST access for Sentinel-3 marine products Dedicated data sets generation (CORE DATASETS e.g. land coverage) Possibility of requesting ADDITIONAL DATASETS Full time access to emergency services (24h/7/365, incl. rush mode) (for authorized users) Service Desk support through dedicated user account management Access to GCMs data, according to GSCDA Terms and Conditions Access Points ESA & EUMETSAT catalogues & dedicated servers, EUMETCAST services for Sentinel-3 Marine

26 Data Access Service Infrastructure ESA Collabora4ve Access ESA Collabora=ve Access Targeted performances to support ESA Member States (Operations defined through dedicated agreements for a limited number of interfaces funded by ESA GMES Segment-3 budget) User account pre-registration based on the terms of agreement The free data access include: Access to a dedicated rolling archive of the Sentinel NRT/24h and consolidated Sentinels products Access via user available bandwidth to a dedicated dissemination bandwidth with committed reliability and performances Dedicated support for limited on-request data set generation or ondemand processing Access Points Rolling archive Data Hub server supporting dedicated product discovery and ftp & http downloads

27 Data Access Service Infrastructure EU Interna4onal Agreement EU Interna=onal Agreement Targeted performances to support EU International Agreements (Operations defined through dedicated agreements for a limited number of interfaces funded by EU Copernicus MFF budget) User account pre-registration based on the terms of agreement The free data access include: Access to a dedicated rolling archive of the Sentinel NRT/24h and consolidated Sentinels products Access via user available bandwidth to a dedicated dissemination bandwidth with committed reliability and performances Dedicated support for limited on-request data set generation or ondemand processing Access Points Rolling archive server supporting dedicated product discovery and ftp & http downloads, EUMETCAST services for Sentinel-3 Marine

28 Data Access Service Infrastructure Scien4fic and other use Scien=fic / Other Use of Sen=nel data Shared and open resources for scientific and other use accesses (Access funded by EU Copernicus budget and granted to all potential users to be confirmed) User self-registration The free data access includes: Access to a dedicated Rolling Archive of a consolidated production baseline (products availability may be deferred) Access via user available bandwidth to a dedicated dissemination bandwidth ensuring gateway to the scientific GEANT backbone Access configured to avoid resources saturation resulting from massive downloads by a limited user community (e.g. maximum number of parallel downloads, maximum volume per retrieval, ) Access Points Rolling archive server supporting dedicated product discovery and http downloads, EUMETCAST services for Sentinel-3 Marine

29 Sen4nel- 1 Users Opera4ons prepara4on Sentinel-1 Test & Reference data (Access granted to all potential users) q Test data sets to support launch prepara=on provided through the respec=ve accesses è V1 is available (format descrip=on and representa=ve products): hmps://scihub.esa.int/ è V2 available this Autumn (launch format version and representa=ve products) q Instrument reference data sets will be available all along the mission life=me star=ng from the commissioning opera=ons è Data sets over selected areas will be collected (e.g. super sites) as soon as the instrument and the data will be considered sufficient for exploita=on prepara=on q Detailed =meline for provisions of data to users during commissioning and ramp- up will be made published prior to launch q User tools will be available to support product exploita=on (e.g. ENVISAT user toolboxes evolu=on) è Consolidated version planned for the end of the instrument commissioning phase è Product Readers available before S1- A launch q Local rolling archive management environment q q Support Tools (Access granted to all potential users) Prototype services for hosted processing are under consolida=on (target: Launch +1 year on reference data sets) Sen4nel Online technical Web portal: hmps://sen=nel.esa.int Similar approach planned for Sen=nel- 2, - 3 and - 5 Precursor to support user readiness

30 Data Access Future Evolu4on A progressive evolution of the Data Access infrastructure is already foreseen for deployment in the timeframe Adap=ng the data access to the user demand q Based on the EU decision to enlarge the user basis, enhancements are prepared along the following lines: è Adapt the access capacity to the measured user scenario è Reduce the need of products download è Increase reprocessing flexibility è Enlarge access to the archived data Data Access Infrastructure Scalability q Built- in system scalability will be used to adapt the different data access infrastructures è Network centre configura=on scalable within the 10Gb/s range q Large & distributed complementary pick- up points will be prototyped to reach a new range of poten=al scalability Hos=ng access q New opera=onal paradigm will be prototyped to reduce the need to transfer the products è Demonstra=on capacity for user processing hos=ng capability will be setup on S- 1 reference data sets, (e.g. reusing exis=ng ESA projects) q Research support service will be introduced to support (big) data access

31 Data Access Future Evolu4on Research Support Service Lessons learned from ENVISAT and the Earth Explorer Missions (*) q When large amounts of data are at stake, scien4fic data exploita4on and research ac4vi4es require a research support service that provides the scien=st with algorithm integra=on and data processing competences and resources; q The user can concentrate on the algorithm development and evolu=on whilst the data is temporary available for his/her processing needs (*) A MODEL FOR THE SCIENTIFIC EXPLOITATION OF EARTH OBSERVATION MISSIONS: THE ESA RESEARCH AND SERVICE SUPPORT, IEEE Geoscience and Remote Sensing Newslefer, March 2012 pp.10-18

32 Data Access Future Evolu4on Research Support Service q The service responsibility would in: è Interac=on with Principal Inves=gators è Algorithm understanding and support to computa=onal op=miza=on è Resources planning (data, storage, integra=on, capacity, etc) è Algorithm integra=on (por=ng, design, implementa=on, test) è Management of data provision (access, replica, caching, coverages) è Processing environment set- up è User support (for on- demand processing) è Bulk Processing management q The required infrastructure comprises: è Compu=ng and cloud based resources è Network and security needs within the already planned capacity q The main benefits introduced by the support services are: è No cost to move and process same data è Algorithms runs on large data amounts è Access to cloud resources for flexible capacity(e.g. to meet demanding deadlines)

33 Further Informa4on During Living Planet Symposium: ESA staff will be available at the GMES/ Copernicus stand to answer ques=ons and provide further informa=on Sen=nel- 1, - 2, - 3 Data Access unveiled: full presenta4on will be made available in GSCDA and Sen=nel Online websites Copernicus Space Component Data Access Opera=ons Website hmp://gmesdata.esa.int/web/gsc/home Sen4nels Online Webportal hmps://sen=nel.esa.int Copernicus Space Component Website hmp:// Copernicus Programme Website hmp://copernicus.eu