Copernicus Space Component Data Access Architecture. Meeting with Austria 27 May 2014, Vienna

Transcription

1 Copernicus Space Component Data Access Architecture Meeting with Austria 27, Vienna

2 Copernicus Data Policy Users shall have free, full and open access to Copernicus dedicated Sentinel data and Copernicus service information The CSC Ground Segment architecture implements this policy, and includes an evolutionary approach to further enhance the data exploitation by the broad user community The CSC Ground Segment features dedicated data access infrastructure solutions, tailored to the needs of the various use typologies 2

3 Data Access A major undertaking A major European Earth Observation Ground Segment design challenge Systematic processing and availability of the complete acquired data corresponding to a sustained generation rate (24h/7d) of a continuous stream of 500Mb/s of user products (Sentinel-1,-2,-3 A series) Distributed interconnected network of centres (improved redundancy) Local centre access capacity built on top of a powerful and scalable network Including Big Data paradigm and use of innovative solutions Progressive inclusion of Research Support & Hosted Processing services Enhanced connectivity to international scientific network (e.g. GEANT) Federation of distributed data pick-up points to optimise proximity to end users 3

4 Use Typologies Copernicus Core & Downstream Services Copernicus Services Other EU needs assimilated to Copernicus services e.g. EMSA, EEA, EUSC, JRC Scientific /Other use Science use Public Value Adding use Commercial Value Adding use MSs CollGS ESA/EU Member States needs (Collaborative GS) ESA funded R&D projects Int l Agreements International Agreements 4

5 CSC GS Data Access CSC Ground Segment Data Access Tailored infrastructures adapted to different user typologies Copernicus Services Access Scientific / Other Access International Agreements Access MSs Collaborative Access Operated by int. partners Operated by MSs Copernicus Services International International Mirrors Mirrors Int l (Inc local Access station) National Mirrors (Inc National local National station) Mirrors (Inc local station) Access Scientific/ Other users e.g. scientific, commercial outreach, general public International users MSs CollGS Users e.g. public, scientific, commercial ESA funded R&D projects 5

6 Copernicus Services Data Access Copernicus Services data access infrastructure, provides access with binding performances All Sentinels core products will be accessible within their specified timeliness Furthermore access to Copernicus Contributing Missions data will be available according to the provisions of the Datawarehouse Traceability document and the CSCDA Terms and Conditions The access to the infrastructure will be via the user available bandwidth to the CSC WAN network backbone, this latter with committed reliability and performance User registration will be based on a user request, verified according to the relevant eligibility criteria as defined in the Data Warehouse document Copernicus Services 6 Access

7 International Agreements Data Access International Agreements data access infrastructure, provides access with target performances A rolling on-line archive covering the last month(s) of Sentinels core products, available within their specific timeliness, will be accessible The time interval covered by this rolling archive will be scalable and include at least the last month of data. Furthermore, access to off-line archived data will be available on-request and limited by the financial allocation assigned to this task as defined in ESA annual workplan The access to the infrastructure will be via the user available bandwidth to a dedicated dissemination bandwidth, this latter with committed reliability and performance User registration will be based on a user account pre-registration, with a dedicated single account per agreement International Agreements 7 Access

8 Scientific/Other use Data Access Scientific/Other use data access infrastructure provides access with intended not binding performances A rolling on-line archive covering the last month(s) of selected Sentinels core products will be accessible. The time interval covered by this rolling archive will be scalable and include at least the last month of data The access to the infrastructure will be via the user available bandwidth to a dedicated dissemination bandwidth, this latter with planned not binding reliability and performance The data access will be configured to avoid resources saturation resulting from massive downloads by a limited number of users (e.g. maximum number of parallel downloads, maximum volume per retrieval, ) User account creation will be based on user self-registration, with a limited number of information fields (e.g. name, password, , ) Scientific / Other Access 8

9 Member States Collaborative Data Access National ESA and EU Member States data access infrastructure, provides access with target performances A rolling on-line archive covering the last month(s) of Sentinels core products, available within their specific timeliness, will be accessible. The time interval covered by this rolling archive will be scalable and include at least the last month of data Furthermore, access to off-line archived data will be available on-request and limited by the financial allocation assigned to this task as defined in ESA annual workplan The access to the infrastructure will be via the user available bandwidth to a dedicated dissemination bandwidth, this latter with committed reliability and performance User registration will be based on a user account pre-registration, with a dedicated single account per requesting Member State MSs Collaborative 9 Access

10 Common User Service Charter The CSC Ground Segment provides a set of main services to all users, independently from the access infrastructure User REGISTRATION and MANAGEMENT DISCOVERY Service VIEW Service DOWNLOAD Services Management of user accounts Dataset and product search + visibility of planned acquisitions Visualization of browse image Interactive Download via web browser or the Download Manager. Systematic background download based on defined filters EMERGENCY Service DATASET GENERATION Service HELP DESK Service RSS and HOSTED PROCESSING Service Opening of an emergency dossier upon user call and management of data collection (tasking, selection from archive). Restricted to eligible users Generation of geographical/temporal data collections according to pre-defined interest/application Support and communications to users including dedicated Web Portal. Management of inquiries, feedback, and suggestions. Research Support Service and Hosted Processing Service operations 19/03/

11 Current Status and outlook The CSC GS data access infrastructure and user service charter is available to support the Sentinel-1A initial operations User can already self-register for data download by logging into sentinel.esa.int This first pre-operational configuration will be the basis for monitoring and consolidating the user scenario Yearly upgrades of the infrastructure and users Service Charter are foreseen to progressively integrate new Sentinels and quickly adapt to evolving user needs A set of mid/long term enhancements have already been identified to anticipate some of these future needs Strong synergies with ESA R&D activities related to Big data and GS evolution Close coordination with European Commission and Member States is envisaged to ensure needs of Copernicus core users and National Collaborative Ground Segments are feedback into the CSC GS evolution 11

12 Copernicus Contributing Missions SPOT (VGT) COSMO-Skymed PROBA-V TerraSAR X Tandem-X Radarsat DMC Pléiades Copernicus Contributing Missions Cryosat Deimos-2 RapidEye Atmospheric missions Jason SPOT (HRS) And many others MetOp Meteosat 2 nd Generation 12

13 Copernicus Pre-Operations: Data Access Status The Copernicus Space Component Data Access (CSCDA) System provides since 2008 comprehensive and coordinated access to EO data products from multiple satellites to Copernicus space data users across Europe The CSCDA manages the coordinated production of Data Sets: multi-mission coherent data collections pre-defined according to specific user needs in terms of data type and mode of operation The key component of the CSCDA is the Coordinated Data Access System (CDS), ensuring Data Set construction and dissemination by coordinating the CCMs production and dissemination flows

14 DWH version 1: current implementation status The implementation of the DWH version 1 is progressing Contracts with the current Copernicus Contributing Mission have been extended until November 2014 However, significant increase in ADDITIONAL dataset quota consumption by GMES Services has been observed over past 12 months In order to re-assign and optimise remaining funds, the European Commission has provided to ESA a new quota table together with a priority scheme, that is currently being assessed

15 Data flow from Sentinels and Contributing Missions to the users

16 some examples Coverage#1 (GAF AG/Euromap): IRS-P6 and Resourcesat during summer months Level 1B, 23.5m Level 3, 20m, national projection Level 3, 25m, EU LAEA projection Coverage#2 (Blackbridge/RapidEye): RapidEye constellation during summer months Level 1B, 6.5m Level 3C, 5m UTM Level 3C, 20m, national projection Level 3C, 25m, EU LAEA projection

17 some more examples Coverage (Airbus Defense & Space): SPOT-5 at 2.5m pan-sharpened SPOT-6 at 1.5 m pan-sharpened National projections & EU LAEA projection Coverage (GAF AG/Euromap): IRS-P6 and Resourcesat-2 AWIfs 60m resolution monthly coverages EU LAEA projection

18 DWH version 1: ADDITIONAL datasets quota consumption evolution

19 DWH version 2: planning The Data Warehouse document v2.0 defines the user requirements for the period Document issued by the European Commission on 5 March 2014 Based on the DWH, ESA derives detailed technical specifications for CORE and ADDITIONAL datasets, described in the Data Access Portfolio (DAP) The DAP considers technical feasibility, availability of Contributing Missions and budgetary constraints The technical specifications will be part of the procurement of Contributing Missions data The CCM data procurement Open Tender schedule foresees Issue of Invitation To Tender: July 2014 Proposals due date: September 2014 Evaluation and TEB: October 2014 Negotiation and kick-off: Nov 2014 / February 2015

20 DWH version 2: status The DWH v2 contains requirements that need further iteration since they are likely not achievable by current/future missions In addition, acquisition of new European optical coverages is requested to start already as of March 2014 In the absence of a signed EU-ESA Copernicus agreement and the release of the related budget, ESA can not procure now these new large coverages The Commission has proposed to acquire the related licences at the end of 2014 relying on CCMs speculative tasking and archived data ESA has informed accordingly Copernicus Services and Contributing Missions

21 CSC Data Access portal: Access to many CCM data is free upon registration of eligible users for EU Public Authorities (incl. Research)

22 How to access data

23

24

25

26

27

28

29