Astrium GEO UK Multi-Mission PDGS Facilities and Services

Transcription

1 Astrium GEO UK Multi-Mission PDGS Facilities and Services

2 Introduction UK-MM-PAC ERS-1/2 UK-MM-PAC ENVISAT Data Hosting Activities Future Activities Infoterra Archives LTDP Preparation Collaborative Activities

3

4 UK-MM-PAC ERS-1/2 Since 1991 for ERS-1, Astrium GEO (then NRSC Ltd) have performed Processing and Archiving Facilities for ESA. In 1994 the facility was expanded to support ERS-2. Archiving of both HR (SAR) and LR (ATSR-1/2, ALT, GOME, WAVE,SCATT) On-Request SAR Processing Systematic ALT Processing Media types Exabyte Sony DIR1000 DLT STK9940B STK T10KB

5 UK-MM-PAC ENVISAT In 2002, UK-PAF became UK MultiMission Processing and Archiving Centre with the addition of ENVISAT operations Archiving of both HR (ASAR) and LR (AATSR, MERIS) On-Request ASAR Processing Systematic AATSR Processing On-Request MERIS Processing Systematic MERIS (MER_FRS) Processing Current Archive volume ~1.2 PB (Inc. ERS) Media types IBM NTP STK9940B STK T10KB

6 UK-MM-PAC Data Hosting The following datasets are made available to Users for FTP download ATSR-1 (L1B, L2, L2P) ~10TB ATSR-2 (L1B, L2, L2P) ~15TB AATSR (L1B, L2, L2P) ~22TB ERS ALT.WAP ~1TB ERS Wind Scatterometer ~1.5TB MERIS Reduced Resolution ~45TB Users granted access through the eoa-up and atsmerci-uk servers Access via 300 Mbps link Additionally, provide backup copy of GEOHAZARD dataset from Cloud

7 UK-MM-PAC Data Hosting Continued In addition to FTP Access to data, HTTP access to (A) ATSR and MERIS RR datasets is provided through two MERCI Servers atsr-merci-uk.eo.esa.int mer-merci-uk.eo.esa.int FTP downloads during Q ~75TB HMA Standards Summary Table

8 Future Activities SWARM APDF Following the launch in Q4 2012, Astrium GEO will provided operational support for the SWARM Mission using MMFI infrastructure Sentinel-1 Offline PAC Astrium GEO will shortly commence site preparation activities for the Sentinel-1 Mission including the provision of an LTA facility Support will also be provided for the commissioning of the PDGS following Launch Sentinel-2 Offline PAC Initial site preparation activities for the Sentinel-2 Mission will also be undertaken

9 The Sentinel LTAs will be interfaced to the PAC infrastructure via a set of web services. The LTAs have generic requirements 30 TB/Day I/O, transfer rate of min 220 Mbytes/sec, 10,000 files a day and max file size of 200GBytes. The Infoterra LTA for Sentinel 1 consists of Web services to realise the interface Fast Network Infrastructure Disk Cache to support fast IO Hierarchical Global File System to automate the archival and retrieval of products Tape Archive Tape Archive to support Long Term Storage Tape archive based on i6000 LTO robotics Support for all LTO 5,6 products Scalable ( 96 Drives 5300 Slots ) LTO technology to deliver an Open format and long roadmap

10 Sentinel LTA StorNext Distributed LAN Clients - upto 4 times NAS Performance plus resiliance against component and server failure Application Workstations Connecting via CIFS or NFS High Performance SAN Clients Linux, Windows, UNIX or Mac StorNext Management Servers Linux or Solaris Fibre LAN Fabric Switch Shared File System File System Metadata & cfg High Perfomance FC Disk StorNext Storage Manager Policy initiated movement of content between disk tiers and tape. Disk Array SATA Tape Library

11 Infoterra Archive Based around a Heterogeneous Global File system, supporting enterprise Hitachi Storage and Quantum robotics (i6k) and LTO 5 Tape Storage. Allowing for 150 TB online storage 0.7 PB Near line storage Aerial Photography ( 25cm, 12.5cm and 10cm), CIR, DEMs, DTM,s, Flood Data, OS Vector DataSets,LiDAR datasets, etc... Served to Customers/Users via Public Internet, OGC Web services, media or ftp. Also storage and distribution of national vector datasets as well as asset management and insurance applications.

12 LTDP Preparations The following activities are currently being undertaken Reviewing Archive content against catalogue Preparation for reading of all Archived media Verification of previously transcribed datasets against transcription records Identification of documentation Scanning of paper documentation Implemented virtualisation of Altimeter processing to generate ERS-1/2 ALT-WAP products Further virtualisation being assessed HMA Standards Summary Table

13 Collaborative Activities Working with ISIC CEMS Project The provision of computing infrastructure for access to largevolume EO and climate model datasets co-located with high performance computing facilities Collaboration of Commercial and academic resources Data integrity service and metadata infrastructure FP7 Charm project. Full vcloud virtualisation for service the commercial and academic user communities User can bring their own data to CEMS for inclusion in their environment and to develop mash ups using EO data sets