NOAA Direct Broadcast Real-Time Network: Current Status and Plans for Delivering Sounder Data to DRARS

Transcription

1 NOAA Direct Broadcast Real-Time Network: Current Status and Plans for Delivering Sounder Data to DRARS Liam Gumley (NOAA DB Demonstration Technical Manager), Bruce Flynn, Heath Skarlupka, David Santek, Kathy Strabala, Jordan Gerth, Jessica Braun, Mark Werner NOAA/CIMSS, University of Wisconsin-Madison Mitch Goldberg (NOAA JPSS Sandy Supplement Direct Readout Demonstration Program Manager), JPSS Program Scientist, NOAA WMO DRARS Meeting, Geneva, 2015/03/11

2 Project Overview The NOAA Direct Broadcast Real-Time Network is a demonstration of a method for providing low latency infrared and microwave sounder data to the NOAA National Weather Service. Started as a Sandy Supplement project to reduce risk of SNPP/JPSS gap by providing all available sounder data with much lower latency than stored mission data. Sustained by JPSS Program Science until NOAA decides on operational commitment based on a formal value assessment by NWS. The sounder data will be assimilated by the National Centers for Environmental Prediction (NCEP) and increase the percentage of polar data used in NCEP NWP models, provide backup in case of anomalies in polar global processing. The project presents an opportunity to expand the coverage of the DRARS network, particularly for advanced sounders (CrIS, ATMS, IASI, AIRS). 3/11/2015 NOAA Real Time Network 2

3 Polar sounder data usage in NCEP NWP Percent Used S-NPP JPSS GOAL NAM GFS Hourly Latency (Minutes) 3/11/2015 NOAA Real Time Network 3

4 DB Antenna Sites 3/11/2015 NOAA Real Time Network 4

5 DB Antenna Sites and Status Future Guam station is under consideration, along with direct download of data from JMA to reduce GTS latency and cover nearly all of the NH Pacific. 3/11/2015 NOAA Real Time Network 5

6 DB Antenna Hardware Honolulu Miami Madison NOAA antennas are Orbital Systems 2.4 or 3.0 meter dual X/L-band receiving SNPP, Metop, POES, Terra, Aqua, FY-3, and GCOM-W1. Other antennas are receiving SNPP, Aqua, and Terra. 3/11/2015 NOAA Real Time Network 6

7 Receiver and Server Rack X-band demodulator (Quorum) L-band demodulator (Quorum) Front End Server (Schedule, Capture) Local Processing Server (L1, L2, Web) Uninterruptible Power Supply 3/11/2015 NOAA Real Time Network 7

8 Data Ingest Level 0 data are ingested from each antenna site and stored at NOAA/CIMSS in the following formats: SNPP: CrIS and ATMS RDR files in HDF5 format Metop: Level 0 files in CCSDS format including ADMIN NOAA: HRPT files in Quorum format Aqua: AIRS, AMSU, and GBAD Level 0 files in CCSDS format SSEC ingests files automatically as soon as they are available. Site, Satellite, Sensor, Product, Filename, and Latency metadata are stored in a DBMS. 3/11/2015 NOAA Real Time Network 8

9 Ingest History to Date 3/11/2015 NOAA Real Time Network 9

10 Level 1 Processing Level 1B products are created for the following sounders: Suomi NPP: CrIS, ATMS Metop-A/B: IASI, AMSU, MHS, HIRS NOAA-15/18/19: AMSU, MHS, HIRS Aqua: AIRS, AMSU Data are processed centrally at NOAA/CIMSS via: Suomi NPP: CSPP SDR Metop-A/B: AAPP and OPS-LRS NOAA-15/18/19: AAPP Aqua: IMAPP 3/11/2015 NOAA Real Time Network 10

11 BUFR Conversion for NCEP Level 1C data are delivered in BUFR format. BUFR converters are provided by AAPP and NOAA (e.g., channel subsetting for CrIS/AIRS/IASI). 1. ATMS, AMSU, MHS, HIRS: AAPP L1C BUFR format is accepted by NCEP. 2. IASI: NCEP requires a 616 channel subset. NESDIS supplied software to create this subset in BUFR format. 3. CrIS: NCEP requires a 399 channel subset, with apodized radiances, TAI/UTC time correction, and land topography. NESDIS supplied software to create this subset in netcdf4 and then convert netcdf4 to BUFR. Transition to full spectral resolution will be considered based on user feedback. Duplicate data will be handled at NCEP as part of assimilation preparation. 3/11/2015 NOAA Real Time Network 11

12 3/11/2015 NOAA Real Time Network 12

13 System Latency to Date 3/11/2015 NOAA Real Time Network 13

14 NCEP Delivery/Usage Status 1. NCEP is routinely downloading the BUFR files and decoding them into their BUFR data tank files : (Continuous decoding of data and accumulation into BUFR database; large BUFR files holding 24 hours of data). 2. Datasets include CrIS, ATMS, IASI, AMSU, MHS, HIRS. 3. NCEP is assesing the data quality compared to their other sources (e.g., IDPS global data for CrIS and ATMS). 4. AIRS and AMSU are routinely processed to Level 1B at CIMSS, however some issues remain to be solved with BUFR file creation (using software provided by NESDIS). 3/11/2015 NOAA Real Time Network 14

15 Providing Data to DRARS 1. The NOAA Real-Time Network represents an opportunity to increase the coverage and availability of advanced sounder data (including CrIS, ATMS, IASI). 2. NOAA, EUMETSAT, and CIMSS have discussed a plan to demonstrate the ability to collect data from the NOAA network, create Level 1C and BUFR files, and send them to EUMETSAT for dissemination on EARS. NOAA Network Coverage EARS-CrIS/ATMS/IASI Coverage 3/11/2015 NOAA Real Time Network 15

16 Implications for DBRTN 1. BUFR files must be produced for all sensors in EARS-compatible format. 2. Sufficient bandwidth must be available between CIMSS and EUMETSAT. 3. Level 1B files must be provided to EUMETSAT for validation and verification. 4. Satellite overpass schedules must be provided to EUMETSAT for monitoring. 5. Site names must be present in the BUFR file names. 6. CIMSS and EUMETSAT must verify the installation of CSPP, AAPP, OPS-LRS, and any other required software. 7. CIMSS must collect monitoring statistics and automated error detection to ensure reliable system operation. 3/11/2015 NOAA Real Time Network 16

17 3/11/2015 NOAA Real Time Network 17

18 Issues and Questions 1. Data formats: Use AAPP BUFR as the standard? 2. Software versions: Do we need to use particular versions of CSPP and AAPP? 3. Latency and reliability: What are the requirements, goals, and expectations? 4. Transition to operations: If the demonstration is successful, how and when does it transition to operations? 5. Channel subsets for IASI and CrIS: Are the current EARS channel subsets sufficient or could more channels be used? EARS-CrIS is 399 channels; EARS-IASI is 366 channels and 300 PC scores. SNPP and JPSS CrIS will transition to higher spectral resolution, further impacting the 399 channel set. 6. Data validation and monitoring: Who will be responsible for routine monitoring of the EARS-CrIS, ATMS, and IASI products? 7. Bandwidth and duplicates: What are the bandwidth implications of adding data from the NOAA Network, including duplicates? 3/11/2015 NOAA Real Time Network 18

19 Summary 1. The NOAA DB Real Time Network is operational and is providing low latency infrared and microwave sounder data from SNPP, Metop, and NOAA satellites to NCEP. 2. Providing the same data to DRARS is achievable with modest technical changes, and cooperation between NOAA, EUMETSAT, and CIMSS. 3. We look forward to contributing to DRARS. 3/11/2015 NOAA Real Time Network 19