AMESD/PUMA SYNERGIE-PUMA Reference: MFI-C0218-04C-ADM-EN Issue: V1.0
Creation Responsibilities Name - Function Date Written by Loïc Le Gallou Technical manager May 20, 2010 Authorized by Loïc Le Gallou Technical manager May 20, 2010 Modifications Issue Date Modified by Modified Description of evolution pages 1.0 May 20, 2010 IE N/A Initial version Meteo France International Page 2
Table of contents FOREWORD... 5 1 PRESENTATION... 7 1.1 SYNERGIE-PUMA... 7 1.2 MAIN FEATURES... 7 1.3 SYSTEM OVERVIEW... 9 1.4 ADMINISTRATOR ROLE...11 1.5 SYSTEM OPERATION LIST: HOW TO?...12 2 OVERALL SYSTEM...13 2.1 SYSTEM DESIGN...13 2.2 SOFTWARE STRUCTURE...19 2.3 MAIN OPERATIONS...20 3 ACQUISITION MODULE: TELLICAST...27 3.1 MODULE PURPOSE...27 3.2 HOW DOES IT WORK...27 3.3 SOFTWARE STRUCTURE...28 3.4 OPERATIONS...29 4 PRE-PROCESSING AND DISTRIBUTION MODULE: FRAC...33 4.1 MODULE PURPOSE...33 4.2 HOW DOES IT WORK...33 4.3 SOFTWARE STRUCTURE...36 4.4 OPERATIONS...40 5 SATELLITE IMAGE PRODUCTION MODULE: ARCHIPEL...48 5.1 MODULE PURPOSE...48 5.2 HOW DOES IT WORK...48 5.3 SOFTWARE STRUCTURE...50 5.4 OPERATIONS...55 6 VISUALISATION DATABASE: SYNERGIE SERVER...66 6.1 MODULE PURPOSE...66 6.2 HOW DOES IT WORK...66 6.3 SOFTWARE STRUCTURE...68 6.4 OPERATIONS...70 7 VISUALIZATION GUI: SYNERGIE CLIENT...73 7.1 MODULE PURPOSE...73 7.2 HOW DOES IT WORK...73 Meteo France International Page 3
7.3 SOFTWARE STRUCTURE...74 7.4 OPERATIONS...75 8 ANNEXES...78 8.1 LINUX USEFUL COMMANDS...78 8.2 SATELLITE PRODUCTS DATA LIST...80 8.3 ARCHIPEL CHAIN: DESCRIPTION OF THE APPLICATIONS...92 8.4 POWER FAILURE STRATEGY...102 Meteo France International Page 4
FOREWORD Scope of this document This document contains the main indications to administrate SYNERGIE-PUMA system. Audience of the document The present manual is intended for administrators of the SYNERGIE-PUMA system. Software release This document is based on SYNERGIE-PUMA V1.0 System requirement The system is based on Linux CentOS 5.4 Applicable documents Synergie User Manual Synergie-PUMA Installation Manual Glossary Application Archipel CMS crontab daemon decompx ebs EFTS EUMETCast EUMETSAT fmsgd FRAC FTP HRIT ICF LRIT MSG Product RPM SAMBA Program dedicated to satellite data processing Data-oriented system, processing all data received by acquisition station. Spatial Meteorological Centre located at Lannion, France Configuration file that specifies shell commands to run periodically on a given schedule Program that runs in the background FRAC component: Decompression tool. Eumetsat Broadcast System: user of the FRAC module: Extended File Transfer Software (EFTS). Software edited by EUMETSAT in charge of data distribution and data transmission EUMETSAT s Broadcast System for Environmental Data, is a multi-service dissemination system based on standard Digital Video Broadcast (DVB) technology. It uses commercial telecommunication geostationary satellites to multicast files (data and products) to a wide user community. The main purpose of the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT) is to deliver weather and climate-related satellite data, images and products 24 hours a day, 365 days a year MSG (Meteosat Second Generation) frontal, producing Image Cycle Files from data issued in the form of segments. FRontal ACquisition module File Transfer Protocol High Rate Information Transmission: MSG format Image Cycle Files: data issued in the form of segments, and then stored are then assembled to form cycles Low Rate Information Transmission: MSG format Meteosat Second Generation Elaborated meteorological data Redhat Package Manager Software that implements several protocols including (SMB/CIFS) Meteo France International Page 5
SEVIRI SSH Synergie Tellicast UMARF XRIT High resolution sensor Secure Shell: communication protocol User-oriented system associating meteorological data visualization and forecasting tools. EUMETCast Client Software. This software performs the following processes: - decryption of data based on a key code - error correction and management of received files. Eumetsat archive catalogue (Unified Meteorological Archive and Retrieval Facility) MSG format (High or Low Rate Information Transmission) received by EUMETCast Meteo France International Page 6
1 PRESENTATION 1.1 Synergie-Puma The Meteosat Second Generation (MSG) of satellites has been the catalyst for the Preparation for Use of MSG in Africa (PUMA) project, an international collaborative venture which provides the continent s National Meteorological and Hydrological Services with operational access to state-of-the-art satellite technology. PUMA has created a pan-african network of countries and regional centres and equipped them with the infrastructure, training and support required for receiving the latest space-based meteorological and environmental data, images and products from EUMETSAT via the EUMETCast distribution system. (EUMETSAT PUMA presentation) The SYNERGIE-PUMA system is the new PUMA project solution for receiving, processing and displaying data from the EUMETCast Africa dataflow. It is based on SYNERGIE forecasting workstation system. This manual describes how the SYNERGIE-PUMA system works and how to operate it. The first part gives a general presentation. The second part presents the overall architecture of the system and how it is organized in several modules. Part three until seven describe each module of the system: how it works, what are the relevant files and directories, and how to make module s operations. 1.2 Main features Hardware The SYNERGIE-PUMA system is based on three PC computers, running on Linux CentOS 5.4. Each PC is dedicated to a specific task: data acquisition, data processing and visualization. Software installation and update Each computer is easy to install thanks to a DVD master: just boot on the DVD, let it install everything automatically, and run the configuration program to define computer mode and the local settings. A software update mechanism is also available which use the reception of patch file through EUMETCAST dissemination (rpm files). Administrators are notified by the system when a new patch is available and just have to apply it with the patch installation tool. Reliability In case of a dysfunction of one PC, The architecture permits a facilitated transition to a safe mode with only two PCs. Each PC has a redundant hard disk using RAID system. If a hard disk is defective, the system will continue to work properly. Meteo France International Page 7
License Philosophy In order to allow hardware maintenance/replacement, all application software licenses are not linked to any specific hardware (e.g. network cards, DVB cards etc.). The license mechanism is based on USB key license: so the same license key can be used on any PC (ex: safe mode). Product Availability The following data types can be processed and displayed: MSG High Rate SEVIRI Image Data, MSG Low Rate SEVIRI Image Data, Meteosat 7 HRI Image Data - Indian Ocean, MSG Meteorological Products MPEF, Data Collection and Retransmission DCP, Meteorological Data Dissemination (MDD), Japanese satellite MTSAT-1R (3-hourly), US satellite GOES East (3-hourly),GOES West (3-hourly), Chinese FY2C Products (hourly), Land SAF products for Africa, Ocean Sea Ice SAF products, Jason products, Vegetation for Africa Products (VITO), MODIS Fire Products (NOAA/NESDIS), MODIS Active Fires - Southern Africa (CSIR) Note: The detailed list of products is available Annex 8.2 Note that only essential products are activated by default (ie after installation of the software). The activation of non-essential products requires a configuration action. Visualization features The visualization features are based on Synergie, a professional Meteorological data visualization system dedicated to weather forecasting. It provides dedicated user s functions in a Graphical User Interface which offer different views of kind of meteorological data (plotting, contouring, thermodynamic chart, cross-section, stability index calculation and display, etc). Archive Product Format The EUMETSAT archive data received through UMARF are supported as they can be processed, after having been ingested manually in original or compressed format, just like data received through EUMETCast data flows. Data archiving All data received from EUMETCast Africa can be archived and made available for external usage (ftp or Windows file sharing). Software modules allow the user to configure the storage of the data according to time or count basis to avoid disk overflow. Meteo France International Page 8
1.3 System overview 1.3.1 Functional description The PUMA system is made of 5 main modules (a module is a high level software): 1. Tellicast: Raw data acquisition via the EUMETCast distribution system 2. FRAC: Raw data pre-processing (assembling and decompression) and distribution 3. Archipel: Satellite data processing (calibration, RGB, etc) and distribution 4. Synergie server: Management of the visualization database 5. Synergie client: Visualization of the data in a user-oriented forecasting module All modules are installed on the three PCs, but only required modules are activated on each PC: PC1: TelliCast and FRAC PC2: Archipel PC3: Synergie server and client 1.3.2 Used technologies The PUMA system is running with Linux CentOS 5.4 Programs are written with the following programming languages: Shell scripts C language Fortran language Java language To communicate and exchange data, modules use the following protocols: FTP SAMBA SSH 1.3.3 SYNERGIE-PUMA Kit Equipment and spare The PUMA solution is based on three PC computers. Each PC has two hard disks of 250 Mb in RAID1+0 mode (software RAID) and 2 Gb RAM. PC1 has a DVB reception card (for operational usage) PC2 has a DVB reception card (as a spare) PC3 has a dual-screen video card. Each PC has one flat screen. A 8 port LAN switch is used for networking between the three computers. Meteo France International Page 9
Media The available media are: A set of two DVD for system installation One DVD for electronic documentation Documentation Different documents are available to help users and administrators to work with the system. User manual This manual, dedicated to PUMA end users, describes in details all functions of the software. Administrator manual (this document) This manual, dedicated to PUMA administrators, describes the software configuration and maintenance procedures. Installation manual This manual describes how to install the system and how to manage safe modes. Technical support access In case of any problem, contact Eumetsat helpdesk. Before you contact the support, try to collect enough information to describe the problem (error messages, screenshot, log files ). Meteo France International Page 10
1.4 Administrator role Mission The SYNERGIE-PUMA administrator is in charge of regular monitoring and troubleshooting issues; basic configuration; backup actions. SYNERGIE-PUMA has been designed to work automatically: old files and data are destroyed while new data are integrated and files created. Anyway people trained to understand how the system works are mandatory in case of any problem or request. The administrator is the interface between end users and the system. Usual request from end-users to administrator is to know why some expected data are not available on the visualization interface. Prerequisite The SYNERGIE-PUMA administrator should be a system engineer or an experienced technician. The SYNERGIE-PUMA administrator holds a university-level degree or equivalent; has acquired an appropriate level of knowledge of computer science, with knowledge in LINUX operating systems and networking. Cautions Some configuration tasks are performed by modifying some text files. These files are documented in this manual. Others file should not be modified. To create a new configuration, the most convenient method is to adapt the existing lines of text already present in each file. The configuration must be performed cautiously since an apparently minor error can provoke a major incident within the whole software system. So it is highly recommended to make a copy of the original file before any modification. This will permit to revert to the original state in case of a problem. Meteo France International Page 11
1.5 System operation list: how to? How to? Reference Overall system Start working with the system 2.3.1 Getting started: how to login Verify the overall system status 2.3.2 General monitoring Apply a software upgrade 2.3.3 Patch application Make a system backup and restore it 2.3.4 System backup and restoration Switch to safe mode (one computer is off) 2.3.5 Managing safe modes Check and replace a faulty hard disk 2.3.6 RAID management Acquisition module: TelliCast Verify raw data acquisition 3.4.1 Monitoring Start and stop raw data acquisition 3.4.2 Start/stop Tellicast Face raw data acquisition problem 3.4.3 Troubleshooting Pre-processing and Distribution module: FRAC Verify raw data distribution 4.4.1 Monitoring Start and stop data distribution 4.4.2 Start/stop FRAC Activate and access raw data archive 4.4.3 Raw data archive management Reload raw archived data from EUMETSAT 4.4.4 Re-process archived data (UMARF) Satellite image production module: Archipel Verify image production 5.4.1 Monitoring Start and stop image production 5.4.2 Start / Stop Archipel Define and generate customized RGB products 5.4.3 Configure custom RGB production Activate and desactivate some products 5.4.4 Enable/disable product generation Visualisation database: Synergie server Verify visualization database 6.4.1 Monitoring Start and stop visualization database 6.4.2 Start/stop Synergie server Visualization GUI: Synergie client Verify visualisation software 7.4.1 Monitoring Start and stop visualization software 7.4.2 Start/stop Retrieve user s document (screenshot, macro, etc) 7.4.3 Access user's documents Create and replay Synergie data archive 7.4.4 Manage local data archive Add a new printer for the visualization software 7.4.5 Configure printers Customize messages origin centers list 7.4.6 Configure alpha messages centers Customize geographical area 7.4.7 Configure geographical area Meteo France International Page 12
2 OVERALL SYSTEM 2.1 System design 2.1.1 Modules The SYNERGIE-PUMA system is made of the following modules: Raw data acquisition: TelliCast Raw data pre-processing and distribution: FRAC Satellite image production: Archipel PUMA Chain Database: Synergie server Visualization: Synergie client Tellicast Tellicast is in charge of the raw data acquisition from Eumetsat via the EUMETCast distribution system: Data decryption based on a key code Error correction and management of raw data received FRAC The FRAC is in charge of data pre-processing tasks in order to make them exploitable for subsequent processing. These processing tasks are: Data decompression File assembly Data distribution to others modules (Archipel and Synergie server) Data archiving and sharing Manual ingestion of archive products provided by UMARF Meteo France International Page 13
Archipel PUMA chain The Archipel PUMA chain is in charge of satellite image creation based on raw data and transfer of the generated products to the Database module: Imagery of single channel products from different satellites Imagery of added value products (MPEF, SAF, etc) Generation of standard or customized RGB imagery products Synergie server The Synergie server is in charge of: Real-time storage of data to be visualized Meta-data storage (additional information like synoptic station WMO Ids, etc) Extraction of customized data for the visualization module Synergie client The Synergie client provides: Data extraction from database depending on user s selection Data viewing and display facilities: Navigation, remapping, zooming, animations, dynamic enhancement, filtering, etc. Specific tools for data presentation and computations: thermodynamic display, crosssection and stability index calculation, etc. Meteo France International Page 14
2.1.2 Physical architecture The modules are installed on three PCs. Each PC is dedicated to a specific task: Puma1: The acquisition PC Puma2: The processing PC Puma3: The visualization PC The three PCs are connected in a Local Area Network (LAN) using a network switch. All modules (software, operating system and drivers) are installed on the 3 PC, but only required modules are active as depicted on the following chart. This architecture ensures a facilitated transition between a nominal and a safe mode. LAN 8 ports switch EumetCast Key Unit Dual screen video card Existing C-band outdoor subsystem DVB card Puma1 : Acquisition Spare DVB card Puma2 : Processing Puma3 : Visualization Synergie license key UPS Linux CentOS Linux CentOS Linux CentOS Driver DVB Driver DVB Driver DVB TelliCast TelliCast TelliCast FRAC FRAC FRAC Archipel PUMA chain Archipel PUMA chain Archipel PUMA chain Synergie server Synergie server Synergie server Synergie client Synergie client Synergie client SYNERGIE-PUMA nominal architecture Legend Synergie server Linux CentOS FRAC Active modules FRAC Installed but not active module Meteo France International Page 15
2.1.3 Operational and Safe modes The 3 PC may act as acquisition, processing or visualization station. If one PC is down, the Operational mode can be easily switched to a Safe mode by following a safe mode procedure. Refer to 2.3.5 Managing safe modes. Meteo France International Page 16
Meteo France International Page 17
2.1.4 Data flow The PUMA general dataflow can be schematized as follows: 1. Tellicast acquires raw data and puts them down in dedicated directories. 2. The FRAC pre-processes data and distributes satellite data to Archipel by FTP (archipel user). 3. The FRAC disseminates meteorological data to Synergie server by FTP (pumadata user). 4. Archipel processes satellite data and disseminates satellite products to Synergie server by FTP (pumadata user). 5. Synergie server transfers data to Synergie client by SSH (synergie user). 6. The FRAC duplicates data and make them available for an external system by FTP or SAMBA. 7. Archive data requested on UMARF can be manually put down in the FRAC. 8. Users can transfer data from Synergie clien to an external system by SAMBA. Meteo France International Page 18
2.2 Software structure 2.2.1 Filesystems Partitions Partitions are configured with Linux RAID software. Partitions Mount Size Description /dev/md2 / 20 Gb Linux system /dev/md0 /data-space 177 Gb PUMA data storage /dev/md1 /home 30 Gb /dev/md4 /boot 12 Mb Swap A swap disk of 4 Gb is defined (twice the RAM). MemDisk As recommended by EUMETSAT, a memory disk is defined in order to optimize Tellicast processing. This MemDisk size is 284Mb. It is defined on /home/ebs/recv_database/ directory. 2.2.2 Applications folders Tellicast uses the following directories: Directory /space/tellicast/ /usr/local/bin/ /home/ebs/recv_database/ Description Root directory Contains the executable file Contains the file database: temporary store for the received file fragments until a file is completely received FRAC uses the following directories: Directory /home/ebs/ /space/efts/ /data/data_share/ /space/decomp/ /space/trs/fmsg/ Description Distribution and FTP push Workspace buffer Data duplication Decompression Cycles assembling Archipel uses the following directories: Directory /archipel/ /soft/ Description Contains the Archipel chain directory structure Contains generic software components Meteo France International Page 19
Synergie server uses the following directories: Directory /data/data_syn /home/synergie Description Synergie data Synergie server programs and configuration files Synergie client uses the following directories: Directory /home/synergie /home/syndocs Description Synergie server programs and configuration files Synergie end-user s documents (screenshot, docs, etc) 2.2.3 Linux users The PUMA system is administrated by the following users: Module User Password Linux Operating System root root-2010 Tellicast and FRAC ebs ebs-2010 Archipel archipel archipel-2010 Synergie synergie synergie 2.3 Main operations 2.3.1 Getting started: how to login Once the computer and Linux Operating System have started, a login screen is displayed. Enter the username and it s password to access user s desktop. End-user will always login has synergie user in order to use the Synergie visualization GUI. Depending on the need, administrator will login as synergie, archipel, ebs or root user. Meteo France International Page 20
2.3.2 General monitoring To check quickly the system, different scripts can be used on each computer to verify the software behavior. Active/Inactive services As root user, type the command: puma-services-status.sh The active and inactive services will be displayed. On PC1: only TelliCast and FRAC services must be active On PC2: only Archipel service must be active On PC3: only Synergie service must be active 2.3.3 Patch application In order to keep the puma machines up to date and to install easily new features and bug corrections, SYNERGIE-PUMA machines own a patch system. This patch system is based on the Red Hat Package Manager called rpm. Reception/Notification All the patches are received from the satellite reception and disseminate to the 3 PCs in the patch directory: /data/data_patch Two times a day (at 3am and 3pm GMT), the directory is scanned. If a patch is available for installation, a notification pop up is displayed on the PCs. Patch notification Installation To install a patch, administrator has to log on as root user on any of the machine (PC1 or PC2 or PC3) then click on the icon PUMA: install updates. This command updates the 3 PCs. During installation, a dialog displays the progression. Meteo France International Page 21
Patch installation When installation of patches is finished, another dialog displays the result of the update with the list of the PC updated. Patch installation result on puma1 Update reporting To sum up the patch installation, a log file is available on: /home/synergie/server/log/puma_update.log Patch download In case of unavailability of the antenna reception during a long period, or if some patches are already available when the SYNERGIE-PUMA machines are installed, patches must be downloaded manually on an ftp account. Administrator has to log on as root on the PC1 (acquisition) and execute the following commands in a terminal (this can take several minutes depending of the number of patches available and the bandwidth): cd /data/data_patch wget ftp://pumapatch:pumapatch-2010@ftp2.mfi.fr/*rpm The automatic patch system takes over once the files are downloaded and the notification popup will be displayed after some hours as it is explained in Reception/Notification paragraph. 2.3.4 System backup and restoration Backup To make a full backup of a PC, log on as root and type: /home/synergie/adminkit/bin/synbackup.sh This command takes 1 or 2 hours and generates two DVD ISO images: Meteo France International Page 22
/home/backup/mondorescue-1.iso /home/backup/mondorescue-2.iso These ISO images can then be burned on DVD with a DVD-writer program. For example: growisofs dvd-compat Z /dev/cdrom=/home/backup/mondorescue-1.iso growisofs dvd-compat Z /dev/cdrom=/home/backup/mondorescue-2.iso Restoration Follow instructions of SYNERGIE-PUMA installation manual and use the new DVD. 2.3.5 Managing safe modes In case of hardware failure, 1 PC could be unusable. The high availability strategy consists in reconfiguring the architecture to run all the process on 2 PCs as described in the following schema. Safe mode architecture If faulty PC is: Then: PC1 - Acquisition layer is enabled on PC2 (Driver DVB, Tellicast, FRAC) - PC3 is unchanged (Visualization layer) Meteo France International Page 23
If faulty PC is: Then: PC2 - Processing layer is enabled on PC1 (Archipel) - PC3 is unchanged (Visualization layer) PC3 - Processing layer is disabled on PC2 and enabled on PC1 (Archipel) - Visualization layer is enabled on PC2 To switch from 3 PCs mode to 2 PCs mode, you have to follow the instructions of SYNERGIE- PUMA installation manual, chapter 7 - Safe Mode Management. 2.3.6 RAID management 2.3.6.1 Raid description A Puma station has 2 hard drives of 250Gb. RAID1 mode is used for High Availaibility reasons. This mode maintains an exact mirror of the information of one disk on the other disk. Each disk is parted identically. Software raid associates each partition of one disk with the same partition of the other disk to have a raid device (mdx). 2.3.6.2 Display RAID status When RAID is running normally: In prompt root: [root@puma1 ~]# cat /proc/mdstat Should return: Personalities : [raid1] md4 : active raid1 sdb1[1] sda1[0] 104320 blocks [2/2] [UU] md0 : active raid1 sdb2[1] sda2[0] 92156800 blocks [2/2] [UU] md1 : active raid1 sdb3[1] sda3[0] 31206144 blocks [2/2] [UU] md3 : active raid1 sdb6[1] sda6[0] 4128576 blocks [2/2] [UU] md5 : active raid1 sdb7[1] sda7[0] 95819584 blocks [2/2] [UU] md2 : active raid1 sdb5[1] sda5[0] 20723712 blocks [2/2] [UU] Each raid device must be active and contains a volume in sda and sdb. Meteo France International Page 24
2.3.6.3 Replace a faulty disk 1 Determine which disk is faulty. 2. Proceed as follows: If faulty disk is: sda (first hard disk) 1. Set partitions as faulty on sda Then: [root@puma1 ~]# mdadm /dev/md0 --fail /dev/sda2 [root@puma1 ~]# mdadm /dev/md1 --fail /dev/sda3 [root@puma1 ~]# mdadm /dev/md2 --fail /dev/sda5 [root@puma1 ~]# mdadm /dev/md3 --fail /dev/sda6 [root@puma1 ~]# mdadm /dev/md4 --fail /dev/sda1 2. Remove disk from RAID [root@puma1 ~]# mdadm --remove /dev/sda2 [root@puma1 ~]# mdadm --remove /dev/sda3 [root@puma1 ~]# mdadm --remove /dev/sda5 [root@puma1 ~]# mdadm --remove /dev/sda6 [root@puma1 ~]# mdadm --remove /dev/sda1 3. Shutdown computer and replace disk 4. Start computer 5. Create partitions on the new disk [root@puma1 ~]# sfdisk /dev/sda </root/sda_ptable 6. Check if the new disk is correctly parted [root@puma1 ~]# sfdisk -l /dev/sda should return: Disk /dev/sda: 250.0 GB, 250000000000 bytes 255 heads, 63 sectors/track, 30394 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 fd Linux raid autodetect /dev/sda2 14 11486 92156872+ fd Linux raid autodetect /dev/sda3 11487 15371 31206262+ fd Linux raid autodetect /dev/sda4 15372 30394 120672247+ 5 Extended /dev/sda5 15372 17951 20723818+ fd Linux raid autodetect /dev/sda6 17952 18465 4128673+ fd Linux raid autodetect /dev/sda7 18466 30394 95819661 fd Linux raid autodetect 7. Add the new disk to the RAID [root@puma1 ~]# mdadm --manage /dev/md0 --add /dev/sda2 [root@puma1 ~]# mdadm --manage /dev/md1 --add /dev/sda3 [root@puma1 ~]# mdadm --manage /dev/md2 --add /dev/sda5 [root@puma1 ~]# mdadm --manage /dev/md3 --add /dev/sda6 [root@puma1 ~]# mdadm --manage /dev/md4 --add /dev/sda1 Meteo France International Page 25
If faulty disk is: sdb (second hard disk) 1. Set partitions as faulty on sdb Then: [root@puma1 ~]# mdadm /dev/md0 --fail /dev/sdb2 [root@puma1 ~]# mdadm /dev/md1 --fail /dev/sdb3 [root@puma1 ~]# mdadm /dev/md2 --fail /dev/sdb5 [root@puma1 ~]# mdadm /dev/md3 --fail /dev/sdb6 [root@puma1 ~]# mdadm /dev/md4 --fail /dev/sdb1 2. Remove disk from RAID [root@puma1 ~]# mdadm --remove /dev/sdb2 [root@puma1 ~]# mdadm --remove /dev/sdb3 [root@puma1 ~]# mdadm --remove /dev/sdb5 [root@puma1 ~]# mdadm --remove /dev/sdb6 [root@puma1 ~]# mdadm --remove /dev/sdb1 3. Shutdown computer and replace disk 4. Start Computer 5. Create partitions on the new disk [root@puma1 ~]# sfdisk /dev/sdb </root/sdb_ptable 6. Check if the new disk is correctly parted [root@puma1 ~]# sfdisk -l /dev/sdb should return: Disk /dev/sdb: 250.0 GB, 250000000000 bytes 255 heads, 63 sectors/track, 30394 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdb1 * 1 13 104391 fd Linux raid autodetect /dev/sdb2 14 11486 92156872+ fd Linux raid autodetect /dev/sdb3 11487 15371 31206262+ fd Linux raid autodetect /dev/sdb4 15372 30394 120672247+ 5 Extended /dev/sdb5 15372 17951 20723818+ fd Linux raid autodetect /dev/sdb6 17952 18465 4128673+ fd Linux raid autodetect /dev/sdb7 18466 30394 95819661 fd Linux raid autodetect 7. Add the new disk to the RAID [root@puma1 ~]# mdadm --manage /dev/md0 --add /dev/sdb2 [root@puma1 ~]# mdadm --manage /dev/md1 --add /dev/sdb3 [root@puma1 ~]# mdadm --manage /dev/md2 --add /dev/sdb5 [root@puma1 ~]# mdadm --manage /dev/md3 --add /dev/sdb6 [root@puma1 ~]# mdadm --manage /dev/md4 --add /dev/sdb1 3. Now the RAID should be ok. Syncing raid devices may take more than 30 minutes. Check with the command: [root@puma1 ~]# cat /proc/mdstat IMPORTANT: do not reboot or shutdown the computer during RAID syncing. Meteo France International Page 26
3 ACQUISITION MODULE: TELLICAST 3.1 Module purpose EUMETSAT provides Tellicast (the EUMETCast Client Software) and the EUMETCast Key Unit (EKU) required to decrypt the DVB signal. Together the client software and EKU, with some additional ancillary software and release notes, form the EUMETCast Package. Tellicast performs the following processes: decryption of data based on a key code error correction and management of received files. 3.2 How does it work Tellicast module is based on the following principles in order to manage the data acquisition from EUMETCast data stream: Data Formatting and file naming conventions The data is made available on the reception station as files organized and formatted according to the reception format specification. No changes are performed in the reception station. The formats of data file provided on EUMETCast are according to the specification for each individual service and are determined by the data provider themselves. Refer to the data list in Annex 8.2 for an indication of the file names of the EUMETSAT provided services on EUMETCast. Data Volume The data volume per file various according to the individual product or data file. For the comprehensive list of a data volumes per EUMETCast channel consult the EUMETCast web pages, or refer to the Product Navigator for information on individual product volumes. Archiving Received files are kept in the target directory. An automatic housekeeping mechanism is implemented. Reporting The station, via the TELLICAST client, maintains a full log of the file reception history. This includes the time of reception for each individual file. The level of reporting is configurable. Timeliness All files are available and accessible on the reception station within a few seconds of the reception of the last DVB packet. However, partial files are not made available and are deleted after a configurable amount of time. Meteo France International Page 27
3.3 Software structure 3.3.1 Linux users The Tellicast module user is: Username User id Group Home folder ebs 3999 acq /home/ebs 3.3.2 Directories Tellicast module uses the following directories: Directory /space/tellicast/data/received/ /space/tellicast/log/ Description Incoming data files directory Log files 3.3.3 Programs and services Service /etc/init.d/dvb-eumetcast /etc/init.d/etokend /etc/init.d/pcscd /etc/init.d/tellicast-client Description Start/stop the DVB reception of EUMETCast data Start/stop support for the Aladdin etoken (License management) Start/stop the PCSC daemon Start/stop the Tellicast client 3.3.4 Configuration files File /etc/recv.ini /etc/recv-channels.ini /etc/license.ini /etc/dvb-eumetcast.cfg Description Contains the central client configuration settings. This file is described in the Tellicast help on line. Allows selection of target directories for incoming files, e.g. another drive. See comments in the file for more information Contains the software license and activated modules Contains the configuration for the reception (band) 3.3.5 Log Files File /home/ebs/log/monitor-eku-decoding.log /space/tellicast/log/recv.log Description License management information TelliCast processing information. The file can be displayed through the web monitoring interface (see next section) 3.3.6 Crontab The EKU decoding is monitored by the ebs user crontab: # # ------------- tellicast : Every minute - monitor the EKU decoding... #* * * * * sudo /usr/local/bin/monitor-eku-decoding >> /home/ebs/log/monitor-ekudecoding.log 2>&1 Meteo France International Page 28
3.4 Operations 3.4.1 Monitoring The main log file which reports all TelliCast activity is: /space/tellicast/log/recv.log A web interface is also available in order to allow the easy monitoring of the Client activity. The important pages are the overview page and the Log File page. The overview page provides a graphic display of the received data and provides a clear indication that data file is being received. The Log File page provides low level information on the files being received. Note that this page does not dynamically update. You have to press the refresh button to update. To open the web interface: Enter the URL "http://system:2517" into your favourite browser. Replace "system" by the identifier of the acquisition machine and "2517" by the selected port (entry 'port', in the section [shell] in the Client Configuration File, default: 2517). Note: Full information about web interface pages is given in the section Help: Web Interface. The web interface consists of various pages that give information about the activity of the TELLICAST Multicast Distribution System Client. A choice between the pages can be made using the menu on the left side of the main area. In the head of the page the following information is given independent from the page chosen for the main area: Status: OK Starting Finishing Not Connected The status of the Client which can be: Everything is okay. The Server is starting. The Server is shutting down. The Client is not connected to the TELLICAST Multicast Distribution System Server. Meteo France International Page 29
Status: WARNING ERROR Config Error The status of the Client which can be: A warning message was written to the Log File. An error message was written to the Log File. An error message about a false configuration was written to the Log File. Error or warning messages are usually the result of one or more configuration problems. The error status will not be reset automatically even if the error condition is resolved. In case of an error or warning condition the following steps should be taken: 1. Click on Log File in the menu of the web interface to open the Log File. 2. Read the Log File to determine what kind of error occurred. 3. Take the necessary steps to eliminate the error. 4. Reset the status by clicking on the Reset button in the head section of the web interface. The status changes back to OK. Host: The host on which the Client is run. Date: The current UTC time and date at the Client. To display the statistics 1. Click Statistics on the Web interface menu: Meteo France International Page 30
The relevant information is: o The received data packets: Number of data packets received since start of the TELLICAST Client or since reset of statistics o The missing data packets : Number of transmitted data packets that were not received by the TELLICAST Client o The recovered data packets: Number of data packets that were not received by the TELLICAST Client but have been recovered by forward error correction (FEC) Check services status Log on as root user and type the following command in bold: # service dvb-eumetcast status DVB device: configured DVB interface 'dvb0_0': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_0': disabled DVB interface 'dvb0_1': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_1': disabled DVB interface 'dvb0_2': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_2': disabled DVB interface 'dvb0_3': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_3': disabled DVB interface 'dvb0_4': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_4': disabled DVB interface 'dvb0_5': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_5': disabled DVB interface 'dvb0_6': configured (up) Kernel anti-spoofing for DVB interface 'dvb0_6': disabled Multicast interface 'dummy0': configured (up) Meteo France International Page 31
Kernel anti-spoofing for multicast interface 'dummy0': disabled # service etokend status Daemon: running # service pcscd status Daemon: running # service tellicast-client status RAM disk: mounted Processes: running 3.4.2 Start/stop Tellicast Note that it should not be necessary to stop Tellicast service. In case of a problem, it is recommended to restart the computer. All services will restart automatically. To start Tellicast 1. Log on as root user and type # service tellicast-client start To stop Tellicast 1. Log on as root user and type # service tellicast-client stop 3.4.3 Troubleshooting Refer to the Eumetsat online documentation: http://www.eumetsat.int/home/main/what_we_do/eumetcast/reception_stati on_set-up/sp_1119358997137 Meteo France International Page 32
4 PRE-PROCESSING AND DISTRIBUTION MODULE: FRAC 4.1 Module purpose The FRAC (Frontal Acquisition) is in charge of the: Distribution of data: It identifies and sorts the different raw data coming from the Acquisition module (Tellicast), Decompression of raw data, Assembling of segments files, Distribution of satellite data to the Satellite image production system (Archipel PUMA chain) and meteorological data directly to the Visualization module (Synergie server). 4.2 How does it work The Frontal acquisition is made of three components: EFTS: in charge of the files distribution decompx: in charge of the decompression of the files fmsgd: in charge of the cycles assembling Meteo France International Page 33
4.2.1 EFTS The EFTS agents is a collection of processes edited by EUMETCast that do local or remote file transfer, copying, and manipulation based on file name filters. The FRAC includes 2 EFTS agents : EFTS_preprocessor and EFTS_PushFtpAgent. EFTS Tellicast Tellicast out EFTS_preprocessor Decompx in Decompx out Role: Files distribution Fmsgd in UMARF Archive Fmsgd out forarchipel forsynergie EFTS_PushFtpAgent Archipel Role: FTP transfer Synergie EFTS: architecture Legend Dir 1 Directory EFTS_ EFTS agent EFTS_preprocessor The EFTS_preprocessor is the distribution agent of the FRAC. It scans directories for new data files. New data files are identifies using regular expression on their file name and are then move to a specific directory depending on their type. Unused files are cleaned. The EFTS_preprocessor manages the following directories: It handles data provided by the Tellicast module and from UMARF Archive (/space/tellicast/data/received/default/ and /space/efts/fromumarf/archive) It feeds the MSG/Xrit data decompression (/space/decomp/data/in/) It feeds the fmsgd in directory (/space/trs/fmsg/in1/ and in2/) It handles decompressed MSG/XRIT data (/space/decomp/data/out/) It handles the fmsgd out directory (/space/trs/fmsg/cycles/) It feeds a buffer directory with files dedicated Archipel module /space/efts/fromtellicast/forarchipel/ {fy,modis,safland,safosi,vito, XRITcyclefiles} It feeds a buffer directory with files dedicated to Synergie module /space/efts/fromtellicast/forsynergie/ Meteo France International Page 34
EFTS_PushFtpAgent EFTS_PushFtpAgent is dedicated to the FTP files transfer: It scans data provided by the EFTS_preprocessor It identifies files names using regular expression It pushes files related to a file name by FTP to remote hosts (Archipel and Synergie modules) Note The EFTS_agents script is the default active service. It activates the two agents. 4.2.2 decompx The MSG/XRIT files received by Tellicast are most of the time compressed and need to be decompressed so that data be operated. In that case, EFTS_preprocessor switches the compressed files to decompx 4.2.3 fmsgd fmsgd is a cycles assembling component. It handles LRIT and HRIT data (MSG data) delivered in the form of segments and assembles the segments to reconstitute image cycles files (ICF). An ICF is related to a channel and results from the ordered concatenation of a prologue file, of "image data" segment files and, only if SEVIRI data are concerned, of an epilogue file. Meteo France International Page 35
4.3 Software structure 4.3.1 Linux users The FRAC module (EFTS, decompx and fmsgd programs) user is: Username User id Group Home folder ebs 3999 acq /home/ebs 4.3.2 Directories EFTS EFTS uses the following directories: Directory Description /home/ebs/efts/bin/ EFTS programs /home/ebs/bin/ Symbolic links to /home/ebs/efts/bin and to /home/ebs/efts/bin/services /home/ebs/efts/dataunits/ EFTS configuration files /home/ebs/log/ EFTS Log files /space/efts/fromtellicast/forarchipel/ Workspace buffer for file to send to Archipel /space/efts/fromtellicast/forsynergie/ Workspace buffer for file to send to Synergie /space/efts/fromumarf/archive/ Workspace buffer for archive data (UMARF) /data/data_share/ Raw archive data /data/umarf/ Entry directory for UMARF and raw archive data decompx decompx uses the following directories: Directory /space/decomp/data/in/ Input directory /space/decomp/data/out/ Output directory /space/decomp/data/rejected/ Rejected data Description Meteo France International Page 36
Directory /space/decomp/data/unused/ /space/decomp/log/ Unused data Log files Description fmsgd fmsgd uses the following directories: Directory /space/trs/fmsg/in1/ /space/trs/fmsg/in2/ /space/trs/fmsg/cycles/ /space/trs/fmsg/waste/ /home/ebs/bin/ /home/ebs/log/ /home/ebs/param/ Input HRIT directory Input LRIT directory Output directory Rejected data Binary files Log files Configuration files Description 4.3.3 Programs and services EFTS Service efts_eumetcast-agents efts_eumetcast-preprocessor efts_eumetcast-pushftpagent Program efts_mode fmsgd fmsgd decompx Service Description Start/stop both EFTS_PreProcessor+EFTS_PushFtpAgent Start/stop only file copy (EFTS_PreProcessor) Start/stop FTP push agent (EFTS_PushFtpAgent) Description Data replication. Available options: efts_mode SHARE: duplicate data in /data/data_share/ efts_mode NOSHARE: desactivate the duplication Description Start/stop the cycle assembling decompx Service Description Start/stop the decompression of MSG/Xrit files 4.3.4 Configuration files EFTS Configuration file /home/ebs/efts/dataunits/ puma-templatepropertyvalues.props /home/ebs/efts/dataunits/ puma-preprocessor-reference.props /home/ebs/efts/dataunits/ puma-pushftpagent-reference.props /home/ebs/efts/dataunits/ puma-efts_preprocessor_eumetcast.props /home/ebs/efts/dataunits/ Description Common properties (format Key=value) Common properties for PreProcessor (format Key=value) Common properties for PushFTPAgent (format Key=value) Configure the distribution of local files depending on their file name pattern (one section for one data type) Configure the FTP sending of files Meteo France International Page 37
Configuration file puma-efts_pushftpagent_eumetcast.props Description depending on their file name pattern (one section for one data type) Refer to the EFTS_Agents_UserGuide for a full description of the configuration file content. fmsgd Configuration file /home/ebs/param/fmsgd.conf /home/ebs/param/fmsgd.d/fmsg_hrit.conf /home/ebs/param/fmsgd.d/fmsg_lrit.conf Description The configuration file manages the different cycles to generate. The configuration is set at the MFI factory and defines how the cycles are generated HRIT factory settings LRIT factory settings 4.3.5 Log files EFTS log file Description /home/ebs/log/efts_preprocessor_eumetcast.logging Main log file (Start and stop report) /home/ebs/log/efts_preprocessor_eumetcast.lastfile Last processed file /home/ebs/log/log_<date>_puma1_to_archipel File distribution to Archipel PUMA chain report /home/ebs/log/log_err_<date>_puma1_to_archipel File distribution to Archipel PUMA chain errors and warnings /home/ebs/log/efts_pushagent.logging Main FTP log file /home/ebs/log/efts_pushagent.lastfile Last FTP processed file /home/ebs/log/log_<date>_puma1_to_synergie FTP sending to synergie server report (PC2) /home/ebs/log/log_err_<date>_puma1_to_synergie FTP sending to synergie server errors and warnings (PC2) <date> in log file names stand for the day of the year number. Ex: Log_20100065_puma1_to_synergie fmsgd log file /home/ebs/log/fmsgd_<date>.log /home/ebs/log/fmsgd.lastfile /home/ebs/log/fmsgd.lasthicf /home/ebs/log/fmsgd.lastlicf Description Main log file Last processed file Last HRIT processed file Last LRIT processed file <date> in log file name stand for the number of the year, the number of the month followed by the number of the day. Ex: fmsgd_100329.log Meteo France International Page 38
decompx log file /space/decomp/log/decomp.x.log Main log Description 4.3.6 Crontab Some tasks are defined in ebs user crontab in order to: Clean old data and log files (EFTS and fmsgd) Check and relaunch the fmsgd daemon if necessary EFTS # ------------- EFTS : logging related cleaning 30 1 * * * find /home/ebs/log -type f -name '*' -mtime +30 -exec rm {} \; fmsgd # ------------- fmsgd : waste cleaning 1 1-23 * * * cleanfiles -d /space/trs/fmsg/waste -n 1 >/dev/null 2>&1 # ------------- fmsgd : ICF directories cleaning 1 2-23 * * * cleanfiles -d /space/trs/fmsg/cycles/hrit -n 1 -N "[0-9]*" -t d >/dev/null 2>&1 1 2-23 * * * cleanfiles -d /space/trs/fmsg/cycles/lrit -n 1 -N "[0-9]*" -t d >/dev/null 2>&1 # ------------- fmsgd : daemons control * * * * * daemon_control -d fmsgd -m ebs@localhost >/dev/null 2>&1 Meteo France International Page 39
4.4 Operations 4.4.1 Monitoring 4.4.1.1 Check the logs Display the log files in the following directories: /home/ebs/log/ /space/decomp/log/ Main log files are: /home/ebs/log/log_err_<date>_puma1_to_synergie /home/ebs/log/log_err_<date>_puma1_to_synergie /home/ebs/log/fmsgd_<date>.log /space/decomp/log/decomp.x.log 4.4.1.2 Get the statuses of the services To get the status of fmsgd 1. As root, type: # service fmsg status To get the status of decompx 1. As root, type: # service decompx status To get the status of EFTS 1. As root, type: # service efts_eumetcast-agents status To get the status of the FRAC (EFTS, decompx and fmsgd) 1. As root or ebs user, type: /home/ebs/bin/frac status 4.4.2 Start/stop FRAC The 3 modules EFTS decompx fmsgd can be started or stopped in any order. Meteo France International Page 40
4.4.2.1 Start the services To start fmsgd 1. As root, type: # service fmsg start To start decompx 1. As root, type: # service decompx start To start EFTS 1. As root, type: # service efts_eumetcast-agents start To start EFTS, fmsgd and decompx 1. As root, type: /home/ebs/bin/frac start 4.4.2.2 Stop the services To stop fmsgd 1. As root, type: # service fmsg stop To stop decompx 1. As root, type: # service decompx stop To stop EFTS 1. As root, type: # service efts_eumetcast-agents stop To stop EFTS, fmsgd and decompx 1. As root, type: /home/ebs/bin/frac stop Meteo France International Page 41
4.4.3 Raw data archive management This feature allows storing data received by EUMETCAST during a defined period (24 hours by deault). Because raw data archive takes hard disk space, it is disabled by default. Activate/disable raw data archiving To check if data archiving is activated, log on as ebs user and type the command in bold: $ efts_mode status... Puma-EFTS_PreProcessor data replication : OFF. To activate data archiving, type: $ efts_mode SHARE Configuration directory for EFTS is /home/ebs/efts/dataunits EFTS[EFTS_PreProcessor] is going to switch in SHARE mode (data replication). Restart the EFTS processor to take the modification into account: # service efts_eumetcast-agents restart To disable data archiving, replace SHARE keywork with NOSHARE. When the duplication of data is activated, EFTS puts data in the /data/data_share/ subdirectories. The data are kept by default during 24 hours. If you need to keep the data longer, you can change the housekeeping default configuration. Access raw data archive Raw data archives are located in the following directories: Directory /data/data_share/admin /data/data_share/ascat /data/data_share/dcp /data/data_share/fy2e /data/data_share/hrit /data/data_share/jason /data/data_share/land-saf /data/data_share/lrit /data/data_share/mdd /data/data_share/modis /data/data_share/mpef /data/data_share/osi-saf /data/data_share/vito /data/data_share/others File type Administration messages ASCAT DCP FY2E MSG HRIT JASON Land SAF MSG LRIT MDD MODIS MPEF OSI SAF VITO All others data It is also possible to access these data from a Windows computer. This requires the Windows computer to be on the same network as the PUMA computers. The name of the raw data archive Windows share is rawdatabase. Meteo France International Page 42
To modify the housekeeping configuration 1. In the directory /home/ebs/efts/dataunits/ edit the configuration file: puma-preprocessor-reference.props #-------------------------------------------------------------------- # Housekeeping #--------------------------------------------------------------------- # Catch all for all Incoming directory # After how many hours to delete files in Incoming directory : 1 day #EFTS.PreProcessor.Incoming.HousekeepingHours=24 EFTS.PreProcessor.Incoming.HousekeepingHours=2 #EFTS.PreProcessor.Incoming.HousekeepingMillisecs=3600000 #EFTS.PreProcessor.Incoming.HousekeepingMillisecs=86400000 # Catch all for all CopyTo directories # After how many hours to delete files in CopyTo directories : 1 day EFTS.PreProcessor.CopyTo.HousekeepingHours=24 #EFTS.PreProcessor.CopyTo.HousekeepingHours=2 #EFTS.PreProcessor.CopyTo.HousekeepingMillisecs=86400000 #EFTS.PreProcessor.CopyTo.HousekeepingMillisecs=600000 # After which size to open new log file EFTS.PreProcessor.HousekeepingSize=2000000 # housekeeping interval of incoming and copyto directories, multiply by EFTS.PreProcessor.Server.CheckInterval EFTS.PreProcessor.HousekeepingInterval=480 Meteo France International Page 43
3. By default the parameter EFTS.PreProcessor.CopyTo.HousekeepingHours is set for 24 hours. Change the value to n hours. 4. Restart the EFTS processor to take the modification into account: # service efts_eumetcast-agents restart 4.4.4 Re-process archived data (UMARF) If you request data to the Eumetsat archive catalogue (UMARF), you can process data in the Archipel chain. It is also possible to replay data archived with the HouseKeeping feature. To request archived data 1. Log on to the EUMETSAT Data Centre Online Ordering http://archive.eumetsat.int/umarf/. 2. Register to get a login and a password. 3. Request archived data and select the appropriate format in the Shipping trolley tab. Meteo France International Page 44
Data MSG SEVIRI (MSG Level 1.5) Appropriate format Select the format: HRIT data sets in tar archive MPEF data Meteosat07 Level 1.5 SAF-LAND SAF-OSI Only one possible format Select the format OpenMTP Only one possible format Only one possible format To process archived data 1. Log in to the acquisition machine with the ebs user. 2. Untar and unzip files sent by the EUMETSAT Data Centre in the directory: /data/umarf/ You will get the following files names: Data MSG SEVIRI (MSG Level 1.5) MPEF data Meteosat07 Level 1.5 SAF-LAND File name example H-000-MSG2 -MSG2 -?????? -?????? - YYYMMDDHHMN-C_ MSG2-SEVI-MSG????-0100-0100- 20100325114500.000000000Z-970646.grb.bz2 OpenMTP_2010-03-29_21_612345_1_1_1.IR OpenMTP_2010-03-29_21_612345_1_1_1.VISSN OpenMTP_2010-03-29_21_612345_1_1_1.WV HDF5_LSASAF_MSG_FAPAR_NAfr_2010033000000.bz2 3. Execute the following command as archipel user: archive-consume The archive-consume script sends the archive in the /space/efts/fromumarf/archive/ directory so the data can be processed by the FRAC and then by the Archipel chain. Meteo France International Page 45
Example with OSI-SAF North Atlantic and Regional SST product 1. NARSST product of 2010/04/11 at 20h00 packaged in a file 971584-1of1.tar $ cp 971584-1of1.tar /data/umarf/ $ tar xvf 971584-1of1.tar -rw-rw-rw- integ/users 2791177 2010-04-12 12:25:47 M02-MARINE-OSSTNAR-0.0-1.0-20100411200000.000000000Z-971584.grb.bz2 $ rm 971584-1of1.tar $ archive-consume 2. After few minutes, launch SYNERGIE in Archive mode : Select data date (2010/04/11): 3. Select data type and date/time and display it: Meteo France International Page 46
Example with METEOSAT7 data: 1. Copy and extract the archived file: $ cp 971676-1of1.tar /data/umarf/ $ tar xvf 971676-1of1.tar METEOSAT7-MVIRI-MTP15-NA-NA-20100402073000.000000000Z-971676.tar.bz2 METEOSAT7-MVIRI-MTP15-NA-NA-20100402070000.000000000Z-971676.tar.bz2 2. Note that the extracted file are.tar.bz2, this means it is needed to extract it again: $ tar xvfj METEOSAT7-MVIRI-MTP15-NA-NA-20100402073000.000000000Z-971676.tar.bz2 OpenMTP_2010-04-02_15_712345_1_1_1.IR OpenMTP_2010-04-02_15_712345_1_1_1.VISSN OpenMTP_2010-04-02_15_712345_1_1_1.WV $ tar xvfj METEOSAT7-MVIRI-MTP15-NA-NA-20100402070000.000000000Z-971676.tar.bz2 OpenMTP_2010-04-02_14_712345_1_1_1.IR OpenMTP_2010-04-02_14_712345_1_1_1.VISSN OpenMTP_2010-04-02_14_712345_1_1_1.WV $ rm f *.tar $ archive-consume 3. After few minutes, the Meteosat7 data can be displayed in Synergie as described above. Meteo France International Page 47
5 SATELLITE IMAGE PRODUCTION MODULE: ARCHIPEL 5.1 Module purpose The Image production module is dedicated to process satellite data (calibration, dynamic, correction, composition and RGB, etc) thanks to a dedicated application set (this set is called a chain) and to transfer the generated products to the visualization module (Synergie server). 5.2 How does it work The Archipel chain processes automatically data based on the following principles: The FRAC puts satellite data in the Reception spool directories. The daemon of the Archipel chain watches periodically the spools directories: it ensures the sequencing of the activity of different services in the chain. Meteo France International Page 48
The Function service provides shared functions as application functions, standard functions (administration and log) to all services. The Reception service takes into account the sources addressed to the Archipel chain. The Application service launches and controls the data processing. The Transmission service disseminates the products to the Synergie server. The Archipel monitoring graphical user interface allows the administrator to display alarms and check log files. Meteo France International Page 49
5.3 Software structure 5.3.1 Linux users The Archipel module user is: Username User id group Home folder archipel 2072 archipel /home/archipel 5.3.2 Directories The Satellite image production module is made of 2 spaces: The data space: contains the data to be processed by the processing chain The soft space: contains the generic software components Data space The data space of the system contains the data to be processed by the processing chain. Note: To keep the directory structure as less as possible dependant on the used file systems, the SPACE notion is used. Under /archipel, the symbolic links SPACE1 point on /data-space/space/archipel/ Directory Description Physical directories and intermediate links /data-space/space/archipel/ Physical directory of Archipel data /space/archipel Link to /data-space/space/archipel/ /archipel/space1 Link to /space/archipel /archipel/app Link to SPACE1/app /archipel/fct Link to SPACE1/fct /archipel/rcp Link to SPACE1/rcp /archipel/trs Link to SPACE1/trs /archipel/tmp Link to SPACE1/TMP /archipel/install Link to SPACE1/INSTALL Applications /archipel/app/ Directory structure of the "application" service: its role is to launch and to control the data processing. Contains the sources (input) and the products (output) directories of the application: app/<appid>/wrk_src/ app/<appid>/wrk_prd/ app/<appid>/spool/ /archipel/app/controle/ Data processing structure for internal usage /archipel/app/imgdiv/ Data processing structure for divergence product /archipel/app/imgfsd/ Data processing structure for GOES-E, GOES-W and MTSAT products /archipel/app/imgfy/ Data processing structure for FY2E products /archipel/app/imgiodc/ Data processing structure for METEOSAT 7 products /archipel/app/imgmodisfire/ Data processing structure for MODIS products /archipel/app/imgprevi/ Data processing structure for MSG products /archipel/app/imgprevicc/ Data processing structure for MSG color composite product /archipel/app/imgprevihrv/ Data processing structure for MSG high resolution Meteo France International Page 50
Directory Description visible product /archipel/app/imgprevimpef/ Data processing structure for MPEF products /archipel/app/imgrgb/ Data processing structure for RGB products /archipel/app/imgrgbhrv/ Data processing structure for RGBhrv products /archipel/app/imgrgbtest/ Data processing structure for RGBtest products /archipel/app/imgsafland/ Data processing structure for SAFLAND products /archipel/app/imgsafo/ Data processing structure for SAFO products /archipel/app/imgsafosi/ Data processing structure for SAFOSI products /archipel/app/imgvito/ Data processing structure for VITO products Functions /archipel/fct/ Directory structure of the "function" service: its role is to provide common functions as directory structures, executables or libraries to all services /archipel/fct/adm/ Archipel administration function /archipel/fct/log/ Archipel log function /archipel/fct/rpt/ Archipel reporting function /archipel/fct/calibration/ files needed for the calibration /archipel/fct/composition/ table files for color composition /archipel/fct/corvisible/ table files for visible correction /archipel/fct/dynamiques/ dynamical files of the products /archipel/fct/imagerie/ files of attribute definition for the different products and sources /archipel/fct/localization/ domain files /archipel/fct/masques/ mask files /archipel/fct/satellites/ correspondence satellite /position (M,W,E,I,J) /archipel/fct/rgb/ files needed to the RGB products parameterization Reception /archipel/rcp/ Directory structure of the "reception" service: its role is to take into account the sources addressed to the chain. /archipel/rcp/archivedata/ archive file reception /archipel/rcp/fy/ Eumetcast reception of FY2E satellite products /archipel/rcp/interne/ internal reception /archipel/rcp/modis/ Eumetcast reception of mod14 products /archipel/rcp/safland/ Eumetcast reception of SAF LAND products /archipel/rcp/safosi/ Eumetcast reception of SAF OSI products /archipel/rcp/vito/ Eumetcast reception of VITO products /archipel/rcp/xritcyclefiles/ Eumetcast reception for XRIT (HRIT MSG et LRIT MPEF) files Transmission /archipel/trs/ Directory structure of the "transmission" service: its role is to disseminate the products to the recipient systems /archipel/trs/interne/ internal transmission /archipel/trs/synergie/ synergie server transmission Physical directories and intermediate links /data-space/space/archipel/ Physical directory of Archipel data /space/archipel/ Link to /data-space/space/archipel/ /archipel/space1/ Link to /space/archipel /archipel/app/ Link to SPACE1/app /archipel/fct/ Link to SPACE1/fct /archipel/rcp/ Link to SPACE1/rcp Meteo France International Page 51
Directory /archipel/trs/ /archipel/tmp/ /archipel/install/ /archipel/spool/app/<appid>/ /archipel/wrk_src/app/<appid>/ /archipel/wrk_prd/app/<appid>/ Description Link to SPACE1/trs Link to SPACE1/TMP Link to SPACE1/INSTALL Allows a direct access to all the SPOOL directories Allows a direct access to all the sources directories Allows a direct access to all the products directories Soft space The soft space of the system contains generic software components Note: The /soft directory is divided in sub-directories gathering the files by domains. <domain> stands for the identifier of the domain. Directory /soft/ /soft/<domain>/ /soft/<domain>/bin/ /soft/<domain>/lib/ /soft/<domain>/libsh/ /soft/<domain>/libperl/ /soft/<domain>/include/ /soft/<domain>/man/ Description Contains generic software components Contains all files of the domain. Contains executable Contains binary libraries Contains shell script libraries Contains Perl libraries Contains include files Contains man files for online documentation 5.3.3 Programs and services Services and programs Service (root user) /etc/init.d/archipel Programs (archipel user) /home/archipel/bin/archipel-monitor /soft/archipel/bin/a_start Description Start/Stop archipel Description Archipel monitoring GUI Control the chain (start, change parameters) Archipel functions The application functions enable the administration functions and shared programs used during the processing of data: Software adm log rpt calibration composition corvisible dynamiques Description Administration function Log function Reporting function Provide files needed for the calibration Provide table files for color composition Provide table files for visible correction Provide dynamical files of the products Meteo France International Page 52
Software edition imagerie localisation masques satellites RGB Description Provide files of the coast outline, of logos Provide files of attribute definition for the different products and sources Provide domain files Provide mask files Give the correspondence satellite /position (M,W,E,I,J) Provide files needed to the RGB products parameterization Archipel applications The specific applications enable the processing of data sources received in the Archipel chain. Find below the specific applications integrated in the Archipel chain for PUMA: Application controle imgprevi imgprevicc imgprevihrv imgiodc imgfy imgfsd imgprevimpef imgdiv imgsafland imgvito imgmodisfire imgsafosi imgrgb imgrgbtest Control Imagery (single channel products) Imagery (color composition products) Purpose Imagery (high resolution visible products) Generation of products from the satellite data meteosat07 Generation of single channel and color composition products from the satellite data FY2E Generation of single channel and color composition products from the satellite data GOES-E, GOES-W and MTSAT Generation of TIFF-MF imagery products from MPEF products with a bufr or grib format In some cases, several imagery products can be generated from one source. Generation of the divergence imagery products Generation of imagery products from the SAF LAND products Generation of imagery products from the VITO products Generation of products from the MODIS Fire product of aqua and terra Generation of imagery products from the SAF OSI products Generation of RGB imagery products Generation of imagery products in test mode (the products are user configurable) 5.3.4 Configuration files Configuration file Description /archipel/fct/adm/base/prd/* Products dissemination rules /archipel/fct/imagerie/prd/*.def Products settings /archipel/fct/rgb/definitions/*.def RGB products definition Meteo France International Page 53
5.3.5 Log files The log files are mainly located in the /archipel/fct/log/ directory. File or directory Description /archipel/fct/log/daemon Input, processed and output file information Listing of input file for processing /archipel/fct/adm/hist/rcp/interne All input files /archipel/fct/adm/hist/rcp/xritcyclefiles Input files for XRIT processing /archipel/fct/adm/hist/rcp/modis Input files for MODIS processing /archipel/fct/adm/hist/rcp/fy Input files for FY2E processing /archipel/fct/adm/hist/rcp/safland Input files for SAFland processing /archipel/fct/adm/hist/rcp/safosi Input files for SAFosi processing /archipel/fct/adm/hist/rcp/vito Input files for VITO processing Listing of output file for sending /archipel/fct/adm/hist/trs/interne Internal output files /archipel/fct/adm/hist/trs/synergie Output files to send to SYNERGIE log files of reception consumption /archipel/fct/log/rcp/interne reception log files about internal consumption. /archipel/fct/log/rcp/xritcyclefiles reception log files about XRITcyclefiles consumption. /archipel/fct/log/rcp/modis reception log files about modis consumption. /archipel/fct/log/rcp/fy reception log files about FY2E consumption. /archipel/fct/log/rcp/safland reception log files about SAFland consumption. /archipel/fct/log/rcp/safosi reception log files about SAFosi consumption. /archipel/fct/log/rcp/vito reception log files about VITO consumption. Log files of applications /archipel/fct/log/app/controle internal task report (controls) /archipel/fct/log/app/imgprevi internal task report (MSG products) /archipel/fct/log/app/imgprevihrv internal task report (high resolution visible product) /archipel/fct/log/app/imgprevicc internal task report (color composite product) /archipel/fct/log/app/imgrgb internal task report (RGB products) /archipel/fct/log/app/imgrgbhrv internal task report (RGB products using high resolution visible) /archipel/fct/log/app/imgrgbtest internal task report (customized RGB products) /archipel/fct/log/app/imgsafland internal task report (SAF Land products) /archipel/fct/log/app/imgsafosi internal task report (SAF OSI products) /archipel/fct/log/app/imgmodisfire internal task report (MODIS Fire products) /archipel/fct/log/app/imgiodc internal task report (METEOSAT 7 products) /archipel/fct/log/app/imgfy internal task report (FY2E products) /archipel/fct/log/app/imgfsd internal task report (GOES-E, GOES-W and MTSAT products) /archipel/fct/log/app/imgdiv internal task report (divergence product) Log files of transmission /archipel/fct/log/trs/interne /archipel/fct/log/trs/synergie Miscellaneous information /archipel/fct/log/cron/ the cron log files report about the fugitive processes running during the execution of a crontab entry. Meteo France International Page 54
5.4 Operations 5.4.1 Monitoring 5.4.1.1 Check log files All log files are updated in real time. You can have a general idea of all operation in the main log file: /archipel/fct/log/daemon See 5.3.5 for the list of all log files. 5.4.1.2 Monitoring GUI The graphical user interface to display alarms is based on X11/Motif. It reports in real-time on Archipel daemon activity and its children processes. To start the monitoring GUI: Log on as archipel user and type: archipel-monitor -S Option Description -S Enable the alarms aknowlegment interface. Or Click on the The alarms are displayed as follows: icon available on the desktop. Color of the buttons The color of the buttons informs of the alarm level. Background color: alarms Dark blue Orange Red Meaning No item on alarm Warning on one item or more Error on one item or more Meteo France International Page 55
Foreground color: item activity White Yellow Red Meaning No item is active (no task or data file is being currently consumed) One item or more is active Error on one item or more Each buttons display information or enable new actions: Info button Update the period where the interface will watch the daemon activity or Suspend the watch. Daemon button 1. Display the state of the daemon 2. Click on the Display log button to display the daemon logs (located in /arcid/fct/log/daemon) fct, rcp, app, trs buttons 1. Display the state of the services items with the same color convention as in the main window: Meteo France International Page 56
2. Click on one item to display more information: Display logs 1. Display the item alarm. 2. Click on the display log button. Meteo France International Page 57
Acknowledge alarms 1. Display the item alarm: 2. Click on the Acknowledge button. Display the daemon status 1. Display the Alarms graphical interface. Meteo France International Page 58
2. Click on the Daemon button: The daemon status is displayed as follows: The window displays the following information: Field PID Number of child Status Number of data files Volume of data Number of task files Description Process identifier When the daemon takes a file into account in the spool, a child process is launched. The child process is in charge of consuming the data file or to execute the task files Active, Inactive Data files are consumed by a process activated by the daemon. This process differs depending on the concerned service item. Data volume in Giga bytes The Task files are executable files that the daemon can activate directly and then destroyed after their execution. The task files allow functions and applications to execute crontab actions under the control of the daemon. Meteo France International Page 59
5.4.2 Start / Stop Archipel 5.4.2.1 Start the chain Note: The Archipel chain is launched automatically by service at the machine startup. The easiest way to start Archipel is to control it by service. As root type: # service archipel start To clear all file in applications spool, execute: rm /archipel/*/*/spool/* To have more control, the A_start command can start a chain and moves the chain status from stopped to active. A_start launches the daemon and activates the crontab. A_start positions ARCHIPEL_realtime environment variable to "ON" if the chain is launched in real-time mode, to "OFF" otherwise. Command syntax A_start [-C -W] [-D -R] [-I interval] Option Description -C Cold start: all spool directories and all applications working directories (WRK_SRC et WRK_PRD) are emptied before the launching of the daemon -W Warm start: spool directories and applications working directories are not emptied before the launching of the daemon. By default, an Archipel chain is launched with a warm start -D Delayed time mode. By default, an Archipel chain is launched in delayed time mode -R Real-time mode. -I Gives the interval in seconds between two watching cycles of the spool by the daemon. By default, the watching period is 10 s. Note: -C and -W are exclusive. D and R are exclusive 5.4.2.2 Stop the chain The easiest way to stop Archipel is to use the service. As root type: # service archipel stop To have more control, the A_stop command can stop a chain and moves the chain status from active to stopped. A_stop stops the daemon and deactivates the crontab. User archipel Command location /soft/archipel/bin Meteo France International Page 60
Command syntax A_stop [-N -S -P] Option Description -N Normal stop: the crontab is deactivated and the daemon is stopped in normal mode: it waits until the end of processes it has launched without launching new ones. -S Stand-by mode: the daemon is stopped in normal mode but the crontab stays active -P Panic mode: the crontab is deactivated and the daemon is stopped in panic mode: it sends a termination signal (SIGTERM) to all processes of its session (except from itself and its direct children). The benefits of a panic mode are a quick stop of the chain but it offers no guarantee on the consistent conclusion of ongoing actions. Note: -N, -S and -P are exclusive. 5.4.3 Configure custom RGB production 5.4.3.1 Principles Each RGB product is based on a definition file located in the directory: /archipel/fct/rgb/definitions/ Eumetsat RGB Eleven definition files are related to Eumetsat RGB products specifications. These products are generated by the imgrgb and imgrgbhrv Archipel applications. These definition files must not be modified. Product name globemconvstormt.def globemdmiphyst.def globemdusth24t.def globemdmiphywt.def globemnmiphyt.def globemairmasst.def globemdaysolart.def globemnatcolort.def globemhrvsstormt.def globemhrvcloudt.def globemhrvfogt.def Generated by the following application imgrgb imgrgbhrv products using the hrv (high resolution visible) Custom RGB It is possible to create up to seven custom RGB products by modifying the customizable definition files: globemrgbtest1t.def globemrgbtest2t.def, globemrgbtest3t.def globemrgbtest4t.def globemrgbtest5t.def Meteo France International Page 61
Note globemrgbtest6t.def globemrgbtest7t.def As these products consume a lot of calculation resources, it is not allowed to manage more than 7 testing products. These custom products are generated by the imgrgbtest Archipel application. When a custom product is activated, it is automatically produced and is displayable in Synergie visualization GUI. Meteo France International Page 62
5.4.3.2 Description of a definition file To move a testing product in production, you have to edit the definition file and to fill in its fields. #-------------------------------------------- # File definition of the product "globemrgbtest1t" List of possible channel to use #-------------------------------------------- # List of possible channels : # HRV VIS006 VIS008 IR_016 IR_039 IR_039r IR_087 IR_097 IR_108 IR_120 IR_134 WV_062 WV_073 #-------------------------------------------- DEF_PRD_id="<ProductIdentifier>" DEF_PRD_todo=<production> Replace <production> by yes if you want to generate the product, else put no DEF_PRD_R_channel_A=<ChannelNameA> <ChannelNameA>: Name of the first channel DEF_PRD_R_channel_B=<ChannelNameB> <ChannelNameB>: Name of the second channel The red component will be a difference between the first and the second channel. If the <ChannelNameB> is empty, the red component will be the first channel DEF_PRD_R_min=<value> DEF_PRD_R_max=<value> Minimal value to apply to the red component (in % of the albedo between 0 and 100 or in Kelvin degrees) Maximal value to apply to the red component (in % of the albedo between 0 and 100 or in Kelvin degrees) DEF_PRD_R_invert=<inversion> Replace <inversion> by yes if you want to invert the dynamic, else put no DEF_PRD_G_channel_A=<ChannelNameA> DEF_PRD_G_channel_B=<ChannelNameB> DEF_PRD_G_min=<value> DEF_PRD_G_max=<value> DEF_PRD_G_invert=<inversion> Same as above for Green component DEF_PRD_B_channel_A=<ChannelNameA> DEF_PRD_B_channel_B=<ChannelNameB> DEF_PRD_B_min=<value> DEF_PRD_B_max=<value> DEF_PRD_B_invert=<inversion> DEF_PRD_R_gamma=<value> DEF_PRD_R_gamma2=<value> DEF_PRD_G_gamma=<value> DEF_PRD_G_gamma2=<value> DEF_PRD_B_gamma=<value> DEF_PRD_B_gamma=<value> # # DO NOT MODIFY BEHOND THIS LINE Same as above for Blue component Value of gamma correction to apply on the Red component Value of gamma 2 correction to apply on the Red component Same as above for gamma and gamma 2 for Green and Blue component Meteo France International Page 63
5.4.3.3 Definition file example To define the product globemairmasst with the following features: Componant Channel Dynamic Gamma Gamma2 Red WV_062 - WV_073-25... 0 1. 1. Green IR_097 - IR_108-40... +5 1. 1. Blue WV_062 +243... +208 1. 1. The definition file is filled in as follows: #------------------------------------------------------------- # File definition of the product "globemrgbtest1t" #------------------------------------------------------------- # List of possible channels : # HRV VIS006 VIS008 IR_016 IR_039 IR_039r IR_087 IR_097 IR_108 IR_120 IR_134 WV_062 WV_073 #------------------------------------------------------------- DEF_PRD_id="globeMRGBtest1T" DEF_PRD_todo=yes # DEF_PRD_R_channel_A=WV_062 DEF_PRD_R_channel_B=WV_073 DEF_PRD_R_min=-25 DEF_PRD_R_max=0 DEF_PRD_R_invert=no # DEF_PRD_G_channel_A=IR_097 DEF_PRD_G_channel_B=IR_108 DEF_PRD_G_min=-40 DEF_PRD_G_max=5 DEF_PRD_G_invert=no # DEF_PRD_B_channel_A=WV_062 DEF_PRD_B_channel_B= DEF_PRD_B_min=208 DEF_PRD_B_max=243 DEF_PRD_B_invert=yes # DEF_PRD_R_gamma=1. DEF_PRD_R_gamma2=1. DEF_PRD_G_gamma=1. DEF_PRD_G_gamma2=1. DEF_PRD_B_gamma=1. DEF_PRD_B_gamma2=1. # # DO NOT MODIFY BEHOND THIS LINE # To make a backup of your custom RGB definitions, just make a file copy. A Windows share is available to access RGB definitions : RGBdefinition Meteo France International Page 64
5.4.4 Enable/disable product generation Only a selection of relevant products is activated by default. Additional products can be activated. Enable a product To activate a product, add it s Archipel Id name in the following file: /archipel/fct/adm/base/liste_prd Then, restart Archipel service. For example, to add MTSAT1R IR 3.8 images, add it s Archipel Id name in the file list: globejir038t To know the list of Archipel product Id, refer to Annex 8.2. Disable a product Just remove the Archipel Id name of the list and restart Archipel service. Meteo France International Page 65
6 VISUALISATION DATABASE: SYNERGIE SERVER 6.1 Module purpose Synergie is a Meteorological data visualization system dedicated to weather forecasting. The purpose of Synergie is to provide professional forecasting tools for processing, storing, and displaying meteorological data. The Synergie server is the data management module. It includes a PostGres database used to store meteorological data. 6.2 How does it work In order to provide the expected user s data, SYNERGIE system must perform different kind of task: The most important is the data integration. New meteorological data must be integrated as soon as these data arrived from the FRAC and Archipel module. When new data are received, they are identified and made available for user request. Because new data are stored every day, the old data are deleted in order to avoid saturation of the hard disk (the period is configurable). System processing overview Meteo France International Page 66
Data integration SYNERGIE server is able to integrate several kinds of meteorological data. The integration is done in two steps: Data identification This process analyses incoming file and determine the type of data (GRIB model, satellite, message ). If the file is not recognized, it is move in a default directory in order to be analyzed by administrators. When the data type is identified, the file is moved to a specific directory in order to be integrated by a data specific process. This process is run each minute. Data integration : Each type of data is processed by specific programs that decode the data and write it into the database. These processes are generally run each minute by the task scheduler. Synergie data housekeeping Because new data arrive every day, the old data must be deleted in order to save hard disk space and to optimize time extraction. This task is performed by a generic script that takes as parameter the data type to clean. The time-life is defined in a configuration file for each data file: Data File Default value Model /home/synergie/server/config/grib_modele/vie_model 5 days Satellite /home/synergie/server/config/satellite/vie_satellite 5 hours Messages /home/synergie/server/config/alpha/message.ascii 5 days T4 charts /home/synergie/server/config/fax/message.ascii 5 days Meteo France International Page 67
6.3 Software structure SYNERGIE is composed of many programs and configuration files. 6.3.1 Linux users The Synergie module Linux user is: Username User id group Home folder synergie dba /home/synergie postgres dba /home/pgsql pumadata dba /home/synergie/data/from_archipel 6.3.2 Directories Software directories Directory Description /home/synergie/server/adm/ contains administration scripts and profile /home/synergie/adminkit/bin/ contains additional administration scripts /home/synergie/server/bin/ contains programs and scripts for the different tasks /home/synergie/server/lib/ contains library used by the programs /home/synergie/server/etc/ contains extra programs /home/synergie/server/config/ all configuration files /home/synergie/server/log/ contains all log files /home/synergie/server/spy/ Internal information about program execution /home/synergie/server/tmp/ used to store temporary files Data directories Two tree structures are used to manage data: a physical one on a dedicated partition (/data) and a logical one which is a directory containing a list of link to the physical structure. Physical data structure The purpose of the physical tree structure is to store data in a distinct partition of the hard disk for security and disk access optimization. Logical data structure The purpose of the logical tree structure is to provide a fast access to data from the SYNERGIE user account. This tree structure is a set of symbolic links on the physical tree structure directories Directory Description Physical data structure /data/pg_syn/ Postgres Database /data/data_syn/data_from/from_archipel/ FRAC and Archipel incoming directory /data/data_syn/data_default/default_retim2000/ Unrecognized data files /data/data_syn/data_tmp/tmp_*/ Spool directories to processing /data/data_syn/data_db/images/ Available satellite images /data/data_syn/data_db/grib/ Available GRIB NWP data /data/data_syn/data_db/fax/ Available FAX/T4 charts Logical data structure (links) Meteo France International Page 68
/home/synergie/data/from_archipel/ /home/synergie/data/default_retim2000/ /home/synergie/data/tmp_*/ /home/synergie/data/images/ /home/synergie/data/grib/ /home/synergie/data/fax/ FRAC and Archipel incoming directory Unrecognized data files Spool directories to processing Available satellite images Available GRIB NWP data Available FAX/T4 charts 6.3.3 Program and services Service (root user) /etc/init.d/postgresql /etc/init.d/synergied Program (synergie user) diag_synsrv.sh syn_pscheck.sh bdm_checktables.sh synergie.start synergie.stop Description Start/stop Synergie database (Postgres) Start/stop Synergie server Description Indicates if synergie server and database are running Indicates if some synergie server processes are missing List number of observations in the database Start synergie server Strop synergie server 6.3.4 Configuration files File Description /home/synergie/server/config/grib_modele/vie_model GRIB NWP housekeeping /home/synergie/server/config/satellite/vie_satellite Satellite images housekeeping /home/synergie/server/config/alpha/message.ascii Alpha messages housekeeping /home/synergie/server/config/fax/message.ascii FAX/T4 charts housekeeping 6.3.5 Log Files File Description /home/synergie/server/log/synergie_start.log Synergie server start/stop performed /home/synergie/server/log/synergie_start.err Synergie server start/stop errors /home/synergie/server/log/traite_archipel.log FRAC and Archipel data processing /home/synergie/server/log/traite_retim2000.err Meteorological data processing /home/synergie/server/log/signal_ressource_data.log Data inserted into the database /home/synergie/server/log/traite_tmp_modele.err GRIB NWP processing /home/synergie/server/log/traite_tmp_satellite.err Satellite images processing /home/synergie/server/log/traite_tmp_message.err Alpha messages processing /home/synergie/server/log/traite_tmp_fax.err FAX/T4 processing Meteo France International Page 69
6.4 Operations To log as an Administrator Click to switch to administrator mode Or Select Programs/Mode/ Admin mode. Then, enter the Administrator password and click OK. 6.4.1 Monitoring Display the Synergie status with a command line To check Synergie server status: 1. Click to open a terminal window. 2. Type the following command: diag_synsrv.sh The status is displayed as follows: Display the graphical monitoring interface To launch the Server monitoring graphical interface: 1. Click on the icon in the bar located at the bottom of the screen. Meteo France International Page 70
2. Click on a tab to display information about the Synergie detailed status, the system, the Network or the Synergie server. Check log files Open a terminal and display files with your favorite command or editor. To Display the log files with the graphical interface: 1. Click on in the bar located at the bottom of the screen. 2. Click on the application to check in the left column. 3. Click on Journal in the middle column. The content of the log file is displayed on the right: Meteo France International Page 71
6.4.2 Start/stop Synergie server Processes are managed by a Synergie start and stop script. To start database manager: dbstart To stop database manager: dbshut To start SYNERGIE server data integration : synergie.start To stop SYNERGIE server data integration : synergie.stop Database must always be started before SYNERGIE server. If a process is missing, rather than trying to re-launch it, it is recommended to stop server and restart it: synergie.stop synergie.start Database and SYNERGIE servers are defined as Linux services: they are automatically started when the computer boot and stopped when it shutdown. The service names are: For database server : postgresql For SYNERGIE server : synergied By default, these services are started when UNIX init state is 3 (multi-user mode with network access). Standard Linux command for services management can be used: To stop Synergie database, as root, type: # service postgresql stop To start Synergie database, as root, type: # service postgresql start To stop Synergie server, as root, type: # service synergied stop To start Synergie server, as root, type: # service synergied start Meteo France International Page 72
7 VISUALIZATION GUI: SYNERGIE CLIENT 7.1 Module purpose Synergie is a Meteorological data visualization system dedicated to weather forecasting. The purpose of Synergie is to provide professional forecasting tools for processing, storing, and displaying meteorological data. The Synergie client is the user-oriented module. It provides dedicated user s functions in a Graphical User Interface which offers: Data extraction from database depending on user s selection Data viewing and display facilities (zooming, overlaying, etc.) Specific tools (data presentation, computations, etc.) 7.2 How does it work On user data request, the system checks the availability of the data, extract it and display it. If the data is not present or in case of a system problem, a message indicates that data is not available. Incoming data files SYNERGIE server SYNERGIE client Data integration Deletion of data out-of-date Data request Write data Delete data Read data user request Data display SYNERGIE data SYNERGIE user System processing overview Data extraction and display When a user requests a data through the SYNERGIE graphical interface, a data request script is executed. This script will start two processes in parallel: The data request: this will extract the data from the server database and put it in the /home/synergie/client/tmp directory. The display window creation: this will create the graphical component of the window When the display window is created, it waits for the data to be available and draw it. The user can then manipulate the data displayed in the window. Meteo France International Page 73
7.3 Software structure 7.3.1 Linux users The Synergie module Linux user is: Username User id Group Home folder synergie dba /home/synergie syndocs dba /home/syndics 7.3.2 Directories Software directories Directory /home/synergie/client/adm/ /home/synergie/adminkit/bin/ /home/synergie/client/bin/ /home/synergie/client/lib/ /home/synergie/client/etc/ /home/synergie/client/config/ /home/synergie/client/log/ /home/synergie/client/spy/ /home/synergie/client/tmp/ Description contains administration scripts and profile contains additional administration scripts contains programs and scripts for the different tasks contains library used by the programs contains extra programs all configuration files contains all log files Internal information about program execution used to store temporary files Data directories Directory /home/synergie/macro_home/ /home/synergie/data_demo/ /home/synergie/data_archive/ /home/syndics/reports/ /home/syndics/images/screenshot/ Description Synergie macro directory Installed archived data (replay mode) Archived data library (for replay mode) User s reports User s screenshots 7.3.3 Programs Program launch_synergie.sh launch_synergie_date.sh synergie-config-archiver synergie-config-printer synergie-config-visualpha-client synergie-config-domains 7.3.4 Log files Log file /home/synergie/client/log/logfile /home/synergie/client/log/desktop.screen-0.log Description Start Synergie GUI Start Synergie GUI at a custom date Run archive data management tool Run Synergie printer configuration Configure alpha messages centers Configure geographical areas Description Synergie GUI main log file Synergie desktop log file Meteo France International Page 74
7.4 Operations 7.4.1 Monitoring Display current data to check if Synergie client is working properly. 7.4.2 Start/stop To start Synergie client Click on in the bar located at the bottom of the screen. To stop Synergie client Click on the Quit Synergie button in the Synergie menu: 7.4.3 Access user's documents (screenshot, etc) User s documents are located in the following directories: Directory /home/synergie/macro_home/ /home/syndics/reports/ /home/syndics/images/screenshot/ Description Synergie macro directory User s reports User s screenshots It is also possible to access these data from a Windows computer. This requires the Windows computer to be on the same network as the PUMA computers. The name of the Windows share for synergie macro files is synmacro, for user documents it is syndocs". Meteo France International Page 75
7.4.4 Manage local data archive 1. Click on in the bar located at the bottom of the screen. 2. Click to display the online help. 3. Follow the help to: o Create archives o Install archives o Uninstall archives 7.4.5 Configure printers To configure printers, see Synergie administration manual or use the graphical interface. The printer must be configured on Linux first. 1. Switch to administrateur mode. 2. Click on the Configuration icon in the bar located at the bottom of the screen. Meteo France International Page 76
3. Select Help/Help printer configuration to display the online help. 4. Follow the help to configure the printers. 7.4.6 Configure the alpha message centers To configure the list of alpha message centers: 1. Switch to administrateur mode. 2. Click on the icon in the bar located at the bottom of the screen. 7.4.7 Configure geographical areas To configure geographical areas: 1. Switch to administrateur mode. 2. Click on the geographical areas icon in the bar located at the bottom of the screen. Meteo France International Page 77
8 ANNEXES 8.1 Linux useful commands 8.1.1 User operations id su su AUser su - AUser indicate the current user change the current user to root (password required) change the current user to AUser (password required) without changing the home directory (.profile is not executed) change the current user to AUser (password required) without changing the home directory (.profile is executed) 8.1.2 Files ls ls l ls lrt file OneFile find. -name SearchName tail filename grep abc filename list files of current directory display all information about files of current directory display all information about files of current directory sorted by date (last modified file is the latest) indicate the type of a file named OneFile find a file in current directory (.) named SearchName Display the 10 last lines of the file Search the abc string into the filename file 8.1.3 Directories (folders) operations. represent the current directory.. represent the parent directory cd ADirectory cd / cd.. cd $HOME pwd mkdir NewDirectory rmdir DirectoryToDelete rm -R DirectoryToDelete goto directory named ADirectory (Change Directory) goto root directory goto parent directory goto home directory of current user (cd with no argument do the same) display current directory (path working directory) create NewDirectory in current directory delete directory named DirectoryToDelete (the directory must be empty) delete directory named DirectoryToDelete containing files or sub-directory (take care!) Meteo France International Page 78
8.1.4 File size and disk space du -k du -sk df kl display size of each file and directory in current directory in kilobyte display sum of all file and directories size in current directory in kilobyte list used and available disk space of each disk partition 8.1.5 List processes ps -ef ps -ef grep Name pstree top display all active processes display all active processes containing Name (ex : synergie) display a tree of active processes display running processes 8.1.6 Remote login ssh X user@hostname vncviewer hostname:display Remote login with a local fowarding of the display Connect to the user's desktop VNC display from a remote machine Meteo France International Page 79
8.2 Satellite products data list Satellite products description Synergie caption EUMETCAST product name details Frequency MSG - Meteosat High Rate SEVIRI Image Data 0 (HR -SEVIRI) MSG / GLOBE-00 / VIS : 0.6 Visible 0.6 15mn MSG / GLOBE-00 / VIS : 0.8 Visible 0.8 15mn MSG / GLOBE-00 / VIS : 1.6 Visible 1.6 (IR 1.6 in navigator) 15mn MSG / GLOBE-00 / IR : 3.9 IR 3.9 15mn MSG / GLOBE-00 / IR : 8.7 IR 8.7 15mn MSG / GLOBE-00 / IR : 9.7 IR 9.7 15mn MSG / GLOBE-00 / IR : 10.8 IR 10.8 15mn MSG / GLOBE-00 / IR : 12.0 IR 12.0 15mn MSG / GLOBE-00 / IR : 13.4 IR 13.4 15mn MSG / GLOBE-00 / WV : 6.2 WV 6.2 15mn MSG / GLOBE-00 / WV : 7.3 WV 7.3 15mn MSG / GLOBE-00 / HRV High Resolution Visible 15mn MSG / GLOBE-00 / Color composition RGB MF Color composite 15mn MSG / GLOBE-00 / VIS : 0.6 (LRIT) Visible 0.6 30mn MSG / GLOBE-00 / VIS : 1.6 (LRIT) Visible 1.6 (IR 1.6 in navigator) 30mn MSG / GLOBE-00 / IR : 3.9 (LRIT) IR 3.9 30mn MSG / GLOBE-00 / IR : 10.8 (LRIT) IR 10.8 30mn MSG / GLOBE-00 / WV : 6.2 (LRIT) WV 6.2 30mn Meteosat Meteorological Products (MSG-MPEF) MPEF / GLOBE-00 / Divergence Divergence -MSG 1hr MPEF / GLOBE-00 / Lifted Index lifted index 15mn MPEF / GLOBE-00 / Glob. Inst. Index K index 15mn MPEF / GLOBE-00 / KO Index Global Instability Index MSG KO Index 15mn MPEF / GLOBE-00 / Maximum Buoyancy Index MPEF / GLOBE-00 / TPWC MPEF / GLOBE-00 / MPE Total precipitation water content (TPWC) Multi-Sensor Precipitation Estimate Maximum Buoyancy Index MPEF / GLOBE-00 / Total Ozone Total Ozone 3hr MPEF / GLOBE-00 / Trop. Humidity Tropospheric Humidity MSG 3hr MPEF / GLOBE-00 / Mid Trop. Humidity mid tropospheric humidity 3hr MPEF / GLOBE-00 / Active Fire Monitoring Active Fire Monitoring MSG (GRIB) 1hr MPEF / GLOBE-00 / Clear-Sky Rad. 3.9 IR 39 1hr MPEF / GLOBE-00 / Clear-Sky Rad. 10.8 Clear-Sky Radiances -MSG IR 10.8 1hr MPEF / GLOBE-00 / Clear-Sky Rad. 12.0 IR 12.0 MPEF / GLOBE-00 / Clear-Sky Ref. Map 0.6 VIS 0.6 1d (13h30) Clear-Sky Reflectance Map - MPEF / GLOBE-00 / Clear-Sky Ref. Map 0.8 MSG VIS 0.8 1d (13h30) MPEF / GLOBE-00 / Clear-Sky Ref. Map 1.6 IR 1.6 1d (13h30) MPEF / GLOBE-00 / Analysis Low Clouds Cloud Analysis Low Clouds 3hr 15mn 15mn 15mn 1hr Meteo France International Page 80
MPEF / GLOBE-00 / Analysis Mid Clouds Mid Clouds 3hr MPEF / GLOBE-00 / Analysis High Clouds Height Clouds 3hr MPEF / GLOBE-00 / Analysis Total Clouds Total Clouds 3hr MPEF / GLOBE-00 / Analysis Cloud Image Cloud Analysis Image 3hr MPEF / GLOBE-00 / Cloud Mask Cloud Mask MSG 15mn MPEF / GLOBE-00 / Cloud Height Cloud Top Height 3hr RGB Meteosat High Rate SEVIRI Image 0 (HR-SEVIRI ) RGB / GLOBE-00 / RGB natural color RGB natural color 15mn RGB day Microphysics RGB / GLOBE-00 / RGB day Microphysics Summer Summer 15mn RGB / GLOBE-00 / RGB day Microphysics Winter RGB day Microphysics Winter 15mn RGB / GLOBE-00 / RGB Solar RGB Solar 15mn RGB / GLOBE-00 / RGB Day convective Storm RGB Day convective Storm 15mn RGB / GLOBE-00 / RGB Nigth Microphysical RGB Nigth Microphysical 15mn RGB / GLOBE-00 / RGB H-24 dust micophysics RGB H-24 dust micophysics 15mn RGB / GLOBE-00 / RGB Airmass RGB Airmass 15mn RGB / GLOBE-00 / RGB HRV cloud RGB HRV cloud 15mn RGB / GLOBE-00 / RGB HRV Fog RGB HRV Fog 15mn RGB / GLOBE-00 / RGB HRV Severe storm RGB HRV Severe storm 15mn RGB / GLOBE-00 / RGB Test i (i=1 to 10) RGB test 1 to 7 15mn Meteosat 7 - HRI Image Data -Indian Ocean Coverage (HRI) METEOSAT7 / SPACE-63E / VIS Visible 30mn METEOSAT7 / SPACE-63E / IR IR modea 30mn METEOSAT7 / SPACE-63E / WV WV 30mn METEOSAT7 / SPACE-63E / Color Composition RGB MF Color composite 30mn FY2E Imagery and products FY2E / SPACE-105E / VIS Visible 1hr FY2E / SPACE-105E / IR : 3.8 IR 3.8 1hr FY2E / SPACE-105E / IR : 10.8 IR 10.8 1hr FY2E / SPACE-105E / IR : 12.0 IR 12 1hr FY2E / SPACE-105E / WV : 7.0 WV 7.0 1hr FY2E / SPACE-105E / Color Composition RGB MF Color composite 1hr FY2E / SPACE-105E / Visible 1km Visible 1km 1hr FY2E products FY2E / CYL50 / Precip. Ext. 6H Precipitation Estimation 6 hours 6hr FY2E / CYL50 / Precip. Ext. 24H 24 hours 1d (23h25) FY2E / CYL60 / BB Brigh. Temp. 1H 1H 1hr FY2E / CYL60 / BB Brigh. Temp. 24H 24H 1d (23h25) Black body brightness FY2E / CYL60 / BB Brigh. Temp. 120H temperature 120H 5d (23h25) FY2E / CYL60 / BB Brigh. Temp. 240H 240H 10d (23h25) FY2E / CYL60 / BB Brigh. Temp. 720H FY2E / CYL55 / Tot. Cloud Amount. Total Cloud Amount 1hr FY2E / CYL50 /Total Precip. Water Total Precipitable Water 1d (21h25) FY2E / CYL60 / Surf. Solar Irrad. Surface Solar Irradiance 1d (20h50) FY2E / CYL55 / HPF 300Hpa Humidity Product analysed by 300 hpa 3hr 720H 30d Meteo France International Page 81
FY2E / CYL55 / HPF 400Hpa cloud information 400 hpa 3hr FY2E / CYL55 / HPF 500Hpa 500 hpa 3hr FY2E / CYL55 / HPF 700Hpa 700 hpa 3hr FY2E / CYL55 / HPF 850Hpa 850 hpa 3hr FY2E / CYL55 / HPF 925Hpa 925 hpa 3hr FY2E / CYL55 / HPF 1000Hpa 1000 hpa 3hr FY2E / CYL55 / Cloud Class. Cloud Classification 1hr FY2E / CYL60 / Snow Fraction Snow Fraction 1d (9h30) FY2E / CYL50 / OLR 3H Outgoing Longwave Radiation 3h 3hr FY2E / CYL50 / OLR 24H 24h 1d (21h25) MTSAT1-R MTSAT1R / SPACE-GMS / VIS Visible 3hr MTSAT1R / SPACE-GMS / IR : 3.8 IR 3.8 3hr MTSAT1R / SPACE-GMS / IR : 10.8 WV 6.8 3hr MTSAT1R / SPACE-GMS / WV : 6.8 IR 10.8 3hr MTSAT1R / SPACE-GMS / Color Composition RGB MF Color composite 3hr GOES-W GOESW / SPACE-135W / VIS Visible 3hr GOESW / SPACE-135W / IR : 3.8 IR 3.8 3hr GOESW / SPACE-135W / IR : 10.8 WV 6.8 3hr GOESW / SPACE-135W / WV : 6.8 IR 10.8 3hr GOESW / SPACE-135W / Color Composition RGB MF Color composite 3hr GOES-E GOESE / SPACE-ADC / VIS Visible 3hr GOESE / SPACE-ADC / IR : 3.9 IR 3.9 3hr GOESE / SPACE-ADC / IR : 10.7 WV 6.6 3hr GOESE / SPACE-ADC / WV : 6.6 IR 10.7 3hr GOESE / SPACE-ADC / Color Composition RGB MF Color composite 3hr Vegetation for Africa Products (VITO) VITO / CYL38 / NDVI S10 NDVI 10d VITO / CYL38 / DMP Dry Matter Productivity 10d Fraction of Surface Covered by VITO / CYL38 / FGC Vegetation 10d VITO / CYL38 / LAI Leaf Area Index 10d Normalized Difference Water VITO / CYL38 / NDWI Index 10d VITO / CYL38 / PHENO_START Dates of start of season 10d VITO / CYL38 / PHENO_HALF Dates of the half-senescence 10d VITO / CYL38 / PHENO_LENGTH Phenology Length of season 10d VITO / CYL38 / PHENO_MAX Dates of the max of season 10d VITO / CYL38 / PHENO_MAXV NDVI value at the max of season VITO / CYL38 / SWB Detected small bodies 10d VITO / CYL38 / SWB_START Small Water Bodies Dates of start of season 10d VITO / CYL38 / SWB_END Dates of end of season 10d VITO / CYL38 / SWB_FLAG VITO / CYL38 / VPI Vegetation Productivity Indicator Flags for seasonality 10d 10d 10d Meteo France International Page 82
VITO / CYL38 / NMOD VITO / CYL38 / LMK VITO / CYL38 / SM VITO / CYL38 / Albedo Broad Band Dir. VITO / CYL38 / Albedo VIS Dir. VITO / CYL38 / Albedo IR Dir. VITO / CYL38 / Albedo Error BB DH VITO / CYL38 / Albedo Error VI DH VITO / CYL38 / Albedo Error NI DH Biogeophysical Quality information Total broadband directional hemispherical reflectance (albedo) Broadband directional hemispherical reflectance (albedo) for visible wavelengths Broadband directional hemispherical reflectance (albedo) for near infrared wavelengths Uncertainty on albedo number of valid observations during period land cover based on GCL2000 status map VITO / CYL38 / Albedo Quality Quality information for albedo status map 10d 10d 10d 10d 10d 10d 10d 10d 10d 10d Land SAF products for Africa (LSA SAF) LSAF / NAF-00 / Surf. LW Fluxes Downwelling Surface LW Northern africa 30mn LSAF / SAF-00 / Surf. LW Fluxes Fluxes Southern africa 30mn LSAF / NAF-00 / Surf. SW Fluxes Downwelling Surface SW Northern africa 30mn LSAF / SAF-00 / Surf. SW Fluxes Fluxes Southern africa 30mn LSAF / NAF-00 / FAPAR Fraction of Absorbed Northern africa 1d (00h00) Photosynthetic LSAF / SAF-00 / FAPAR Active Radiation (FAPAR) Southern africa 1d (00h00) LSAF / NAF-00 / Frac. Veget. Cover Northern africa 1d (00h00) Fractional Vegetation Cover LSAF / SAF-00 / Frac. Veget. Cover Southern africa 1d (00h00) LSAF / NAF-00 / Land Surf. Temp. Northern africa 15mn Land Surface Temperature LSAF / SAF-00 / Land Surf. Temp. Southern africa 15mn LSAF / NAF-00 / Leaf Area Index Northern africa 1d (00h00) Leaf Area Index LSAF / SAF-00 / Leaf Area Index Southern africa 1d (00h00) LSAF / NAF-00 / Risk of Fire Map Northern africa 15mn Risk of Fire Map LSAF / SAF-00 / Risk of Fire Map Southern africa 15mn LSAF / NAF-00 / Snow cover Northern africa 1d (00h00) Snow cover LSAF / SAF-00 / Snow cover Southern africa 1d (00h00) LSAF / NAF-00 / Evapotranspiration Northern africa 30mn LSAF / SAF-00 / Evapotranspiration Southern Africa 30mn LSAF / [NAF SAF]-00 / Albedo Broad Band Bi Broad Band Bi Hemisperical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo Broad Band Dir. Evapotranspiration Bread Band Directional Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo IR Dir. Near Infrared Directional Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo VIS Dir. visible Direcational Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo VIS 0.6 Bi channel visible 0.6 µ Bi- Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo VIS 0.6 Dir. channel visible 0.6 µ Directional Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo VIS 0.8 Bi channel visible 0.8 µ Bi- Albedo Hemsispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo VIS 0.8 Dir. channel visible 0.8 µ Directional Hemispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo IR 1.6 Bi channel ir 1.6 Bi-Hemsispherical 1d (00h00) LSAF / [NAF SAF]-00 / Albedo IR 1.6 Dir. channel ir 1.6 Directional Hemispherical 1d (00h00) Meteo France International Page 83
MODIS / CYL38 / Risk of Fire (Aqua) MODIS / CYL38 / FC (Aqua) MODIS / CYL38 / Risk of Fire (Terra) MODIS / CYL38 / FC (Terra) Plotting / Fire / Modis MODIS Fire Products (NOAA/NESDIS) MODIS FIRE PRODUCT 14 aqua MODISFIRE PRODUCT 14 terra MODIS Active Fires Southern Africa (CSIR) 5mn 5mn 5mn 5mn METOP / CYL60 / Atl. SST METOP / CYL90 / Atl. SST (Merged) METOP / CYL60 / Atl. SSI METOP / CYL90 / Atl. SSI (Merged) METOP / CYL60 / Atl. DLI METOP / CYL90 / Atl. DLI (Merged) METOP - Ocean Sea Ice SAF products (OSI SAF) Atlantic SST at Low and Mid Latitudes Multimission (Atl SST) Atlantic SST merged (MAP SST) (Atl. SST Merged) Atlantic Surface Solar Irradiance at Low and Mid Latitudes Multimission (Atl. SSI) Merge Atlantic Product Surface Solar Irradiance Multimission Atlantic Downward Longwave Irradiance at Low and Mid Latitudes -Multimission (Atl.DLI) Merged Atlantic Product Downward Longwave Irradiance Multimission 3hr (+1hr) 3hr (+15mn) 1d (12h00) 3hr 1d (23h15) METOP / GLOBUS / SST Global Metop SST 12hr METOP / ATL_EUROPE / SST North Atlantic and Regional SST (NAR SST) Metop & NOAA 19 3,10,13,20h METOP / NH / Sea Ice Concentration Global Sea Ice Concentration Northern hemisphere 1d (12h00) METOP / SH / Sea Ice Concentration (Northerm Hemiphere & Southern hemisphere 1d (12h00) Southern Hemisphere) METOP / MULTI / Sea Ice Concentration Northern hemisphere 1d (12h00) METOP / NH / Sea Ice Edge Global Sea Ice Edge Northern hemisphere 1d (12h00) METOP / SH / Sea Ice Edge (Northerm Hemiphere & Southern hemisphere 1d (12h00) Southern Hemisphere) METOP / MULTI / Sea Ice Edge Northern hemisphere 1d (12h00) METOP / NH / Sea Ice Type Global Sea Ice Type Northern hemisphere 1d (12h00) METOP / SH / Sea Ice Type (Northerm Hemiphere & Southern hemisphere 1d (12h00) Southern Hemisphere) METOP / MULTI / Sea Ice Type Northern hemisphere 1d (12h00) Meteo France International Page 84
Satellite products Ids (Synergie, Archipel and TelliCast) Synergie caption Default setting Synergie product acronym archipel application archipel product acronym Eumetcast identification MSG - Meteosat High Rate SEVIRI Image Data 0 (HR -SEVIRI) MSG / GLOBE-00 / VIS : 0.6 enable VIS006 imgprevi globemvis006td H-000-MSG2 -MSG2 -VIS006-000008 -201003132345-C_ MSG / GLOBE-00 / VIS : 0.8 enable VIS008 imgprevi globemvis008td H-000-MSG2 -MSG2 -VIS008-000008 -201003132345-C_ MSG / GLOBE-00 / VIS : 1.6 enable VIS016 imgprevi globemvis016td H-000-MSG2 -MSG2 -IR_016-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 3.9 enable IR_039 imgprevi globemir039td H-000-MSG2 -MSG2 -IR_039-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 8.7 enable IR_087 imgprevi globemir087td H-000-MSG2 -MSG2 -IR_087-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 9.7 enable IR_097 imgprevi globemir097td H-000-MSG2 -MSG2 -IR_097-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 10.8 enable IR_108 imgprevi globemir108td H-000-MSG2 -MSG2 -IR_108-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 12.0 enable IR_120 imgprevi globemir120td H-000-MSG2 -MSG2 -IR_120-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 13.4 enable IR_134 imgprevi globemir134td H-000-MSG2 -MSG2 -IR_134-000008 -201003132345-C_ MSG / GLOBE-00 / WV : 6.2 enable WV_062 imgprevi globemwv062tq H-000-MSG2 -MSG2 -WV_062-000008 -201003132345-C_ MSG / GLOBE-00 / WV : 7.3 enable WV_073 imgprevi globemwv073tq H-000-MSG2 -MSG2 -WV_073-000008 -201003132345-C_ MSG / GLOBE-00 / HRV enable HRV imgprevi globemhrvtq H-000-MSG2 -MSG2 -HRV -000024-201003130000-C_ MSG / GLOBE-00 / Color composition enable CC imgprevicc globemccgene2td N/A MSG / GLOBE-00 / VIS : 0.6 (LRIT) disable VIS006L imgprevi globemvis006td L-000-MSG2 -MSG2 -VIS006-000008 -201003132345-C_ MSG / GLOBE-00 / VIS : 1.6 (LRIT) disable VIS016L imgprevi globemvis016td L-000-MSG2 -MSG2 -IR_016-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 3.9 (LRIT) disable IR_039L imgprevi globemir039td L-000-MSG2 -MSG2 -IR_039-000008 -201003132345-C_ MSG / GLOBE-00 / IR : 10.8 (LRIT) disable IR_108L imgprevi globemir108td L-000-MSG2 -MSG2 -IR_108-000008 -201003132345-C_ MSG / GLOBE-00 / WV : 6.2 (LRIT) disable WV_062L imgprevi globemwv062tq L-000-MSG2 -MSG2 -WV_062-000008 -201003132345-C_ Meteosat Meteorological Products (MSG-MPEF) MPEF / GLOBE-00 / Divergence enable MPEF_DIV imgprevimpef globemdivt L-000-MSG2 -MPEF -TOZ -* MPEF / GLOBE-00 / Lifted Index enable MPEF_LIDX imgprevimpef globemgiilit MPEF / GLOBE-00 / Glob. Inst. Index enable MPEF_GII imgprevimpef globemgiikt L-000-MSG2 -MPEF -GII -* MPEF / GLOBE-00 / KO Index enable MPEF_KO imgprevimpef globemgiikot Meteo France International Page 85
MPEF / GLOBE-00 / Maximum Buoyancy Index enable MPEF_IPHM imgprevimpef globemgiimbt MPEF / GLOBE-00 / TPWC enable MPEF_TPWC imgprevimpef globemgiitpwt MPEF / GLOBE-00 / MPE enable MPEF_MPE imgprevimpef globemmpet L-000-MSG2 -MPEF -MPEG -* MPEF / GLOBE-00 / Total Ozone enable MPEF_TOZ imgprevimpef globemtozt L-000-MSG2 -MPEF -TOZ -* MPEF / GLOBE-00 / Trop. Humidity enable MPEF_TH imgprevimpef globemutht L-000-MSG2 -MPEF -TH -* MPEF / GLOBE-00 / Mid Trop. Humidity enable MPEF_MTH imgprevimpef globemmtht MPEF / GLOBE-00 / Active Fire Monitoring enable MPEF_FIR imgprevimpef globemfirgt L-000-MSG2 -MPEF -FIRG -* MPEF / GLOBE-00 / Clear-Sky Rad. 3.9 disable MPEF_CSR_039 imgprevimpef globemcsrir039t L-000-MSG2 -MPEF -CSR -* MPEF / GLOBE-00 / Clear-Sky Rad. 10.8 disable MPEF_CSR_108 imgprevimpef globemcsrir108t MPEF / GLOBE-00 / Clear-Sky Rad. 12.0 disable MPEF_CSR_120 imgprevimpef globemcsrir120t MPEF / GLOBE-00 / Clear-Sky Ref. Map 0.6 disable MPEF_CRM_06 imgprevimpef globemcrmvis006t L-000-MSG2 -MPEF -CRM -* MPEF / GLOBE-00 / Clear-Sky Ref. Map 0.8 disable MPEF_CRM_08 imgprevimpef globemcrmvis008t MPEF / GLOBE-00 / Clear-Sky Ref. Map 1.6 disable MPEF_CRM_16 imgprevimpef globemcrmvis016t MPEF / GLOBE-00 / Analysis Low Clouds enable MPEF_CLA_L imgprevimpef globemclalcdct L-000-MSG2 -MPEF -CLA -* MPEF / GLOBE-00 / Analysis Mid Clouds enable MPEF_CLA_M imgprevimpef globemclamcdct MPEF / GLOBE-00 / Analysis High Clouds enable MPEF_CLA_H imgprevimpef globemclahcdct MPEF / GLOBE-00 / Analysis Total Clouds enable MPEF_CLA_T imgprevimpef globemclatcdct MPEF / GLOBE-00 / Analysis Cloud Image enable MPEF_CLAI imgprevimpef globemclait L-000-MSG2 -MPEF -CLAI -* MPEF / GLOBE-00 / Cloud Mask enable MPEF_CLM imgprevimpef globemclmt L-000-MSG2 -MPEF -CLM -* MPEF / GLOBE-00 / Cloud Height enable MPEF_CTH imgprevimpef globmctht L-000-MSG2 -MPEF -CTH -* RGB Meteosat High Rate SEVIRI Image 0 (HR-SEVIR I) RGB / GLOBE-00 / RGB natural color enable CC_DNC imgrgb globemnatcolort N/A RGB / GLOBE-00 / RGB day Microphysics Summer enable CC_DMP imgrgb globemmiphyst N/A RGB / GLOBE-00 / RGB day Microphysics Winter enable CC_DMPW imgrgb globmmiphywt N/A RGB / GLOBE-00 / RGB Solar enable CC_DS imgrgb globemdaysolart N/A RGB / GLOBE-00 / RGB Day convective Storm enable CC_DCS imgrgb globemconvstormt N/A RGB / GLOBE-00 / RGB Nigth Microphysical enable CC_NMP imgrgb globmnmiphyt N/A RGB / GLOBE-00 / RGB H-24 dust micophysics enable CC_DUST imgrgb globemdusth24t N/A RGB / GLOBE-00 / RGB Airmass enable CC_AIRMASS imgrgb globmairmasst N/A RGB / GLOBE-00 / RGB HRV cloud enable HRV-CLOUD imgrgb globemhrvcloudt N/A Meteo France International Page 86
RGB / GLOBE-00 / RGB HRV Fog enable HRV-FOG imgrgb globemhrvfogt N/A RGB / GLOBE-00 / RGB HRV Severe storm enable HRV-SS imgrgb globemhrvsstormt N/A RGB / GLOBE-00 / RGB Test i (i=1 to 10) enable CC_TEST (1 to 10) imgrgbtest globemrgbtestit (i=1,10) N/A Meteosat 7 - HRI Image Data -Indian Ocean Coverage (HRI) METEOSAT7 / SPACE-63E / VIS enable VIS imgiodc globeivst L-000-MTP -MET7-00_7_057E-000010-201003140000-C_ METEOSAT7 / SPACE-63E / IR enable IR imgiodc globeiirt L-000-MTP -MET7-11_5_057E-000005-201003140000-C_ METEOSAT7 / SPACE-63E / WV enable WV imgiodc globeiwvt L-000-MTP -MET7-06_4_057E-000005-201003140000-C_ METEOSAT7 / SPACE-63E / Color Composition enable CC imgiodc globeicct N/A FY2E Imagery and products FY2E / SPACE-105E / VIS enable VIS imgfy globecvis007t Z_SATE_C_BABJ_20100202090000_O_FY2E_FDI_VIS_001_NOM.HDF FY2E / SPACE-105E / IR : 3.8 enable IR_038 imgfy globecir038t Z_SATE_C_BABJ_20100202090000_O_FY2E_FDI_IR4_001_NOM.HDF FY2E / SPACE-105E / IR : 10.8 enable IR_108 imgfy globecir108t Z_SATE_C_BABJ_20100202090000_O_FY2E_FDI_IR1_001_NOM.HDF FY2E / SPACE-105E / IR : 12.0 enable IR_012 imgfy globecir120t Z_SATE_C_BABJ_20100202090000_O_FY2E_FDI_IR2_001_NOM.HDF FY2E / SPACE-105E / WV : 7.0 enable WV_070 imgfy globecwv070t Z_SATE_C_BABJ_20100202090000_O_FY2E_FDI_IR3_001_NOM.HDF FY2E / SPACE-105E / Color Composition enable CC imgfy globecccmediat N/A FY2E / SPACE-105E / Visible 1km disable VIS 1KM imgfy globecvis1kmt Z_SATE_C_BABJ_20100313220000_O_FY2E_FDI_VIS1KM_001_NOM.HDF.gz FY2E / CYL50 / Precip. Ext. 6H disable PRE_6H fycylcpre006t Z_SATE_C_BABJ_20100313180000_O_FY2E_PRE_006_NOM.AWX.gz FY2E / CYL50 / Precip. Ext. 24H disable PRE_24H fycylcpre024t Z_SATE_C_BABJ_20100313000000_O_FY2E_PRE_024_NOM.AWX.gz FY2E / CYL60 / BB Brigh. Temp. 1H disable TBB_1H fycylctbb001t Z_SATE_C_BABJ_20100313230000_O_FY2E_TBB_IR1_001_NOM.AWX.gz FY2E / CYL60 / BB Brigh. Temp. 24H disable TBB_24H fycylctbb024t Z_SATE_C_BABJ_20100312230000_O_FY2E_TBB_IR1_024_NOM.AWX.gz FY2E / CYL60 / BB Brigh. Temp. 120H disable TBB_120H fycylcbbt120t Z_SATE_C_BABJ_20071201010000_O_FY2E_TBB_IR1_120_ NOM.AWX.GZ FY2E / CYL60 / BB Brigh. Temp. 240H disable TBB_240H fycylcbby240t Z_SATE_C_BABJ_20071201010000_O_FY2E_TBB_IR1_240_ NOM.AWX.GZ FY2E / CYL60 / BB Brigh. Temp. 720H disable TBB_720H fycylcbbt720t Z_SATE_C_BABJ_20071201010000_O_FY2E_TBB_IR1_720_ NOM.AWX.GZ FY2E / CYL55 / Tot. Cloud Amount. disable TCA_1H fycylcctat Z_SATE_C_BABJ_20100313230000_O_FY2E_CTA_MLT_001_NOM.AWX.gz FY2E / CYL50 /Total Precip. Water disable TPW fycylctpwt Z_SATE_C_BABJ_20100313210000_O_FY2E_TPW_MLT_001_NOM.AWX.gz FY2E / CYL60 / Surf. Solar Irrad. disable SSI fycylcssit Z_SATE_C_BABJ_20071206230000_O_FY2E_SSI_MLT_024_ OTG.AWX.GZ FY2E / CYL55 / HPF 300Hpa disable HPF_300 fycylchpf300t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_300hPa.AWX.gz FY2E / CYL55 / HPF 400Hpa disable HPF_400 fycylchpf400t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_400hPa.AWX.gz FY2E / CYL55 / HPF 500Hpa disable HPF_500 fycylchpf500t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_500hPa.AWX.gz FY2E / CYL55 / HPF 700Hpa disable HPF_700 fycylchpf700t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_700hPa.AWX.gz FY2E / CYL55 / HPF 850Hpa disable HPF_850 fycylchpf850t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_850hPa.AWX.gz Meteo France International Page 87
FY2E / CYL55 / HPF 925Hpa disable HPF_925 fycylchpf925t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_925hPa.AWX.gz FY2E / CYL55 / HPF 1000Hpa disable HPF_1000 fycylchpf1000t Z_SATE_C_BABJ_20100313210000_O_FY2E_HPF_MLT_003_NOM_1000hPa.AWX.gz FY2E / CYL55 / Cloud Class. enable CLT fycylccltp Z_SATE_C_BABJ_20071206160000_O_FY2E_CLT_MLT_001_ NOM.AWX.GZ FY2E / CYL60 / Snow Fraction disable TSG fycylctsgt Z_SATE_C_BABJ_20100313160000_O_FY2E_TSG_MLT_024_OTG.AWX.gz FY2E / CYL50 / OLR 3H disable OLR_3H fycylcolr003t Z_SATE_C_BABJ_20100313210000_O_FY2E_OLR_MLT_003_NOM.AWX.gz FY2E / CYL50 / OLR 24H disable OLR_24H fycylcolr024 Z_SATE_C_BABJ_20100313230000_O_FY2E_OLR_MLT_024_NOM.AWX.gz MTSAT1-R MTSAT1R / SPACE-GMS / VIS enable VIS imgfsd globejvis007t L-000-MSG2 -MTSAT1R -00_7_140E-CYCLE -201002032200 MTSAT1R / SPACE-GMS / IR : 3.8 enable IR_308 imgfsd globejir038t L-000-MSG2 -MTSAT1R -03_8_140E-CYCLE -201002032200 MTSAT1R / SPACE-GMS / IR : 10.8 enable WV_068 imgfsd globejiwv068t L-000-MSG2 -MTSAT1R -06_8_140E-CYCLE -201002040000 MTSAT1R / SPACE-GMS / WV : 6.8 enable IR_108 imgfsd globejir108t L-000-MSG2 -MTSAT1R -10_8_140E-CYCLE -201002032200 MTSAT1R / SPACE-GMS / Color Composition enable CC imgfsd globejccmediat N/A GOES-West GOESW / SPACE-135W / VIS disable VIS imgfsd globewvis007t L-000-MSG2 -GOES11-00_7_135W-CYCLE -201002040500 GOESW / SPACE-135W / IR : 3.8 disable IR_308 imgfsd globewir039t L-000-MSG2 -GOES11-03_9_135W-CYCLE -201002040200 GOESW / SPACE-135W / IR : 10.8 disable WV_068 imgfsd globewwv068t L-000-MSG2 -GOES11-06_8_135W-CYCLE -201002040200 GOESW / SPACE-135W / WV : 6.8 disable IR_108 imgfsd globewir107t L-000-MSG2 -GOES11-10_7_135W-CYCLE -201002040200 GOESW / SPACE-135W / Color Composition disable CC imgfsd globewcct N/A GOES-East GOESE / SPACE-ADC / VIS enable VIS imgfsd globeevis007t L-000-MSG2 -GOES12-10_7_075W-CYCLE -201002040400 GOESE / SPACE-ADC / IR : 3.9 enable IR_309 imgfsd globeeir039t L-000-MSG2 -GOES12-03_9_075W-CYCLE -201002040400 GOESE / SPACE-ADC / IR : 10.7 enable WV_066 imgfsd globeewv066t L-000-MSG2 -GOES12-06_6_075W-CYCLE -201002040400 GOESE / SPACE-ADC / WV : 6.6 enable IR_107 imgfsd globeeir107t L-000-MSG2 -GOES12-10_7_075W-CYCLE -201002040000 GOESE / SPACE-ADC / Color Composition enable CC imgfsd globeeccmediat N/A Vegetation for Africa Products (VITO) VITO / CYL38 / NDVI disable NDVI imgvito africasv4andvit V2KRNS10 YYYYMMDD_NDVI Africa.ZIP VITO / CYL38 / DMP disable DMP imgvito africasv4admpt VGT4AFRICA_DMP_YYYYMMDD_Africa.ZIP VITO / CYL38 / FGC disable FGC imgvito africasv4afcovert VGT4AFRICA_FCOVER_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / LAI disable LAI imgvito africasv4alait VGT4AFRICA_LAI_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / NDWI disable NDWI imgvito africasv4andwit VGT4AFRICA_NDWI_YYYYMMDD_Africa.ZIP Meteo France International Page 88
VITO / CYL38 / PHENO_START disable PHENO_START imgvito africasv4aphenoksstartt VITO / CYL38 / PHENO_HALF disable PHENO_HALF imgvito africasv4aphenokshalft VGT4AFRICA_PHENOKS_YYYYMMDD_Africa.ZIP VITO / CYL38 / PHENO_LENGTH disable PHENO_LENGTH imgvito africasv4aphenokslengtht VITO / CYL38 / PHENO_MAX disable PHENO_MAX imgvito africasv4aphenomaxt VITO / CYL38 / PHENO_MAXV disable PHENO_MAXV imgvito africasv4aphenomaxvalt VGT4AFRICA_PHENOMAX_YYYYMMDD_Africa.ZIP VITO / CYL38 / SWB disable SWB imgvito africasv4aswbt VITO / CYL38 / SWB_START disable SWB_START imgvito africasv4aswbstartt VGT4AFRICA_SWB_YYYYMMDD_Africa.ZIP VITO / CYL38 / SWB_END disable SWB_END imgvito africasv4aswbendt VITO / CYL38 / SWB_FLAG disable SWB_FLAG imgvito africasv4aswbflagt VITO / CYL38 / VPI disable VPI imgvito africasv4avpit VGT4AFRICA_VPI_YYYYMMD_Africa.ZIP VITO / CYL38 / NMOD disable NMOD imgvito africasv4abioqnbvalidt VITO / CYL38 / LMK disable LMK imgvito africasv4abioqcovert VITO / CYL38 / SM disable SM imgvito africasv4abioqstatust VGT4AFRICA_BIOQ_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / Albedo Broad Band Dir. disable ALB_BB_DH imgvito africasv4aalbbbdhrtt VGT4AFRICA_BBDHRT_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / Albedo VIS Dir. disable ALB_VI_DH imgvito africasv4aalbbbdhrvt VGT4AFRICA_BBDHRV_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / Albedo IR Dir. disable ALB_NI_DH imgvito africasv4aalbbbdhrnt VGT4AFRICA_BBDHRN_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / Albedo Error BB DH disable ALB_ERR_BB_DH imgvito africasv4aalberrbbdhrtt VITO / CYL38 / Albedo Error VI DH disable ALB_ERR_VI_DH imgvito africasv4aalberrbbdhrvt VITO / CYL38 / Albedo Error NI DH disable ALB_ERR_NI_DH imgvito africasv4aalberrbbdhrnt VGT4AFRICA_ALBE_YYYYMMDD_Africa_POSTEL.ZIP VITO / CYL38 / Albedo Quality disable ALB_SM imgvito africasv4aalbqualstatust VGT4AFRICA_ALBQ_YYYYMMDD_Africa_POSTEL.ZIP Land SAF products for Africa (LSA SAF) LSAF / NAF-00 / Surf. LW Fluxes disable DSLF imgsafland nafrmsaflsadslft S-LSA_-HDF5_LSASAF_MSG_DSLF_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Surf. LW Fluxes disable DSLF imgsafland safrmsaflsadslft S-LSA_-HDF5_LSASAF_MSG_DSLF_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Surf. SW Fluxes disable DSSF imgsafland nafrmsaflsadssft S-LSA_-HDF5_LSASAF_MSG_DSSF_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Surf. SW Fluxes disable DSSF imgsafland safrmsaflsadssft S-LSA_-HDF5_LSASAF_MSG_DSSF_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / FAPAR disable FAPAR imgsafland nafrmsaflsafapart S-LSA_-HDF5_LSASAF_MSG_FAPAR_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / FAPAR disable FAPAR imgsafland safrmsaflsafapart S-LSA_-HDF5_LSASAF_MSG_FAPAR_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Frac. Veget. Cover disable FVC imgsafland nafrmsaflsafvct S-LSA_-HDF5_LSASAF_MSG_FVC_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Frac. Veget. Cover disable FVC imgsafland safrmsaflsafvct S-LSA_-HDF5_LSASAF_MSG_FVC_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Land Surf. Temp. enable LST imgsafland nafrmsaflsalstt S-LSA_-HDF5_LSASAF_MSG_LST_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Land Surf. Temp. enable LST imgsafland safrmsaflsalstt S-LSA_-HDF5_LSASAF_MSG_LST_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Leaf Area Index disable LAI imgsafland nafrmsaflsalait S-LSA_-HDF5_LSASAF_MSG_LAI_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Leaf Area Index disable LAI imgsafland safrmsaflsalait S-LSA_-HDF5_LSASAF_MSG_LAI_SAfr_YYYYMMDDHHMM Meteo France International Page 89
LSAF / NAF-00 / Risk of Fire Map enable FRP imgsafland nafrmsaflsafrpt S-LSA_-HDF5_LSASAF_MSG_FRP-PIXEL-ListProduct_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Risk of Fire Map enable FRP imgsafland safrmsaflsafrpt S-LSA_-HDF5_LSASAF_MSG_FRP-PIXEL-ListProduct_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Snow cover disable SC imgsafland nafrmsaflsasct S-LSA_-HDF5_LSASAF_MSG_SC2_NAfr_YYYYMMDDHHMM LSAF / SAF-00 / Snow cover disable SC imgsafland safrmsaflsasct S-LSA_-HDF5_LSASAF_MSG_SC2_SAfr_YYYYMMDDHHMM LSAF / NAF-00 / Evapotranspiration disable ET imgsafland nafrmsaflsaett S-LSA_-HDF5_LSASAF_MSG_ET_NAfr_201003132300.bz2 LSAF / SAF-00 / Evapotranspiration disable ET imgsafland safrmsaflsaett S-LSA_-HDF5_LSASAF_MSG_ET_SAfr_201003132300.bz2 LSAF / [NAF SAF]-00 / Albedo Broad Band Bi disable ALB_BB_BH imgsafland [nafr safr]msaflsaalbbbht S-LSA_-HDF5_LSASAF_MSG_ALBEDO_[NAfr SAfr]_201003120000.bz2 LSAF / [NAF SAF]-00 / Albedo Broad Band Dir. disable ALB_BB_DH imgsafland [nafr safr]msaflsaalbbdht LSAF / [NAF SAF]-00 / Albedo IR Dir. disable ALB_NI_DH imgsafland [nafr safr]msaflsaalnidht LSAF / [NAF SAF]-00 / Albedo VIS Dir. disable ALB_VI_DH imgsafland [nafr safr]msaflsaavidht LSAF / [NAF SAF]-00 / Albedo VIS 0.6 Bi disable ALB_06_BH imgsafland [nafr safr]msaflsaal006bht S-LSA_-HDF5_LSASAF_MSG_AL-C1_[NAfr SAfr]_201003120000.bz2 LSAF / [NAF SAF]-00 / Albedo VIS 0.6 Dir. disable ALB_06_DH imgsafland [nafr safr]msaflsaal006dht LSAF / [NAF SAF]-00 / Albedo VIS 0.8 Bi disable ALB_08_BH imgsafland [nafr safr]msaflsaal008bht S-LSA_-HDF5_LSASAF_MSG_AL-C2_[NAfr SAfr]_201003120000.bz2 LSAF / [NAF SAF]-00 / Albedo VIS 0.8 Dir. disable ALB_08_DH imgsafland [nafr safr]msaflsaal008dht LSAF / [NAF SAF]-00 / Albedo IR 1.6 Bi disable ALB_16_BH imgsafland [nafr safr]msaflsaal016bht S-LSA_-HDF5_LSASAF_MSG_AL-C3_[NAfr SAfr]_201003120000.bz2 LSAF / [NAF SAF]-00 / Albedo IR 1.6 Dir. disable ALB_16_DH imgsafland [nafr safr]msaflsaal016dht MODIS Fire Products (NOAA/NESDIS) MODIS / CYL38 / Risk of Fire (Aqua) enable africapfrpt MOD14.PYYYYMMDD.HHMN.hdf.gz MODIS / CYL38 / FC (Aqua) enable africappct MODIS / CYL38 / Risk of Fire (Terra) enable africapfrpt MOD14.AYYYYMMDD.HHMN.hdf.gz MODIS / CYL38 / FC (Terra) enable africapict Plotting / Fire / Modis enable direct send to synergie MODIS[A T]_FIRE.2008001.0830.txt METOP / CYL60 / Atl. SST enable LMLSST METOP / CYL90 / Atl. SST (Merged) enable MAPSST METOP / CYL60 / Atl. SSI enable LML SSI METOP - Ocean Sea Ice SAF products (OSI SAF) direct to Synergie (GRIB->GRIBS) direct to Synergie (GRIB->GRIBS) S-OSI_-FRA_-MULT-LMLSST_G[INF FIELD TIME QUAL]_- YYYYMMDDYYMMZ.[txt grb]. gz S-OSI_-FRA_-MULT-MAPSST_G[INF FIELD TIME QUAL]_- YYYYMMDDHHMNZ.[txt grb]. Gz direct to Synergie (modele) S-OSI_-FRA_-MULT-LMLSSI_G[INF FIELD QUAL]_-YYYYMMDDHHMNZ.[txt grb]. gz METOP / CYL90 / Atl. SSI (Merged) enable MAP SSI direct to S-OSI_-FRA_-MULT-MAPSSI_G[INF FIELD QUAL]_-YYYYMMDDHHMNZ.[txt grb]. gz Meteo France International Page 90
METOP / CYL60 / Atl. DLI enable LMLDLI METOP / CYL90 / Atl. DLI (Merged) enable MAP DLI Synergie (modele) direct to Synergie (modele) S-OSI_-FRA_-MULT-LMLDLI_G[INF QUAL FIELD]_-YYYYMMDDHHMNZ.[txt grb] direct to Synergie (modele) S-OSI_-FRA_-MULT-MAPDLI_G[INF FIELD QUAL]_-YYYYMMDDHHMNZ.[txt grb]. gz METOP / GLOBUS / SST enable SST imgsafosi glbsstt S-OSI_-FRA_-MTOP-GLBSST_FIELD-YYYYMMDDHHMNZ.grb. gz METOP / ATL_EUROPE / SST enable NAR SST imgsafosi narsstt S-OSI_-FRA_-[MTOP NOAA]-NARSST_FIELD-YYYYMMDDHHMNZ.grb.gz METOP / NH / Sea Ice Concentration enable direct to Synergie S-OSI_-NOR_-MULT-GL_NH_CONC -200611141200Z.grb.gz METOP / SH / Sea Ice Concentration enable direct to Synergie S-OSI_-NOR_-MULT-GL_SH_CONC -200611141200Z.grb.gz METOP / MULTI / Sea Ice Concentration enable direct to Synergie S-OSI_-NOR_-MULT-MULTI_CONC -201003121200Z.grb.gz METOP / NH / Sea Ice Edge enable direct to Synergie S-OSI_-NOR_-MULT-GL_NH_EDGE -200611141200Z.grb.gz direct to GLBSIE METOP / SH / Sea Ice Edge enable Synergie S-OSI_-NOR_-MULT-GL_SH_EDGE -200611141200Z.grb.gz direct to METOP / MULTI / Sea Ice Edge enable Synergie S-OSI_-NOR_-MULT-MULTI_EDGE -201003121200Z.grb.gz METOP / NH / Sea Ice Type enable direct to Synergie S-OSI_-NOR_-MULT-GL_NH_TYPE -200611141200Z.grb.gz METOP / SH / Sea Ice Type enable direct to Synergie S-OSI_-NOR_-MULT-GL_SH_TYPE -200611141200Z.grb.gz METOP / MULTI / Sea Ice Type enable direct to Synergie S-OSI_-NOR_-MULT-MULTI_TYPE -201003121200Z.grb.gz Meteo France International Page 91
8.3 Archipel chain: description of the applications Find below the specific applications integrated in the Archipel chain for PUMA: Application Purpose Incoming data Outgoing products controle Control HMChrv, HMCvis006,HMCvis008,HMCwv062,HMC wv073,hmcir108,hmcir016,hmcir039,h MCir087,HMCir097,HMCir120,HMCir134 imgprevi Imagery (single channel products) HMCir016,HMCir039,HMCir087,HMCir09 7,HMCir108,HMCir120,HMCir134,HMCvi s006,hmcvis008,hmcwv062,hmcwv073 globemvis006td, globemvis008td, globemvis016td, globemir039td, globemir087td, globemir097td, globemir108td, globemir120td, globemir134td, globemwv062tq, globemwv073tq, The visible products are not corrected for sun angle. The dynamics used for these products is as follows: Reflectance (%) = 100* CN/255 for a numerical account of a value «CN». The infra-red product is defined with the dynamics «modea» : T (degrees K) = 330 - (CN/2.0) for CN [0,175] Meteo France International Page 92
Application Purpose Incoming data Outgoing products T (degrees K) = 242 (CN-176) for CN [176,255] The steam product is defined with the following dynamics: T (degrees K) = 180 + CN/2 The products have the TIFF-MF bi-plane format (an image plane, a dating plane). imgprevicc imgprevihrv imgiodc Imagery (color composition products) Imagery (high resolution visible products) Generation of products from the satellite data meteosat07 HMCvis006, HMCvis008, HMCir016, HMCir039, HMCir087, HMCir108, HMCir120, HMCir134, globemir016fis, globemir087fis, globemir108fis, globemir134fis, globemvis008fis, globemwv073fis, globemir039fis, globemir097fis, globemir120fis, globemvis006fis, globemwv062fis HMChrv LIC007057e, LIC064057e, LIC115057e The reference date of the products with a TIFF-MF format is later than a quarter of an hour compared to the reference date of the HRIT data globemccgene2tp This product has been a very advanced design at Météo-France and offers a colorful rendering facilitating cloud recognition for the forecasters. The reference date of the products with a TIFF-MF format is later than a quarter of an hour compared to the reference date of the HRIT data GlobeMhrvTQ This product is not corrected for sun angle. The dynamics used for this product is as follows: Reflectance (%) = 100* CN/255 for a numerical account of a value «CN» globeicct, globeiirt, globeivst, globeiwvt This product is not corrected for sun angle. Meteo France International Page 93
Application Purpose Incoming data Outgoing products The dynamics used for this product is as follows: Reflectance (%) = 100* CN/255 for a numerical account of a value «CN» The infra-red product is defined with the dynamics «modea» : T (degrees K) = 330 - (CN/2.0) for CN [0,175] T (degrees K) = 242 (CN-176) for CN [176,255] imgfy Generation of single channel and color composition products from the satellite data FY2E hdfcir1, hdfcir2, hdfcir3, hdfcir4, hdfcvis Format: hdf5 Identification interface: java HDFfy_idf The steam product is defined with the following dynamics: T (degrees K) = 180 + CN/3 globecir108t, globecir120t, globecwv070t, globecir038t, globecvis007t, globecccmediat The visible product is not corrected for sun angle. The dynamics used for this product is as follows: Reflectance (%) = 100* CN/255 for a numerical account of a value «CN» The infra-red products are defined with the dynamics «modea» : Meteo France International Page 94
Application Purpose Incoming data Outgoing products T (degrees K) = 330 - (CN/2.0) for CN [0,175] T (degrees K) = 242 (CN-176) for CN [176,255] imgfsd Generation of single channel and color composition products from the satellite data GOES-E, GOES- W and MTSAT LEC007075w, LEC039075w, LEC066075w, LEC107075w, LJC007140e, LJC038140e, LJC068140e, LJC108140e, LWC007135w, LWC039135w, LWC068135w, LWC107135w The steam product is defined with the following dynamics: T (degrees K) = 180 + CN/3 globejvis007t, globejir038t, globejiwv068t, globejir108t, globejccmediat, globeevis007t, globeeir039t, globeewv066t, globeeir107t, globeeccmediat, globewvis007t, globewir039t, globewwv068t, globewir108t, globewccmediat The visible products are not corrected for sun angle. The dynamics used for this product is as follows: Reflectance (%) = 100* CN/255 for a numerical account of a value «CN» The infra-red products are defined with the dynamics «modea» : T (degrees K) = 330 - (CN/2.0) for CN [0,175] Meteo France International Page 95
Application Purpose Incoming data Outgoing products T (degrees K) = 242 (CN-176) for CN [176,255] imgprevimpef Generation of TIFF-MF imagery products from MPEF products with a bufr or grib format In some cases, several imagery products can be generated from one source. LMCamv, LMCasr, LMCcla, LMCclai, LMCclm, LMCcrm, LMCcsr, LMCcth, LMCfira, LMCfirg, LMCgii, LMCmpeg, LMCth, LMCtoz Format: LRIT files reconstituted in cycles Identification interface: XRITfile_idf For the archive reprocessing, the declared sources are: mpefmasr, mpefmcla, mpefmclai, mpefmclm, mpefmcmr, mpefmcrm, mpefmcsr, mpefmcth, mpefmdiv, mpefmfirg, mpefmgii, mpefmmpeg, mpefmth, mpefmtoz Format: grib or bufr The steam product is defined with the following dynamics: T (degrees K) = 180 + CN/3 globemfirgt: Fire Detection globmcsrir039t: Clear sky radiance ir 39 globemcsrir108t: Clear sky radiance ir 10.8 globemcsrir120t: clear sky radiance ir 12.0 globemcrmvis006t: Clear sky reflectance map vis 0.6 globemcrmvis008t: Clear sky reflectance map vis 0.8 globemcrmvis016t: Clear sky reflectance map ir 1.6 globemclalcdct: Cloud Analysis Law Clouds globemclamcdct: Cloud Analysis Mid Clouds globemclahcdct: Cloud Analysis Height Clouds globemclatcdct: Cloud Analysis Total Clouds globemclmt: Cloud mask globmctht: Cloud heigth globemgiilit: Lifted index globemgiikt: globemgiitpwt: k index Total precipitation water content Meteo France International Page 96
Application Purpose Incoming data Outgoing products imgdiv imgsafland Generation of the divergence imagery products Generation of imagery products from the SAF LAND products LMCdiv Format: HDF5 compressed bz2 Domains: - Euro - Nafr - Safr Frequency: - DSLF : 2 / hour - DSSF : 2 / hour - FAPAR : 1 / day - FRPList : 4 / hour - FRPQual : 4 / hour - FVC : 1 / day - LAI : 1 / day - LST : 4 / hour - SC : 1 / day globemmpet: globemtozt: globemutht: globemmtht: Multi-Sensor Precipitation Estimate Total Ozone Upper topospheric humidity Mid tropospheric humidity The reference date of the products is later than a quarter of an hour compared to the reference date of the source data globemdivt the product is reprojected on a domain full disk 1250x1250 and interpolated (bilinear interpolation) The reference date of the product is later than a quarter of an hour compared to the reference date of the source data Frequency and domain= like sources euromsaflsadslft euromsaflsadssft euromsaflsafapart euromsaflsafrpt euromsaflsafvct euromsaflsalait euromsaflsalstt euromsaflsasct nafrmsaflsadslft nafrmsaflsadssft nafrmsaflsafapart nafrmsaflsafrpt nafrmsaflsafvct nafrmsaflsalait nafrmsaflsalstt nafrmsaflsasct safrmsaflsadslft Meteo France International Page 97
Application Purpose Incoming data Outgoing products Sources: - lsameurodslf - lsameurodssf - lsameurofapar - lsameurofrplist - lsameurofrpqual - lsameurofvc - lsameurolai - lsameurolst - lsameurosc - lsamnafrdslf - lsamnafrdssf - lsamnafrfapar - lsamnafrfrplist - lsamnafrfrpqual - lsamnafrfvc - lsamnafrlai - lsamnafrlst - lsamnafrsc - lsamsafrdslf - lsamsafrdssf - lsamsafrfapar - lsamsafrfrplist - lsamsafrfrpqual - lsamsafrfvc - lsamsafrlai - lsamsafrlst - lsamsafrsc The reference date of the products is the expiry date. safrmsaflsadssft safrmsaflsafapart safrmsaflsafrpt safrmsaflsafvct safrmsaflsalait safrmsaflsalstt safrmsaflsasct Identification interface: java SAFLand_idf imgvito Generation of imagery products Format: ZIP Archive containing useful Frequency and domain= like sources Meteo France International Page 98
Application Purpose Incoming data Outgoing products from the VITO products files with HDF4 format Frequency: decadal Africa domains: - cylindric - 26 W 60 E, 35 S 38 N, - 9633 pixels X 8177 lines meaning a 1 km resolution Sources list: - v4asdmp - v4asfcover - v4aslai - v4asndvi - v4asndwi - v4asphenoks - v4asphenomax - v4asswb - v4asvpi List : - africasv4admpt - africasv4afcovert - africasv4alait - africasv4andvit - africasv4andwit - africasv4aphenokshalft - africasv4aphenokslengtht - africasv4aphenoksstartt - africasv4aphenomaxt - africasv4aphenomaxvalt - africasv4aswbt - africasv4aswbendt - africasv4aswbflagt - africasv4aswbstartt - africasv4avpit imgmodisfire Generation of products from the MODIS Fire product of aqua and terra Identification interface: java VGT4AFRICA_idf - mod14aqua - mod14terra These sources are related to the products MODIS Active Fire Level 2 Refer to «MODIS Collection 5 Active Fire Product User's Guide Version 2.4» Format : hdf4 Frequency: a granule every 5mn for each satellite. Identification interface: java modfire.modfire_idf - africapfrpt: Fire radiative power on the africa domain - africapfct: Fire Confidence on the africa domain The africa domain is the same than the one used by the VITO application: - cylindric - 26 W 60 E, 35 S 38 N, - 9633 pixels X 8177 lines meaning a 1 km resolution The data from the Fire Pixel Tables are used to generate products. We use FP_power to generate the africapfrpt product and FP_confidence to Meteo France International Page 99
Application Purpose Incoming data Outgoing products imgsafosi Generation of imagery products from the SAF OSI products GLBsstgrb NARsstgrb generate the africapfct product. Each granule is analysed, if the granule does not correspond to the africa domain or if no fire is observed for this granule, the product is not generated. Otherwise, data are pointed on the africa domain and a mask is elaborated around the observed data from the following information read in the Metadata «Archive» part of the data files: - "NORTHBOUNDINGCOORDINATE" - "SOUTHBOUNDINGCOORDINATE" - "EASTBOUNDINGCOORDINATE" - "WESTBOUNDINGCOORDINATE" - glbsstt - narsstt Format: grib edition 2 imgrgb Generation of RGB imagery HMCir016, HMCir039, HMCir087, - globemnatcolort: RGB «Natural Color» products HMCir097, HMCir108, HMCir120, - globemdmiphyst: RGB«day HMCir134, HMCvis006, HMCvis008, microphysical summer» HMCwv062, HMCwv073, HMChrv - globemdmiphywt: RGB«day microphysical winter» - globemdaysolart: RGB «day solar» - globemconvstormt: RGB «Convective Storms» - globemnmiphyt: RGB «night microphysical» - globemdusth24t: «Dust» - globemairmasst: «Airmass» - globemhrvcloudt: «HRV Clouds» - globem hrvfogt: «HRV Fog» - globemhrvsstormt: «HRV Severe Storms» imgrgbtest Generation of imagery products HMCir016, HMCir039, HMCir087, globemrgbtestit (i=1,10): definition of Meteo France International Page 100
Application Purpose Incoming data Outgoing products in test mode (the products are user configurable) HMCir097, HMCir108, HMCir120, HMCir134, HMCvis006, HMCvis008, HMCwv062, HMCwv073, HMChrv product in test Meteo France International Page 101
8.4 Power failure strategy 8.4.1 Presentation The UPS manager software is automatically installed on SYNERGIE-PUMA stations. The shutdown procedure is also configured. The computer PC1 is directly linked to the UPS via an USB cable and is in charge of the power management of the others computers (PC2 and PC3). In case of local power failure (T0), the following procedure is executed: The UPS switches to battery mode and continue to supply power to the 3 PCs. The UPS rings. The UPS software agent is informed of the failure and throws the shutdown procedure as follows : T0 + 30 : Automatic shutdown of PC2 (Processing) and PC3 (visualization) T0 + 30 : Shutdown of the UPS segment 2 (2 visualization screens and Netgear switch) T0 + 30 : Automatic shutdown of PC1 (Acquisition) T0 + 32 : Shutdown of the UPS 8.4.2 Configuration of the wake up on lan service The Wake up on lan service is configured by the icon UPS: detect machines available on the root desktop. This service allows to switch on automatically the machines if the power supply to UPS is restarted and if the battery charge is more than 30%. This service is based on the Mac address (Physical address of the network card). In case of substitution of a network card, this service must be reinitialized by clicking on the icon UPS: detect machines on the root desktop. Meteo France International Page 102
8.4.3 Configuration of the automatic restart delay It is possible to configure the charge segment to reboot automatically when the power is back if it has been stopped by: The stop button An external command with an auto restart option A sub-voltage state An automatic stop command on battery The delay to restart each segment can be configured as follow: Select 0 second to restart automatically (this is the default value) Select a value between 1 and 32767 seconds to delay the restart of a number of second Select off to let the device switched off. To configure the restart delay for each device: 1. Click on the button < during 1 second to select the main menu then select the item Settings by using the button >. 2. Click on the button > to enter in the Settings menu. 3. Use the button to scroll down the option Delay of automatic restart then click on the button (The current setting flash when it is selected). 4. Adjust the restart delay using the buttons < and >. 5. Click on the button to validate. 6. Adjust the restart delay for the other segment. 7. Click on the button to validate. Note : The start and stop commands for charge segment (in the Command menu) go beyond the users parameters for charge segments. A unique delay for many segments is applied to both plugs. Whereas one supplementary second is added between the two segments closing. This delay is always present when a ON command is sent to the 2 segments at the same time The UPS must be configured to activate power supply automatically Meteo France International Page 103