AUTOMATED IMAGE RECEPTION, PROCESSING AND DISTRIBUTION SYSTEM FOR HIGH RESOLUTION REMOTE SENSING SATELLITES



Similar documents
The RapidEye optical satellite family for high resolution imagery

t6000 client and server software Transaction and archiving software for the 21st century

LANDSAT 7 - GROUND SEGMENT ACTIVITIES AT THE GERMAN REMOTE SENSING DATA CENTER. Deutsches Fernerkundungsdatenzentrum (DFD) DLR (*)

Implementing a Digital Video Archive Using XenData Software and a Spectra Logic Archive

The Multimission National Center of the Italian Space Agency

Implementing an Automated Digital Video Archive Based on the Video Edition of XenData Software

GEOSPATIAL DIGITAL ASSET MANAGEMENT A SOLUTION INTEGRATING IMAGERY AND GIS WHERE WILL ALL THE PIXELS GO?(AND HOW WILL WE EVER FIND THEM?

Information Contents of High Resolution Satellite Images

CBERS Program Update Jacie Frederico dos Santos Liporace AMS Kepler

CONCEPTUAL DESIGN OF DATA ARCHIVE AND DISTRIBUTION SYSTEM FOR GEO-KOMPSAT-2A

Hardware Configuration Guide

Implementing a Digital Video Archive Based on XenData Software

Content Management Playout Encryption Broadcast Internet. Content Management Services

CLOUDDMSS: CLOUD-BASED DISTRIBUTED MULTIMEDIA STREAMING SERVICE SYSTEM FOR HETEROGENEOUS DEVICES

One Solution for Real-Time Data protection, Disaster Recovery & Migration

High Resolution Digital Surface Models and Orthoimages for Telecom Network Planning

Digital image processing

Implementing Offline Digital Video Storage using XenData Software

Avid. inews. Redundancy and Failover in Avid News Management Solutions

How To Use A Recoverypoint Server Appliance For A Disaster Recovery

Patriot Hardware and Systems Software Requirements

The National Strategy, Current Activities for Space Technology Development and Application

Processing, Cataloguing and Distribution of UAS Images in Near-Real-Time. Andreas Kühnen GEOSYSTEMS

Automotive Applications of 3D Laser Scanning Introduction

Tier 2 Nearline. As archives grow, Echo grows. Dynamically, cost-effectively and massively. What is nearline? Transfer to Tape

Archiving and Managing Remote Sensing Data Using State of the Art Storage Technologies

SuperGuard VT-05 Vehicle Tracking Device

Antelope Enterprise. Electronic Documents Management System and Workflow Engine

SAMPLE MIDTERM QUESTIONS

Keystone Image Management System

Chapter 11 I/O Management and Disk Scheduling

3D MultiVision SOFTWARE OPERATING INSTRUCTIONS

Adaptation of High Resolution Ikonos Images to Googleearth for Zonguldak Test Field

IMPORTANT PRODUCT INFORMATION

IT Service Management with System Center Service Manager

Using Linux Clusters as VoD Servers

SPOT Satellite Earth Observation System Presentation to the JACIE Civil Commercial Imagery Evaluation Workshop March 2007

Performance analysis and comparison of virtualization protocols, RDP and PCoIP

CROSS PLATFORM AUTOMATIC FILE REPLICATION AND SERVER TO SERVER FILE SYNCHRONIZATION

Migration of Medical Image Data Stored through Mini-PACS to Full-PACS

Siemens and National Instruments Deliver Integrated Automation and Measurement Solutions

Sage CRM Technical Specification

Chapter 5: System Software: Operating Systems and Utility Programs

Creating A Highly Available Database Solution

IBM TotalStorage IBM TotalStorage Virtual Tape Server

Front-safe Creates an Efficient and High-Performance Cloud Solution for Tivoli Storage Manager

ScanEx Ground Stations Network: Network of ground stations receiving data from artificial Earth remote sensing satellites

Terminal Services for InTouch 7.1/7.11. Terminal Services for InTouch 7.1/7.11 PRODUCT POSITION PRODUCT DATASHEET

Protecting your SQL database with Hybrid Cloud Backup and Recovery. Session Code CL02

Functional Area 3. Skill Level 301: Applications Systems Analysis and Programming Supervisor (Mercer 1998 Job 011)

HUS-IPS-5100S(D)-E (v.4.2)

RADIUS. Brief brochure. Product Purpose

GPS Data Collection Procedures for Georeferencing Vegetation Resources Inventory and National Forest Inventory Field Sample Plots

Radar Image Processing with Clusters of Computers

MULTIPURPOSE USE OF ORTHOPHOTO MAPS FORMING BASIS TO DIGITAL CADASTRE DATA AND THE VISION OF THE GENERAL DIRECTORATE OF LAND REGISTRY AND CADASTRE

Using Linux Clusters as VoD Servers

AP ENPS ANYWHERE. Hardware and software requirements

IT Service Management with System Center Service Manager

Distribution One Server Requirements

LDA, the new family of Lortu Data Appliances

IBM ^ xseries ServeRAID Technology

Digital Remote Sensing Data Processing Digital Remote Sensing Data Processing and Analysis: An Introduction and Analysis: An Introduction

Executive Summary WHAT IS DRIVING THE PUSH FOR HIGH AVAILABILITY?

GV-Hot Swap Backup Center System (Rev. B) 3U, 16 / 8-Bay

MoveInspect HF HR. 3D measurement of dynamic processes MEASURE THE ADVANTAGE. MoveInspect TECHNOLOGY

STORNEXT PRO SOLUTIONS. StorNext Pro Solutions

STORNEXT PRO SOLUTIONS. StorNext Pro Solutions

Management Challenge. Managing Hardware Assets. Central Processing Unit. What is a Computer System?

15 Organisation/ICT/02/01/15 Back- up

How To Use Safety System Software (S3)

Updated: April Copyright DBA Software Inc. All rights reserved. 2 Getting Started Guide

The Education Edge / The Financial Edge 7.85

Network Station - Thin Client Computing - Overview

pc resource monitoring and performance advisor

A Real Time, Object Oriented Fieldbus Management System

ITPS AG. Aplication overview. DIGITAL RESEARCH & DEVELOPMENT SQL Informational Management System. SQL Informational Management System 1

Córdoba Ground Station CONAE - Argentina

The syslog-ng Store Box 3 LTS

XenData Video Edition. Product Brief:

AN OPENGIS WEB MAP SERVER FOR THE ESA MULTI-MISSION CATALOGUE

Install SQL Server 2014 Express Edition

FNT EXPERT PAPER. // From Cable to Service AUTOR. Data Center Infrastructure Management (DCIM)

DeltaV Remote Client. DeltaV Remote Client. Introduction. DeltaV Product Data Sheet. Remote engineering and operator consoles

Avira Small Business Security Suite Avira Endpoint Security. Quick Guide

SQL-BackTrack the Smart DBA s Power Tool for Backup and Recovery

PNG : A new CTD profiling float

Data Protection with IBM TotalStorage NAS and NSI Double- Take Data Replication Software

Virtualization s Evolution

Every organization has critical data that it can t live without. When a disaster strikes, how long can your business survive without access to its

Transcription:

AUTOMATED IMAGE RECEPTION, PROCESSING AND DISTRIBUTION SYSTEM FOR HIGH RESOLUTION REMOTE SENSING SATELLITES Moon-Gyu Kim, Taejung Kim, Sung-Og Park, Dongseok Shin*, Min Nyo Hong*, Sunghee Kwak*, Wookhyun Choi* Satellite Technology Research Center, KAIST, 373-1, Yusung-gu, Taejon, 305-701, ROK Tel: (82)-42-869-8626 Fax: (82)-42-861-0064 E-mail: {mgkim, tjkim, sopark}@satrec.kaist.ac.kr, URL: http://satrec.kaist.ac.kr *SaTReCi, 18F Sahak Bldg., 929 Dunsan-dong, Seo-gu, Taejon, 302-120, ROK Tel: (82)-42-365-7531 Fax: (82)-42-365-7549 E-mail: {dshin, mnhong, shkwak, whchoi}@satreci.co.kr, URL: http://www.satreci.co.kr KEY WORDS: Image reception, processing, distribution system ABSTRACT: This paper addresses the development work of image reception, processing and distribution system for the KOMPSAT-2 (KOrea Multi-Purpose SATellite-2), which to be launched in 2004 by the Korean Government. KOMPSAT-2 is a new high-resolution earth observation satellite that is capable of 1m panchromatic and 4m multi-spectral imaging. The system under development is divided into three sub-systems: Receiving and Archiving Subsystem (RAS), Search and Processing Subsystem (SPS), and Value-added Product Generator (VPG). Big effort has been made to achieve maximum automation from image reception to generation of value-added products. In this paper, key factors used during design phase are addressed, and progress and lessons learned will be reported. 1. INTRODUCTION The rapid progress of the technology of commercial remote sensing satellite and sensor development has made high-resolution satellite images available. Since the successful launch of IKOMOS satellite, which is capable of 1m panchromatic and 4m multi-spectral imaging, there have been growing demands on the high-resolution satellite images. To fulfill those need, many high-resolution earth observation satellites are to be launched, such as QuickBird-4, Orbview-2, etc. High resolution imaging satellites require drastic evolution of image reception, processing and distribution system to provide high-quality satellite images in a prompt and efficient manner due to the very high-speed downlink rate and extensive amo unt of image data comparing conventional earth imaging systems. Table 1 * shows a few examples of commercial system for data receiving, processing and distribution system (Hong, 1999). The table figures each system in terms of maximum data rate for reception, the type of main computers, and archive media. Most systems aimed the data rate at which 1m resolution satellite transmitted its image data There was a trend of using disk arrays for real-time storages and DLT or D1 tapes for permanent archives. This paper will address the development work of image reception, processing and distribution system for a new high-resolution satellite, KOMPSAT-2 (KOrea Multi-Purpose SATellite-2), which to be launched in 2004 by the Korean Government. The specification of KOMPSAT-2 is given in Table 1. The development work is still undergoing and this paper will report the design of the system, lessons learned during the development work and future plan. The development work has been focused on automation, high speed, reliability, integrity, cost, expandability, accessibility and security of the system (Park, 2001). The paper is organized as follows. Section 2 explains the image reception, processing and distribution system under development. Section 3 describes the progress and lesson learned. Vendor (Nationality) Max. Data rate Main Computer Archive media DTi (USA) 320Mbps SGI Dual processor R10000 Disk Array ->DLT Ve xcel (USA) 320Mbps UNIX Workstation Disk Array->DLT MDA (Canada) 170Mbps SGI Challenge 10000 Disk Array->DLT Astrium (France) 160Mbps Digital Symmetric Multiprocessing Disk Array->Tape ASC (Canada) 200Mbps Unspecified Tape IAI (Israel) 85.5Mbps Unspecified D1 Table 1. Characteristics of commercial image receiving, processing and archiving systems * Note that the information was gathered from product brochures, which may be incorrect or out-of-date.

Orbit CCD Band Radiometric resolution No. of pixels Pixel distance Downlink 685Km Sun-synchronous Linear push-broom 1 Panchromatic: 500-900 nm 4 Multi-spectral: 450 520 nm, 520 600 nm, 630 690 nm, 760 900 nm 10 bits 15000 for panchromatic 3750 for multi-spectral 1m for panchromatic 4m for multi-spectral 320Mbps QPSK Table 2. KOMPSAT-2 Specification 2. IMAGE RECEPTION, PROCESSING AND DISTRIBUTION SYSTEM FOR KOMPSAT-2 This section describes the overview of an image reception, processing and dis tribution system (hereby, the system) under development for KOMPSAT-2. 2.1 The System Design Concepts The system was designed to meet the following seven operational concepts. - Maximum automation: The system shall be centralized and operated with minimum operator s interaction. - High speed: The system shall handle up to 320Mbps image data and generate image products as fast as possible. - High reliability: The system shall not fail to achieve system objectives by single point failure and/or operators trivial mistake. - Integrity: Operations and managements of system is integrated in the most efficient manner. - Cost effectiveness: The system shall be operated economically so that it can save time, efforts and resources. - Expandability: The system shall be upgraded for processing other satellite data with little change of the system. - Security/Accessibility: Only authorized user shall have access to catalog data and only authorized operators to system modules. For public data, user shall be able to access easily. Many efforts have been made to realize maximum automation from image receiving to the generation of value-added products with minimum user intervention. Centralized order management and careful order management scheme made maximum automation of processing chain. High-speed data handling is achieved by using state-of-art technology in processing and storage equipment and appropriate redundancy, self-diagnosis and severe error check on user inputs are implemented to provide enough reliability. System integrity and security are realized by comprehensive management system with a high performance commercial database. WWW technology was used to increase user accessibility to image data. 2.2 System Architecture The system is divided into three subsystems, i.e. Receiving and Archiving Subsystem (RAS), Search and Processing Sub-system (SPS), and Value-added Product Generator (VPG) as shown in Fig. 1. RAS receives, displays, and archives raw data, which is downlinked from the satellite at 320 Mbps. SPS is responsible for generation, manipulation and distribution of image products. VPG produces value-added products from standard products. The hardware configuration is shown in Fig. 2. The RAS is hosted on the PC-base NT server and configured to have hot standby to improve the reliability as real-time receiving and storing is a very critical objective of the system. SPS and VPG are hosted on the same H/W, SGI server, to provide stable user services. High performance RAID was used for real-time image data storing and RAID, DLT jukebox and DLT are used to provide hierarchical storage management to handle large amount of image data. System Antenna RAS SPS VPG User Fig.1 System block diagram

X -band antenna High Speed Network Real-time receiving and archiving media (RAID) Hot Stand- by Receiving & Archiving Subsystem Internal Users Ext. Server system internet Disconnectable network On-line storage (RAID) Near-line storage (DLT Jukebox) Cold Stand- by Catalogue, Processing & VAP Subsystem Fig. 2. System Configuration 2.2.1 Receiving and Archiving Subsystem The RAS receives and archives image data transmitted at up to 320Mbps in real-time, performs moving window display (MWD) and provides antenna pointing data. The RAS subsystem consists of DRC (Direct Receiving Card), NT Server, RAID and DLT as shown in Fig. 3. The DRC receives and convert high speed ECL data stream to parallel signal, and feed them into host computer. The PCI-based DRC was designed and manufactured to handle up to 400Mbps data rate. Pentium based NT server was selected as a RAS platform considering fast progress of CPU performance and relatively low price comparing high-performance workstation/server. While selecting RAID system, the performance and reliability of a dozen of major RAID systems were tested using our own benchmarking program to choose reliable real-time storage. As a result, real-time receiving and archiving of up to 320Mbps has been achieved. The RAS consists of two software modules: Pass scheduler and data processor. The pass scheduler can schedule antenna system for automatic down-link reception, handle multiple reception of work orders, maintain RAID capacity and perform RAID-to-DLT backup and restoration. Necessary is the efficient management of storage devices. The pass scheduler was designed to manage the storage devices with hierarchy and to perform the backup of data stored as requested. The data processor stores the data to RAIDs in real-time, performs real-time MWD after de-packetizing, decryption, decomp ression. Rather than using a special hardware to process downlink format, software implementation was adopted for system expandability and we pay extensive attention in parallel processing and code optimization to attain high performance. SIMD instructions are used for parallel processing to achieve high-speed data handling where applicable. Data processor also performs playback MWD of the data already stored in RAIDs. 2.2.2 Search and Processing Subsystem The SPS provides a tool for catalog searching to users and generates pre-processed products. The SPS performs radiometric and geometric correction of KOMPSAT-2 image data, and is capable of image data processing and standard image product generation. It also provides orbit, attitude, and sensor models to support data correction and processing. The SPS subsystem consists of a number of software mo dules: catalog browse and order ingest module, catalog and product generation module, order manager, system information manager, network manager, media formatter, physical device manager, archive manager, pass scheduler, etc.. Catalog browse and order ingest module is to provide users catalogue searching and order generation. This module was designed using WWW technology to provide easy access on the image data. User can apply a search condition using any web browser with a help of 1:25,000 digital map DB for visualization. Catalog browse and order ingest module provide catalogue searching, ingests acquisition, product, and distribution orders and control user access. The example of user interface is shown in Fig. 4. RAS NT Server RAID ECL data stream DRC DLT Fig. 3 Receiving and archiving system

Fig. 4 Running instance of Catalogue Browse and Order Ingestion module (left) and Catalogue and Product Generation module (right) The catalog and product generation module generates catalog and pre-processed products. An operator can select the product level for automated processing. Cloud assessment can be done automatically, semi -automatically and manually. Also user can configure browse image level. The order manager analyzes user s orders, makes a plan of execution, monitors system resources and produces reports and statistics. As a result of order analysis, order manager generates and transfers work order to the responsible modules in appropriate sequence while monitoring system resources to guarantee automatic processing of user order. Reports are also generated after the completion of order execution or for any possible error. The information manager is implemented as a comprehensive management system using a high performance commercial database to keep system integrity and security. It manages DB for operators, users and system configuration to control and monitor user access and system integrity. The network manager sends and receives message with the RAS. The media formatter reads data from input media and writes to output media, which include 4mm, 8mm, compact disks and DLT tapes. Also this module outputs label and product list, and handles various data formats, including EOSAT Fast Format, HDF, GeoTiff, Raw, etc.. The physical device manager exists as a part of other modules. This diagnoses a status of physical drivers. The archive manager archives satellite data to a storage device and manages data. The pass scheduler provides a tool to plan image acquisition and to help satellite-programming request to a mission control center. 2.2.3 Value-Added product generator subsystem The VPG generates value-added products such as precision-correction image, ortho-corrected images, digital elevation models, road and building network from KOMPSAT-2 image data. These data are fed to the SPS for distribution to users. The VPG receives orders from the SPS for automatic execution or operators for manual. An emphasis was put to the integration of value-added processing mo dules into the whole system. With this, we intended to fully automate the processing chain from image reception to the generation of value-added information. Fig. 5 shows two examples of VPG subsystem. Fig. 5 Example of Value-added Product Generation: Left image shows DEM extracted from KOMPSAT-1 (6.6m resolution) with height accuracy of about 15m. Right image shows semi-automatic road extraction.

3. PROGRESS AND LESSONS LEARNED Currently, the system development stage is a system integration phase. Development model we adopted was a mixture of prototyping and iterative models. As a prototype of the system, a SPOT image receiving and processing system had been developed. From the prototype, the system has been upgraded for the KOMPSAT-2 specification. Development of each module has been completed and system integration and tests are on-going. The system integration will be finished by August 2002. The system will be finally verified in real operation when the KOMPSAT-2 is launched in 2004. Throughout the on-going development, we have found several very important issues. First issue is selection of appropriate devices and platforms. The major difference between the prototype (for the SPOT) and the complete system (for the KOMPSAT-2) is the amount of data the system should handle. It was difficult to select reliable and fast enough disk storage devices at an affordable price range. Often the devices did not perform as specified by vendors. Also handling of some 100s terra bytes of data does require very special treatments. We invested enormous time and efforts to select adequate storage system by performing our own benchmarking tests. While selecting the platform for image receiving and archiving subsystem, PCs and UNIX-based platforms were considered. We chose PCs for their rapid performance upgrade, low cost and developmental convenience. We believe the choice was valid and cares were taken to achieve reliability and to keep high performance. Since the system handles image data of very high speed, special care should be made to prevent bottleneck in overall processing chain from hardware selection to software implementation. A trade-off study between system performance and cost was also important. For example, the configuration of host PCs for RAS was closely related to the requirement of disk storage devices and hence to the overall system cost. The choice of platforms for the SPS and VPG was also related to this issue. The other issue was the level of automation and system performance. Cloud assessment, for example, was designed to work in three modes: automatic, semi-automatic and manual. It was difficult to make cloud assessment work well automatically in all cases. Instead, we found a very simple but robust semi-automatic technique that could be applied for fast execution as well as in good accuracy. The last issue to discuss here, but not the least, is the image resolution. Preprocessing, ground control point acquis ition, value-added processing, etc. were designed accordingly. In the design of catalogue search and display, order generation and pass scheduling, the image resolution was also taken into account. As many high-resolution remote sensing satellite programs are being carried out and more will start in near future, the development of ground stations for those satellites has become more and more important. The development work stated here, we hope, can be of any help when ma king such ground stations. 4. REFERENCES [1] Hong, M., Kim, T., and Kim, T.G., 1999, Requirements Study of High-Resolution Satellite Image Receiving, Processing and Archiving System, 15th fall symposion of Korean Remote Sensing Society [2] Park, S., Kim, M., Kim, T. and Kweon, I., 2001, Development of automated Image Reception, Processing and Distribution System for KOMPSAT-2, IGARSS 2001