SHADOW DETECTION AND RECONSTRUCTION OF IMAGES FROM SATELLITE IMAGES: GIS



Similar documents
A System of Shadow Detection and Shadow Removal for High Resolution Remote Sensing Images

COMPARISON OF OBJECT BASED AND PIXEL BASED CLASSIFICATION OF HIGH RESOLUTION SATELLITE IMAGES USING ARTIFICIAL NEURAL NETWORKS

Vision based Vehicle Tracking using a high angle camera

Modelling, Extraction and Description of Intrinsic Cues of High Resolution Satellite Images: Independent Component Analysis based approaches

Environmental Remote Sensing GEOG 2021

Digital image processing

Assessment. Presenter: Yupu Zhang, Guoliang Jin, Tuo Wang Computer Vision 2008 Fall

How To Fix Out Of Focus And Blur Images With A Dynamic Template Matching Algorithm

AUTOMATIC CROWD ANALYSIS FROM VERY HIGH RESOLUTION SATELLITE IMAGES

Image Normalization for Illumination Compensation in Facial Images

Multiscale Object-Based Classification of Satellite Images Merging Multispectral Information with Panchromatic Textural Features

Detection and Restoration of Vertical Non-linear Scratches in Digitized Film Sequences

An Automatic and Accurate Segmentation for High Resolution Satellite Image S.Saumya 1, D.V.Jiji Thanka Ligoshia 2

Speed Performance Improvement of Vehicle Blob Tracking System

Colour Image Segmentation Technique for Screen Printing

PIXEL-LEVEL IMAGE FUSION USING BROVEY TRANSFORME AND WAVELET TRANSFORM

LOCAL SURFACE PATCH BASED TIME ATTENDANCE SYSTEM USING FACE.

VEHICLE LOCALISATION AND CLASSIFICATION IN URBAN CCTV STREAMS

Classification of High-Resolution Remotely Sensed Image by Combining Spectral, Structural and Semantic Features Using SVM Approach

ECE 533 Project Report Ashish Dhawan Aditi R. Ganesan

Canny Edge Detection

ROBUST VEHICLE TRACKING IN VIDEO IMAGES BEING TAKEN FROM A HELICOPTER

3D Model of the City Using LiDAR and Visualization of Flood in Three-Dimension

Signature Region of Interest using Auto cropping

Determining optimal window size for texture feature extraction methods

HSI BASED COLOUR IMAGE EQUALIZATION USING ITERATIVE n th ROOT AND n th POWER

Efficient Background Subtraction and Shadow Removal Technique for Multiple Human object Tracking

Practical Tour of Visual tracking. David Fleet and Allan Jepson January, 2006

Robert Collins CSE598G. More on Mean-shift. R.Collins, CSE, PSU CSE598G Spring 2006

A Novel Method to Improve Resolution of Satellite Images Using DWT and Interpolation

Analecta Vol. 8, No. 2 ISSN

Image Processing Based Automatic Visual Inspection System for PCBs

REAL TIME TRAFFIC LIGHT CONTROL USING IMAGE PROCESSING

Low-resolution Character Recognition by Video-based Super-resolution

Simultaneous Gamma Correction and Registration in the Frequency Domain

A Learning Based Method for Super-Resolution of Low Resolution Images

An Assessment of the Effectiveness of Segmentation Methods on Classification Performance

Classification-based vehicle detection in highresolution

FACE RECOGNITION BASED ATTENDANCE MARKING SYSTEM

WATER BODY EXTRACTION FROM MULTI SPECTRAL IMAGE BY SPECTRAL PATTERN ANALYSIS

A Dynamic Approach to Extract Texts and Captions from Videos

Sub-pixel mapping: A comparison of techniques

Poker Vision: Playing Cards and Chips Identification based on Image Processing

Automatic Traffic Estimation Using Image Processing

Colorado School of Mines Computer Vision Professor William Hoff

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA

A Study of Automatic License Plate Recognition Algorithms and Techniques

A secure face tracking system

Galaxy Morphological Classification

The Role of Size Normalization on the Recognition Rate of Handwritten Numerals

WITH the technological developments in aerospace, an

Automatic Detection of PCB Defects

DIGITAL IMAGE PROCESSING AND ANALYSIS

Crater detection with segmentation-based image processing algorithm

Neural Network based Vehicle Classification for Intelligent Traffic Control

ADVANTAGES AND DISADVANTAGES OF THE HOUGH TRANSFORMATION IN THE FRAME OF AUTOMATED BUILDING EXTRACTION

Convolution. 1D Formula: 2D Formula: Example on the web:

The Scientific Data Mining Process

An Approach for Utility Pole Recognition in Real Conditions

Component Ordering in Independent Component Analysis Based on Data Power

Medical Image Segmentation of PACS System Image Post-processing *

Automatic Change Detection in Very High Resolution Images with Pulse-Coupled Neural Networks

Tracking And Object Classification For Automated Surveillance

Bildverarbeitung und Mustererkennung Image Processing and Pattern Recognition


Research On The Classification Of High Resolution Image Based On Object-oriented And Class Rule

AUTOMATIC BUILDING DETECTION BASED ON SUPERVISED CLASSIFICATION USING HIGH RESOLUTION GOOGLE EARTH IMAGES

Object-Oriented Approach of Information Extraction from High Resolution Satellite Imagery

SOURCE SCANNER IDENTIFICATION FOR SCANNED DOCUMENTS. Nitin Khanna and Edward J. Delp

Extraction of Satellite Image using Particle Swarm Optimization

Local features and matching. Image classification & object localization

Visibility optimization for data visualization: A Survey of Issues and Techniques

Automatic 3D Reconstruction via Object Detection and 3D Transformable Model Matching CS 269 Class Project Report

How To Filter Spam Image From A Picture By Color Or Color

Tracking and Recognition in Sports Videos

Building an Advanced Invariant Real-Time Human Tracking System

SEMANTIC LABELLING OF URBAN POINT CLOUD DATA

The Role of SPOT Satellite Images in Mapping Air Pollution Caused by Cement Factories

False alarm in outdoor environments

Face detection is a process of localizing and extracting the face region from the

The Visual Internet of Things System Based on Depth Camera

Multisensor Data Fusion and Applications

SIGNATURE VERIFICATION

Intrusion Detection via Machine Learning for SCADA System Protection

Algorithm for License Plate Localization and Recognition for Tanzania Car Plate Numbers

Template-based Eye and Mouth Detection for 3D Video Conferencing

3D Vehicle Extraction and Tracking from Multiple Viewpoints for Traffic Monitoring by using Probability Fusion Map

Super-resolution method based on edge feature for high resolution imaging

Multimodal Biometric Recognition Security System

A Method of Caption Detection in News Video

Some elements of photo. interpretation

Low-resolution Image Processing based on FPGA

Transcription:

International Journal of Applied Engineering Research and Development (IJAERD) ISSN(P): 2250-1584; ISSN(E): 2278-9383 Vol. 4, Issue 2, Apr 2014, 5-12 TJPRC Pvt. Ltd. SHADOW DETECTION AND RECONSTRUCTION OF IMAGES FROM SATELLITE IMAGES: GIS GAYATRI GURAV 1, M. B LIMKAR 2 & SANJAY M. HUNDIWALE 3 1 Research Scholar, ARMIET College of Engineering, Mumbai, Maharashtra, India 2 Associate Professor, Department of Electronics, Terna College of Engineering, Nerul, Mumbai, Maharashtra, India 3 Department of Electronics and Telecommunication, Alamuri Ratnamala Institute of Engineering & Technology, Shahpur, India ABSTRACT The increase in spatial resolution has enabled analysis and detection of images obtained through satellite. To increase the accuracy in image processing, an unwanted shadow needs to be processed effectively. A quality check mechanism governs the false reconstruction problems. In the proposed paper we would like to suggest use of Lib SVM algorithm. The original image obtained from satellite is first supervised to identify shadow and non shadow regions. The shadow region is then filtered using morphological filter and a border is created around shadow. With the help of Lib SVM algorithm the shadow image can be removed using post classification methods and shadow free image can be obtained. KEYWORDS: Morphological Operator, Pattern Recognition, Reconstruction of Images, Shadow, Spatial Resolution, Vector Machine Approach INTRODUCTION The remote sensing of an object has become possible because of very high resolution (VHR) satellite images. The increase of spatial resolution demands new analysis, classification, and change in detection techniques. The objects, like small building structures, trees, vehicles, and roofs can be revealed with the help of VHR images. In urban areas the presence of high rise structures such as buildings, towers causes large change in surface elevations and results in longer shadows. Though shadow characteristics are used in recognition of building position, height and other useful parameters it may cause a high risk to produce false color tones, to distort the shape, to merge, or to lose objects. Due to the partial or total loss of information in the image, shadows may impact adversely in the exploitation of VHR images as it influences detailed mapping that leads in flawed classification/interpretation. To soothe these drawbacks and to increase image credulous ability, two steps are necessary. Detection of Shadow Reconstruction of Shadow The shadow detection algorithms are based on properties, such as lower brightness, higher saturation, and greater hue values. There exist essentially three different methods: 1) Gamma Correction 2) Histogram Matching 3) Linear Correlation, in order to compensate/reconstruct shadow areas. Shadows can be removed by contextual texture analysis performed between a segment of shadow and its neighbors. Knowing the kind of surface under the shadow, a local gamma transformation is then used to restore the shadow area. Once the shadow detected, the HIS values in shadow regions are adjusted respectively according to the analogous

6 Gayatri Gurav, M. B Limkar & Sanjay M. Hundiwale values in the local surrounding of each shadow region by adopting the histogram matching method. The method consists of recovering spectral information in shadow areas in an IKONOS image by exploiting the height data from the airborne laser scanner. Such information is used to overlay and eliminate the real shadow. The whole processing chain includes also two important capabilities: A rejection mechanism to limit as much as possible reconstruction errors Explicit handling of the shadow borders PROBLEM DEFINITION In the urban areas, the presence of shadows destroys the information contained in their images. This missing Information in shadow areas directly influences common processing and analysis operations, such as the generation of classification maps. By considering these problems, we tried to find solution for this problem using Lib SVM Algorithm. Identification of the Shadow and non shadow area Separate shadow and non shadow area of the image Reconstruction of the Shadow area LITERATURE SURVEY Shadow A shadow is an area where direct light from a light source cannot reach due to obstruction by an object. There have been few studies concerning shadow removal, and the existing approaches cannot perfectly restore the original background patterns after removing the shadows. Assumptions of Shadow Here are our basic assumptions as follows The illumination image is spatially smooth. There is no change in the texture inside the shadow region. In the shadow regions, the illumination image is close to being constant. Pixels inside shadow regions have different colors because of the reflectance image, not the illumination one Self and Cast Shadow: Shadow detection and removal is an important task in image processing when dealing with the outdoor images. Shadow occurs when objects occlude light from light source. Shadows provide rich information about the object shapes as well as light orientations. Some time we cannot recognize the original image of a particular object. Shadow in image reduces the reliability of many computer vision algorithms. Shadow often degrades the visual quality of images. Shadow removal in an image is an important pre-processing step for computer vision algorithm and image enhancement. Figure 1: Illustration of Cast and Self Shadows

Shadow Detection and Reconstruction of Images from Satellite Images: GIS 7 Shadow Detection Techniques Table 1 Sr. No Method Key Idea Advantages Disadvantages Seed pixels have been selected Region growing failed 1 Region and set as shadow group mean Orientation based when the pixel intensity growing and standard deviation are technique varied widely in the calculated. shadow region. 2 3 4. 5. 6 7 Dual pass Otsu method Edge subtraction and Morphology Gradient based background subtraction Based on intensity Information Based on photo metric invariants information Partial Differential Equations. PROPOSED METHOD Pixels value is separated into high and low level intensity. Threshold is set to distinguish between self and cast shadow. Cast shadow pixels are than replaced by background pixels. Canny edge detection is used to detect background edge and foreground edge. Resultant edge image is calculated by difference of both background and foreground edge centered of vehicle shadow region is found by formula. Fixed threshold is set for T vertical and T horizontal boundary of object is extracted using neighbored ratio. Foreground is extracted by using mixture of Gaussians. Standard deviation is calculated for ratio value. Conditions are set for a shadowed pixel. Intensities in the neighbor pixels in the foreground region is equal to the ratio of neighbor pixels in the background image in the presence of shadow Different filters are used to smooth the image. Gradient vector is used to detect shadow. Image information is used. It is computational inexpensiveness. Method is best when scenes containing light and dark vehicles Location is used to detect the shadow. Shadow detection is done correctly.real time application take advantage of the algorithm. Performance is better by using robust features. It takes little time. The average time consumption is good for real-time application. Shadow detection is successful and effective. Performance is poorest. It is most computationally expensive Actually the pixel intensity value is susceptible to illumination changes. Figure 2: Flow Chart for Proposed Method

8 Gayatri Gurav, M. B Limkar & Sanjay M. Hundiwale DESIGN STEPS Mask Construction The shadows versus non-shadow mask are created in two steps: Binary Classification Post-Processing Binary Classification This classification is implemented using support vector machine (SVM), which proved its effectiveness in the literature of remote sensing data classification. The feature space where the classification task is performed is defined by the original image bands and features extracted by means of the wavelet transform. In particular, a one-level stationary wavelet transform is applied on each spectral band, thus obtaining for each band four space-frequency features. The symlet Wavelet is adopted in order to maximize the sparseness of the transformation while enforcing texture areas. For an original image I composed of B spectral bands, the resulting feature space thus consists of B (1 + 4) dimensions. Post Processing The binary image M1 may be characterized by a salt and pepper effect due to the presence of noise in the image. An opening by reconstruction, followed by a closing by reconstruction, is applied on M1 to attenuate this potential problem. The choice of morphological filters to deal with this problem is motivated by their effectiveness and better shape preservation capability as shown in the literature and by the possibility to adapt them according to the image filtering requirements as is the case in the border creation. Both morphological operators are needed in order to remove isolated shadow pixels in a non shadow area and also isolated non shadow pixels in a shadow area. Border Creation The transition in between shadow and non shadow areas can raise problems such as boundary ambiguity, color inconstancy, and illumination variation [9]. Indeed, the presence of the penumbra induces mixed pixels which are difficult to classify. The penumbra is a region where the light source is only partially obscured. For this reason, a border between the shadow and non shadow classes is defined in order to appropriately handle the border pixels. These lasts are not processed within the shadow reconstruction procedure as is, but separately. The border region is constructed by means of morphological operators. The mask c_imgb2 is dilated (δ) and eroded (ε).then, the difference between these two images is computed to form the border image B: B[x, y] = δ (c_imgb2[x, y]) ε (c_imgb2[x, y]) (1) The Final Mask Image becomes:. (2) Shadow Reconstruction Image reconstruction is one of the most important steps in our methodology. For the sake of getting a simple but satisfactory reconstruction model, we assume that the underlying relationship between the non shadow class (Y) and the corresponding shadow classes (X) are of the linear type [10]. We have empirically observed that shadow classes and the

Shadow Detection and Reconstruction of Images from Satellite Images: GIS 9 corresponding non shadow classes reasonably exhibit a linear relationship. Regarding the statistical model of the classes, three estimation ways may be envisioned. Histogram estimation done by box counting, Kernel density estimation. We assume that the classes follow a Gaussian distribution. Although it can be expected that such a hypothesis does not always hold, it is however useful to get a simple and fast solution to the reconstruction problem. Indeed, denoting the shadow class as: (3) And the corresponding non shadow class as: (4) The reconstruction of the shadow class will be reduced to a simple random variable transformation: (5) Where: μ and Σ stand for the mean and covariance matrix, respectively. Since the two distributions are assumed linearly correlated, x and y may be linked by (6) (7) Σ Σ (8) Where K is a transformation matrix, KT is its transpose, and c a bias vector. To estimate K and c, the Cholesky factorization is applied (9) (10) Where: c and K are the lower and upper triangular Cholesky matrices related to the non shadow and shadow classes, respectively. Once K and c are estimated, equation applied to compensate the pixels of the shadow class. Note that this process needs to be carried out for each couple of shadow and non shadow classes. EXPECTED RESULTS Figure 3 Figure 4

10 Gayatri Gurav, M. B Limkar & Sanjay M. Hundiwale Figure 5: VHR Image Simulation Results CONCLUSIONS For VHR images, the proposed methodology is supervised. The shadow areas are not only detected but also classified so as to allow their customized compensation. The classification tasks are implemented by means of the state-of-the-art SVM approach. Drawbacks and Limitations The proposed method for detecting and removing of shadows described may not be up to expectations in some conditions such as presence of darker regions and thus may be detected as shadows thus will be removed. Secondly, in the proposed method shadows are removed partially, not completely. REFERENCES 1. J.M. Wang, Y.C. Chung, C.L. Chang, S.W. Chen, Shadow Detection and Removal for Traffic Images, Proc. IEEE International Conference on Net working, Sensing and Control, vol. 1, pp. 649 654, 2004. 2. T. Chen, W. Yin, X.S. Zhou, D. Comaniciu, and T.S. Huang, Illumination Normalization for Face Recognition and Uneven Back ground Correction Using Total Variation Based Image Models, Proc. CVPR, vol. 2, pp. 532-539, 2005. 3. Y. Adini, Y. Moses, and S. Ullman, Face recognition: The problem of compensating for changes in illumination direction, IEEE Trans. Pattern Anal Machine Intell. 19(7):721 732, 1997. 4. T. Kasetkasem and P. K. Varshney, An optimum land cover mapping algorithm in the presence of shadow, IEEE J. Select. Topics Signal Process., vol. 5, no. 3, pp. 592 605, Jun. 2011 5. D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. PAMI 24 (5):603 619, 2002. 6. N. Ghoggali and F. Melgani Genetic SVM approach to semi supervised multi temporal classification, IEEE Geosci. Remote Sens. Lett., vol.5, no. 2, pp. 212 216, Apr. 2008. 7. T. Habib, J. Inglada, G. Mercier and J. Chanussot Support vector reduction in SVM algorithm for abrupt change detection in remote sensing, IEEE Geosci. Remote Sens. Lett., vol. 6, no.3, pp. 606 610, Jul. 2009. 8. P. Soille, Morphological Image Analysis. New York: Springer-Verlag, 1999. 9. V. Tsai, A comparative study on shadow compensation of color aerial images in invariant color models IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1661 1671, Jun. 2006. 10. Giorgos Mountrakis, JunghoIm, Caesar Ogole Support vector machines in remote sensing: A review in ISPRS Journal of Photo grammetry and Remote Sensing.

Shadow Detection and Reconstruction of Images from Satellite Images: GIS 11 11. E. Salvador, A. Cavallaro, and T. Ebrahimi Shadow identification and classification using invariant color models in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2001, vol. 3 pp. 1545 1548. 12. Victor J. D. Tsai A Comparative Study on Shadow Compensation of Color Aerial Images in Invariant Color Models in IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, Jun. 2006. 13. Ken chi Kouchi and Fumio Yamazaki Characteristics of Tsunami-Affected Areas in Moderate-Resolution Satellite Images in IEEE Trans. Geosci. Remote Sens, vol. 45, no.6, Jun.2007.