Multispectral and multiresolution image fusion using particle swarm optimization

Multispectral and multiresolution image fusion is important for many multimedia and remote sensing applications, such as video surveillance, medical imaging, and satellite imaging. For the commercial satellite “IKONOS,” spatial resolutions of high-resolution panchromatic (PAN) and low-resolution multispectral (MS) satellite images are 1 m and 4 m, respectively. To cope with color distortion and blocking artifacts in fused images, in this study, a multispectral and multiresolution image fusion approach using PSO is proposed. The pixels of fused images in the training set are classified into several categories based on the characteristics of low-resolution MS images. Then, the smooth parameters of spatial and spectral responses between the high-resolution PAN and low-resolution MS images are determined by PSO. All the pixels within each category are normalized by its own smooth parameter so that color distortion and blocking artifacts can be greatly reduced. Based on the experimental results obtained in this study, the overall visual quality of the fused images by the proposed approach is better than that by three comparison approaches, whereas the correlation coefficients, γPAN, for the fused images by the proposed approach are greater than that by three comparison approaches.

[1]  Jyh-Horng Jeng,et al.  Fractal image compression using visual-based particle swarm optimization , 2008, Image Vis. Comput..

[2]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[3]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[4]  J. Chassery,et al.  The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multisp , 1996 .

[5]  José A. Malpica,et al.  Hue Adjustment to IHS Pan-Sharpened IKONOS Imagery for Vegetation Enhancement , 2007, IEEE Geoscience and Remote Sensing Letters.

[6]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[7]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[8]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[9]  Jun-ichi Kudoh,et al.  Image Fusion Processing for IKONOS 1-m Color Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[10]  P. S. Chavez,et al.  Comparison of the spectral information content of Landsat Thematic Mapper and SPOT for three different sites in the Phoenix, Arizona region , 1988 .

[11]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[12]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[15]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .

[16]  Xavier Otazu,et al.  A low computational-cost method to fuse IKONOS images using the spectral response function of its sensors , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Te-Ming Tu,et al.  Best Tradeoff for High-Resolution Image Fusion to Preserve Spatial Details and Minimize Color Distortion , 2007, IEEE Geoscience and Remote Sensing Letters.

[18]  Khaled El-Fakih,et al.  A GA-based movie-on-demand platform using multiple distributed servers , 2008, Multimedia Tools and Applications.

[19]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[20]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[21]  P. Chavez.  Digital merging of Landsat TM and digitized NHAP data for 1: 24,000-scale image mapping((National Hi , 1986 .

[22]  Li-Wei Kang,et al.  Two error resilient coding schemes for wavelet-based image transmission based on data embedding and genetic algorithms , 2006, J. Vis. Commun. Image Represent..

[23]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[24]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[25]  Zora Konjovic,et al.  Adaptive content-based music retrieval system , 2010, Multimedia Tools and Applications.

[26]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[27]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[28]  Junyu Dong,et al.  Capture and fusion of 3d surface texture , 2011, Multimedia Tools and Applications.

[29]  Vassilia Karathanassi,et al.  Investigation of the Dual-Tree Complex and Shift-Invariant Discrete Wavelet Transforms on Quickbird Image Fusion , 2007, IEEE Geoscience and Remote Sensing Letters.

[30]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[31]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.