Multispectral and panchromatic images fusion using the Markov-random-field-based FCM

This article proposes a multispectral (MS) and panchromatic (PAN) images fusion approach exploiting local spatial information by using fuzzy c-means clustering algorithm based on the Markov random field (MRFFCM). The standard principal component analysis (PCA) technique is first employed to transform the MS images into principal component spaces to extract the first principal component (PC1). Then, we decompose the PAN image using the à trous wavelet transform to get the high frequency detailed information and the approximation of the PAN image. In the process, the local relationship is employed through MRFFCM between the two to produce a fused PC1 by choosing the saliency and significant coefficients. The fused MS image is generated after the detailed information has been incorporated with the fused PC1 and finally the inverse PCA is implemented. Experimental results demonstrate that the proposed approach improves the quality of fused images both qualitatively and quantitatively.

[1]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[2]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[3]  Sotirios Chatzis,et al.  A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation , 2008, IEEE Transactions on Fuzzy Systems.

[4]  Javier Marcello,et al.  Evaluation of Spatial and Spectral Effectiveness of Pixel-Level Fusion Techniques , 2013, IEEE Geoscience and Remote Sensing Letters.

[5]  Maoguo Gong,et al.  Fuzzy Clustering With a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2014, IEEE Transactions on Fuzzy Systems.

[6]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[8]  Patrick Pérez,et al.  Discrete Markov image modeling and inference on the quadtree , 2000, IEEE Trans. Image Process..

[9]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[11]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Feng Luo,et al.  A non-parameter Ising model for network-based identification of differentially expressed genes in recurrent breast cancer patients , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[14]  Jixian Zhang Multi-source remote sensing data fusion: status and trends , 2010 .

[15]  Guoying Liu,et al.  Multi-resolution Markov random field model with variable potentials in wavelet domain for texture image segmentation , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[16]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[17]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[18]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[19]  Xukun Shen,et al.  PM-PM: PatchMatch With Potts Model for Object Segmentation and Stereo Matching , 2015, IEEE Transactions on Image Processing.

[20]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[21]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[22]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[23]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[25]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Roger L. King,et al.  Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.