Multiresolution fusion using contourlet transform based edge learning

In this paper, we propose a new approach for multi-resolution fusion of remotely sensed images based on the contourlet transform based learning of high frequency edges. We obtain a high spatial resolution (HR) and high spectral resolution multi-spectral (MS) image using the available high spectral but low spatial resolution MS image and the Panchromatic (Pan) image. Since we need to predict the missing high resolution pixels in each of the MS images the problem is posed in a restoration framework and is solved using maximum a posteriori (MAP) approach. Towards this end, we first obtain an initial approximation to the HR fused image by learning the edges from the Pan image using the contourlet transform. A low resolution model is used for the MS image formation and the texture of the fused image is modeled as a homogeneous Markov random field (MRF) prior. We then optimize the cost function which is formed using the data fitting term and the prior term and obtain the fused image, in which the edges correspond to those in the initial HR approximation. The procedure is repeated for each of the MS images. The advantage of the proposed method lies in the use of simple gradient based optimization for regularization purposes while preserving the discontinuities. This in turn reduces the computational complexity since it avoids the use of computationally taxing optimization methods for discontinuity preservation. Also, the proposed method has minimum spectral distortion as we are not using the actual Pan digital numbers, instead learn the texture using contourlet coefficients. We demonstrate the effectiveness of our approach by conducting experiments on real satellite data captured by Quickbird satellite.

[1]  Julien Radoux,et al.  Bayesian Data Fusion for Adaptable Image Pansharpening , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Subhasis Chaudhuri,et al.  An MRF Model-Based Approach to Simultaneous Recovery of Depth and Restoration from Defocused Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Subhasis Chaudhuri,et al.  Simultaneous depth recovery and image restoration from defocused images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Deepu Rajan,et al.  Simultaneous Estimation of Super-Resolved Scene and Depth Map from Low Resolution Defocused Observations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Josiane Zerubia,et al.  An adaptive Gaussian model for satellite image deblurring , 2004, IEEE Transactions on Image Processing.

[6]  Manjunath V. Joshi,et al.  MAP Estimation for Multiresolution Fusion in Remotely Sensed Images Using an IGMRF Prior Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[8]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[9]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[10]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[11]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[12]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[13]  Roger L. King,et al.  Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[17]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[18]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[19]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..