An edge preserving multi-resolution image fusion: Use of joint bilateral filter

In this paper, we propose a new fusion method based on an edge preserving joint bilateral filter. Here, a multistage form of joint bilateral filter is used to fuse high spectral resolution multispectral (MS) and high spatial resolution panchromatic (PAN) images. In the detail extraction process, both PAN and MS images are used to obtain the available high frequency details. First, the details of PAN image are extracted by using MS image as an auxiliary input to the joint bilateral filter. Similarly, PAN image is used as an auxiliary image to joint bilateral filter to extract the high frequency features from the MS image. This process is extended to multistage form in order to obtain the meaningful details from PAN as well as MS images. Next, these extracted details are first weighted with an average gain and then fused separately with the four MS image bands i.e. red (R), green (G), blue (B) and near infra-red (NIR) to obtain four consistent image bands. The proposed method is tested over images obtained from Quick-bird satellite. The experimental results are compared with the widely popular methods as well as recently proposed methods.

[1]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[2]  Shutao Li,et al.  Fusion of panchromatic and multispectral images using multiscale dual bilateral filter , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Isin Erer,et al.  Fusion of multispectral and panchromatic images by combining bilateral filter and IHS transform , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[4]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[5]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[6]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.

[11]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..