Fusion of Panchromatic and Multispectral Images via Morphological Operator and Improved PCNN in Mixed Multiscale Domain

In order to effectively combine the spectral information of the multispectral (MS) image with the spatial details of the panchromatic (PAN) image and improve the fusion quality, a fusion method based on morphological operator and improved pulse coupled neural network (PCNN) in mixed multi-scale (MM) domain is proposed. Firstly, the MS and PAN images are decomposed by nonsubsampled shearlet transform (NSST) to low- and high-frequency coefficients, respectively; secondly, morphological filter-based intensity modulation (MFIM) technology and stationary wavelet transform (SWT) are applied to the fusion of the low-frequency coefficients; an improved PCNN model is employed to the fusion of the high-frequency coefficients; thirdly, the final coefficients are reconstructed with inverse NSST. The experimental results on QuickBird satellite demonstrate that the proposed method is superior to five other kinds of traditional and popular methods: HIS, PCA, SWT, NSCT-PCNN and NSST-PCNN. The proposed method can improve the spatial resolution effectively while maintaining the spectral information well. The experimental results show that the proposed method outperforms the other methods in visual effect and objective evaluations.

[1]  Guy Flouzat,et al.  Data fusion thanks to an improved morphological pyramid approach: comparison loop on simulated images and application to SPOT 4 data , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[2]  Erik Blasch,et al.  Biological information fusion using a PCNN and belief filtering , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[3]  Jocelyn Chanussot,et al.  Fusion of Multispectral and Panchromatic Images Based on Morphological Operators , 2016, IEEE Transactions on Image Processing.

[4]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[5]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[6]  Gitta Kutyniok,et al.  Shearlets: Multiscale Analysis for Multivariate Data , 2012 .

[7]  Bhabatosh Chanda,et al.  Fusion of 2D grayscale images using multiscale morphology , 2001, Pattern Recognit..

[8]  Edward J. Delp,et al.  Color image coding using morphological pyramid decomposition , 1995, IEEE Trans. Image Process..

[9]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[10]  Jiang Pin Fusion algorithm for infrared and visible image based on NSST and adaptive PCNN , 2014 .

[11]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[12]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[13]  Shuyuan Yang,et al.  Fusion of Panchromatic and Multispectral Images via Coupled Sparse Non-Negative Matrix Factorization , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Fu Wei,et al.  Image fusion based on Shearlet and improved PCNN , 2012 .