Remote Sensing Image Fusion Method Based on PCA and Curvelet Transform

Abstract In order to fuse two registered multi-spectral (MS) image and panchromatic (PAN) image in the same scene, a new remote sensing image fusion algorithm based on Principal Component Analysis (PCA) and Curvelet transform is proposed. The first principle component PC1 of MS image is extracted via PCA transform, at the same time, we perform the Morphology-Hat transform on the PAN image, and segment the transformed PAN image by the PCNN segmentation algorithm. Perform the Curvelet transform on the component PC1 of MS image and the PAN image after Morphology-Hat transform, and use different fusion rule to fuse different scale layers coefficients (coarse, detail and fine scale layer). For obtaining the fused image, we use the inverse Curvelet transform and inverse PCA transform to obtain the fused image. The experimental results illustrate that the proposed fusion algorithm outperforms Curvelet transform and other traditional fusion algorithms in whole such as intensity–hue–saturation, PCA, Brovey and Weighted Average both in visual effect and objective evaluation indexes (standard deviation, mean, information entropy, correlation coefficient, spectral distortions and deviation index).

[1]  Wei Huang,et al.  An improved fusion algorithm for infrared and visible images based on multi-scale transform , 2016 .

[2]  R. Vidhya,et al.  Optical image fusion using support value transform (SVT) and curvelets , 2015 .

[3]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[4]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[5]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[6]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[7]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[8]  Yang Lei,et al.  Novel fusion method for visible light and infrared images based on NSST–SF–PCNN , 2014 .

[9]  Sushmita Mitra,et al.  Satellite image segmentation with Shadowed C-Means , 2011, Inf. Sci..

[10]  Bai Zhang,et al.  SPOT5 multi-spectral (MS) and panchromatic (PAN) image fusion using an improved wavelet method based on local algorithm , 2013, Comput. Geosci..

[11]  Wenxing Bao,et al.  A Remote Sensing Image Fusion Algorithm Based on the Second Generation Curvelet Transform and DS Evidence Theory , 2014, Journal of the Indian Society of Remote Sensing.

[12]  Boying Wu,et al.  An Image Edge Detection Method Based on Mathematical Morphology , 2012 .

[13]  Yang Tongguang,et al.  Research of rotor faults in motor based on particle swarm optimization , 2011 .

[14]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[15]  J. R. Jensen,et al.  An automatic region-based image segmentation algorithm for remote sensing applications , 2010, Environ. Model. Softw..

[16]  Pang Shaoning Segmentation method of remote sensed images based on principal component analysis and pulse coupled neural network , 2011 .

[17]  Biswajit Biswas,et al.  Remote Sensing Image Fusion using PCNN Model Parameter Estimation by Gamma Distribution in Shearlet Domain , 2015 .

[18]  Mingliang Xu,et al.  High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform , 2015, Neurocomputing.

[19]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .