Multi-sensor image fusion with SCDPT transform

A multi-sensor image fusion algorithm based on SCDPT transform is proposed in this paper. SCDPT transform is used to decompose source images in each scale and direction to get low-pass sub-band coefficients and band-pass directional sub-band coefficients. The principle for low-pass sub-band coefficients is based on structural similarity (SSIM), regional energy and regional average gradient, while the principle for directional band-pass sub-band coefficients is based on SSIM and regional variance. Finally, fused image is obtained by SCDPT inverse transform. The proposed method is compared to the wavelet transform, Laplacian pyramid transform and gradient pyramid transform. Our algorithm not only has more flexible directional and shift invariance, but also is able to accurately capture the image information of the contour feature and texture details.

[1]  K. Muneeswaran,et al.  Significant region based image retrieval using curvelet transform , 2011, 2011 INTERNATIONAL CONFERENCE ON RECENT ADVANCEMENTS IN ELECTRICAL, ELECTRONICS AND CONTROL ENGINEERING.

[2]  Soontorn Oraintara,et al.  The Shiftable Complex Directional Pyramid—Part I: Theoretical Aspects , 2008, IEEE Transactions on Signal Processing.

[3]  Long Wang,et al.  Similarity-based multimodality image fusion with shiftable complex directional pyramid , 2011, Pattern Recognit. Lett..

[4]  Yi Chai,et al.  Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection , 2013 .

[5]  Wang Juan,et al.  The improved algorithm of image fusion based segmentation region , 2012, Proceedings of 2012 International Conference on Measurement, Information and Control.

[6]  Yi Chai,et al.  Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain , 2012 .

[7]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[8]  Nikolaos Mitianoudis,et al.  Region-based image fusion using a combinatory Chebyshev-ICA method , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.