PCNN-Based Image Fusion in Compressed Domain

This paper addresses a novel method of image fusion problem for different application scenarios, employing compressive sensing (CS) as the image sparse representation method and pulse-coupled neural network (PCNN) as the fusion rule. Firstly, source images are compressed through scrambled block Hadamard ensemble (SBHE) for its compression capability and computational simplicity on the sensor side. Local standard variance is input to motivate PCNN and coefficients with large firing times are selected as the fusion coefficients in compressed domain. Fusion coefficients are smoothed by sliding window in order to avoid blocking effect. Experimental results demonstrate that the proposed fusion method outperforms other fusion methods in compressed domain and is effective and adaptive in different image fusion applications.

[1]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[2]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[3]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[4]  David A. Landgrebe,et al.  Decision fusion approach for multitemporal classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[6]  E. Micheli-Tzanakou,et al.  Medical imaging fusion applications: An overview , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[7]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[8]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[9]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[10]  W. Shi,et al.  Wavelet-based image fusion and quality assessment , 2005 .

[11]  A. Ross,et al.  Level Fusion Using Hand and Face Biometrics , 2005 .

[12]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[13]  Arun Ross,et al.  Feature level fusion of hand and face biometrics , 2005, SPIE Defense + Commercial Sensing.

[14]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[15]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[16]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[17]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[18]  Chongzhao Han,et al.  An Overview on Pixel-Level Image Fusion in Remote Sensing , 2007, 2007 IEEE International Conference on Automation and Logistics.

[19]  Yang Xiao ADAPTIVE IMAGE FUSION ALGORITHM FOR INFRARED AND VISIBLE LIGHT IMAGES BASED ON DT-CWT , 2007 .

[20]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[21]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[22]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[23]  Cedric Nishan Canagarajah,et al.  Compressive image fusion , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Trac D. Tran,et al.  Fast compressive imaging using scrambled block Hadamard ensemble , 2008, 2008 16th European Signal Processing Conference.

[25]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[26]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[27]  Michael B. Wakin,et al.  An Introduction To Compressive Sampling [A sensing/sampling paradigm that goes against the common knowledge in data acquisition] , 2008 .

[28]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[29]  Qionghai Dai,et al.  Image fusion in compressed sensing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[31]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[32]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[33]  Robert Wang,et al.  Multi image fusion based on compressive sensing , 2010, 2010 International Conference on Audio, Language and Image Processing.

[34]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[35]  Ujwala Patil,et al.  Image fusion using hierarchical PCA. , 2011, 2011 International Conference on Image Information Processing.

[36]  Shutao Li,et al.  Pixel-level image fusion with simultaneous orthogonal matching pursuit , 2012, Inf. Fusion.

[37]  Yifeng Niu,et al.  Airborne Infrared and Visible Image Fusion for Target Perception Based on Target Region Segmentation and Discrete Wavelet Transform , 2012 .

[38]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.