Simultaneous spatial-temporal image fusion using Kalman filtered compressed sensing

Image fusion is a process to combine multiple frames of the same scene into one image. The popular image fusion methods mainly concentrate on static image fusion and lack spatial-temporal adaptability. The conventional multi-resolution image fusion algorithms have not fully exploited the temporal information. To resolve this problem, we present a novel dynamic image fusion algorithm based on Kalman filtered compressed sensing. The fusion procedure characterized by estimation fusion is completed in state space. A parametric fusion model is proposed to learn and combine spatial and temporal information simultaneously. The experiments on the ground-truth data sets show that the proposed fusion algorithm offers a considerable improvement on the dynamic fusion performance and rivals the traditional multi-resolution-based fusion methods.

[1]  Wei Lu,et al.  Real-time dynamic MR image reconstruction using Kalman Filtered Compressed Sensing , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[3]  Zhang Xiu-qiong,et al.  Dynamic Infrared and Visible Image Sequence Fusion Based on DT-CWT Using GGD , 2008, 2008 International Conference on Computer Science and Information Technology.

[4]  Cedric Nishan Canagarajah,et al.  Compressive image fusion , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[6]  Xiao Gang,et al.  Infrared and visible dynamic image sequence fusion based on region target detection , 2007, 2007 10th International Conference on Information Fusion.

[7]  Jamie P. Heather,et al.  A review of image fusion technology in 2005 , 2005, SPIE Defense + Commercial Sensing.

[8]  Chongzhao Han,et al.  Optimal linear estimation fusion .I. Unified fusion rules , 2003, IEEE Trans. Inf. Theory.

[9]  Jingwen Yan,et al.  A novel image fusion algorithm based on bandelet transform , 2007 .

[10]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[11]  O. Ersoy,et al.  Image fusion by compressive sensing , 2009, 2009 17th International Conference on Geoinformatics.

[12]  Tao Chen,et al.  Remote sensing image fusion based on ridgelet transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[13]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[15]  Yaonan Wang,et al.  Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images , 2002, Inf. Fusion.

[16]  Gang Xiao,et al.  Feature-based fusion of infrared and visible dynamic images using target detection , 2007 .

[17]  Feng Zhao,et al.  The nonsubsampled contourlet transform for image fusion , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[18]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[19]  Qionghai Dai,et al.  Image fusion in compressed sensing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[21]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[22]  Zhongliang Jing,et al.  Image fusion using a low-redundancy and nearly shift-invariant discrete wavelet frame , 2007 .

[23]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[24]  Gang Xiao,et al.  Improved dynamic image fusion scheme for infrared and visible sequence based on image fusion system , 2008, 2008 11th International Conference on Information Fusion.

[25]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[26]  R. DeVore,et al.  The Johnson-Lindenstrauss Lemma Meets Compressed Sensing , 2006 .