Joint Fusion and Blind Restoration For Multiple Image Scenarios With Missing Data

Image fusion systems aim at transferring ‘interesting’ information from the input sensor images to the fused image. The common assumption for most fusion approaches is the existence of a high-quality reference image signal for all image parts in all input sensor images. In the case that there are common degraded areas in at least one of the input images, the fusion algorithms cannot improve the information provided there, but simply convey a combination of this degraded information to the output. The authors propose a combined spatial-domain method of fusion and restoration in order to identify these common degraded areas in the fused image and use a regularized restoration approach to enhance the content in these areas. The proposed approach was tested on both multi-focus and multi-modal image sets and produced interesting results.

[1]  Michalis E. Zervakis,et al.  On the application of robust functionals in regularized image restoration , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Vladimir S. Petrovic,et al.  Objective pixel-level image fusion performance measure , 2000, SPIE Defense + Commercial Sensing.

[3]  A. Cañada,et al.  Handbook of differential equations , 2004 .

[4]  G. Piella.  New quality measures for image fusion , 2004 .

[5]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[6]  C. N. Canagarajah,et al.  Image fusion using a 3-D wavelet transform , 1999 .

[7]  Nick Kingsbury,et al.  The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters , 1998 .

[8]  S. John,et al.  Multiframe selective information fusion from robust error estimation theory , 2005, IEEE Transactions on Image Processing.

[9]  Aggelos K. Katsaggelos,et al.  Bayesian and regularization methods for hyperparameter estimation in image restoration , 1999, IEEE Trans. Image Process..

[10]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[12]  Alexander Toet.  Detection of dim point targets in cluttered maritime backgrounds through multisensor image fusion , 2002, SPIE Defense + Commercial Sensing.

[13]  D. Gennery.  Determination of optical transfer function by inspection of frequency-domain plot , 1973 .

[14]  Mostafa Kaveh,et al.  A regularization approach to joint blur identification and image restoration , 1996, IEEE Trans. Image Process..

[15]  Nikolaos Mitianoudis,et al.  Adaptive Image Fusion Using Ica Bases , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[16]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[17]  Nikolaos Mitianoudis,et al.  Pixel-based and region-based image fusion schemes using ICA bases , 2007, Inf. Fusion.

[18]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.