Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution

We present a novel algorithm for image fusion from irregularly sampled data. The method is based on the framework of normalized convolution (NC), in which the local signal is approximated through a projection onto a subspace. The use of polynomial basis functions in this paper makes NC equivalent to a local Taylor series expansion. Unlike the traditional framework, however, the window function of adaptive NC is adapted to local linear structures. This leads to more samples of the same modality being gathered for the analysis, which in turn improves signal-to-noise ratio and reduces diffusion across discontinuities. A robust signal certainty is also adapted to the sample intensities to minimize the influence of outliers. Excellent fusion capability of adaptive NC is demonstrated through an application of super-resolution image reconstruction.

[1]  Gunnar Farnebäck,et al.  Polynomial expansion for orientation and motion estimation , 2002 .

[2]  R. van den Boomgaard,et al.  Linear and Robust Estimation of Local Image Structure , 2003 .

[3]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[4]  Klamer Schutte,et al.  Signal conditioning algorithms for enhanced tactical sensor imagery , 2003, SPIE Defense + Commercial Sensing.

[5]  R. Franke.  Smooth Interpolation of Scattered Data by Local Thin Plate Splines , 1982 .

[6]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[7]  Michael Elad,et al.  On the bilateral filter and ways to improve it , 2002 .

[8]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[9]  Joost van de Weijer,et al.  Local Mode Filtering , 2001, CVPR.

[10]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[12]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[13]  Michael Elad,et al.  Robust shift and add approach to superresolution , 2003, SPIE Optics + Photonics.

[14]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[16]  Mark Nitzberg,et al.  Nonlinear Image Filtering with Edge and Corner Enhancement , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Carl-Fredrik Westin,et al.  Normalized and differential convolution , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[19]  David Capel.  Image Mosaicing and Super-Resolution (Cphc/Bcs Distinguished Dissertations.) , 2004 .

[20]  Lucas J. van Vliet,et al.  Curvature of n-dimensional space curves in grey-value images , 2002, IEEE Trans. Image Process..

[21]  R. Haralick,et al.  A facet model for image data , 1981 .

[22]  Lucas J. van Vliet,et al.  Recursive Gabor filtering , 2002, IEEE Trans. Signal Process..

[23]  Lucas J. van Vliet,et al.  Normalized Averaging Using Adaptive Applicability Functions with Applications in Image Reconstruction from Sparsely and Randomly Sampled Data , 2003, SCIA.

[24]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[25]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[26]  Lucas J. van Vliet,et al.  On curvature estimation of ISO surfaces in 3D gray-value images and the computation of shape descriptors , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[28]  D. R. K. Brownrigg,et al.  The weighted median filter , 1984, CACM.

[29]  Joost van de Weijer,et al.  Curvature Estimation in Oriented Patterns Using Curvilinear Models Applied to Gradient Vector Fields , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  C. Westin,et al.  Normalized and differential convolution , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[32]  Klamer Schutte,et al.  Performance of optimal registration estimators , 2005, SPIE Defense + Commercial Sensing.

[33]  Klamer Schutte,et al.  Influence of signal-to-noise ratio and point spread function on limits of superresolution , 2005, IS&T/SPIE Electronic Imaging.

[34]  R A Young,et al.  The Gaussian derivative model for spatial vision: I. Retinal mechanisms. , 1988, Spatial vision.