Super-Resolution Reconstruction of Image Sequences

In an earlier work (1999), we introduced the problem of reconstructing a super-resolution image sequence from a given low resolution sequence. We proposed two iterative algorithms, the R-SD and the R-LMS, to generate the desired image sequence. These algorithms assume the knowledge of the blur, the down-sampling, the sequences motion, and the measurements noise characteristics, and apply a sequential reconstruction process. It has been shown that the computational complexity of these two algorithms makes both of them practically applicable. In this paper, we rederive these algorithms as approximations of the Kalman filter and then carry out a thorough analysis of their performance. For each algorithm, we calculate a bound on its deviation from the Kalman filter performance. We also show that the propagated information matrix within the R-SD algorithm remains sparse in time, thus ensuring the applicability of this algorithm. To support these analytical results we present some computer simulations on synthetic sequences, which also show the computational feasibility of these algorithms.

[1]  A. Murat Tekalp,et al.  High-resolution image reconstruction from a low-resolution image sequence in the presence of time-varying motion blur , 1992, Proceedings of 1st International Conference on Image Processing.

[2]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[3]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[4]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[5]  Michael Elad,et al.  Super-resolution reconstruction of continuous image sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[6]  Andrew J. Patti,et al.  Image sequence restoration and deinterlacing by motion-compensated Kalman filtering , 1993, Electronic Imaging.

[7]  N E Manos,et al.  Stochastic Models , 1960, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[8]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[9]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[10]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[11]  Peter Cheeseman,et al.  Super-Resolved Surface Reconstruction from Multiple Images , 1996 .

[12]  Michael Elad,et al.  Superresolution restoration of an image sequence: adaptive filtering approach , 1999, IEEE Trans. Image Process..

[13]  Aggelos K. Katsaggelos,et al.  Spatio-Temporal Motion Compensated Noise Filtering Of Image Sequences , 1989, Other Conferences.