A new motion-compensated reduced-order model Kalman filter for space-varying restoration of progressive and interlaced video

We propose a new approach for motion-compensated, reduced order model Kalman filtering for restoration of progressive and interlaced video. In the case of interlaced inputs, the proposed filter also performs deinterlacing. In contrast to the literature, both motion-compensation and reduced-order state modeling are achieved by augmenting the observation equation, as opposed to modifying the state-transition equation. The proposed modeling, which includes the two-dimensional (2-D) reduced order model Kalman filtering (ROMKF) of Angwin and Kaufman as a special case, results in significant performance improvement in fixed-lag Kalman filtering of space-varying blurred images. This is demonstrated by experimental results.

[1]  Robert Grover Brown,et al.  Introduction to random signal analysis and Kalman filtering , 1983 .

[2]  John W. Woods,et al.  Hierarchical approach to image estimation , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  A. M. Tekalp,et al.  Space-variant and color image restoration using Kalman filtering , 1989, Sixth Multidimensional Signal Processing Workshop,.

[5]  H. Kaufman,et al.  Image restoration using reduced order models , 1988 .

[6]  J. W. Woods,et al.  Motion Compensated Spatiotemporal Kalman Filter , 1993 .

[7]  A. Murat Tekalp,et al.  POCS-based restoration of space-varying blurred images , 1994, IEEE Trans. Image Process..

[8]  A.M. Tekalp,et al.  Survey of estimation techniques in image restoration , 1991, IEEE Control Systems.

[9]  A. M. Tekalp,et al.  Multichannel image modeling and Kalman filtering for multispectral image restoration , 1990 .

[10]  Shmuel Peleg,et al.  A Three-Frame Algorithm for Estimating Two-Component Image Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  J. J. Gerbrands,et al.  A fast Kalman filter for images degraded by both blur and noise , 1983 .

[12]  Mahmood R. Azimi-Sadjadi,et al.  Two-dimensional block Kalman filtering for image restoration , 1987, IEEE Trans. Acoust. Speech Signal Process..

[13]  Nikolas P. Galatsanos,et al.  Restoration of color images by multichannel Kalman filtering , 1991, IEEE Trans. Signal Process..

[14]  A. Murat Tekalp,et al.  Efficient multiframe Wiener restoration of blurred and noisy image sequences , 1992, IEEE Trans. Image Process..

[15]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[16]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[17]  Zhe Wu,et al.  Multidimensional state-space model Kalman filtering with application to image restoration , 1985, IEEE Trans. Acoust. Speech Signal Process..

[18]  Howard Kaufman,et al.  Restoration of spatially varying blurred images using multiple model-based extended Kalman filters , 1995, IEEE Trans. Image Process..

[19]  J. Woods,et al.  Kalman filtering in two dimensions: Further results , 1981 .