Noise reduction filters for dynamic image sequences: a review

In this paper, a thorough review is presented of noise reduction filters for digital image sequences. Detailed descriptions of several spatiotemporal and temporal noise reduction algorithms are provided. To aid in comparing between these different algorithms, we classify them based on their support (i.e., 3-D or 1-D filter) and whether or not motion compensation is employed. Several algorithms from each of the four categories are implemented and tested on real sequences degraded to various signal-to-noise ratios. These experimental results are discussed and analyzed to determine the overall advantages and disadvantages of the four general classifications, as well as, the individual filters. >

[1]  Gösta H. Granlund,et al.  Image Sequence Analysis , 1993, DAGM-Symposium.

[2]  Aggelos K. Katsaggelos,et al.  Linear-quadratic noise-smoothing filters for quantum-limited images , 1995, IEEE Trans. Image Process..

[3]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[4]  Richard A. Jones,et al.  Motion Compensated Image Coding with a Combined Maximum A Posteriori and Regression Algorithm , 1985, IEEE Trans. Commun..

[5]  P. Pirsch,et al.  Advances in picture coding , 1985, Proceedings of the IEEE.

[6]  N. Gallagher,et al.  An application of median filters to digital television , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Tor Arne Reinen.  Noise reduction in heart movies by motion-compensated filtering , 1991, Other Conferences.

[8]  Aggelos K. Katsaggelos,et al.  Spatio-Temporal Motion Compensated Noise Filtering Of Image Sequences , 1989, Other Conferences.

[9]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[10]  Aggelos K. Katsaggelos,et al.  Low bit rate video coding using robust motion vector regeneration in the decoder , 1994, IEEE Trans. Image Process..

[11]  Eric Dubois,et al.  Motion-compensated filtering of time-varying images , 1992, Multidimens. Syst. Signal Process..

[12]  Jae Lim,et al.  Implicit motion compensated noise reduction of motion video scenes , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Reginald L. Lagendijk,et al.  Noise reduction of severely corrupted image sequences , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Aggelos K. Katsaggelos,et al.  Formula for the steady-state gain of a recursive estimator , 1990 .

[15]  Gonzalo R. Arce,et al.  Multistage order statistic filters for image sequence processing , 1991, IEEE Trans. Signal Process..

[16]  J. W. Woods,et al.  Motion Compensated Spatiotemporal Kalman Filter , 1993 .

[17]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[18]  Aggelos K. Katsaggelos,et al.  Adaptive image sequence noise filtering methods , 1991, Other Conferences.

[19]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[20]  Nikolas P. Galatsanos,et al.  Least squares restoration of multichannel images , 1991, IEEE Trans. Signal Process..

[21]  A.K. Katsaggelos,et al.  A general framework for frequency domain multi-channel signal processing , 1993, IEEE Trans. Image Process..

[22]  Anil Kokaram,et al.  System for the removal of impulsive noise in image sequences , 1992, Other Conferences.

[23]  D. Boekee,et al.  A pel-recursive Wiener-based displacement estimation algorithm , 1987 .

[24]  M. Bierling,et al.  Displacement Estimation By Hierarchical Blockmatching , 1988, Other Conferences.

[25]  Nikolas P. Galatsanos,et al.  Digital restoration of multichannel images , 1989, IEEE Trans. Acoust. Speech Signal Process..

[26]  Eric Dubois,et al.  Bayesian Estimation of Motion Vector Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  A. Murat Tekalp,et al.  Efficient multiframe Wiener restoration of blurred and noisy image sequences , 1992, IEEE Trans. Image Process..

[28]  Georgios B. Giannakis,et al.  Image motion estimation algorithms using cumulants , 1995, IEEE Trans. Image Process..

[29]  Aggelos K. Katsaggelos,et al.  A recursive nonstationary MAP displacement vector field estimation algorithm , 1995, IEEE Trans. Image Process..

[30]  Aggelos K. Katsaggelos,et al.  Nonstationary AR modeling and constrained recursive estimation of the displacement field , 1992, IEEE Trans. Circuits Syst. Video Technol..

[31]  A. Murat Tekalp,et al.  Adaptive motion-compensated filtering of noisy image sequences , 1993, IEEE Trans. Circuits Syst. Video Technol..

[32]  Nader M. Namazi,et al.  Nonuniform image motion estimation from noisy data , 1990, IEEE Trans. Acoust. Speech Signal Process..

[33]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[34]  Aggelos K. Katsaggelos,et al.  Recursive displacement estimation and restoration of noisy-blurred image sequences , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[36]  Aggelos K. Katsaggelos,et al.  An adaptive regularized recursive displacement estimation algorithm , 1993, IEEE Trans. Image Process..

[37]  Jill Macdonald Boyce,et al.  Noise reduction of image sequences using adaptive motion compensated frame averaging , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[38]  John W. Woods,et al.  Image Estimation Using Doubly Stochastic Gaussian Random Field Models , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[40]  John P. Rossi,et al.  A Digital Noise Reducer for Encoded NTSC Signals , 1978 .

[41]  Ajem Janssen,et al.  The contour plot method for noise reduction in digital video. , 1985 .

[42]  Aggelos K. Katsaggelos,et al.  Image sequence filtering in quantum-limited noise with applications to low-dose fluoroscopy , 1993, IEEE Trans. Medical Imaging.

[43]  Mehmet K. Özkan,et al.  Temporally adaptive filtering of noisy image sequences using a robust motion estimation algorithm , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[44]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[45]  A. A. Sawchuk,et al.  Motion compensated enhancement of noisy image sequences , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[46]  Aggelos K. Katsaggelos,et al.  Recursive Locally Linear MMSE Motion-Compensated Image Sequence Filtering under Quantum-Limited Conditions , 1993, J. Vis. Commun. Image Represent..

[47]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[48]  F. Rocca,et al.  The Differential Method for Image Motion Estimation , 1983 .

[49]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[50]  Michael Mills,et al.  Blockmatching motion estimation algorithms-new results , 1990 .

[51]  Bor-Shenn Jeng,et al.  Postprocessing of video sequence using motion-dependent median filters , 1991, Other Conferences.

[52]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  D. Brzakovic,et al.  Bayesian restoration of image sequences using 3-D Markov random fields , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[54]  Reginald L. Lagendijk,et al.  An order-statistics supported non-linear filter with application to image sequence filtering , 1993, IEEE Winter Workshop on Nonlinear Digital Signal Processing.

[55]  David J. Fleet.  Measurement of image velocity , 1992 .

[56]  G. Haan,et al.  Motion compensated noise filtering of image sequences , 1992 .

[57]  J. D. Robbins,et al.  Motion-compensated coding: Some new results , 1980, The Bell System Technical Journal.

[58]  Sergei Fogel,et al.  The estimation of velocity vector fields from time-varying image sequences , 1991, CVGIP Image Underst..

[59]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  T. J. Dennis.  Nonlinear temporal filter for television picture noise reduction , 1980 .

[61]  K Sauer,et al.  Nonstationary filtering of transmission tomograms in high photon counting noise. , 1991, IEEE transactions on medical imaging.

[62]  Yrjö Neuvo,et al.  3-dimensional median filters for image sequence processing , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.