Joint noise reduction, motion estimation, missing data reconstruction, and model parameter estimation for degraded motion pictures

Image sequence restoration has been steadily gaining in importance with the arrival of digital video broadcasting. Automated treatment of archived video material typically involves dealing with replacement noise in the form of 'blotches' with varying intensity levels and additive 'grain' noise. In the case of replacement noise the problem is essentially one of missing data which must be detected and then reconstructed based upon surrounding spatio- temporal information, while the additive noise can be treated as a noise reduction problem. This paper introduces a fully Bayesian specification of the problem, Markov chain Monte Carlo methodology is applied to the joint detection and removal of both replacement and additive noise components. The work presented builds upon the Bayesian image detection/interpolation methods developed in including now the ability to reduce noise in an image sequence as well as reconstruct the image intensity information within missing regions.

[1]  Eric Dubois,et al.  Bayesian Estimation of Motion Vector Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jun S. Liu,et al.  Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[3]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[4]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[5]  Andrew L. Rukhin,et al.  Tools for statistical inference , 1991 .

[6]  Anil C. Kokaram,et al.  A System for Reconstruction of Missing Data in Image Sequences Using Sampled 3D AR Models and MRF Motion Priors , 1996, ECCV.

[7]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[8]  A. Kokaram Motion picture restoration , 1998 .

[9]  Anil Kokaram,et al.  Fast method for sampling from Laplacian-type distributions , 1998, Optics & Photonics.

[10]  K OrJ Numerical Bayesian methods applied to signal processing , 1996 .

[11]  K. Riedel Numerical Bayesian Methods Applied to Signal Processing , 1996 .

[12]  Anil C. Kokaram,et al.  Joint Detection, Interpolation, Motion and Parameter Estimation for Image Sequences with Missing Data , 1997, ICIAP.

[13]  Anil C. Kokaram,et al.  Detection of missing data in image sequences , 1995, IEEE Trans. Image Process..

[14]  Anil Kokaram,et al.  System for the removal of impulsive noise in image sequences , 1992, Other Conferences.

[15]  Christoph Stiller Motion estimation for coding of moving video at 8 kbit/s with Gibbs-modeled vectorfield smoothing , 1990, Other Conferences.

[16]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[17]  R. D. Morris,et al.  Stochastic and deterministic methods in motion picture restoration , 1994 .

[18]  William J. Fitzgerald,et al.  Detection and correction of speckle degradation in image sequences using a 3D Markov random field , 1993 .

[19]  S. Godsill,et al.  Restoration of Image Sequences using a Causal Spatio-Temporal Model , 1997 .

[20]  William J. Fitzgerald,et al.  Replacement noise in image sequences-detection and interpolation by motion field segmentation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.