Motion compensated film restoration

Abstract. Motion picture films are susceptible to local degradations such as dust spots. Other deteriorations are global such as intensity and spatial jitter. It is obvious that motion needs to be compensated for before the detection/correction of such local and dynamic defects. Therefore, we propose a hierarchical motion estimation method ideally suited for high resolution film sequences. This recursive block-based motion estimator relies on an adaptive search strategy and Radon projections to improve processing speed. The localization of dust particles then becomes straightforward. Thus, it is achieved by simple inter-frame differences between the current image and motion compensated successive and preceding frames. However, the detection of spatial and intensity jitter requires a specific process taking advantage of the high temporal correlation in the image sequence. In this paper, we present our motion compensation-based algorithms for removing dust spots, spatial and intensity jitter in degraded motion pictures. Experimental results are presented showing the usefulness of our motion estimator for film restoration at reasonable computational costs.

[1]  Olivier Buisson Analyse de séquence d'images haute résolution : application à la restauration numérique de films cinématographiques , 1997 .

[2]  S. Negahdaripour,et al.  Relaxing the Brightness Constancy Assumption in Computing Optical Flow , 1987 .

[3]  A. Murat Tekalp,et al.  Efficient multiframe Wiener restoration of blurred and noisy image sequences , 1992, IEEE Trans. Image Process..

[4]  Robert P. Loce,et al.  Restoration of images scanned in the presence of vibrations , 1996, J. Electronic Imaging.

[5]  G. De Haan Motion estimation and compensation: an integrated approach to consumer display field rate conversion , 1992 .

[6]  Deterioration detection for digital film restoration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[8]  Azriel Rosenfeld,et al.  A Pyramid Framework for Early Vision , 1994 .

[9]  Nicola Ancona,et al.  Optical flow from 1-D correlation: Application to a simple time-to-crash detector , 1993, 1993 (4th) International Conference on Computer Vision.

[10]  Aggelos K. Katsaggelos,et al.  Simultaneous recursive displacement estimation and restoration of image sequences , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[11]  Yrjö Neuvo,et al.  A New Class of Detail-Preserving Filters for Image Processing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  David Suter,et al.  Optic flow calculation using robust statistics , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Michael J. Black Robust incremental optical flow , 1992 .

[14]  Raymond N. J. Veldhuis Restoration of lost samples in digital signals , 1992 .

[15]  Etienne Decencière,et al.  Restauration automatique de films anciens , 1997 .

[16]  Ioannis Pitas,et al.  Nonlinear Digital Filters - Principles and Applications , 1990, The Springer International Series in Engineering and Computer Science.

[17]  David Suter,et al.  Historical Film Restoration and Video Coding , 1996 .

[18]  P. Haavisto,et al.  Median-based algorithms for image sequence processing , 1990, Other Conferences.

[19]  Jorge L. C. Sanz,et al.  Radon and Projection Transform-Based Computer Vision: Algorithms, A Pipeline Architecture, and Industrial Applications , 1988 .

[20]  Azriel Rosenfeld,et al.  A Pyramid Framework for Early Vision: Multiresolutional Computer Vision , 1993 .

[21]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[22]  Yi Wu,et al.  Historical film processing , 1995, Optics & Photonics.

[23]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[24]  R. Srinivasan,et al.  Predictive Coding Based on Efficient Motion Estimation , 1985, IEEE Trans. Commun..

[25]  P. Burt Fast filter transform for image processing , 1981 .

[26]  Jorge L. C. Sanz,et al.  Radon and projection transform-based computer vision , 1988 .