An improved motion-compensated restoration method for damaged color motion picture films

In this paper, we propose an improved motion-compensated restoration method for color motion picture films deteriorated due to flashing blotches. The method consists of an improved multiresolution block matching with log-D search, a rank ordered differences-based blotch detection and 3D vector median filtering for interpolation of missing data, and utilizes five consecutive frames. Performance of the method is tested on artificially corrupted image sequences and real motion picture films, and is compared to that of the three-frame-based method which involves similar algorithms except improved motion estimation and blotch detection. The results show that the method efficiently works even in severely blotched and motion regions in image sequences.

[1]  A. Murat Tekalp,et al.  Adaptive motion-compensated filtering of noisy image sequences , 1993, IEEE Trans. Circuits Syst. Video Technol..

[2]  Luciano Alparone,et al.  Regularization of optic flow estimates by means of weighted vector median filtering , 1999, IEEE Trans. Image Process..

[3]  M. GHANBARI,et al.  The cross-search algorithm for motion estimation [image coding] , 1990, IEEE Trans. Commun..

[4]  G. A. Thomas,et al.  Television motion measurement for DATV and other applications , 1987 .

[5]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[6]  Munchurl Kim,et al.  Efficient motion estimation algorithm for bidirectional prediction scheme , 1994 .

[7]  Ming-Ting Sun,et al.  Motion Vector Refinement for High-Performance Transcoding , 1999, IEEE Trans. Multim..

[8]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[9]  M.N.S. Swamy,et al.  Pyramidal motion estimation techniques exploiting intra-level motion correlation , 2003, IEEE Trans. Circuits Syst. II Express Briefs.

[10]  Wooi-Boon Goh,et al.  Bi-directional 3D auto-regressive model approach to motion picture restoration , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[11]  Anil C. Kokaram,et al.  Detection of missing data in image sequences , 1995, IEEE Trans. Image Process..

[12]  Konstantinos N. Plataniotis,et al.  Multichannel filters for image processing , 1997, Signal Process. Image Commun..

[13]  Jill Macdonald Boyce,et al.  Noise reduction of image sequences using adaptive motion compensated frame averaging , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Yap-Peng Tan,et al.  On the methods and performances of rational downsizing video transcoding , 2004, Signal Process. Image Commun..

[15]  W. E. Lynch.  Bidirectional motion estimation based on P frame motion vectors and area overlap , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Wooi-Boon Goh,et al.  A new spatio-temporal MRF model for the detection of missing data in image sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[18]  Hussein Baher,et al.  Analog & digital signal processing , 1990 .

[19]  R. Srinivasan,et al.  Predictive Coding Based on Efficient Motion Estimation , 1985, IEEE Trans. Commun..

[20]  Yun Q. Shi,et al.  A thresholding multiresolution block matching algorithm , 1997, IEEE Trans. Circuits Syst. Video Technol..

[21]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[22]  Man-Nang Chong,et al.  Bidirectional motion estimation via vector propagation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[23]  Raphaël Bornard,et al.  Probabilistic Approaches for the Digital Restoration of Television Archives. (Approches probabilistes appliquées à la restauration numérique d'archives télévisées) , 2002 .

[24]  J. Astola,et al.  Vector median filters , 1990, Proc. IEEE.

[25]  Pao-Ta Yu,et al.  Adaptive fuzzy hybrid multichannel filters for removal of impulsive noise from color images , 1999, Signal Process..

[26]  Konstantinos N. Plataniotis,et al.  Color image processing using adaptive multichannel filters , 1997, IEEE Trans. Image Process..

[27]  Luciano Alparone,et al.  Adaptively weighted vector-median filters for motion-fields smoothing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[28]  Robert THOMA,et al.  Motion compensating interpolation considering covered and uncovered background , 1989, Signal Process. Image Commun..

[29]  Mohammed Ghanbari,et al.  The Cross-Search Algorithm for Motion Estimation , 1990 .

[30]  Anil Kokaram,et al.  System for the removal of impulsive noise in image sequences , 1992, Other Conferences.

[31]  Jenq-Neng Hwang,et al.  Scene context dependent reference frame placement for MPEG video coding , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  JongWon Kim,et al.  Hybrid global-local motion compensated frame interpolation for low bit rate video coding , 2003, J. Vis. Commun. Image Represent..

[33]  Sanjit K. Mitra,et al.  Blotch and Scratch Detection in Image Sequences based on Rank Ordered Differences , 1997 .

[34]  Stephen Armstrong,et al.  Film and Video Restoration using Rank-Order Models , 1999 .

[35]  Richard Storey,et al.  Electronic detection and concealment of film dirt , 1985 .

[36]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[37]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[38]  M. Bierling,et al.  Displacement Estimation By Hierarchical Blockmatching , 1988, Other Conferences.

[39]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[40]  오승준.  [서평]「Digital Video Processing」 , 1996 .