An automatic video scratch removal based on Thiele type continued fraction

Old age, repeat play and improper preservation always deteriorate the film, and dust and mechanical operations produce artifacts like scratches and blotches. Many researches carried out to repair the damaged digital videos and video inpainting gradually becomes an important topic in digital image process ing. Challenges in scratched video inpainting are automatic detection of scratches and restoration of damaged part. This paper presents an automatic scratch detec tion method as well as a novel scratch removal approach. Stationary wavelet transform (SWT) which shows excellent performance in keeping translation-invariant is introduced to automatically detect the scratches, this strategy makes the scratches’ detection more accurate. At the heart of our method is a new nonlinear interpolation method based on continued fraction in which Thiele-type continued fraction is used to interpolate surrounding known pixels for repairing the damaged part. Algorithm presented in this paper also utilizes both spatial and temporal information of the scratched video during the restoration stage. Experimental results show that our scheme not only obtains more accurate detection of scratches, but also gives better video quality.

[1]  A. Chambolle.  Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[2]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[3]  Olivier Buisson,et al.  Detection and removal of line scratches in motion picture films , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Torbjørn Eltoft,et al.  A Stationary Wavelet-Domain Wiener Filter for Correlated Speckle , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yi Fang,et al.  Newton-Thiele's rational interpolants , 2000, Numerical Algorithms.

[6]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[7]  V. Karnaukhov,et al.  Restoration of blurred images with conditional total variation method , 2010, Pattern Recognition and Image Analysis.

[8]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[9]  Olivier Buisson,et al.  Reconstruction of degraded image sequences. Application to film restoration , 2001, Image Vis. Comput..

[10]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[11]  Vincent Brost,et al.  Vertical scratches detection based on edge detection for old film , 2010, 2010 2nd International Conference on Industrial and Information Systems.

[12]  P. R. Graves-Morris,et al.  Efficient reliable rational interpolation , 1981 .

[13]  V. R. Vijaykumar,et al.  Decision based adaptive median filter to remove blotches, scratches, streaks, stripes and impulse noise in images , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004 .

[16]  Deok-Hwan Kim,et al.  A robust texture feature extraction using the localized angular phase , 2011, Multimedia Tools and Applications.

[17]  Domenico Tegolo,et al.  A genetic algorithm for scratch removal in static images , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[18]  Bernard Besserer,et al.  Tracking and MAP reconstruction of line scratches in degraded motion pictures , 2002, Machine Vision and Applications.

[19]  Xueming Qian,et al.  Video text detection and localization in intra-frames of H.264/AVC compressed video , 2012, Multimedia Tools and Applications.

[20]  L. Wuytack,et al.  Padé Approximation and its Applications , 1979 .

[21]  Sarp Ertürk,et al.  Scratch detection via temporal coherency analysis and removal using edge priority based interpolation , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[22]  Shengli Xie,et al.  An efficient spatio-temporal boundary matching algorithm for video error concealment , 2011, Multimedia Tools and Applications.

[23]  Xinpeng Zhang,et al.  Simultaneous inpainting for image structure and texture using anisotropic heat transfer model , 2010, Multimedia Tools and Applications.

[24]  Lei Zhang,et al.  Noise Reduction for Magnetic Resonance Images via Adaptive Multiscale Products Thresholding , 2003, IEEE Trans. Medical Imaging.

[25]  Cangju Xing,et al.  Global bi-directional motion compensation frame interpolation algorithm , 2009, Multimedia Tools and Applications.