Trainable blotch detection on high resolution archive films minimizing the human interaction

Film archives are continuously in need of automatic restoration tools to accelerate the correction of film artifacts and to decrease the costs. Blotches are a common type of film degradation and their correction needs a lot of manual interaction in traditional systems due to high false detection rates and the huge amount of data of high resolution images. Blotch detectors need reliable motion estimation to avoid the false detection of uncorrupted regions. In case of erroneous detection, usually an operator has to remove the false alarms manually, which significantly decreases the efficiency of the restoration process. To reduce manual intervention, we developed a two-step false alarm reduction technique including pixel- and object-based methods as post-processing. The proposed pixel-based algorithm compensates motion, decreasing false alarms at low computational cost, while the following object based method further reduces the residual false alarms by machine learning techniques. We introduced a new quality metric for detection methods by measuring the required amount of manual work after the automatic detection. In our novel evaluation technique, the ground truth is collected from digitized archive sequences where defective pixel positions are detected in an interactive process.

[1]  Isabelle Bloch,et al.  Blotch Detection for Digital Archives Restoration based on the Fusion of Spatial and Temporal Detectors , 2006, 2006 9th International Conference on Information Fusion.

[2]  Stephen Marshall,et al.  Genetic algorithm optimization of multidimensional grayscale soft morphological filters with applications in film archive restoration , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Livio Tenze,et al.  Robust detection and correction of blotches in old films using spatio-temporal information , 2002, IS&T/SPIE Electronic Imaging.

[4]  Olivier Buisson,et al.  Reconstruction of degraded image sequences. Application to film restoration , 2001, Image Vis. Comput..

[5]  László Czúni,et al.  Semi automatic digital motion picture restoration system with learning capabilities , 2004 .

[6]  Levente Kovács,et al.  Digital motion picture restoration system for film archives (DIMORF). A complex solution for film scanning, processing and recording , 2003 .

[7]  Shmuel Peleg,et al.  A Three-Frame Algorithm for Estimating Two-Component Image Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Shohreh Kasaei,et al.  Novel Post-Processing Methods Used in Detection of Blotches in Image Sequences , 2004 .

[9]  Jinchang Ren,et al.  Segmentation-Assisted Dirt Detection for the Restoration of Archived Films , 2005, BMVC.

[10]  Tamás Szirányi,et al.  Adaptive Stabilization of Vibration in Archive Films , 2003, CAIP.

[11]  Livio Tenze,et al.  Blotches correction and contrast enhancement for old film pictures , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[12]  Temel Kayikçioglu,et al.  An improved motion-compensated restoration method for damaged color motion picture films , 2004, Signal Process. Image Commun..

[13]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[14]  Marcel J. T. Reinders,et al.  VIDEO ENHANCEMENT AND RESTORATION , 2005 .

[15]  György Kovács,et al.  A digital motion picture restoration system for film archives , 2004 .

[16]  Olivier Buisson,et al.  Motion compensated film restoration , 2003, Machine Vision and Applications.

[17]  Tamás Szirányi,et al.  Trainable post-processing method to reduce false alarms in the detection of small blotches of archive films , 2005, IEEE International Conference on Image Processing 2005.

[18]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[19]  Peter Schallauer,et al.  Automatic Restoration Algorithms for 35 mm Film , 1999 .

[20]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[21]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[22]  Anil C. Kokaram,et al.  On missing data treatment for degraded video and film archives: a survey and a new Bayesian approach , 2004, IEEE Transactions on Image Processing.

[23]  Anil C. Kokaram,et al.  Detection of missing data in image sequences , 1995, IEEE Trans. Image Process..

[24]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[25]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[26]  Antonio Albiol,et al.  Morphological -Reconstruction applied to restoration of blotches in old films , 2002 .

[27]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[28]  Sanjit K. Mitra,et al.  Blotch and Scratch Detection in Image Sequences based on Rank Ordered Differences , 1997 .