Missing-data recovery from dirt sparkles on degraded color films

A novel spatiotemporal method is proposed for detection of and recovery from dirt sparkles on degraded color films. Firstly, a confidence measurement of dirt is extracted by comparing pixel values per color component after global motion compensation. Then, candidate dirt is detected by filtering and thresholding this confidence measurement. For each candidate region of dirt, bidirectional local motion compensation is employed, and motion-compensated pixels are selected according to their confidence values, using an improved ML3Dex filter to preserve details and avoid oversmoothing of images. Experiments on real data demonstrate that our method outperforms several well-established algorithms in accuracy, efficiency, and robustness.

[1]  Richard Storey,et al.  Electronic detection and concealment of film dirt , 1985 .

[2]  Peter Schallauer,et al.  Automatic Restoration Algorithms for 35 mm Film , 1999 .

[3]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[4]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[5]  Sanjit K. Mitra,et al.  Blotch and Scratch Detection in Image Sequences based on Rank Ordered Differences , 1997 .

[6]  Yrjö Neuvo,et al.  A New Class of Detail-Preserving Filters for Image Processing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Temel Kayikçioglu,et al.  An improved motion-compensated restoration method for damaged color motion picture films , 2004, Signal Process. Image Commun..

[8]  Louis Laborelli,et al.  Missing data correction in still images and image sequences , 2002, MULTIMEDIA '02.

[9]  Jinchang Ren,et al.  Segmentation-Assisted Dirt Detection for the Restoration of Archived Films , 2005, BMVC.

[10]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[11]  Gonzalo R. Arce,et al.  Multistage order statistic filters for image sequence processing , 1991, IEEE Trans. Signal Process..

[12]  A. Kokaram.  Motion picture restoration , 1998 .

[13]  Anil C. Kokaram,et al.  On missing data treatment for degraded video and film archives: a survey and a new Bayesian approach , 2004, IEEE Transactions on Image Processing.

[14]  Russell C. Hardie,et al.  LUM filters: a class of rank-order-based filters for smoothing and sharpening , 1993, IEEE Trans. Signal Process..

[15]  Stephen Marshall,et al.  Genetic algorithm optimization of multidimensional grayscale soft morphological filters with applications in film archive restoration , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Reginald L. Lagendijk,et al.  Improved blotch detection by postprocessing , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[17]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..