A Variational Method for Flicker Removal in High Speed Video Sequences

Deflickering of color image sequences constitutes a fundamental task in many video applications. Recently, it has received increased attention with the popularity of consumer-level high speed video acquisition devices, for instance in newer smartphone generations or sports/action cameras. These are capable of acquiring videos at more than 100 frames per second. In this context, flicker corresponds to undesirable intensity and chroma variations due to the interaction between the acquisition frequency on the one hand, and the alternating current powering artificial light sources on the other. Non-uniform periodic flicker is not easy to correct since its estimation requires object tracking, and since most tracking techniques assume consistent illumination. In this paper, we adopt a new optimization approach to solve this problem. We propose causal and non-causal robust correction schemes using a block matching technique paired with color variation estimation. A post processing step is introduced to remove block artifacts in an efficient manner. A multi-resolution approach is also developed to reduce computation time without affecting the quality of our results. We demonstrate the efficacy of our method both on simulated and real data.

[1]  Guillaume Forbin,et al.  Nonlinear flicker compensation for archived film sequences using motion-compensated graylevel tracing , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Fernando Díaz-de-María,et al.  Standard-Compliant Low-Pass Temporal Filter to Reduce the Perceived Flicker Artifact , 2014, IEEE Transactions on Multimedia.

[3]  Anil Kokaram,et al.  LOCALISED DEFLICKER OF MOVING IMAGES , 2006 .

[4]  Reginald L. Lagendijk,et al.  Correction of intensity flicker in old film sequences , 1999, IEEE Trans. Circuits Syst. Video Technol..

[5]  Anil C. Kokaram,et al.  Simultaneous luminance and position stabilization for film and video , 2003, IS&T/SPIE Electronic Imaging.

[6]  Antonio Albiol,et al.  Flicker reduction in old films , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[7]  Bertrand Chupeau,et al.  Modeling the flicker effect in camcorded videos to improve watermark robustness , 2014, 2014 IEEE International Workshop on Information Forensics and Security (WIFS).

[8]  Guillaume Forbin,et al.  Flicker Compensation for Archived Film Using a Spatially-Adaptive Nonlinear Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[9]  Etienne Decencière,et al.  Restauration automatique de films anciens , 1997 .

[10]  Jean-Christophe Pesquet,et al.  Motion estimation in the presence of illumination variations , 2000, Signal Process. Image Commun..

[11]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[12]  Masayuki Kawamata,et al.  Flicker Parameters Estimation in Old Film Sequences Containing Moving Objects , 2011, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[13]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[14]  Jie Ren,et al.  Postprocessing of block-coded videos for deflicker and deblocking , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Theodore Vlachos Flicker correction for archived film sequences using a nonlinear model , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Ali Kanj,et al.  Global image registration and video color correction in presence of illumination variations , 2015, 2015 Fifth International Conference on Digital Information and Communication Technology and its Applications (DICTAP).

[17]  Rafael García,et al.  Online Sunflicker Removal using Dynamic Texture Prediction , 2012, VISAPP.

[18]  Julie Delon,et al.  Movie and video scale-time equalization application to flicker reduction , 2006, IEEE Transactions on Image Processing.

[19]  Hugues Talbot,et al.  A Majorize-Minimize Subspace Approach for ℓ2-ℓ0 Image Regularization , 2011, SIAM J. Imaging Sci..

[20]  Marilyn Wolf,et al.  A Train Station Surveillance System: Challenges and Solutions , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[22]  Anil C. Kokaram,et al.  A New Robust Technique for Stabilizing Brightness Fluctuations in Image Sequences , 2004, ECCV Workshop SMVP.

[23]  Petros Maragos,et al.  Motion displacement estimation using an affine model for image matching , 1991 .

[24]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[25]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[26]  Takahiro Saito,et al.  A robust method of image flicker correction for heavily-corrupted old film sequences , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[27]  Man Nang Chong,et al.  Enhanced approach to film flicker removal , 2000, SPIE Optics + Photonics.

[28]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .