Video completion using robust motion estimation and color compensation

Video completion is used for repairing damaged or missing data in a video sequence. This paper proposes a video completion method using robust motion estimation and color compensation. The proposed method consists of three steps: motion estimation, source patch search, and color assignment. If an input video contains brightness change, existing video completion methods give poor results. For overcoming this drawback, we apply two methods: color normalization for motion estimation and source patch search, and color compensation for color assignment. In the first step, we estimate the motion using normalized input video. Then, we search the source patch using normalized color information and motion information extracted in the first step. Finally, color compensation using color transform is used for color assignment. Experimental results show that the proposed method gives better visual results than conventional video completion methods.

[1]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[2]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[3]  Guillermo Sapiro,et al.  Video Inpainting Under Constrained Camera Motion , 2007, IEEE Transactions on Image Processing.

[4]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Yasuyuki Matsushita,et al.  Video Completion by Motion Field Transfer , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Gui Yun Tian,et al.  Colour correction for panoramic imaging , 2002, Proceedings Sixth International Conference on Information Visualisation.

[7]  Polina Golland,et al.  Motion from Color , 1997, Comput. Vis. Image Underst..

[8]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.