Exemplar-Based Object Removal in Video Using GMM

This paper presents an exemplar-based video inpainting mechanism that restores the area of the removal object, and this mechanism can be further employed to extract the background of videos. The region to be inpainted in video is still in background and moving in foreground. Our method consists of a simple preprocessing stage and video inpainting step. The preprocessing stage consists in constructing Gaussian Mixture Model (GMM) for both background and foreground separately, then make use of GMMs to distinguish background and foreground of the entire video. That saves the time for calculating the optical flow mosaics as many video inpainting algorithms do in the preprocessing step. As for video inpainting, we firstly fill the gap as much as possible by copying information from other frames pixel by pixel, and then inpaint the remaining holes in the background by extending the exemplar-based image inpainting algorithm. Experimental results demonstrate that our method for object removal in video is feasible and effective.

[1]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[2]  Jenq-Neng Hwang,et al.  Exemplar-Based Video Inpainting Without Ghost Shadow Artifacts by Maintaining Temporal Continuity , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[4]  Guillermo Sapiro,et al.  Video inpainting of occluding and occluded objects , 2005, IEEE International Conference on Image Processing 2005.

[5]  Borivoj Vojnovic,et al.  An Algorithm for image stitching and blending , 2005, SPIE BiOS.

[6]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Guillermo Sapiro,et al.  Video Inpainting Under Constrained Camera Motion , 2007, IEEE Transactions on Image Processing.

[8]  Mubarak Shah,et al.  Motion Layer Based Object Removal in Videos , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[9]  William H. Press,et al.  Numerical recipes: the art of scientific computing, 3rd Edition , 2007 .

[10]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.