Temporal coherent image segmentation and its applications

We propose a trapped-ball method for image segmentation, which is fast, supports non-uniformly colored regions, and allows robust region segmentation even in the presence of imperfectly linked region edges. We also introduce two applications by using the trapped-ball image segmentation, for temporal coherent animations generation and editing. First, we present a system for vectorizing 2D raster format cartoon animations by the segmentation method and background construction. The output animations are visually flicker free, smaller in file size, and easy to edit. And then we present an automatic method for online video stream stylization, producing a temporally coherent output video stream, based on the trapped-ball segmentation and optical flow. Our system transforms video into an abstract style with large regions of constant color and highlighted bold edges.

[1]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[2]  Andrew Zisserman,et al.  Learning Layered Motion Segmentation of Video , 2005, ICCV.

[3]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Nebojsa Jojic,et al.  Consistent segmentation for optical flow estimation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[6]  Joo-Haeng Lee,et al.  Thread-Based BRDF Rendering on GPU , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[7]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[8]  Mubarak Shah,et al.  Motion layer extraction in the presence of occlusion using graph cuts , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.