Video Vectorization via Tetrahedral Remeshing

We present a video vectorization method that generates a video in vector representation from an input video in raster representation. A vector-based video representation offers the benefits of vector graphics, such as compactness and scalability. The vector video we generate is represented by a simplified tetrahedral control mesh over the spatial-temporal video volume, with color attributes defined at the mesh vertices. We present novel techniques for simplification and subdivision of a tetrahedral mesh to achieve high simplification ratio while preserving features and ensuring color fidelity. From an input raster video, our method is capable of generating a compact video in vector representation that allows a faithful reconstruction with low reconstruction errors.

[1]  Albert M. Vossepoel,et al.  Adaptive Vectorization of Line Drawing Images , 1997, Comput. Vis. Image Underst..

[2]  Yuan Zhou,et al.  Quadric-based simplification in any dimension , 2005, TOGS.

[3]  Derek Nowrouzezahrai,et al.  Hierarchical diffusion curves for accurate automatic image vectorization , 2014, ACM Trans. Graph..

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Yizhou Yu,et al.  Patch-based image vectorization with automatic curvilinear feature alignment , 2009, ACM Trans. Graph..

[6]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[7]  Harry Shum,et al.  Image vectorization using optimized gradient meshes , 2007, ACM Trans. Graph..

[8]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Hong Qin,et al.  A new solid subdivision scheme based on box splines , 2002, SMA '02.

[10]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, ACM Trans. Graph..

[11]  Ju Jia Zou,et al.  Cartoon image vectorization based on shape subdivision , 2001, Proceedings. Computer Graphics International 2001.

[12]  Ross T. Whitaker,et al.  Lattice Cleaving: Conforming Tetrahedral Meshes of Multimaterial Domains with Bounded Quality , 2012, IMR.

[13]  David A. Forsyth,et al.  A Subdivision-Based Representation for Vector Image Editing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[14]  Wolfgang Straßer,et al.  Tetrahedral mesh compression with the cut-border machine , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[15]  Jirí Zára,et al.  Video Codec for Classical Cartoon Animations with Hardware Accelerated Playback , 2005, ISVC.

[16]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[17]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[18]  William A. Barrett,et al.  Object-based vectorization for interactive image editing , 2006, The Visual Computer.

[19]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, SIGGRAPH 2008.

[20]  Sylvain Paris,et al.  Edge-Preserving Smoothing and Mean-Shift Segmentation of Video Streams , 2008, ECCV.

[21]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[22]  Chuan Wang,et al.  Video Object Co-Segmentation via Subspace Clustering and Quadratic Pseudo-Boolean Optimization in an MRF Framework , 2014, IEEE Transactions on Multimedia.

[23]  Kun Zhou,et al.  Large mesh deformation using the volumetric graph Laplacian , 2005, ACM Trans. Graph..

[24]  Yizhou Yu,et al.  Vector solid textures , 2010, ACM Trans. Graph..

[25]  Jirí Zára,et al.  Sketching Cartoons by Example , 2005, SBM.

[26]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[27]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, SIGGRAPH 2009.

[28]  John W. Fisher,et al.  A Video Representation Using Temporal Superpixels , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Stephen Lin,et al.  Diffusion curve textures for resolution independent texture mapping , 2012, ACM Trans. Graph..

[30]  Kun Zhou,et al.  Multiscale vector volumes , 2011, SA '11.

[31]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..