Automatic and topology-preserving gradient mesh generation for image vectorization

Gradient mesh vector graphics representation, used in commercial software, is a regular grid with specified position and color, and their gradients, at each grid point. Gradient meshes can compactly represent smoothly changing data, and are typically used for single objects. This paper advances the state of the art for gradient meshes in several significant ways. Firstly, we introduce a topology-preserving gradient mesh representation which allows an arbitrary number of holes. This is important, as objects in images often have holes, either due to occlusion, or their 3D structure. Secondly, our algorithm uses the concept of image manifolds, adapting surface parameterization and fitting techniques to generate the gradient mesh in a fully automatic manner. Existing gradient-mesh algorithms require manual interaction to guide grid construction, and to cut objects with holes into disk-like regions. Our new algorithm is empirically at least 10 times faster than previous approaches. Furthermore, image segmentation can be used with our new algorithm to provide automatic gradient mesh generation for a whole image. Finally, fitting errors can be simply controlled to balance quality with storage.

[1]  Ju Jia Zou,et al.  Cartoon image vectorization based on shape subdivision , 2001, Proceedings. Computer Graphics International 2001.

[2]  James Ferguson,et al.  Multivariable Curve Interpolation , 1964, JACM.

[3]  Lakshman Prasad,et al.  Rapid Automated Polygonal Image Decomposition , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[4]  M. Floater Mean value coordinates , 2003, Computer Aided Geometric Design.

[5]  William A. Barrett,et al.  Object-based vectorization for interactive image editing , 2006, The Visual Computer.

[6]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Kai Hormann,et al.  Surface Parameterization: a Tutorial and Survey , 2005, Advances in Multiresolution for Geometric Modelling.

[9]  H. Seidel,et al.  Multi-level partition of unity implicits , 2003 .

[10]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[12]  Hans-Peter Seidel,et al.  A fast and simple stretch-minimizing mesh parameterization , 2004, Proceedings Shape Modeling Applications, 2004..

[13]  Nira Dyn,et al.  Image compression by linear splines over adaptive triangulations , 2006, Signal Process..

[14]  Jack Tumblin,et al.  Bixels: Picture Samples with Sharp Embedded Boundaries , 2004, Rendering Techniques.

[15]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, SIGGRAPH 2008.

[16]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[17]  George Wolberg,et al.  Monotonic cubic spline interpolation , 1999, 1999 Proceedings Computer Graphics International.

[18]  Stefano Soatto,et al.  Integral Invariant Signatures , 2004, ECCV.

[19]  John F. Jarvis,et al.  A survey of techniques for the display of continuous tone pictures on bilevel displays , 1976 .

[20]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH 2005.

[21]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[22]  Shi-Min Hu,et al.  Surface fitting based on a feature sensitive parametrization , 2006, Comput. Aided Des..

[23]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Shing-Tung Yau,et al.  Slit Map: Conformal Parameterization for Multiply Connected Surfaces , 2008, GMP.

[25]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[26]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[27]  Jian Sun,et al.  Image vectorization using optimized gradient meshes , 2007, SIGGRAPH 2007.

[28]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..