Patch-based image vectorization with automatic curvilinear feature alignment

Raster image vectorization is increasingly important since vector-based graphical contents have been adopted in personal computers and on the Internet. In this paper, we introduce an effective vector-based representation and its associated vectorization algorithm for full-color raster images. There are two important characteristics of our representation. First, the image plane is decomposed into nonoverlapping parametric triangular patches with curved boundaries. Such a simplicial layout supports a flexible topology and facilitates adaptive patch distribution. Second, a subset of the curved patch boundaries are dedicated to faithfully representing curvilinear features. They are automatically aligned with the features. Because of this, patches are expected to have moderate internal variations that can be well approximated using smooth functions. We have developed effective techniques for patch boundary optimization and patch color fitting to accurately and compactly approximate raster images with both smooth variations and curvilinear features. A real-time GPU-accelerated parallel algorithm based on recursive patch subdivision has also been developed for rasterizing a vectorized image. Experiments and comparisons indicate our image vectorization algorithm achieves a more accurate and compact vector-based representation than existing ones do.

[1]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  R. Fletcher Practical Methods of Optimization , 1988 .

[3]  Tony DeRose,et al.  Mesh optimization , 1993, SIGGRAPH.

[4]  Graham F. Carey,et al.  Extension of a Mesh Quality Metric for Elements With a Curved Boundary Edge or Surface , 2005, J. Comput. Inf. Sci. Eng..

[5]  William A. Barrett,et al.  Object-based vectorization for interactive image editing , 2006, The Visual Computer.

[6]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[7]  Harry Shum,et al.  Image vectorization using optimized gradient meshes , 2007, ACM Trans. Graph..

[8]  Sung Yong Shin,et al.  Image metamorphosis using snakes and free-form deformations , 1995, SIGGRAPH.

[9]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[10]  Anjul Patney,et al.  Real-time Reyes-style adaptive surface subdivision , 2008, SIGGRAPH Asia '08.

[11]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[12]  Hugues Hoppe,et al.  Random-access rendering of general vector graphics , 2008, ACM Trans. Graph..

[13]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[14]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[15]  Hong Yan,et al.  Vectorization of hand-drawn image using piecewise cubic Bézier curves fitting , 1998, Pattern Recognit..

[16]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[17]  Nira Dyn,et al.  Image compression by linear splines over adaptive triangulations , 2006, Signal Process..

[18]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[19]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, ACM Trans. Graph..

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yizhou Yu,et al.  Patch-based image vectorization with automatic curvilinear feature alignment , 2009, SIGGRAPH 2009.

[22]  Lakshman Prasad,et al.  Rapid Automated Polygonal Image Decomposition , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[23]  Ju Jia Zou,et al.  Cartoon image vectorization based on shape subdivision , 2001, Proceedings. Computer Graphics International 2001.