Effective Clipart Image Vectorization through Direct Optimization of Bezigons

Bezigons, i.e., closed paths composed of Bézier curves, have been widely employed to describe shapes in image vectorization results. However, most existing vectorization techniques infer the bezigons by simply approximating an intermediate vector representation (such as polygons). Consequently, the resultant bezigons are sometimes imperfect due to accumulated errors, fitting ambiguities, and a lack of curve priors, especially for low-resolution images. In this paper, we describe a novel method for vectorizing clipart images. In contrast to previous methods, we directly optimize the bezigons rather than using other intermediate representations; therefore, the resultant bezigons are not only of higher fidelity compared with the original raster image but also more reasonable because they were traced by a proficient expert. To enable such optimization, we have overcome several challenges and have devised a differentiable data energy as well as several curve-based prior terms. To improve the efficiency of the optimization, we also take advantage of the local control property of bezigons and adopt an overlapped piecewise optimization strategy. The experimental results show that our method outperforms both the current state-of-the-art method and commonly used commercial software in terms of bezigon quality.

[1]  D. Salesin,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2013, CACM.

[2]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, SIGGRAPH 2009.

[3]  James Richard. Diebel,et al.  Bayesian image vectorization : the probabilistic inversion of vector image rasterization / james richard diebel. , 2008 .

[4]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[5]  Stefan Jeschke,et al.  Rendering surface details with diffusion curves , 2009, ACM Trans. Graph..

[6]  Jirí Zára,et al.  Sketching Cartoons by Example , 2005, SBM.

[7]  Markus H. Gross,et al.  Topology-driven vectorization of clean line drawings , 2013, ACM Trans. Graph..

[8]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[9]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[10]  Philip J. Schneider,et al.  An algorithm for automatically fitting digitized curves , 1990 .

[11]  John Y. Chiang,et al.  A new approach for binary line image vectorization , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[12]  Michael Isard,et al.  Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion , 2000 .

[13]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, ACM Trans. Graph..

[14]  李蕻 培训站Adobe Illustrator(三) , 1996 .

[15]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jhing-Fa Wang,et al.  A topology-based component extractor for understanding electronic circuit diagrams , 1988, Comput. Vis. Graph. Image Process..

[17]  Josiah Manson,et al.  Analytic Rasterization of Curves with Polynomial Filters , 2013, Comput. Graph. Forum.

[18]  P. Selinger Potrace : a polygon-based tracing algorithm , 2003 .

[19]  Yizhou Yu,et al.  Patch-based image vectorization with automatic curvilinear feature alignment , 2009, ACM Trans. Graph..

[20]  Lakshman Prasad,et al.  Rapid Automated Polygonal Image Decomposition , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[21]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Osamu Hori,et al.  Raster-to-vector conversion by line fitting based on contours and skeletons , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[23]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Gerald L. Engel,et al.  VISUALIZATION AND COMPUTER GRAPHICS , 2005 .

[25]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[26]  Edwin E. Catmull,et al.  A hidden-surface algorithm with anti-aliasing , 1978, SIGGRAPH.

[27]  M. Powell The NEWUOA software for unconstrained optimization without derivatives , 2006 .

[28]  Noshir A. Langrana,et al.  Engineering Drawing Processing and Vectorization System , 1990, Comput. Vis. Graph. Image Process..

[29]  Y. Ermoliev,et al.  The Minimization of Semicontinuous Functions: Mollifier Subgradients , 1995 .

[30]  Bruce Gooch,et al.  Image simplification and vectorization , 2011, NPAR '11.

[31]  Dani Lischinski,et al.  Depixelizing pixel art , 2011, ACM Trans. Graph..

[32]  곽순섭,et al.  Generalized Functions , 2006, Theoretical and Mathematical Physics.

[33]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[34]  Khanh P. V. Doan,et al.  Antialiased rendering of self-intersecting polygons using polygon decomposition , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[35]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[36]  William A. Barrett,et al.  Object-based vectorization for interactive image editing , 2006, The Visual Computer.

[37]  Marco Alexander Treiber Optimization for Computer Vision: An Introduction to Core Concepts and Methods , 2013 .

[38]  Josiah Manson,et al.  Wavelet Rasterization , 2011, Comput. Graph. Forum.

[39]  Harry Shum,et al.  Image vectorization using optimized gradient meshes , 2007, ACM Trans. Graph..

[40]  Jirí Zára,et al.  Video Codec for Classical Cartoon Animations with Hardware Accelerated Playback , 2005, ISVC.

[41]  Ramyad Hadidi,et al.  CAIRO , 2017, At the Corner of a Dream.