Image vectorization and editing via linear gradient layer decomposition

A key advantage of vector graphics over raster graphics is their editability. For example, linear gradients define a spatially varying color fill with a few intuitive parameters, which are ubiquitously supported in standard vector graphics formats and libraries. By layering regions filled with linear gradients, complex appearances can be created. We propose an automatic method to convert a raster image into layered regions of linear gradients. Given an input raster image segmented into regions, our approach decomposes the resulting regions into opaque and semi-transparent linear gradient fills. Our approach is fully automatic (e.g., users do not identify a background as in previous approaches) and exhaustively considers all possible decompositions that satisfy perceptual cues. Experiments on a variety of images demonstrate that our method is robust and effective.

[1]  Edward Chien,et al.  Keypoint-driven line drawing vectorization via PolyVector flow , 2021, ACM Trans. Graph..

[2]  Yotam I. Gingold,et al.  Video recoloring via spatial-temporal geometric palettes , 2021, ACM Trans. Graph..

[3]  Bing-Yu Chen,et al.  ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis , 2021, IEEE Transactions on Visualization and Computer Graphics.

[4]  Yongwei Nie,et al.  A Blind Color Separation Model for Faithful Palette-Based Image Recoloring , 2021, IEEE Transactions on Multimedia.

[5]  N. Mitra,et al.  Im2Vec: Synthesizing Vector Graphics without Vector Supervision , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  David Vanderhaeghe,et al.  A benchmark for rough sketch cleanup , 2020, ACM Trans. Graph..

[7]  Adrien Bousseau,et al.  Integer‐Grid Sketch Simplification and Vectorization , 2020, Comput. Graph. Forum.

[8]  Alla Sheffer,et al.  PolyFit : perception-aligned vectorization of raster clip-art via intermediate polygonal fitting , 2020 .

[9]  L. Sigal,et al.  PolyFit , 2020 .

[10]  Kun Xu,et al.  An Improved Geometric Approach for Palette‐based Image Decomposition and Recoloring , 2019, Comput. Graph. Forum.

[11]  Damir Demirović,et al.  An Implementation of the Mean Shift Algorithm , 2019, Image Process. Line.

[12]  C. Theobalt,et al.  Real-time Global Illumination Decomposition of Videos , 2019, ACM Trans. Graph..

[13]  Mathieu Aubry,et al.  Unsupervised Image Decomposition in Vector Layers , 2018, 2020 IEEE International Conference on Image Processing (ICIP).

[14]  Yotam I. Gingold,et al.  Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry , 2018, ACM Trans. Graph..

[15]  Leonidas J. Guibas,et al.  DeepPrimitive: Image decomposition by layered primitive detection , 2018, Computational Visual Media.

[16]  Masataka Goto,et al.  Decomposing Images into Layers with Advanced Color Blending , 2018, Comput. Graph. Forum.

[17]  Tae-Hyun Oh,et al.  Semantic soft segmentation , 2018, ACM Trans. Graph..

[18]  Alla Sheffer,et al.  Perception-driven semi-structured boundary vectorization , 2018, ACM Trans. Graph..

[19]  Markus H. Gross,et al.  Semantic Segmentation for Line Drawing Vectorization Using Neural Networks , 2018, Comput. Graph. Forum.

[20]  Yotam I. Gingold,et al.  Palette-based image decomposition, harmonization, and color transfer , 2018, ArXiv.

[21]  Mikhail Bessmeltsev,et al.  Vectorization of Line Drawings via Polyvector Fields , 2018, ACM Trans. Graph..

[22]  Stephen DiVerdi,et al.  Pigmento: Pigment-Based Image Analysis and Editing , 2017, IEEE Transactions on Visualization and Computer Graphics.

[23]  Chunxia Xiao,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization , 2017, IEEE Transactions on Image Processing.

[24]  Yotam I. Gingold,et al.  Decomposing images into layers via RGB-space geometry , 2017, TOGS.

[25]  Frédo Durand,et al.  Inverse Diffusion Curves Using Shape Optimization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[26]  Adrien Bousseau,et al.  Fidelity vs. simplicity , 2016, ACM Trans. Graph..

[27]  Wencheng Wang,et al.  Vector Regression Functions for Texture Compression , 2015, ACM Trans. Graph..

[28]  Yotam I. Gingold,et al.  Decomposing time-lapse paintings into layers , 2015, ACM Trans. Graph..

[29]  Derek Nowrouzezahrai,et al.  Hierarchical diffusion curves for accurate automatic image vectorization , 2014, ACM Trans. Graph..

[30]  Adrien Bousseau,et al.  Vectorising Bitmaps into Semi‐Transparent Gradient Layers , 2014, Comput. Graph. Forum.

[31]  Adrien Bousseau,et al.  Depicting stylized materials with vector shade trees , 2013, ACM Trans. Graph..

[32]  David A. Forsyth,et al.  A Subdivision-Based Representation for Vector Image Editing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[33]  P. Cavanagh,et al.  The art of transparency , 2011, i-Perception.

[34]  Vladimir G. Kim,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[35]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Harry Shum,et al.  Image vectorization using optimized gradient meshes , 2007, ACM Trans. Graph..

[37]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[38]  Xiaolei Huang,et al.  Computing layered surface representations: an algorithm for detecting and separating transparent overlays , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[39]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[41]  J. Nocedal Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[42]  Eugene W. Myers,et al.  Finding All Spanning Trees of Directed and Undirected Graphs , 1978, SIAM J. Comput..

[43]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[44]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[45]  Marc Pollefeys,et al.  Unmixing-Based Soft Color Segmentation for Image Manipulation , 2017, ACM Trans. Graph..

[46]  I. Moreno,et al.  and pattern recognition , 2014 .

[47]  S. Palmer,et al.  A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. , 2012, Psychological bulletin.

[48]  P. Selinger Potrace : a polygon-based tracing algorithm , 2003 .