Representing Images Using Curvilinear Feature Driven Subdivision Surfaces

This paper presents a subdivision-based vector graphics for image representation and creation. The graphics representation is a subdivision surface defined by a triangular mesh augmented with color attribute at vertices and feature attribute at edges. Special cubic B-splines are proposed to describe curvilinear features of an image. New subdivision rules are then designed accordingly, which are applied to the mesh and the color attribute to define the spatial distribution and piecewise-smoothly varying colors of the image. A sharpness factor is introduced to control the color transition across the curvilinear edges. In addition, an automatic algorithm is developed to convert a raster image into such a vector graphics representation. The algorithm first detects the curvilinear features of the image, then constructs a triangulation based on the curvilinear edges and feature attributes, and finally iteratively optimizes the vertex color attributes and updates the triangulation. Compared with existing vector-based image representations, the proposed representation and algorithm have the following advantages in addition to the common merits (such as editability and scalability): 1) they allow flexible mesh topology and handle images or objects with complicated boundaries or features effectively; 2) they are able to faithfully reconstruct curvilinear features, especially in modeling subtle shading effects around feature curves; and 3) they offer a simple way for the user to create images in a freehand style. The effectiveness of the proposed method has been demonstrated in experiments.

[1]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, ACM Trans. Graph..

[2]  Yongyi Yang,et al.  Tomographic image reconstruction using content-adaptive mesh modeling , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Michel Barlaud,et al.  Fractal image compression based on Delaunay triangulation and vector quantization , 1996, IEEE Trans. Image Process..

[4]  Harry Shum,et al.  Image vectorization using optimized gradient meshes , 2007, ACM Trans. Graph..

[5]  Yizhou Yu,et al.  Patch-based image vectorization with automatic curvilinear feature alignment , 2009, ACM Trans. Graph..

[6]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yan Lin Image Compression by Linear Splines over Adaptive Triangulation , 2009 .

[8]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, SIGGRAPH 2009.

[9]  Anthony Vetro,et al.  Use of two-dimensional deformable mesh structures for video coding. II. The analysis problem and a region-based coder employing an active mesh representation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[10]  Philip J. Willis,et al.  Image Interpolation by Pixel‐Level Data‐Dependent Triangulation , 2004, Comput. Graph. Forum.

[11]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[12]  Bryan S. Morse,et al.  Isophote-based interpolation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[13]  Michael D. Adams A Flexible Content-Adaptive Mesh-Generation Strategy for Image Representation , 2011, IEEE Transactions on Image Processing.

[14]  Yongyi Yang,et al.  A fast approach for accurate content-adaptive mesh generation , 2003, IEEE Trans. Image Process..

[15]  Kup-Sze Choi,et al.  Fast Rendering of Diffusion Curves with Triangles , 2012, IEEE Computer Graphics and Applications.

[16]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, SIGGRAPH 2008.

[17]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[18]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[19]  Dave Hale Atomic Images - A Method For Meshing Digital Images , 2001, IMR.

[20]  Klaus Diepold,et al.  Content Adaptive Mesh Representation of Images Using Binary Space Partitions , 2009, IEEE Transactions on Image Processing.

[21]  William A. Barrett,et al.  Object-based vectorization for interactive image editing , 2006, The Visual Computer.

[22]  A. Murat Tekalp,et al.  Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes , 1997, IEEE Trans. Image Process..

[23]  Nira Dyn,et al.  Image compression by linear splines over adaptive triangulations , 2006, Signal Process..

[24]  Bruno Lévy,et al.  Ardeco: automatic region detection and conversion , 2006, EGSR '06.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Lakshman Prasad,et al.  Rapid Automated Polygonal Image Decomposition , 2006, 35th IEEE Applied Imagery and Pattern Recognition Workshop (AIPR'06).

[27]  Tom Lyche,et al.  Discrete B-splines and subdivision techniques in computer-aided geometric design and computer graphics , 1980 .

[28]  Stefan Jeschke,et al.  Rendering surface details with diffusion curves , 2009, SIGGRAPH 2009.

[29]  Max Froumentin,et al.  A Vector‐based Representation for Image Warping , 2000 .

[30]  Jean Schweitzer,et al.  Analysis and application of subdivision surfaces , 1996 .

[31]  Thomas W. Sederberg,et al.  Image Reconstruction Using Data-Dependent Triangulation , 2001, IEEE Computer Graphics and Applications.

[32]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[33]  S. Ozawa,et al.  Image description for coding using triangular patch structure , 1992, [Proceedings] Singapore ICCS/ISITA `92.

[34]  Bryan W. Scotney,et al.  Image feature detection on content-based meshes , 2002, Proceedings. International Conference on Image Processing.

[35]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[36]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[37]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[38]  Krzysztof Okarma Colour Image Quality Assessment Using Structural Similarity Index and Singular Value Decomposition , 2008, ICCVG.

[39]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..

[40]  Sheng-Jyh Wang,et al.  Representing images using points on image surfaces , 2005, IEEE Transactions on Image Processing.

[41]  Jian Sun,et al.  Image vectorization using optimized gradient meshes , 2007, SIGGRAPH 2007.

[42]  Yao Wang,et al.  Active mesh-a feature seeking and tracking image sequence representation scheme , 1994, IEEE Trans. Image Process..

[43]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Stefan Jeschke,et al.  Estimating Color and Texture Parameters for Vector Graphics , 2011, Comput. Graph. Forum.