Region-based bas-relief generation from a single image

Abstract Bas-relief is an art form part way between sculpture and drawing. In this paper, we present an algorithm for generating a bas-relief from a single image, inspired by the process that artists use to create reliefs. We do not aim to recover exact depth values for objects in the image, which is a tricky computer vision problem, requiring assumptions that are rarely satisfied. Instead, we determine layers based on relative depth ordering of objects (and their parts) in the image, and use this information to construct surfaces in the 3D relief model. Feature lines are extracted and used to build a new region-based representation of the input image. During surface construction, a base surface is first generated; it is then augmented using both intensity and gradient information from the original image. To prevent depth errors arising due to augmentation, a feedback process is used to refine the output. Our experimental results show the generated bas-reliefs have smooth boundaries with appropriate height relationships, a key property of bas-reliefs created by artists. We demonstrate that our algorithm works well for a range of input images, including human faces, flowers and animals.

[1]  Ralph R. Martin,et al.  Making bas-reliefs from photographs of human faces , 2013, Comput. Aided Des..

[2]  H. Pottmann,et al.  Fitting B-Spline Curves to Point Clouds by Squared Distance Minimization , 2006 .

[4]  Hans-Peter Seidel,et al.  Computer Assisted Relief Generation—A Survey , 2012, Comput. Graph. Forum.

[5]  Marc Alexa,et al.  Reliefs as images , 2010, SIGGRAPH 2010.

[6]  Hans-Peter Seidel,et al.  Automatic Generation of Bas-reliefs from 3D Shapes , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[7]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[8]  Paolo Cignoni,et al.  Computer-Assisted Generation of Bas-and High-Reliefs , 1997, J. Graphics, GPU, & Game Tools.

[9]  Helmut Pottmann,et al.  Fitting B-spline curves to point clouds by curvature-based squared distance minimization , 2006, TOGS.

[10]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[11]  Ilan Shimshoni,et al.  Reconstruction of relief objects from line drawings , 2011, CVPR 2011.

[12]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[14]  Junjun Pan,et al.  Image-based bas-relief generation with gradient operation , 2010 .

[15]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[16]  J. Todd Book Review: Digital image processing (second edition). By R. C. Gonzalez and P. Wintz, Addison-Wesley, 1987. 503 pp. Price: £29.95. (ISBN 0-201-11026-1) , 1988 .

[17]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[18]  Ralph R. Martin,et al.  Bas-relief Generation Using Adaptive Histogram Equalisation , 2022 .

[19]  Ralph R. Martin,et al.  Estimating depth from line drawing , 2002, SMA '02.

[20]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[21]  Paul L. Rosin,et al.  Background Surface Estimation for Reverse Engineering of Reliefs , 2007 .

[22]  Hong Qin,et al.  Surface reconstruction of noisy and defective data sets , 2004, IEEE Visualization 2004.

[23]  Hartmut Noltemeier Computational Geometry and its Applications , 1988 .

[24]  Ralph R. Martin,et al.  Density-Controlled Sampling of Parametric Surfaces Using Adaptive Space-Filling Curves , 2006, GMP.

[25]  R. Martin,et al.  Estimating Depth from Line Drawings , 2002 .

[26]  Hans-Peter Seidel,et al.  Feature sensitive bas relief generation , 2009, 2009 IEEE International Conference on Shape Modeling and Applications.

[27]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[28]  Song Wang,et al.  Restoration of Brick and Stone Relief from Single Rubbing Images , 2012, IEEE Transactions on Visualization and Computer Graphics.

[29]  Hans-Peter Seidel,et al.  Feature preserving depth compression of range images , 2007, SCCG.

[30]  Jy Wang,et al.  Computational Geometry and its Applications , 1988, Lecture Notes in Computer Science.