Estimating reflectance and shape of objects from a single cartoon-shaded image

Although many photorealistic relighting methods provide a way to change the illumination of objects in a digital photograph, it is currently difficult to relight digital illustrations having a cartoon shading style. The main difference between photorealistic and cartoon shading styles is that cartoon shading is characterized by soft color quantization and nonlinear color variations that cause noticeable reconstruction errors under a physical reflectance assumption, such as Lambertian reflection. To handle this non-photorealistic shading property, we focus on shading analysis of the most fundamental cartoon shading technique. Based on the color map shading representation, we propose a simple method to determine the input shading as that of a smooth shape with a nonlinear reflectance property. We have conducted simple ground-truth evaluations to compare our results to those obtained by other approaches.

[1]  Adrien Bousseau,et al.  BendFields , 2015, ACM Trans. Graph..

[2]  Jason L. Mitchell,et al.  Illustrative rendering in Team Fortress 2 , 2007, NPAR '07.

[3]  Yaser Sheikh,et al.  3D object manipulation in a single photograph using stock 3D models , 2014, ACM Trans. Graph..

[4]  Adrien Bousseau,et al.  CrossShade: shading concept sketches using cross-section curves , 2012, ACM Trans. Graph..

[5]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[6]  Erik Reinhard,et al.  Stylized depiction of images based on depth perception , 2010, NPAR.

[7]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[8]  Peter V. Gehler,et al.  Recovering Intrinsic Images with a Global Sparsity Prior on Reflectance , 2011, NIPS.

[9]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Pascal Barla,et al.  X-toon: an extended toon shader , 2006, NPAR.

[11]  Yasuyuki Matsushita,et al.  Single-View Relighting with Normal Map Painting , 2006 .

[12]  Olga Sorkine-Hornung,et al.  Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters , 2014, TOGS.

[13]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[14]  Scott F. Johnston Lumo: illumination for cel animation , 2002, NPAR '02.

[15]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[16]  Jürgen Döllner,et al.  Image Abstraction by Structure Adaptive Filtering , 2008, TPCG.

[17]  Erik Reinhard,et al.  Multiple Light Source Estimation in a Single Image , 2013, Comput. Graph. Forum.

[18]  Harry Shum,et al.  Interactive normal reconstruction from a single image , 2008, SIGGRAPH Asia '08.

[19]  Mark J. Harris,et al.  Stylized rendering techniques for scalable real-time 3D animation , 2000, NPAR '00.

[20]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[21]  Yotam I. Gingold,et al.  Inverse toon shading: interactive normal field modeling with isophotes , 2015, SBIM '15.

[22]  Harry Shum,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, ACM Trans. Graph..

[23]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, ACM Trans. Graph..