Gloss perception in painterly and cartoon rendering

Depictions with traditional media such as painting and drawing represent scene content in a stylized manner. It is unclear, however, how well stylized images depict scene properties like shape, material, and lighting. In this article, we describe the first study of material perception in stylized images (specifically painting and cartoon) and use nonphotorealistic rendering algorithms to evaluate how such stylization alters the perception of gloss. Our study reveals a compression of the range of representable gloss in stylized images so that shiny materials appear more diffuse in painterly rendering, while diffuse materials appear shinier in cartoon images. From our measurements we estimate the function that maps realistic gloss parameters to their perception in a stylized rendering. This mapping allows users of NPR algorithms to predict the perception of gloss in their images. The inverse of this function exaggerates gloss properties to make the contrast between materials in a stylized image more faithful. We have conducted our experiment both in a lab and on a crowdsourcing Web site. While crowdsourcing allows us to quickly design our pilot study, a lab experiment provides more control on how subjects perform the task. We provide a detailed comparison of the results obtained with the two approaches and discuss their advantages and drawbacks for studies like ours.

[1]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[2]  Philip Dutré,et al.  Shape-dependent gloss correction , 2008, APGV '08.

[3]  K. Bala,et al.  Effects of global illumination approximations on material appearance , 2010, SIGGRAPH 2010.

[4]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[5]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, SIGGRAPH 2007.

[6]  David Salesin,et al.  Rendering parametric surfaces in pen and ink , 1996, SIGGRAPH.

[7]  Joëlle Thollot,et al.  Automatic Pen-and-Ink Illustration of Tone, Gloss, And Texture , 2010 .

[8]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[9]  David J. Kriegman,et al.  Toward a perceptual space for gloss , 2009, TOGS.

[10]  J WardGregory,et al.  Measuring and modeling anisotropic reflection , 1992 .

[11]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[12]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[13]  Edward H. Adelson,et al.  How do Humans Determine Reflectance Properties under Unknown Illumination , 2001, CVPR 2001.

[14]  Adam Finkelstein,et al.  How well do line drawings depict shape , 2009, SIGGRAPH 2009.

[15]  John C. Baird,et al.  Fundamentals of scaling and psychophysics , 1978 .

[16]  Xuejin Chen,et al.  Printed Patterns for Enhanced Shape Perception of Papercraft Models , 2010, Comput. Graph. Forum.

[17]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[18]  Irfan A. Essa,et al.  Image and video based painterly animation , 2004, NPAR '04.

[19]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, SIGGRAPH 2007.

[20]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, ACM Trans. Graph..

[22]  K. Bala,et al.  Effects of global illumination approximations on material appearance , 2010, ACM Trans. Graph..

[23]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[24]  Barbara J. Meier.  Painterly rendering for animation , 1996, SIGGRAPH.

[25]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[26]  E. Adelson,et al.  Recognition of Surface Reflectance Properties from a Single Image under Unknown Real-World Illumination , 2001 .

[27]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[28]  Jan Kautz,et al.  Is accurate occlusion of glossy reflections necessary? , 2007, APGV.

[29]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[30]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[31]  DeCarloDoug,et al.  Stylization and abstraction of photographs , 2002 .

[32]  Adam Finkelstein,et al.  How well do line drawings depict shape? , 2009, SIGGRAPH '09.

[33]  Elaine Cohen,et al.  A non-photorealistic lighting model for automatic technical illustration , 1998, SIGGRAPH.

[34]  Donald P. Greenberg,et al.  Psychophysically based model of surface gloss perception , 2001, IS&T/SPIE Electronic Imaging.

[35]  Holger Winnemöller,et al.  Using NPR to evaluate perceptual shape cues in dynamic environments , 2007, NPAR '07.

[36]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[37]  Hereward Lester Cooke.  Painting lessons from the great masters , 1968 .

[38]  Ennio Mingolla,et al.  Highlights and surface gloss perception , 2010 .

[39]  Heinrich H. Bülthoff,et al.  Evaluation of real-world and computer-generated stylized facial expressions , 2007, TAP.

[40]  Song-Chun Zhu,et al.  From image parsing to painterly rendering , 2009, TOGS.

[41]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, ACM Trans. Graph..

[42]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[43]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[44]  Aaron Hertzmann,et al.  Fast paint texture , 2002, NPAR '02.

[45]  R. Biertümpfel,et al.  1. Wall temperatures in natural convection flow with laminar longitudinal vortices , 1999 .

[46]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.