Authorial subjective evaluation of non-photorealistic images

I argue in favor of a systematic subjective evaluation of non-photorealistic images. Objective measurements are hard to design, and quantitative user studies are problematic for a multiplicity of reasons. Subjective evaluations are not quantitative but are faster to conduct and offer the chance to dig into subtleties that are obscured by numerical scores. By carefully laying out the important elements of the intended image style, and then evaluating their results according to their adherence to the style, researchers can produce convincing evaluations with a manageable level of effort.

[1]  Fritz Drury,et al.  Visualization Criticism , 2008, IEEE Computer Graphics and Applications.

[2]  T. Kushner.  The anatomy of art : problems in the description and evaluation of works of art , 1983 .

[3]  Stephen C. Pepper,et al.  Principles of art appreciation , 1949 .

[4]  Sangwon Lee,et al.  Interactive 3D fluid jet painting , 2006, SIGGRAPH Sketches.

[5]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields , 2006, ECCV.

[6]  Tobias Isenberg.  Evaluating and Validating Non-photorealistic and Illustrative Rendering , 2013, Image and Video-Based Artistic Stylisation.

[7]  Daniel Cohen-Or,et al.  Structure-aware halftoning , 2008, ACM Trans. Graph..

[8]  Jan Eric Kyprianidis,et al.  Image and video abstraction by multi-scale anisotropic Kuwahara filtering , 2011, NPAR '11.

[9]  Peter Hall,et al.  Don't Measure - Appreciate! NPR Seen Through the Prism of Art History , 2013, Image and Video-Based Artistic Stylisation.

[10]  Tobias Isenberg,et al.  A Systematic Review on the Practice of Evaluating Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[11]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[12]  Nicholas Tran,et al.  Generating photomosaics: an empirical study , 1999, SAC '99.

[13]  Bruce Gooch,et al.  Viewing progress in non-photorealistic rendering through Heinlein's lens , 2010, NPAR.

[14]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[15]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[16]  Tobias Isenberg,et al.  Non-photorealistic rendering in context: an observational study , 2006, NPAR.

[17]  Adam Finkelstein,et al.  Where do people draw lines , 2008, SIGGRAPH 2008.

[18]  Brian Wyvill,et al.  Determining an aesthetic inscribed curve , 2012, CAe '12.

[19]  Austin Lee Nichols,et al.  The Good-Subject Effect: Investigating Participant Demand Characteristics , 2008, The Journal of general psychology.

[20]  Aaron Hertzmann,et al.  Non-Photorealistic Rendering and the science of art , 2010, NPAR.

[21]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[22]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.