Visual explanations

Human perceptual processes organize visual input to make the structure of the world explicit. Successful techniques for automatic depiction, meanwhile, create images whose structure clearly matches the visual information to be conveyed. We discuss how analyzing these structures and realizing them in formal representations can allow computer graphics to engage with perceptual science, to mutual benefit. We call these representations visual explanations: their job is to account for patterns in two dimensions as evidence of a visual world.

[1]  P. A. Van Der Helm,et al.  The resurrection of simplicity in vision , 2007 .

[2]  J. Searle.  Intentionality: Name index , 1983 .

[3]  Manish Singh,et al.  Toward a perceptual theory of transparency. , 2002, Psychological review.

[4]  Barbara J. Meier.  Painterly rendering for animation , 1996, SIGGRAPH.

[5]  Xiaofeng Mi,et al.  Abstraction of 2D shapes in terms of parts , 2009, NPAR '09.

[6]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[7]  David Salesin,et al.  Interactive cutaway illustrations of complex 3D models , 2007, SIGGRAPH 2007.

[8]  J. Willats.  Art and representation : new principles in the analysis of pictures , 1999 .

[9]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[10]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[11]  J. Hochberg,et al.  A quantitative approach to figural "goodness". , 1953, Journal of experimental psychology.

[12]  Jonathan Winawer,et al.  Layered image representations and the computation of surface lightness. , 2008, Journal of vision.

[13]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[14]  Frédo Durand,et al.  An invitation to discuss computer depiction , 2002, NPAR '02.

[15]  Tristan Needham,et al.  Visual Complex Analysis , 1997 .

[16]  M. Wright,et al.  Image Fidelity , 2022 .

[17]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[18]  Chris Stolte,et al.  Rendering effective route maps: improving usability through generalization , 2001, SIGGRAPH.

[19]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[20]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, SIGGRAPH 2008.

[21]  S. Bhogle,et al.  LITTLEWOOD'S MISCELLANY , 1990 .

[22]  J. Feldman,et al.  Bayes and the Simplicity Principle in Perception Simplicity versus Likelihood Principles in Perception , 2022 .

[23]  H. Reeves,et al.  The Guild handbook of scientific illustration , 1991 .

[24]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[25]  Donald D. Hoffman,et al.  Part-Based Representations of Visual Shape and Implications for Visual Cognition , 2001 .

[26]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[27]  T. Funkhouser,et al.  A planar-reflective symmetry transform for 3D shapes , 2006, SIGGRAPH '06.

[28]  D. Thompson,et al.  A History of Greek Mathematics , 1922, Nature.

[29]  Leonidas J. Guibas,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Trans. Graph..

[30]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, SIGGRAPH 2007.

[31]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[32]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  William T. Freeman,et al.  The generic viewpoint assumption in a framework for visual perception , 1994, Nature.

[34]  Jason L. Mitchell,et al.  Illustrative rendering in Team Fortress 2 , 2007, NPAR '07.

[35]  Bill Andrews.  Introduction to “Perceptual Principles in Medical Illustration” Some Course 6 presentations are available on the introduction citation page , 2006, SIGGRAPH Courses.

[36]  M. Leyton.  Symmetry, Causality, Mind , 1999 .

[37]  Kurt von Fritz.  The discovery of incommensurability by Hippasus of Metapontum , 2004 .

[38]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[39]  David Salesin,et al.  Interactive cutaway illustrations of complex 3D models , 2007, ACM Trans. Graph..

[40]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[41]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[42]  E. Adelson.  Lightness Perception and Lightness Illusions , 1999 .