What Line Drawings Reveal About the Visual Brain

Scenes in the real world carry large amounts of information about color, texture, shading, illumination, and occlusion giving rise to our perception of a rich and detailed environment. In contrast, line drawings have only a sparse subset of scene contours. Nevertheless, they also trigger vivid three-dimensional impressions despite having no equivalent in the natural world. Here, we ask why line drawings work. We see that they exploit the underlying neural codes of vision and they also show that artists’ intuitions go well beyond the understanding of vision found in current neurosciences and computer vision.

[1]  R Vogels,et al.  Responses of monkey inferior temporal neurons to luminance-, motion-, and texture-defined gratings. , 1995, Journal of neurophysiology.

[2]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[3]  D. A. Huffman,et al.  Impossible Objects as Nonsense Sentences , 2012 .

[4]  T D Albright,et al.  Form-cue invariant motion processing in primate visual cortex. , 1992, Science.

[5]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[6]  Henry Gee,et al.  Art and illusion , 2011 .

[7]  J. Hochberg,et al.  Pictorial recognition as an unlearned ability: a study of one child's performance. , 1962, The American journal of psychology.

[8]  Donald D. Hoffman,et al.  Genericity in spatial vision , 1995 .

[9]  J. Deręgowski Real space and represented space: Cross-cultural perspectives , 1989, Behavioral and Brain Sciences.

[10]  R. Keynes,et al.  Light Scattering and Birefringence Changes during Nerve Activity , 1968, Nature.

[11]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[12]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[13]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[14]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[15]  James J. Gibson,et al.  The Information Available in Pictures , 1971 .

[16]  M. Seghier,et al.  Functional neuroimaging findings on the human perception of illusory contours , 2006, Neuroscience & Biobehavioral Reviews.

[17]  K. Kennedy,et al.  How the blind draw. , 1997, Scientific American.

[18]  E. Switkes,et al.  Deoxyglucose analysis of retinotopic organization in primate striate cortex. , 1982, Science.

[19]  Leslie G. Ungerleider,et al.  The Representation of Objects in the Human Occipital and Temporal Cortex , 2000, Journal of Cognitive Neuroscience.

[20]  J. Kennedy A psychology of picture perception , 1974 .

[21]  G. Blasdel,et al.  Voltage-sensitive dyes reveal a modular organization in monkey striate cortex , 1986, Nature.

[22]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[23]  A Watanabe,et al.  Changes in fluorescence, turbidity, and birefringence associated with nerve excitation. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Nelson Goodman,et al.  Languages of Art, an Approach to a Theory of Symbols , 1970 .

[25]  E. Gombrich ART AND ILLUSION: A STUDY IN THE PSYCHOLOGY OF PICTORIAL REPRESENTATION. , 1960 .

[26]  N. Goodman,et al.  Languages of art : an approach to a theory of symbols , 1979 .

[27]  A Yonas,et al.  Infants Perceive Spatial Structure Specified by Line Junctions , 1994, Perception.

[28]  Li Fei-Fei,et al.  Simple line drawings suffice for functional MRI decoding of natural scene categories , 2011, Proceedings of the National Academy of Sciences.

[29]  Masayuki Tanaka,et al.  Recognition of pictorial representations by chimpanzees (Pan troglodytes) , 2007, Animal Cognition.

[30]  Refractor Vision , 2000, The Lancet.

[31]  Irving Biederman,et al.  17000 Years of Depicting the Junction of Two Smooth Shapes , 2008, Perception.

[32]  安藤 広志,et al.  20世紀の名著名論:David Marr:Vision:a Computational Investigation into the Human Representation and Processing of Visual Information , 2005 .

[33]  K R Gegenfurtner,et al.  Processing of color, form, and motion in macaque area V2 , 1996, Visual Neuroscience.

[34]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[35]  S. Sutherland Seeing things , 1989, Nature.

[36]  John M. Kennedy,et al.  Outline Picture Perception by the Songe of Papua , 1975 .

[37]  J. Gibson The Ecological Approach to Visual Perception , 1979 .