On the perception of shape from shading

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search (“pop-out”), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two “assumptions” or constraints—first,that there is a single light source illuminating the whole scene, and second, that the light is shining from “above” in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This “pop-out” effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of “overhead illumination” that leads to perceptual grouping depends primarily on retinal rather than on “phenomenal” or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an “early” visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as “cognitive”) correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.

[1]  David Brewster,et al.  XLII.—On the Conversion of Relief by Inverted Vision , 1844 .

[2]  David Brewster.  1. On the Conversion of Relief by Inverted Vision , 1845 .

[3]  D. Brewster,et al.  XLII.—On the Conversion of Relief by Inverted Vision , 1847, Transactions of the Royal Society of Edinburgh.

[4]  Gerald Handerson Thayer,et al.  Concealing-Coloration in the Animal Kingdom , 1909 .

[5]  J. Beck.  Effect of orientation and of shape similarity on perceptual grouping , 1966 .

[6]  R. Gregory.  The intelligent eye , 1970 .

[7]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[8]  J. Pettigrew,et al.  The neurophysiology of binocular vision. , 1972, Scientific American.

[9]  J. Pokorny.  Foundations of Cyclopean Perception , 1972 .

[10]  K. Nakayama,et al.  Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis , 1974, Perception.

[11]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[12]  S. Zeki.  Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[13]  A. Yonas,et al.  The role of frames of reference in the development of responsiveness to shading information. , 1979, Child development.

[14]  D. C. Essen,et al.  Visual areas of the mammalian cerebral cortex. , 1979 .

[15]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[16]  I P Howard,et al.  Occluding Edges in Apparent Reversal of Convexity and Concavity , 1983, Perception.

[17]  Donald D. Hoffman.  The Interpretation of Visual Illusions , 1983 .

[18]  K. Berbaum,et al.  Light Source Position in the Perception of Object Shape , 1983, Perception.

[19]  E. Mingolla,et al.  Perception of surface curvature and direction of illumination from patterns of shading. , 1983, Journal of experimental psychology. Human perception and performance.

[20]  V. Ramachandran,et al.  The Neurobiology of Perception , 1985, Perception.

[21]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[22]  Anne Treisman,et al.  Features and objects in visual processing , 1986 .

[23]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Terrence J. Sejnowski,et al.  Network model of shape-from-shading: neural function arises from both receptive and projective fields , 1988, Nature.

[25]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[26]  V S Ramachandran,et al.  Perceiving shape from shading. , 1988, Scientific American.

[27]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[28]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[29]  2-D or not 2-D-that is the question , 1989 .

[30]  In Reply: Binocular Depth Reversals Despite Familiarity Cues: An Artifact? , 1990 .

[31]  Vilayanur S. Ramachandran,et al.  Theories of Perception. , 1951 .

[32]  Ronald A. Rensink,et al.  Influence of scene-based properties on visual search. , 1990, Science.

[33]  J T Todd,et al.  Perceived depth inversion of smoothly curved surfaces due to image orientation. , 1990, Journal of experimental psychology. Human perception and performance.

[34]  Binocular Depth Reversals Despite Familiarity Cues: An Artifact? , 1990, Science.

[35]  Heinrich H. Bülthoff,et al.  Integration of Depth Modules , 1990 .

[36]  Binocular depth reversals despite familiarity cues: an artifact? , 1990, Science.