Shape from shadows.

The colors, textures, and shapes of shadows are physically constrained in several ways in natural scenes. The visual system appears to ignore these constraints, however, and to accept many patterns as shadows even though they could not occur naturally. In the stimuli that we have studied, the only requirements for the perception of depth due to shadows were that shadow regions be darker than the surrounding, nonshadow regions and that there be consistent contrast polarity along the shadow border. Three-dimensional shape due to shadows was perceived when shadow areas were filled with colors or textures that could not occur in natural scenes, when shadow and nonshadow regions had textures that moved in different directions, or when they were presented on different depth planes. The results suggest that the interpretation of shadows begins with the identification of acceptable shadow borders by a cooperative process that requires consistent contrast polarity across a range of scales at each point along the border. Finally, we discuss how the identification of a shadow region can help the visual system to patch together areas that are separated by shadow boundaries, to identify directions of surface curvature, and to select a preferred three-dimensional interpretation while rejecting others. Language: en

[1]  A. Treisman Focused attention in the perception and retrieval of multidimensional stimuli , 1977 .

[2]  S M Luria,et al.  Comparison of Eye Movements over Faces in Photographic Positives and Negatives , 1978, Perception.

[3]  J. Hochberg,et al.  Recognition memory for photographs of faces. , 1971, The American journal of psychology.

[4]  Albert Yonas Attached and cast shadows , 1979 .

[5]  E. Mingolla,et al.  Perception of surface curvature and direction of illumination from patterns of shading. , 1983, Journal of experimental psychology. Human perception and performance.

[6]  C. WILLIAM TYLER,et al.  Depth perception in disparity gratings , 1974, Nature.

[7]  L. Maffei,et al.  Spatial frequency rows in the striate visual cortex , 1977, Vision Research.

[8]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[9]  K. Nakayama,et al.  Psychophysical isolation of movement sensitivity by removal of familiar position cues , 1981, Vision Research.

[10]  A. Pentland Finding the illuminant direction , 1982 .

[11]  P. Cavanagh,et al.  Equiluminance: spatial and temporal factors and the contribution of blue-sensitive cones. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[12]  K Berbaum,et al.  Extending the Perception of Shape from Known to Unknown Shading , 1984, Perception.

[13]  K. Laughery,et al.  Recognition of human faces: effects of target exposure time, target position, pose position, and type of photograph. , 1971, The Journal of applied psychology.

[14]  S. Ullman The Interpretation of Visual Motion , 1979 .

[15]  D. F. Fisher,et al.  Perception and pictorial representation , 1979 .

[16]  M C Morrone,et al.  Recognition of Positive and Negative Bandpass-Filtered Images , 1986, Perception.

[17]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[18]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[19]  Richard Langton Gregory Stereo vision and isoluminance , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  Kent A. Stevens,et al.  The Visual Interpretation of Surface Contours , 1981, Artif. Intell..

[21]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  S. Shafer Shadows and Silhouettes in Computer Vision , 1985 .

[23]  J. Beck Surface color perception , 1972 .

[24]  Leslie G. Ungerleider Cortical Sensory Organization, Vol. 2: Multiple Visual Areas edited by Clinton N. Woolsey, The Humana Press, Inc., 1981. $34.50 (USA and Canada) $44.50 (elsewhere) (xv + 222 pages) ISBN 0 896 03031 8 , 1983, Trends in Neurosciences.

[25]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[26]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[27]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[28]  J. Yellott,et al.  Depth Inversion despite Stereopsis: The Appearance of Random-Dot Stereograms on Surfaces Seen in Reverse Perspective , 1979, Perception.

[29]  M A Georgeson,et al.  Random-Dot Stereograms of Real Objects: Observations on Stereo Faces and Moulds , 1979, Perception.

[30]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[31]  S. Zeki The representation of colours in the cerebral cortex , 1980, Nature.

[32]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[33]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  C. M. Mooney Age in the development of closure ability in children. , 1957, Canadian journal of psychology.

[35]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[36]  E Switkes,et al.  Simultaneous masking interactions between chromatic and luminance gratings. , 1983, Journal of the Optical Society of America.

[37]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[38]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[39]  R. J. Woodham Photometric Method for Determining Shape from Shading , 1984 .

[40]  Thomas O. Binford,et al.  Survey of Model-Based Image Analysis Systems , 1982 .

[41]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[42]  M. Hasselmo,et al.  The responses of neurons in the cortex in the superior temporal sulcus of the monkey to band-pass spatial frequency filtered faces , 1987, Vision Research.

[43]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[44]  S. Petersen,et al.  Visual Topography and Function: Cortical Visual Areas in the Owl Monkey , 1981 .

[45]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[46]  K Berbaum,et al.  Depth Perception of Surfaces in Pictures: Looking for Conventions of Depiction in Pandora's Box , 1983, Perception.

[47]  S. Zeki Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[48]  R. Leeper A Study of a Neglected Portion of the Field of Learning—the Development of Sensory Organization , 1935 .

[49]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[50]  J. Moran,et al.  Sensation and perception , 1980 .

[51]  R. Phillips Why are faces hard to recognize in photographic negative? , 1972 .

[52]  A Yonas,et al.  Development of sensitivity to pictorial depth. , 1978, Science.

[53]  K. Mullen The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[54]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[55]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[56]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[57]  Leo Ganz,et al.  Recognition of faces in the presence of two-dimensional sinusoidal masks , 1977 .

[58]  L. Vinci The notebooks of Leonardo da Vinci. , 1952 .

[59]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[60]  S. Anstis,et al.  Phi movement as a subtraction process. , 1970, Vision research.

[61]  R. Galper,et al.  Recognition of faces in photographic negative , 1970 .

[62]  A. Gilchrist,et al.  The classification and integration of edges as critical to the perception of reflectance and illumination , 1983, Perception & psychophysics.