Decoding figure-ground occlusions from contours and shading

Visual experience of surface properties relies on accurately attributing encoded luminance variations (e.g., edges and contours) to any one of several potential environmental causes. We examined the role of differences in the local shading directions across sharp contours in (i) identifying occlusion boundaries and (ii) perceiving the depth layout of adjacent surfaces. We used graphical rendering to control the orientation of a simulated light source, and hence the shading direction between adjacent surface regions that met at a common edge. We call the difference in shading direction across the edge the delta shading angle. We found that delta-shaded edges looked like occluding boundaries. We also found that the perceived figure-ground organisation of the adjacent surface regions depended on an assumed lighting from above prior. Shaded regions experienced as convex surfaces illuminated from above were perceived as occluding surfaces in the foreground. We computed an image-based measure of delta shading using the difference in local shading direction (the orientation field) and found this model could reliably account for observer judgments of surface occlusion, better than local (in-)coherence in the orientation of isophotes across the edge alone. However, additional information from co-alignment of isophotes relative to the edge is necessary to explain figure-ground distinctions across a broad class of occlusion events. We conclude that both local and global measures of shading direction are needed to explain perceived scene organisation, and material appearance more generally.

[1]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[2]  S. Anstis,et al.  Perceived depth from shading boundaries. , 2016, Journal of vision.

[3]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  M. Luckiesh Visual Illusions: their Causes, Characteristics, and Applications , 1923, Nature.

[5]  Edward H. Adelson,et al.  Estimating surface reflectance properties from images under unknown illumination , 2001, IS&T/SPIE Electronic Imaging.

[6]  Phillip J. Marlow,et al.  The perception of gloss depends on highlight congruence with surface shading. , 2011, Journal of vision.

[7]  Ohad Ben-Shahar,et al.  On Computing Visual Flows with Boundaries: The Case of Shading and Edges , 2002, Biologically Motivated Computer Vision.

[8]  Barton L Anderson,et al.  Image statistics and the perception of surface gloss and lightness. , 2010, Journal of vision.

[9]  S. Palmer,et al.  Gradient cuts and extremal edges in relative depth and figure–ground perception , 2015, Attention, Perception, & Psychophysics.

[10]  E. Adelson,et al.  Image statistics for surface reflectance perception. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Barton L Anderson,et al.  Image statistics do not explain the perception of gloss and lightness. , 2009, Journal of vision.

[12]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Barton L. Anderson,et al.  Coupled computations of three-dimensional shape and material , 2015, Current Biology.

[14]  V S Ramachandran,et al.  Perceiving shape from shading. , 1988, Scientific American.

[15]  Ohad Ben-Shahar,et al.  On the perceptual organization of texture and shading flows: from a geometrical model to coherence computation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Barton L Anderson,et al.  Texture-shading flow interactions and perceived reflectance. , 2014, Journal of vision.

[17]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[18]  Tandra Ghose,et al.  Extremal edges versus other principles of figure-ground organization. , 2010, Journal of vision.

[19]  F. E. Nicodemus Directional Reflectance and Emissivity of an Opaque Surface , 1965 .

[20]  S. Palmer,et al.  Extremal Edges A Powerful Cue to Depth Perception and Figure-Ground Organization , 2007 .

[21]  Barton L Anderson,et al.  The role of brightness and orientation congruence in the perception of surface gloss. , 2011, Journal of vision.

[22]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[23]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[24]  Thomas Poeschl,et al.  Detecting surface irregularities using isophotes , 1984, Comput. Aided Geom. Des..

[25]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[26]  P. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance under Measured Natural Illumination , 2011 .