Light fields and shape from shading.

From a theoretical point of view, the use of the shading cue involves estimates of the light field and thus observers need to judge the light field and the shape simultaneously. The conventional stimulus in perceptual experiments, a circular disk filled with a monotonic gradient on a uniform surround, represents a local shading or tonal gradient. In typical scenes, such gradients vary smoothly from point to point over large areas, whereas light fields are globally defined and tend to be invariant over large parts of the scene. Hence, it is hardly surprising that multi-local shape estimates tend to synchronize although previous reports of such synchronies involved uniform, homogeneous light fields. Here, we consider more complicated and more realistic light fields. We present extensive, highly structured, quantitative observations using novel paradigms. Human observers are able to deal with some structured light fields but totally fail in others, even though these may be formally similar (like radial and circular fields). Observers respond very differently in some cases where the light fields differ only by sign, like converging and diverging fields. These results can be qualitatively understood on the basis of a few simple assumptions, mainly global top-down template matching of peripheral local data.

[1]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[2]  K. Lorenz Die Rückseite des Spiegels : Versuch einer Naturgeschichte menschlichen Erkennens , 1973 .

[3]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[4]  Jan J. Koenderink,et al.  Spatial properties of light fields in natural scenes , 2007, APGV.

[5]  Ted Seth Jacobs,et al.  Light for the Artist , 1988 .

[6]  W. Metzger Gesetze des Sehens , 1937 .

[7]  Rupert Riedl,et al.  Biology of Knowledge: The Evolutionary Basis of Reason , 1984 .

[8]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[9]  J Farley Norman,et al.  The perception and discrimination of local 3-D surface structure from deforming and disparate boundary contours , 2002, Perception & psychophysics.

[10]  Matthew,et al.  Light and Shade: And Their Applications , 2007 .

[11]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[12]  J. Koenderink,et al.  Phenomenological description of bidirectional surface reflection , 1998 .

[13]  J. Koenderink,et al.  Illumination direction from texture shading. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  Marlene Behrmann,et al.  Perceiving Parts and Shapes from Concave Surfaces , 2022 .

[15]  M.-C. Dubois,et al.  Light from above , 2003 .

[16]  Melvyn A. Goodale,et al.  A neurological dissociation between shape from shading and shape from edges , 1996, Behavioural Brain Research.

[17]  J. Lambert Photometria sive de mensvra et gradibvs lvminis, colorvm et vmbrae , 1970 .

[18]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[19]  Alexander A. Mury,et al.  Structure of light fields in natural scenes. , 2009, Applied optics.

[20]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[21]  J. Koenderink,et al.  The Structure of Relief , 1998 .

[22]  V. Ramachandran,et al.  On the perception of shape from shading , 1988, Nature.

[23]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[24]  V S Ramachandran,et al.  Perceiving shape from shading. , 1988, Scientific American.

[25]  P. Perona,et al.  Where is the sun? , 1998, Nature Neuroscience.

[26]  J. Koenderink,et al.  Geometrical modes as a general method to treat diffuse interreflections in radiometry , 1983 .

[27]  David Brewster,et al.  Letters on natural magic , 2010 .

[28]  Jan J. Koenderink,et al.  Illuminance Flow , 2003, CAIP.

[29]  J. Koenderink,et al.  Perception of local shape from shading , 1993, Perception & psychophysics.

[30]  Andrea J. van Doorn,et al.  Local structure of gaussian texture , 2003 .

[31]  David A. Forsyth,et al.  Reflections on Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  D. Spencer,et al.  The photic field , 1981 .

[33]  Wendy J. Adams Frames of reference for the light-from-above prior in visual search and shape judgements , 2010 .

[34]  Robert W. Boyd,et al.  Radiometry and the Detection of Optical Radiation , 1983 .

[35]  E. Ising Beitrag zur Theorie des Ferromagnetismus , 1925 .

[36]  Mitsuo Kawato,et al.  A computational model for shape estimation by integration of shading and edge information , 1994, Neural Networks.

[37]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[38]  Rudolf Arnheim,et al.  Gesetze des Sehens , 1977 .

[39]  Wendy J Adams,et al.  A common light-prior for visual search, shape, and reflectance judgments. , 2007, Journal of vision.

[40]  Alexander A. Mury,et al.  Representing the light field in finite three-dimensional spaces from sparse discrete samples. , 2009, Applied optics.

[41]  Sylvia C Pont,et al.  The Visual Light Field , 2007, Perception.

[42]  J. Koenderink,et al.  Irradiation direction from texture. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[44]  Mümtaz Turhan Erzurum Über räumliche Wirkungen von Helligkeitsgefällen , 1937 .

[45]  M. Levoy,et al.  The light field , 1939 .

[46]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[47]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[48]  William Rowan,et al.  The Study of Instinct , 1953 .

[49]  Donald D. Hoffman,et al.  Object Categorization: The Interface Theory of Perception: Natural Selection Drives True Perception to Swift Extinction , 2009 .

[50]  Lotte Lauenstein,et al.  Über räumliche Wirkungen von Licht und Schatten , 1938 .

[51]  J. V. Diggelen Photometric properties of lunar crater floors , 1964 .

[52]  Jan J. Koenderink,et al.  Surface illuminance flow , 2004 .

[53]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[54]  V Bruce,et al.  A Comparison between the Hollow-Face and ‘Hollow-Potato’ Illusions , 1994, Perception.

[55]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[56]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Kenneth A. Hoffman Ancient magnetic reversals: clues to the geodynamo. , 1988 .

[58]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[59]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.

[60]  M. Baxandall Shadows and Enlightenment , 1995 .