Material — Illumination Ambiguities and the Perception of Solid Objects

The appearance of objects depends on their material, shape, and on the illumination conditions. Conversely, object appearance provides us with cues about the illumination and the material. This so-called inverse problem is basically underdetermined and therefore we expect that material and illumination perception are confounded. To gain insight into the relevant mechanisms, we rendered a set of artificial spheres for vastly different canonical light fields and reflectance functions. We used four physics-based bidirectional reflectance distribution functions (BRDFs) representing glossy, pitted, velvety, and matte material. The six illumination conditions were collimated illumination from four directions, hemispherical diffuse illumination, and fully diffuse (Ganzfeld) illumination. In three sub-experiments we presented pairs of stimuli and asked human observers to judge whether the material was the same, whether the illumination was the same, and for a subset in which either the illumination or the material was the same to judge which of the two was constant. We found that observers made many errors in all sub-experiments. In experiment 2 the illumination direction was chosen at random. Using an interactive interface, we asked human observers to match the illumination direction of a sphere of one of the four materials with that of a Lambertian sphere. We found systematical material-dependent deviations from veridical performance. Theoretical analysis of the radiance patterns suggests that judgments were based mainly on the position of the shadow edge. In conclusion, we found no evidence for ‘material constancy’ for perception of smooth rendered spheres despite vast quantitative and qualitative differences in illumination and in BRDF between the stimuli. Although human observers demonstrated some ‘illumination constancy’, they made systematic errors depending on the material reflectance, suggesting that they used mainly the location of the shadow edge. Our results suggest that material perception and light-field perception are basically confounded.

[1]  Sylvia C. Pont,et al.  A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres , 2005, APGV '05.

[2]  E. Mingolla,et al.  Remote Effects of Highlights on Gloss Perception , 2005, Perception.

[3]  Ron O Dror,et al.  Statistical characterization of real-world illumination. , 2004, Journal of vision.

[4]  Anya Hurlbert,et al.  Color and size interactions in a real 3D object similarity task. , 2004, Journal of vision.

[5]  G. Obein,et al.  Difference scaling of gloss: nonlinearity, binocularity, and constancy. , 2004, Journal of vision.

[6]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[7]  Shree K. Nayar,et al.  Bidirectional Reflection Distribution Function of Thoroughly Pitted Surfaces , 1999, International Journal of Computer Vision.

[8]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[9]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[10]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, ACM Trans. Graph..

[11]  J. Koenderink,et al.  Bidirectional reflectance distribution function of specular surfaces with hemispherical pits. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Laurence T Maloney,et al.  Illuminant estimation as cue combination. , 2002, Journal of vision.

[13]  Ennio Mingolla,et al.  Perception of lightness of glossy surfaces , 2001, IS&T/SPIE Electronic Imaging.

[14]  Edward H. Adelson,et al.  On seeing stuff: the perception of materials by humans and machines , 2001, IS&T/SPIE Electronic Imaging.

[15]  M. Langer Human perception of local shape from shading under variable lighting , 2001 .

[16]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[18]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[20]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[21]  Laura Hoch Computer Analysis of Images and Patterns , 1993, Lecture Notes in Computer Science.

[22]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[24]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[25]  M. Minnaert The reciprocity principle in lunar photometry , 1941 .