Image statistics for surface reflectance perception.

Human observers can distinguish the albedo of real-world surfaces even when the surfaces are viewed in isolation, contrary to the Gelb effect. We sought to measure this ability and to understand the cues that might underlie it. We took photographs of complex surfaces such as stucco and asked observers to judge their diffuse reflectance by comparing them to a physical Munsell scale. Their judgments, while imperfect, were highly correlated with the true reflectance. The judgments were also highly correlated with certain image statistics, such as moment and percentile statistics of the luminance and subband histograms. When we digitally manipulated these statistics in an image, human judgments were correspondingly altered. Moreover, linear combinations of such statistics allow a machine vision system (operating within the constrained world of single surfaces) to estimate albedo with an accuracy similar to that of human observers. Taken together, these results indicate that some simple image statistics have a strong influence on the judgment of surface reflectance.

[1]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[2]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[3]  A. Gilchrist.  Perceived lightness depends on perceived spatial arrangement. , 1977, Science.

[4]  A. Gilchrist.  The perception of surface blacks and whites. , 1979, Scientific American.

[5]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[6]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[7]  A. Gilchrist,et al.  Perception of Lightness and Illumination in a World of One Reflectance , 1984, Perception.

[8]  T Michael,et al.  Maloney, and J. , 1992 .

[9]  E. Adelson.  Perceptual organization and the judgment of brightness. , 1993, Science.

[10]  M. D'Zmura,et al.  Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[12]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[13]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[14]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[15]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[16]  D. Brainard,et al.  Color constancy in the nearly natural image. 2. Achromatic loci. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Jitendra Malik,et al.  Recovering photometric properties of architectural scenes from photographs , 1998, SIGGRAPH.

[19]  A. Hurlbert,et al.  Perception of three-dimensional shape influences colour perception through mutual illumination , 1999, Nature.

[20]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999, Psychological review.

[21]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[22]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[23]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999 .

[24]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[25]  Shoji Tominaga,et al.  Estimating Reflection Parameters from a Single Color Image , 2000, IEEE Computer Graphics and Applications.

[26]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[27]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[28]  E. Adelson,et al.  Recognition of Surface Reflectance Properties from a Single Image under Unknown Real-World Illumination , 2001 .

[29]  Katsushi Ikeuchi,et al.  Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  K. Ikeuchi,et al.  Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[31]  André Gagalowicz,et al.  Image-based rendering of diffuse, specular and glossy surfaces from a single image , 2001, SIGGRAPH.

[32]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[33]  D. Brainard,et al.  PSYCHOLOGICAL SCIENCE Research Article LIGHTNESS CONSTANCY: A Direct Test of the Illumination-Estimation Hypothesis , 2022 .

[34]  Ron O. Dror,et al.  Surface reflectance recognition and real-world illumination statistics , 2002 .

[35]  Brainard,et al.  Colour constancy: developing empirical tests of computational models , 2003 .

[36]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[37]  L. Maloney,et al.  The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes. , 2003, Journal of vision.

[38]  Laurence T. Maloney,et al.  The illumination estimation hypothesis and surface color perception , 2003 .

[39]  Q. Zaidi,et al.  Limits of lightness identification for real objects under natural viewing conditions. , 2004, Journal of vision.

[40]  Shree K. Nayar,et al.  Bidirectional Reflection Distribution Function of Thoroughly Pitted Surfaces , 1999, International Journal of Computer Vision.

[41]  Paul E. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination , 2004, VMV.

[42]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[43]  M. Landy,et al.  A visual mechanism tuned to black , 2004, Vision Research.

[44]  E. Mingolla,et al.  Lightness Constancy in the Presence of Specular Highlights , 2004, Psychological science.

[45]  Shree K. Nayar,et al.  Generalization of the Lambertian model and implications for machine vision , 1995, International Journal of Computer Vision.

[46]  Qasim Zaidi,et al.  Lightness identification of patterned three-dimensional, real objects. , 2006, Journal of vision.

[47]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.