Lightness perception for matte and glossy complex shapes

Abstract Humans are able to estimate the reflective properties of the surface (albedo) of an object despite the large variability in the reflected light due to shading, illumination and specular reflection. Here we first used a physically based rendering simulation to study how different statistics (i.e. percentiles) based on the luminance distributions of matte and glossy objects predict the overall surface albedo. We found that the brightest parts of matte surfaces are good predictors of the surface albedo. As expected, the brightest parts led to poor performance in glossy surfaces. We then asked human observers to sort four (2 matte and 2 glossy) objects in a virtual scene in terms of their albedo. The brightest parts of matte surfaces highly correlated with human judgments, whereas in glossy surfaces, the highest correlation was achieved by percentiles within the darker half of the objects’ luminance distributions. Furthermore, glossy surfaces tend to appear darker than matte ones, and observers are less precise in judging their lightness. We then manipulated different bands of the virtual objects’ luminance distributions separately for glossy and matte surfaces. Modulating the brightest parts of the luminance distributions of the glossy surfaces had a limited impact on lightness perception, whereas it clearly influenced the perceived lightness of the matte objects. Our results demonstrate that human observers effectively ignore specular reflections while evaluating the lightness of glossy objects, which results in a bias to perceive glossy objects as darker.

[1]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[2]  Robin E. Hauck,et al.  Measurements of the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[3]  E. Adelson,et al.  Image statistics for surface reflectance perception. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Z. Pizlo Perception viewed as an inverse problem , 2001, Vision Research.

[5]  J. Beck THE EFFECT OF GLOSS ON PERCEIVED LIGHTNESS. , 1964, The American journal of psychology.

[6]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[7]  S. Zdravković,et al.  Lightness constancy: Object identity and temporal integration , 2008 .

[8]  Andrew Blake,et al.  Specular reflections and the estimation of shape from binocular disparity , 2013, Proceedings of the National Academy of Sciences.

[9]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[10]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[11]  Barton L Anderson,et al.  The role of brightness and orientation congruence in the perception of surface gloss. , 2011, Journal of vision.

[12]  Refractor Vision , 2000, The Lancet.

[13]  Matteo Toscani,et al.  Statistical correlates of perceived gloss in natural images , 2015, Vision Research.

[14]  David H Brainard,et al.  Joint effects of illumination geometry and object shape in the perception of surface reflectance , 2011, i-Perception.

[15]  G. Orban,et al.  Perception of Three-Dimensional Shape From Specular Highlights, Deformations of Shading, and Other Types of Visual Information , 2004, Psychological science.

[16]  Jonathan Winawer,et al.  Layered image representations and the computation of surface lightness. , 2008, Journal of vision.

[17]  K. Gegenfurtner,et al.  Optimal sampling of visual information for lightness judgments , 2013, Proceedings of the National Academy of Sciences.

[18]  David H Brainard,et al.  RenderToolbox3: MATLAB tools that facilitate physically based stimulus rendering for vision research. , 2014, Journal of vision.

[19]  T. Poggio,et al.  Ill-posed problems in early vision: from computational theory to analogue networks , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[20]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[21]  Huang Yumin,et al.  A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING , 1991 .

[22]  Nicola Schneider,et al.  Color and lightness constancy in different perceptual tasks , 1998, Biological Cybernetics.

[23]  David H Brainard,et al.  Surface color perception and equivalent illumination models. , 2011, Journal of vision.

[24]  R. Fleming Visual perception of materials and their properties , 2014, Vision Research.

[25]  David Attewell,et al.  The distribution of reflectances within the visual environment , 2007, Vision Research.

[26]  Thomas L. Heath,et al.  A History of Greek Mathematics , 1923, The Classical Review.

[27]  F. Metelli An algebraic development of the theory of perceptual transparency. , 1970, Ergonomics.

[28]  Sir Thomas Heath,et al.  A History Of Greek Mathematics Volume II , 1921 .

[29]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[30]  Maria Olkkonen,et al.  Perceived glossiness and lightness under real-world illumination. , 2010, Journal of vision.

[31]  F. Scharnowski,et al.  Long-lasting modulation of feature integration by transcranial magnetic stimulation. , 2009, Journal of vision.

[32]  L. Arend,et al.  Lightness, brightness, and brightness contrast: 1. Illuminance variation , 1993, Perception & psychophysics.

[33]  Jonathan Winawer,et al.  Image segmentation and lightness perception , 2005, Nature.

[34]  Steven W. Zucker,et al.  Predicting 3D shape perception from shading and texture flows , 2014 .

[35]  E. Adelson Lightness Perception and Lightness Illusions , 1999 .

[36]  Lavanya Sharan,et al.  Image statistics and the perception of surface reflectance , 2005 .

[37]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[38]  E. Adelson Perceptual organization and the judgment of brightness. , 1993, Science.

[39]  A. Gilchrist,et al.  When does perceived lightness depend on perceived spatial arrangement? , 1980, Perception & psychophysics.

[40]  Barton L Anderson,et al.  Image statistics do not explain the perception of gloss and lightness. , 2009, Journal of vision.

[41]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[42]  E. Mingolla,et al.  Lightness Constancy in the Presence of Specular Highlights , 2004, Psychological science.

[43]  Barton L. Anderson,et al.  Coupled computations of three-dimensional shape and material , 2015, Current Biology.

[44]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[45]  Johan Eriksson,et al.  Looking as if you know: Systematic object inspection precedes object recognition. , 2008, Journal of vision.

[46]  Barton L Anderson,et al.  Motion and texture shape cues modulate perceived material properties. , 2016, Journal of vision.

[47]  Huseyin Boyaci,et al.  Estimating the glossiness transfer function induced by illumination change and testing its transitivity. , 2010, Journal of vision.

[48]  Karl R Gegenfurtner,et al.  Color appearance of real objects varying in material, hue, and shape. , 2010, Journal of vision.

[49]  D. Todorović,et al.  Adjacency and surroundedness in the depth effect on lightness. , 2010, Journal of vision.

[50]  Roland W. Fleming,et al.  ‘Proto-rivalry’: how the binocular brain identifies gloss , 2016, Proceedings of the Royal Society B: Biological Sciences.

[51]  W. Geisler,et al.  Optimal disparity estimation in natural stereo images. , 2014, Journal of vision.

[52]  Steven A. Cholewiak,et al.  Towards a unified explanation of shape from shading and texture , 2013 .

[53]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[54]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[55]  David H Brainard,et al.  Color and material perception: achievements and challenges. , 2010, Journal of vision.

[56]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[57]  A. Gelb Die „Farbenkonstanz“ der Sehdinge , 1929 .

[58]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[59]  Matteo Valsecchi,et al.  Effect of fixation positions on perception of lightness , 2015, Electronic Imaging.

[60]  Sarah H. Creem-Regehr,et al.  Visual Perception from a Computer Graphics Perspective , 2011 .

[61]  Q. Zaidi,et al.  Limits of lightness identification for real objects under natural viewing conditions. , 2004, Journal of vision.

[62]  Barton L Anderson,et al.  The dark side of gloss , 2012, Nature Neuroscience.

[63]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[64]  F. Billmeyer,et al.  Visual gloss scaling and multidimensional scaling analysis of painted specimens , 1987 .

[65]  Paul Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[66]  Erich W. Graf,et al.  Touch influences perceived gloss , 2016, Scientific Reports.

[67]  Eli Peli,et al.  Spatial or Temporal 2AFC May Give Different Results Depending on Context , 2004 .

[68]  Paul R. Schrater,et al.  Rapid classification of specular and diffuse reflection from image velocities , 2011, Pattern Recognit..

[69]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[70]  B. Anderson The role of occlusion in the perception of depth, lightness, and opacity. , 2003, Psychological review.

[71]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[72]  Romain Vergne,et al.  Distinguishing between texture and shading flows for 3D shape estimation. , 2015, Journal of vision.

[73]  O. Schwartz,et al.  Specificity and timescales of cortical adaptation as inferences about natural movie statistics , 2016, Journal of vision.

[74]  Phillip J. Marlow,et al.  The perception of gloss depends on highlight congruence with surface shading. , 2011, Journal of vision.

[75]  B. Anderson A Theory of Illusory Lightness and Transparency in Monocular and Binocular Images: The Role of Contour Junctions , 1997, Perception.

[76]  K. J. Craik The effect of adaptation on differential brightness discrimination , 1938, The Journal of physiology.