Motion of glossy objects does not promote separation of lighting and surface colour

The surface properties of an object, such as texture, glossiness or colour, provide important cues to its identity. However, the actual visual stimulus received by the eye is determined by both the properties of the object and the illumination. We tested whether operational colour constancy for glossy objects (the ability to distinguish changes in spectral reflectance of the object, from changes in the spectrum of the illumination) was affected by rotational motion of either the object or the light source. The different chromatic and geometric properties of the specular and diffuse reflections provide the basis for this discrimination, and we systematically varied specularity to control the available information. Observers viewed animations of isolated objects undergoing either lighting or surface-based spectral transformations accompanied by motion. By varying the axis of rotation, and surface patterning or geometry, we manipulated: (i) motion-related information about the scene, (ii) relative motion between the surface patterning and the specular reflection of the lighting, and (iii) image disruption caused by this motion. Despite large individual differences in performance with static stimuli, motion manipulations neither improved nor degraded performance. As motion significantly disrupts frame-by-frame low-level image statistics, we infer that operational constancy depends on a high-level scene interpretation, which is maintained in all conditions.

[1]  Robin E. Hauck,et al.  Measurements of the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[2]  Barton L Anderson,et al.  The role of brightness and orientation congruence in the perception of surface gloss. , 2011, Journal of vision.

[3]  Marcia Grabowecky,et al.  Simultaneous shape repulsion and global assimilation in the perception of aspect ratio. , 2011, Journal of vision.

[4]  Bruce G. Cumming,et al.  RECOGNITION AND PERCEPTUAL USE OF SPECULAR REFLECTIONS , 1991 .

[5]  Barton L. Anderson,et al.  Coupled computations of three-dimensional shape and material , 2015, Current Biology.

[6]  John D Mollon,et al.  Conditions under Which Stereopsis and Motion Perception are Blind , 2002, Perception.

[7]  Jordan W. Suchow,et al.  Motion Silences Awareness of Visual Change , 2011, Current Biology.

[8]  Kinjiro Amano,et al.  Time-lapse ratios of cone excitations in natural scenes , 2016, Vision Research.

[9]  N. Marshall,et al.  Communication and camouflage with the same 'bright' colours in reef fishes. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  Barton L Anderson,et al.  Motion and texture shape cues modulate perceived material properties. , 2016, Journal of vision.

[11]  Huseyin Boyaci,et al.  Surface color perception and light field estimation in 3D scenes , 2011 .

[12]  Steven K Shevell,et al.  Stereo disparity improves color constancy , 2002, Vision Research.

[13]  Barton L Anderson,et al.  Texture-shading flow interactions and perceived reflectance. , 2014, Journal of vision.

[14]  Peter Zolliker,et al.  Interaction improves perception of gloss. , 2013, Journal of vision.

[15]  Marlene Behrmann,et al.  Competition and cooperation in spatial attention: The joint effect of regularity in target location and exogenous cueing , 2010 .

[16]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[18]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[19]  Vebjørn Ekroll,et al.  Disparity, motion, and color information improve gloss constancy performance. , 2010, Journal of vision.

[20]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[21]  A. Hurlbert,et al.  Interactions between colour and motion in image segmentation , 1997, Current Biology.

[22]  Sérgio M C Nascimento,et al.  Effect of Scene Dimensionality on Colour Constancy with Real Three-Dimensional Scenes and Objects , 2010, Perception.

[23]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[24]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[25]  David H Brainard,et al.  The color constancy of three-dimensional objects. , 2012, Journal of vision.

[26]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[27]  Bruce G. Cumming,et al.  CONSTRAINTS OF SPECULARITY MOTION ON GLOSSINESS AND ON SHAPE PERCEPTION , 1991 .

[28]  Frederick Bonato,et al.  Visual/vestibular conflict, illusory self-motion, and motion sickness , 2004 .

[29]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[30]  C. M. D. de Weert,et al.  Transparent layer constancy. , 1990, Journal of experimental psychology. Human perception and performance.

[31]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[32]  Ohad Ben-Shahar,et al.  Effects of surface reflectance on local second order shape estimation in dynamic scenes , 2015, Vision Research.

[33]  Pascal Barla,et al.  Specular motion and 3D shape estimation. , 2017, Journal of vision.

[34]  Alexa I Ruppertsberg,et al.  Color constancy improves for real 3D objects. , 2009, Journal of vision.

[35]  R. W. Kentridge,et al.  The perception of gloss: A review , 2015, Vision Research.

[36]  Annette Werner,et al.  The Influence of Depth Segmentation on Colour Constancy , 2006, Perception.

[37]  A. Hurlbert,et al.  Perception of three-dimensional shape influences colour perception through mutual illumination , 1999, Nature.

[38]  Emily A. Cooper,et al.  Sensitivity and bias in the discrimination of two-dimensional and three-dimensional motion direction. , 2016, Journal of vision.

[39]  Ohad Ben-Shahar,et al.  Shape from Specular Flow , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[41]  J. Rabin,et al.  Blue-Black or White-Gold? Early Stage Processing and the Color of 'The Dress' , 2016, PloS one.

[42]  David H. Foster,et al.  An operational approach to colour constancy , 1992, Vision Research.

[43]  N. Troje,et al.  Ultraviolet as a component of flower reflections, and the colour perception of hymenoptera , 1994, Vision Research.

[44]  Hannah E Smithson,et al.  Low levels of specularity support operational color constancy, particularly when surface and illumination geometry can be inferred. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  Barton L. Anderson,et al.  Material properties derived from three-dimensional shape representations , 2015, Vision Research.

[46]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[47]  Hannah E. Smithson Perceptual organization of color , 2015 .

[48]  Bevil R. Conway,et al.  Striking individual differences in color perception uncovered by ‘the dress’ photograph , 2015, Current Biology.

[49]  H E Smithson,et al.  Sensory, computational and cognitive components of human colour constancy , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  Michael A. Webster,et al.  Supplemental Information : Asymmetries in blue-yellow color perception and in the color of “ the dress ” , 2015 .

[51]  Annette Werner,et al.  Color constancy improves, when an object moves: high-level motion influences color perception. , 2007, Journal of vision.

[52]  B. Khang,et al.  Accuracy of color scission for spectral transparencies. , 2002, Journal of vision.

[53]  H. Boyaci,et al.  Testing limits on matte surface color perception in three-dimensional scenes with complex light fields , 2007, Vision Research.

[54]  L. Maloney,et al.  Perceived surface color in binocularly viewed scenes with two light sources differing in chromaticity. , 2004, Journal of vision.

[55]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[56]  Phillip J. Marlow,et al.  The Perception and Misperception of Specular Surface Reflectance , 2012, Current Biology.

[57]  Tandra Ghose,et al.  Generalization between canonical and non-canonical views in object recognition. , 2013, Journal of vision.

[58]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[59]  Daniel Kersten,et al.  Distinguishing shiny from matte , 2010 .

[60]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.

[61]  A. H. Taylor,et al.  The Distribution of Energy in the Visible Spectrum of Daylight , 1941 .

[62]  R. Andersen,et al.  A Computational Framework for Determining Stereo Correspondence from a Set of Linear Spatial Filters Perception of Three-dimensional Structure from Motion Review , 2022 .

[63]  Yuichi Sakano,et al.  Effects of self-motion on gloss perception , 2008 .

[64]  Juan Luis Nieves,et al.  Parallel detection of violations of color constancy , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[65]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[66]  Franz Faul,et al.  Highlight disparity contributes to the authenticity and strength of perceived glossiness. , 2008, Journal of vision.

[67]  S. Ullman The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[68]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.