Touch influences perceived gloss

Identifying an object’s material properties supports recognition and action planning: we grasp objects according to how heavy, hard or slippery we expect them to be. Visual cues to material qualities such as gloss have recently received attention, but how they interact with haptic (touch) information has been largely overlooked. Here, we show that touch modulates gloss perception: objects that feel slippery are perceived as glossier (more shiny).Participants explored virtual objects that varied in look and feel. A discrimination paradigm (Experiment 1) revealed that observers integrate visual gloss with haptic information. Observers could easily detect an increase in glossiness when it was paired with a decrease in friction. In contrast, increased glossiness coupled with decreased slipperiness produced a small perceptual change: the visual and haptic changes counteracted each other. Subjective ratings (Experiment 2) reflected a similar interaction – slippery objects were rated as glossier and vice versa. The sensory system treats visual gloss and haptic friction as correlated cues to surface material. Although friction is not a perfect predictor of gloss, the visual system appears to know and use a probabilistic relationship between these variables to bias perception – a sensible strategy given the ambiguity of visual clues to gloss.

[1]  Christiane B Wiebel,et al.  The speed and accuracy of material recognition in natural images , 2013, Attention, perception & psychophysics.

[2]  Wendy J Adams,et al.  Highlights, disparity, and perceived gloss with convex and concave surfaces. , 2013, Journal of vision.

[3]  M. Hutley,et al.  The Optical Properties of 'Moth Eye' Antireflection Surfaces , 1982 .

[4]  W. B. Tiest.  Tactual perception of material properties , 2010, Vision Research.

[5]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[6]  A. Charpentier.  Experimental study of some aspects of weight perception , 1891 .

[7]  B. Jones,et al.  Combining vision and touch in texture perception , 1985, Perception & psychophysics.

[8]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.

[9]  A. Kappers,et al.  Haptic and visual perception of roughness. , 2007, Acta psychologica.

[10]  Stephen P. Harshfield,et al.  Weight judgment as a function of apparent density of objects , 1970 .

[11]  L. D’Alba,et al.  What makes a feather shine? A nanostructural basis for glossy black colours in feathers , 2011, Proceedings of the Royal Society B: Biological Sciences.

[12]  E. Mingolla,et al.  Lightness Constancy in the Presence of Specular Highlights , 2004, Psychological science.

[13]  James H. Elder,et al.  Effects of Specular Highlights on Perceived Surface Convexity , 2014, PLoS Comput. Biol..

[14]  Jacqueline Krim,et al.  Surface science and the atomic-scale origins of friction: what once was old is new again , 2002 .

[15]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[16]  M. D. Luca,et al.  Perceived compliance in a pinch , 2011, Vision Research.

[17]  Erich W Graf,et al.  Efficient Visual Recalibration from Either Visual or Haptic Feedback: The Importance of Being Wrong , 2010, The Journal of Neuroscience.

[18]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[19]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[20]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[21]  M. Di Luca,et al.  Effects of visual–haptic asynchronies and loading–unloading movements on compliance perception , 2011, Brain Research Bulletin.

[22]  Knut Drewing,et al.  Haptic, visual and visuo-haptic softness judgments for objects with deformable surfaces , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[23]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[24]  Martin Buss,et al.  Combination and Integration in the Perception of Visual-Haptic Compliance Information , 2010, IEEE Transactions on Haptics.

[25]  M. Ernst.  Learning to integrate arbitrary signals from vision and touch. , 2007, Journal of vision.

[26]  Marc O Ernst,et al.  Perceptual Learning: Inverting the Size–Weight Illusion , 2009, Current Biology.

[27]  M. Lesch,et al.  Visually based perceptions of slipperiness: Underlying cues, consistency and relationship to coefficient of friction , 2008, Ergonomics.

[28]  R. W. Kentridge,et al.  The perception of gloss: A review , 2015, Vision Research.

[29]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[30]  Barton L Anderson,et al.  Visual perception of materials and surfaces , 2011, Current Biology.

[31]  Wendy J. Adams,et al.  Learning different light prior distributions for different contexts , 2013, Cognition.

[32]  S. Lederman,et al.  Perception of texture by vision and touch: multidimensionality and intersensory integration. , 1986, Journal of experimental psychology. Human perception and performance.

[33]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[34]  S. Lederman,et al.  Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. , 1981, Journal of experimental psychology. Human perception and performance.

[35]  Angelika Peer,et al.  Haptic Perception of Material Properties and Implications for Applications , 2013, Proceedings of the IEEE.

[36]  Knut Drewing,et al.  Learning from vision-to-touch is different than learning from touch-to-vision , 2012, Front. Integr. Neurosci..

[37]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[38]  Edward H. Adelson,et al.  On seeing stuff: the perception of materials by humans and machines , 2001, IS&T/SPIE Electronic Imaging.

[39]  Marion A. Eppler,et al.  Why walkers slip: Shine is not a reliable cue for slippery ground , 2006, Perception & psychophysics.

[40]  Lukas Kaim,et al.  Visual and haptic integration in the estimation of softness of deformable objects , 2013, i-Perception.

[41]  H E Ross,et al.  Charpentier (1891) on the size—weight illusion , 1999, Perception & psychophysics.

[42]  Heinrich H. Bülthoff,et al.  Touch can change visual slant perception , 2000, Nature Neuroscience.

[43]  Jonathan S. Cant,et al.  Living in a material world: how visual cues to material properties affect the way that we lift objects and perceive their weight. , 2009, Journal of neurophysiology.

[44]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[45]  Roberta L. Klatzky,et al.  Haptic Rendering and Psychophysical Evaluation of a Virtual Three-Dimensional Helical Spring , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[46]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[47]  C. Spence,et al.  What role does multisensory integration play in the visuotactile perception of texture? , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[48]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.