Perception of the material properties of wood based on vision, audition, and touch

Most research on the multimodal perception of material properties has investigated the perception of material properties of two modalities such as vision-touch, vision-audition, audition-touch, and vision-action. Here, we investigated whether the same affective classifications of materials can be found in three different modalities of vision, audition, and touch, using wood as the target object. Fifty participants took part in an experiment involving the three modalities of vision, audition, and touch, in isolation. Twenty-two different wood types including genuine, processed, and fake were perceptually evaluated using a questionnaire consisting of twenty-three items (12 perceptual and 11 affective). The results demonstrated that evaluations of the affective properties of wood were similar in all three modalities. The elements of "expensiveness, sturdiness, rareness, interestingness, and sophisticatedness" and "pleasantness, relaxed feelings, and liked-disliked" were separately grouped for all three senses. Our results suggest that the affective material properties of wood are at least partly represented in a supramodal fashion. Our results also suggest an association between perceptual and affective properties, which will be a useful tool not only in science, but also in applied fields.

[1]  L. N. Solomon Semantic Approach to the Perception of Complex Sounds , 1958 .

[2]  Jonathan S. Cant,et al.  Living in a material world: how visual cues to material properties affect the way that we lift objects and perceive their weight. , 2009, Journal of neurophysiology.

[3]  Wolfgang Straßer,et al.  Perceptual Reparameterization of Material Properties , 2007, CAe.

[4]  R. Lutfi,et al.  Auditory discrimination of material changes in a struck-clamped bar. , 1997, The Journal of the Acoustical Society of America.

[5]  A. Kappers,et al.  Analysis of haptic perception of materials by multidimensional scaling and physical measurements of roughness and compressibility. , 2006, Acta psychologica.

[6]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[7]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[8]  L. Maloney,et al.  Visual Perception of Thick Transparent Materials , 2011, Psychological science.

[9]  Susan J. Lederman,et al.  Multisensory Texture Perception , 2010 .

[10]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Edward H. Adelson,et al.  Material perception: What can you see in a brief glance? , 2010 .

[12]  V. Jousmäki,et al.  Parchment-skin illusion: sound-biased touch , 1998, Current Biology.

[13]  G. Von Bismarck,et al.  Sharpness as an attribute of the timbre of steady sounds , 1974 .

[14]  Fiona N. Newell,et al.  Vision and touch: Independent or integrated systems for the perception of texture? , 2008, Brain Research.

[15]  S. Lederman,et al.  Perception of texture by vision and touch: multidimensionality and intersensory integration. , 1986, Journal of experimental psychology. Human perception and performance.

[16]  A. Gabrielsson,et al.  Perceived sound quality of sound-reproducing systems. , 1979, The Journal of the Acoustical Society of America.

[17]  J. Goodnow,et al.  Haptic and visual perception of proportion. , 1970, Journal of experimental psychology.

[18]  Bruno L. Giordano,et al.  Material identification of real impact sounds: effects of size variation in steel, glass, wood, and plexiglass plates. , 2006, The Journal of the Acoustical Society of America.

[19]  Michiteru Kitazaki,et al.  Experts and Novices Use the Same Factors–But Differently–To Evaluate Pearl Quality , 2014, PloS one.

[20]  J. Enns,et al.  Spatial selection and target identification are separable processes in visual search. , 2010, Journal of vision.

[21]  A. Kappers,et al.  Haptic and visual perception of roughness. , 2007, Acta psychologica.

[22]  I. Motoyoshi,et al.  Adaptation-induced blindness to sluggish stimuli. , 2010, Journal of vision.

[23]  Naokazu Goda,et al.  Transformation from image-based to perceptual representation of materials along the human ventral visual pathway , 2011, NeuroImage.

[24]  Christiane B. Wiebel,et al.  Perceptual qualities and material classes. , 2013, Journal of vision.

[25]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[26]  Salvador Soto-Faraco,et al.  I can't believe this isn't wood! An investigation in the perception of naturalness. , 2011, Acta psychologica.

[27]  C. Spence,et al.  What role does multisensory integration play in the visuotactile perception of texture? , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Living in a Material World T , 2022 .

[29]  G.W.A.M. van der Heijden,et al.  Measuring Perception of Naturalness , 2008 .

[30]  Shin'ya Nishida,et al.  Audiovisual integration in the human perception of materials. , 2014, Journal of vision.

[31]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[32]  Guillaume Lemaitre,et al.  Auditory perception of material is fragile while action is strikingly robust. , 2012, The Journal of the Acoustical Society of America.

[33]  J. Macke,et al.  Quantifying the effect of intertrial dependence on perceptual decisions. , 2014, Journal of vision.

[34]  Vision Research , 1961, Nature.

[35]  Charles Spence,et al.  The role of auditory cues in modulating the perceived crispness and staleness of potato chips , 2004 .

[36]  C. Osgood,et al.  Certain relations among experienced contingencies, associative structure, and contingencies in encoded messages. , 1957, The American journal of psychology.

[37]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[38]  Dinesh K. Pai,et al.  Perception of Material from Contact Sounds , 2000, Presence: Teleoperators & Virtual Environments.

[39]  Paul Rozin,et al.  The Meaning of “Natural” , 2005, Psychological science.

[40]  Richard Kronland-Martinet,et al.  Controlling the Perceived Material in an Impact Sound Synthesizer , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[41]  Christiane B Wiebel,et al.  Visual and haptic representations of material properties. , 2013, Multisensory research.

[42]  I. Motoyoshi Highlight-shading relationship as a cue for the perception of translucent and transparent materials. , 2010, Journal of vision.