Visual discrimination of optical material properties: A large-scale study

Complex visual processing involved in perceiving the object materials can be better elucidated by taking a variety of research approaches. Sharing stimulus and response data is an effective strategy to make the results of different studies directly comparable and can assist researchers with different backgrounds to jump into the field. Here, we constructed a database containing a variety of material images annotated with visual discrimination performance. We created various material images by using physically-based computer graphics techniques and conducted psychophysical experiments using them in both laboratory and crowdsourcing settings. The observer’s task was to discriminate materials on six dimensions (gloss contrast, gloss sharpness, translucent vs. opaque, metal vs. plastic, metal vs. glass, and glossy vs. painted) with several task difficulties. The illumination consistency and object geometry were also varied. We used a non-verbal procedure (an oddity task) so that our database could be used in diverse cross-cultural, cross-species, clinical, and developmental studies. The results showed that discrimination performance was affected by the illumination condition and object geometry, in agreement with previous studies on gloss perception, although the pattern of effects was slightly different for some material dimensions. We also found that the ability to discriminate the spatial consistency of specular highlights in glossiness perception showed larger individual differences than in other tasks. The results obtained through crowdsourcing were strongly correlated with those obtained in the laboratory, which suggests that our database can be used even when the experimental conditions are not strictly controlled. Several projects using our dataset are underway.

[1]  Shin'ya Nishida,et al.  Material and shape perception based on two types of intensity gradient information , 2018, PLoS Comput. Biol..

[2]  Shin'ya Nishida,et al.  Motion Perception: From Detection to Interpretation. , 2018, Annual review of vision science.

[3]  Bei Xiao,et al.  Estimating mechanical properties of cloth from videos using dense motion trajectories: Human psychophysics and machine learning. , 2018, Journal of vision.

[4]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[5]  I. Motoyoshi Highlight-shading relationship as a cue for the perception of translucent and transparent materials. , 2010, Journal of vision.

[6]  Isamu Motoyoshi,et al.  Pre-constancy Vision in Infants , 2015, Current Biology.

[7]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[8]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[9]  Bruce Walter,et al.  Looking against the light: how perception of translucency depends on lighting direction. , 2014, Journal of vision.

[10]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[11]  Shin'ya Nishida,et al.  Visual wetness perception based on image color statistics. , 2017, Journal of vision.

[12]  F. Kingdom,et al.  Applying the Model-Comparison Approach to Test Specific Research Hypotheses in Psychophysical Research Using the Palamedes Toolbox , 2018, Front. Psychol..

[13]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[14]  Kavita Bala,et al.  Effect of geometric sharpness on translucent material perception , 2019, bioRxiv.

[15]  Kavita Bala,et al.  Effect of geometric sharpness on translucent material perception , 2020, Journal of vision.

[16]  Shin'ya Nishida,et al.  Human perception of subresolution fineness of dense textures based on image intensity statistics. , 2017, Journal of vision.

[17]  David Eriksson,et al.  A Principle for Describing and Verifying Brain Mechanisms Using Ongoing Activity , 2017, Front. Neural Circuits.

[18]  Bei Xiao,et al.  Perceptual constancy of mechanical properties of cloth under variation of external forces , 2016, SAP.

[19]  Steve Marschner,et al.  Microfacet Models for Refraction through Rough Surfaces , 2007, Rendering Techniques.

[20]  Roland W Fleming,et al.  Material Perception. , 2017, Annual review of vision science.

[21]  Hiroshi Ban,et al.  fMRI evidence for areas that process surface gloss in the human visual cortex , 2015, Vision Research.

[22]  Kazushi Maruya,et al.  Seeing liquids from visual motion , 2015, Vision Research.

[23]  Hendrikje Nienborg,et al.  Manipulating patterns of dynamic deformation elicits the impression of cloth with varying stiffness. , 2019, Journal of vision.

[24]  Robert W. Kentridge,et al.  Glossiness perception can be mediated independently of cortical processing of colour or texture , 2012, Cortex.

[25]  B J Craven A table ofd′ forM-alternative odd-man-out forced-choice procedures , 1992, Perception & psychophysics.

[26]  Edward H. Adelson,et al.  On the appearance of translucent edges , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Philip Watkinson,et al.  On Appearance , 2018, Performance Research.

[28]  Erich W. Graf,et al.  Touch influences perceived gloss , 2016, Scientific Reports.

[29]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[30]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[31]  Isamu Motoyoshi,et al.  Variability in constancy of the perceived surface reflectance across different illumination statistics , 2012, Vision Research.

[32]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[33]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[34]  John P. Spencer,et al.  Probing the neural basis of visual working memory: A validation study using fMRI and fNIRS , 2014 .

[35]  Hannah E. Smithson,et al.  Beyond scattering and absorption: Perceptual unmixing of translucent liquids , 2018, Journal of vision.

[36]  Toni Saarela ShapeToolbox: Creating 3D models for vision research , 2018 .

[37]  R. Fleming,et al.  Visual Features in the Perception of Liquids , 2018, Current Biology.

[38]  Edward H. Adelson,et al.  Image statistics for material perception , 2004 .

[39]  Maria Olkkonen,et al.  Perceived glossiness and lightness under real-world illumination. , 2010, Journal of vision.

[40]  Edward H. Adelson,et al.  Understanding the role of phase function in translucent appearance , 2013, TOGS.

[41]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[42]  Hanhan Wei,et al.  Can you see what you feel? Color and folding properties affect visual-tactile material discrimination of fabrics. , 2016, Journal of vision.

[43]  Juno Kim,et al.  Turning the World Upside Down to Understand Perceived Transparency , 2016, i-Perception.

[44]  Hideki Tamura,et al.  Distinguishing mirror from glass: A “big data” approach to material perception , 2019, Journal of vision.

[45]  Anthony J. Adams Color studies of cone pathway sensitivity in eye disease , 2010 .

[46]  Kowa Koida,et al.  Categorical properties of the color term "GOLD". , 2011, Journal of vision.

[47]  Naohisa Miyakawa,et al.  Representation of Glossy Material Surface in Ventral Superior Temporal Sulcal Area of Common Marmosets , 2017, Front. Neural Circuits.

[48]  Naokazu Goda,et al.  Crossmodal Association of Visual and Haptic Material Properties of Objects in the Monkey Ventral Visual Cortex , 2016, Current Biology.

[49]  Frederick A. A. Kingdom,et al.  Introduction and Aims , 2016 .

[50]  Phillip J. Marlow,et al.  The perception of gloss depends on highlight congruence with surface shading. , 2011, Journal of vision.

[51]  S. Nishida,et al.  Perceptual transparency from image deformation , 2015, Proceedings of the National Academy of Sciences.

[52]  Naokazu Goda,et al.  Neural Selectivity and Representation of Gloss in the Monkey Inferior Temporal Cortex , 2012, The Journal of Neuroscience.

[53]  Barton L Anderson,et al.  The role of brightness and orientation congruence in the perception of surface gloss. , 2011, Journal of vision.

[54]  Pascal Barla,et al.  A systematic approach to testing and predicting light-material interactions. , 2019, Journal of vision.

[55]  David H. Brainard,et al.  Colour Vision: Understanding #TheDress , 2015, Current Biology.

[56]  Michiteru Kitazaki,et al.  Image regions contributing to perceptual translucency: A psychophysical reverse-correlation study , 2013, i-Perception.

[57]  Filipp Schmidt,et al.  Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. , 2017, Journal of vision.

[58]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[59]  Matteo Toscani,et al.  The many colours of ‘the dress’ , 2015, Current Biology.

[60]  Bei Xiao,et al.  Manipulating patterns of dynamic deformation elicits the impression of cloth with varying stiffness , 2019, bioRxiv.

[61]  Phillip J. Marlow,et al.  The Perception and Misperception of Specular Surface Reflectance , 2012, Current Biology.

[62]  Naokazu Goda,et al.  Perceptual Gloss Parameters Are Encoded by Population Responses in the Monkey Inferior Temporal Cortex , 2014, The Journal of Neuroscience.