Digital Transmission of Subjective Material Appearance

The digital recreation of real-world materials has a substantial role in applications such as product design, on-line shopping or video games. Since decisions in design or shopping are often driven by qualities like “softness” or “beautifulness” of a material (rather than its photo-accurate visual depiction), a digital material should not only closely capture the texture and reflectance of the physical sample, but also its subjective feel. Computer graphics research constantly struggles to trade physical accuracy against computational efficiency. However, the connection between measurable properties of a material and its perceived quality is subtle and hard to quantify. Here, we analyze the capability of a state-of-the-art model for digital material appearance (the spatially-varying BRDF) to transport certain subjective qualities through the visual channel. In a psychophysical study, we presented users with measured material SVBRDFs in the form of rendered still images and animations, as well as photographs and physical samples of the original materials. The main insight from this experiment is that photographs reproduce better those qualities associated with the sense of touch, particularly for textile materials. We hypothesized that the abstraction of volumetric materials as opaque and flat textures destroys important visual cues especially in border regions, where fluff and protruding fibers are most prominent. We therefore performed a follow-up experiment where the border regions have been removed from the photographs. The fact that this step greatly reduced the capability of photos to transport important qualities suggests strong directions of future research in applied perception and computer graphics.

[1]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[2]  R. Fleming Visual perception of materials and their properties , 2014, Vision Research.

[3]  M. Landy,et al.  How direction of illumination affects visually perceived surface roughness. , 2006, Journal of vision.

[4]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Helen Storey Fabric for Fashion , 2010 .

[6]  Diego Gutierrez,et al.  Effects of Approximate Filtering on the Appearance of Bidirectional Texture Functions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[7]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[8]  Michal Haindl,et al.  Visual Texture: Accurate Material Appearance Measurement, Representation and Modeling , 2013 .

[9]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[10]  Barton L Anderson,et al.  Visual perception of materials and surfaces , 2011, Current Biology.

[11]  Michael Goesele,et al.  Advances in Geometry and Reflectance Acquisition , 2016, Eurographics.

[12]  Vebjørn Ekroll,et al.  Disparity, motion, and color information improve gloss constancy performance. , 2010, Journal of vision.

[13]  Reinhard Klein,et al.  Verification of rendering quality from measured BTFs , 2006, APGV '06.

[14]  Michael Weinmann,et al.  Multimodal perception of material properties , 2015, SAP.

[15]  Christiane B. Wiebel,et al.  Perceptual qualities and material classes. , 2013, Journal of vision.

[16]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[17]  Paul E. Green,et al.  Conjoint Analysis in Marketing: New Developments with Implications for Research and Practice , 1990 .

[18]  David J. Kriegman,et al.  Toward a perceptual space for gloss , 2009, TOGS.

[19]  Edward H. Adelson,et al.  On seeing stuff: the perception of materials by humans and machines , 2001, IS&T/SPIE Electronic Imaging.

[20]  Clive Hallett,et al.  Fabric for Fashion: The Swatch Book , 2014 .

[21]  Gerald L. Lohse,et al.  Towards a texture naming system: Identifying relevant dimensions of texture , 1993, Vision Research.

[22]  Midori Tokita,et al.  Perception of the material properties of wood based on vision, audition, and touch , 2015, Vision Research.

[23]  Gero Müller,et al.  From Color to Appearance in the Real World , 2013, Material Appearance Modeling.

[24]  Derek Hoiem,et al.  Geometry-Informed Material Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jirí Filip,et al.  Predicting Visual Perception of Material Structure in Virtual Environments , 2017, Comput. Graph. Forum.