A Low-Dimensional Perceptual Space for Intuitive BRDF Editing

Understanding and characterizing material appearance based on human perception is challenging because of the highdimensionality and nonlinearity of reflectance data. We refer to the process of identifying specific characteristics of material appearance within the same category as material estimation, in contrast to material categorization which focuses on identifying inter-category differences [FNG15]. In this paper, we present a method to simulate the material estimation process based on human perception. We create a continuous perceptual space for measured tabulated data based on its underlying low-dimensional manifold. Unlike many previous works that only address individual perceptual attributes (such as gloss), we focus on extracting all possible dimensions that can explain the perceived differences between appearances. Additionally, we propose a new material editing interface that combines image navigation and sliders to visualize each perceptual dimension and facilitate the editing of tabulated BRDFs. We conduct a user study to evaluate the efficacy of the perceptual space and the interface in terms of appearance matching. CCS Concepts • Computing methodologies Ñ Perception;

[1]  Steve Marschner,et al.  Microfacet Models for Refraction through Rough Surfaces , 2007, Rendering Techniques.

[2]  Julie Dorsey,et al.  Learning-Based Inverse Bi-Scale Material Fitting From Tabular BRDFs , 2020, IEEE Transactions on Visualization and Computer Graphics.

[3]  Gary W. Meyer,et al.  Applying appearance standards to light reflection models , 2001, SIGGRAPH.

[4]  Sumanta N. Pattanaik,et al.  BRDF-Shop: creating physically correct bidirectional reflectance distribution functions , 2006, IEEE Computer Graphics and Applications.

[5]  Jinwei Gu,et al.  Toward a Perceptually Based Metric for BRDF Modeling , 2012, Color Imaging Conference.

[6]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[7]  Peter Schröder,et al.  Spherical wavelets: efficiently representing functions on the sphere , 1995, SIGGRAPH.

[8]  Rui Wang,et al.  Fast, realistic lighting and material design using nonlinear cut approximation , 2008, SIGGRAPH Asia '08.

[9]  Noah Snavely,et al.  Material recognition in the wild with the Materials in Context Database , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[11]  Franz Faul,et al.  The influence of Fresnel effects on gloss perception. , 2019, Journal of vision.

[12]  Reinhard Klein,et al.  Appearance Bending: A Perceptual Editing Paradigm for Data-Driven Material Models , 2017, VMV.

[13]  Karol Myszkowski,et al.  Perceptually Motivated BRDF Comparison using Single Image , 2016, Comput. Graph. Forum.

[14]  David J. Kriegman,et al.  Toward a perceptual space for gloss , 2009, TOGS.

[15]  R. W. Kentridge,et al.  The perception of gloss: A review , 2015, Vision Research.

[16]  Diego Gutierrez,et al.  The joint role of geometry and illumination on material recognition , 2021, Journal of vision.

[17]  Adam Tauman Kalai,et al.  Adaptively Learning the Crowd Kernel , 2011, ICML.

[18]  David J. Kriegman,et al.  Generalized Non-metric Multidimensional Scaling , 2007, AISTATS.

[19]  Diego Gutierrez,et al.  A similarity measure for material appearance , 2019, ACM Trans. Graph..

[20]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[21]  Barton L Anderson,et al.  Visual perception of materials and surfaces , 2011, Current Biology.

[22]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[23]  Brent Burley Physically-Based Shading at Disney , 2012 .

[24]  Pascal Barla,et al.  The perception of hazy gloss. , 2017, Journal of vision.

[25]  Yanjun Chen,et al.  DeepBRDF: A Deep Representation for Manipulating Measured BRDF , 2020, Comput. Graph. Forum.

[26]  K. Bala,et al.  Effects of global illumination approximations on material appearance , 2010, ACM Trans. Graph..

[27]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Stephen H. Westin,et al.  Predicting reflectance functions from complex surfaces , 1992, SIGGRAPH.

[29]  Edward H. Adelson,et al.  Understanding the role of phase function in translucent appearance , 2013, TOGS.

[30]  Seung-Woo Nam,et al.  A PCA Decomposition for Real‐time BRDF Editing and Relighting with Global Illumination , 2010, Comput. Graph. Forum.

[31]  Luc Van Gool,et al.  Material Classification under Natural Illumination Using Reflectance Maps , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[32]  Karl R. Gegenfurtner,et al.  Perception of material properties , 2015, Vision Research.

[33]  Jon Yngve Hardeberg,et al.  Behavioral Investigation of Visual Appearance Assessment , 2018, Color and Imaging Conference.

[34]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[35]  Pat Hanrahan,et al.  Exploratory modeling with collaborative design spaces , 2009, ACM Trans. Graph..

[36]  Holly E. Rushmeier,et al.  Material Design in Augmented Reality with In-Situ Visual Feedback , 2017, EGSR.

[37]  Edward H. Adelson,et al.  On the appearance of translucent edges , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Derek Nowrouzezahrai,et al.  A Versatile Parameterization for Measured Material Manifolds , 2018, Comput. Graph. Forum.

[39]  R. Gonzalez Applied Multivariate Statistics for the Social Sciences , 2003 .

[40]  Jannik Boll Nielsen,et al.  On optimal, minimal BRDF sampling for reflectance acquisition , 2015, ACM Trans. Graph..

[41]  K. Myszkowski,et al.  The effect of shape and illumination on material perception , 2021, ACM Trans. Graph..

[42]  Hans-Peter Seidel,et al.  An intuitive control space for material appearance , 2016, ACM Trans. Graph..

[43]  David H Brainard,et al.  Color and material perception: achievements and challenges. , 2010, Journal of vision.

[44]  Julie Dorsey,et al.  Digital Modeling of Material Appearance , 2007 .

[45]  T. Jacobsen,et al.  Classification of material substances: Introducing a standards-based approach , 2020 .

[46]  Kun Zhou,et al.  Interactive relighting with dynamic BRDFs , 2007, SIGGRAPH 2007.

[47]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[48]  Wenzel Jakob,et al.  An adaptive parameterization for efficient material acquisition and rendering , 2018, ACM Trans. Graph..

[49]  Frédo Durand,et al.  Image-driven navigation of analytical BRDF models , 2006, EGSR '06.

[50]  Diego Gutierrez,et al.  Attribute‐preserving gamut mapping of measured BRDFs , 2017, Comput. Graph. Forum.

[51]  W. B. Kerr,et al.  Toward evaluating material design interface paradigms for novice users , 2010, ACM Trans. Graph..

[52]  Szymon Rusinkiewicz,et al.  Gamut Mapping Spatially Varying Reflectance with an Improved BRDF Similarity Metric , 2012, Comput. Graph. Forum.

[53]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[54]  M. Landy,et al.  How direction of illumination affects visually perceived surface roughness. , 2006, Journal of vision.

[55]  R. Fleming,et al.  Visual Features in the Perception of Liquids , 2018, Current Biology.

[56]  Edward H. Adelson,et al.  Band-Sifting Decomposition for Image-Based Material Editing , 2015, ACM Trans. Graph..

[57]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[58]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[59]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[60]  R. Fleming Visual perception of materials and their properties , 2014, Vision Research.

[61]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[62]  Diego Gutierrez,et al.  Attribute-preserving gamut mapping of measured BRDFs , 2017, SIGGRAPH Posters.

[63]  Ravi Ramamoorthi,et al.  Connecting measured BRDFs to analytic BRDFs by data-driven diffuse-specular separation , 2018, ACM Trans. Graph..

[64]  Paul R. Schrater,et al.  Visual Motion and the Perception of Surface Material , 2011, Current Biology.

[65]  James J. Thomas,et al.  Proceedings of the 19th annual conference on Computer graphics and interactive techniques , 1992, SIGGRAPH.

[66]  Scott Sorensen,et al.  Material classification with thermal imagery , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).