An intuitive control space for material appearance

Many different techniques for measuring material appearance have been proposed in the last few years. These have produced large public datasets, which have been used for accurate, data-driven appearance modeling. However, although these datasets have allowed us to reach an unprecedented level of realism in visual appearance, editing the captured data remains a challenge. In this paper, we present an intuitive control space for predictable editing of captured BRDF data, which allows for artistic creation of plausible novel material appearances, bypassing the difficulty of acquiring novel samples. We first synthesize novel materials, extending the existing MERL dataset up to 400 mathematically valid BRDFs. We then design a large-scale experiment, gathering 56,000 subjective ratings on the high-level perceptual attributes that best describe our extended dataset of materials. Using these ratings, we build and train networks of radial basis functions to act as functionals mapping the perceptual attributes to an underlying PCA-based representation of BRDFs. We show that our functionals are excellent predictors of the perceived attributes of appearance. Our control space enables many applications, including intuitive material editing of a wide range of visual properties, guidance for gamut mapping, analysis of the correlation between perceptual attributes, or novel appearance similarity metrics. Moreover, our methodology can be used to derive functionals applicable to classic analytic BRDF representations. We release our code and dataset publicly, in order to support and encourage further research in this direction.

[1]  David J. Kriegman,et al.  Toward a perceptual space for gloss , 2009, TOGS.

[2]  Pat Hanrahan,et al.  Exploratory modeling with collaborative design spaces , 2009, ACM Trans. Graph..

[3]  Ravi Ramamoorthi,et al.  Real-time BRDF editing in complex lighting , 2006, ACM Trans. Graph..

[4]  Paul S. Strauss,et al.  A realistic lighting model for computer animators , 1990, IEEE Computer Graphics and Applications.

[5]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, ACM Trans. Graph..

[6]  Kun Zhou,et al.  Interactive relighting with dynamic BRDFs , 2007, SIGGRAPH 2007.

[7]  Sumanta N. Pattanaik,et al.  BRDF-Shop: creating physically correct bidirectional reflectance distribution functions , 2006, IEEE Computer Graphics and Applications.

[8]  Jessica K. Hodgins,et al.  A perceptual control space for garment simulation , 2015, ACM Trans. Graph..

[9]  Edward H. Adelson,et al.  Band-Sifting Decomposition for Image-Based Material Editing , 2015, ACM Trans. Graph..

[10]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[11]  Kristen Grauman,et al.  Relative attributes , 2011, 2011 International Conference on Computer Vision.

[12]  T. Tominaga,et al.  Performance comparisons of subjective quality assessment methods for mobile video , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[13]  Karol Myszkowski,et al.  Rendering Pearlescent Appearance Based On Paint‐Composition Modelling , 2001, Comput. Graph. Forum.

[14]  Frédo Durand,et al.  Experimental analysis of BRDF models , 2005, EGSR '05.

[15]  Ravi Ramamoorthi,et al.  Reflectance sharing: predicting appearance from a sparse set of images of a known shape , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Diego Gutierrez,et al.  A similarity measure for illustration style , 2014, ACM Trans. Graph..

[17]  Diego Gutierrez,et al.  Effects of Approximate Filtering on the Appearance of Bidirectional Texture Functions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[18]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[19]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[20]  Adrien Bousseau,et al.  Gloss perception in painterly and cartoon rendering , 2013, TOGS.

[21]  Seung-Woo Nam,et al.  A PCA Decomposition for Real‐time BRDF Editing and Relighting with Global Illumination , 2010, Comput. Graph. Forum.

[22]  Diego Gutierrez,et al.  To stylize or not to stylize? , 2015, ACM Trans. Graph..

[23]  Jannik Boll Nielsen,et al.  On optimal, minimal BRDF sampling for reflectance acquisition , 2015, ACM Trans. Graph..

[24]  GutierrezDiego,et al.  An intuitive control space for material appearance , 2016 .

[25]  D. Amnon Silverstein,et al.  Efficient method for paired comparison , 2001, J. Electronic Imaging.

[26]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[27]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[28]  Xin Tong,et al.  AppWarp: retargeting measured materials by appearance-space warping , 2011, SA '11.

[29]  Christiane B. Wiebel,et al.  Perceptual qualities and material classes. , 2013, Journal of vision.

[30]  Fabio Pellacini,et al.  Toward evaluating lighting design interface paradigms for novice users , 2009, SIGGRAPH 2009.

[31]  Jaakko Lehtinen,et al.  Two-shot SVBRDF capture for stationary materials , 2015, ACM Trans. Graph..

[32]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[33]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[34]  Levent Burak Kara,et al.  Semantic shape editing using deformation handles , 2015, ACM Trans. Graph..

[35]  Wojciech Matusik,et al.  Inverse shade trees for non-parametric material representation and editing , 2006, ACM Trans. Graph..

[36]  Takeo Igarashi,et al.  Crowd-powered parameter analysis for visual design exploration , 2014, UIST.

[37]  Michael Pointer,et al.  Measurement of appearance , 2002, Other Conferences.

[38]  Frédo Durand,et al.  Image-driven navigation of analytical BRDF models , 2006, EGSR '06.

[39]  Gary W. Meyer,et al.  Applying appearance standards to light reflection models , 2001, SIGGRAPH.

[40]  Rafal Mantiuk,et al.  Comparison of Four Subjective Methods for Image Quality Assessment , 2012, Comput. Graph. Forum.

[41]  Diego Gutierrez,et al.  Perception in graphics, visualization, virtual environments and animation , 2011, SA '11.

[42]  Diego Gutierrez,et al.  A metric of visual comfort for stereoscopic motion , 2013, ACM Trans. Graph..

[43]  Edward H. Adelson,et al.  Understanding the role of phase function in translucent appearance , 2013, TOGS.

[44]  W. B. Kerr,et al.  Toward evaluating material design interface paradigms for novice users , 2010, ACM Trans. Graph..

[45]  Brent Burley Physically-Based Shading at Disney , 2012 .

[46]  Siddhartha Chaudhuri,et al.  Attribit: content creation with semantic attributes , 2013, UIST.

[47]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[48]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[49]  Frédo Durand,et al.  A precomputed polynomial representation for interactive BRDF editing with global illumination , 2008, TOGS.

[50]  Rui Wang,et al.  Fast, realistic lighting and material design using nonlinear cut approximation , 2008, SIGGRAPH Asia '08.

[51]  Jinwei Gu,et al.  Toward a Perceptually Based Metric for BRDF Modeling , 2012, Color Imaging Conference.

[52]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[53]  Jirí Filip,et al.  Template‐Based Sampling of Anisotropic BRDFs , 2014, Comput. Graph. Forum.

[54]  Noah Snavely,et al.  OpenSurfaces , 2013, ACM Trans. Graph..

[55]  Hitoshi Urabe,et al.  ISO 20462: a psychophysical image quality measurement standard , 2003, IS&T/SPIE Electronic Imaging.