Spatio-temporal BRDF: Modeling and synthesis

Abstract We propose a generalization of example-based texture synthesis to spatio-temporal BRDFs. A key component of our method is a novel representation of time-varying materials using polynomials describing time-varying BRDF parameters. Our representation allows efficient fitting of measured data into a compact spatio-temporal BRDF representation, and it allows an efficient analytical evaluation of distances between spatio-temporal BRDF parameters. We show that even polynomials of low degree are sufficient to represent various time-varying phenomena and provide more accurate results than the previously proposed representation. We are the first who applied the example-based texture synthesis on abstract structures such as polynomial functions. We present two applications of synthesizing spatio-temporal BRDFs using our method: material enlargement and transfer of time-varying phenomenon from an example to a given static material. We evaluated the synthesized BRDFs in the context of realistic rendering and real-time rendering.

[1]  Reinhard Klein,et al.  Neural Appearance Synthesis and Transfer , 2019, MAM@EGSR.

[2]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[3]  NishitaTomoyuki,et al.  A lighting model aiming at drive simulators , 1990 .

[4]  Siu Chi Hsu,et al.  Simulating dust accumulation , 1995, IEEE Computer Graphics and Applications.

[5]  Leon A. Gatys,et al.  Texture Synthesis Using Convolutional Neural Networks , 2015, NIPS.

[6]  Daniel Cohen-Or,et al.  Time-varying weathering in texture space , 2016, ACM Trans. Graph..

[7]  Hans-Peter Seidel,et al.  Spatio-temporal Reflectance Sharing for Relightable 3D Video , 2007, MIRAGE.

[8]  Hugues Hoppe,et al.  Appearance-space texture synthesis , 2006, SIGGRAPH 2006.

[9]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[10]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[11]  Pat Hanrahan,et al.  Flow and changes in appearance , 2006, SIGGRAPH Courses.

[12]  H. Shum,et al.  Appearance manifolds for modeling time-variant appearance of materials , 2006, SIGGRAPH 2006.

[13]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[14]  Shree K. Nayar,et al.  Time-varying surface appearance , 2006, SIGGRAPH 2006.

[15]  Qasim Zaidi,et al.  Visual inferences of material changes: color as clue and distraction. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[16]  Murat Kurt,et al.  Linear approximation of Bidirectional Reflectance Distribution Functions , 2008, Comput. Graph..

[17]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[18]  Dani Lischinski,et al.  Analysis and Controlled Synthesis of Inhomogeneous Textures , 2017, Comput. Graph. Forum.

[19]  László Szirmay-Kalos,et al.  An anisotropic BRDF model for fitting and Monte Carlo rendering , 2010, COMG.

[20]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[21]  Carles Bosch,et al.  A Physically‐Based Model for Rendering Realistic Scratches , 2004, Comput. Graph. Forum.

[22]  N. Elton,et al.  Reflectometry of drying latex paint , 2014, Journal of Coatings Technology and Research.

[23]  Fang-Lue Zhang,et al.  A survey of the state-of-the-art in patch-based synthesis , 2017, Computational Visual Media.

[24]  Pierre Poulin,et al.  The Simulation of Paint Cracking and Peeling , 2002, Graphics Interface.

[25]  Chen Xu,et al.  Synthesis of material drying history: phenomenon modeling, transferring and rendering , 2005, NPH.

[26]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[27]  Julie Dorsey,et al.  Rendering of Wet Materials , 1999, Rendering Techniques.

[28]  Takashi Okamoto,et al.  A lighting model aiming at drive simulators , 1990, SIGGRAPH.

[29]  Marcelo Walter,et al.  Synthesis and Transfer of Time-Variant Material Appearance on Images , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.

[30]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[31]  Hujun Bao,et al.  Visual simulation of weathering by γ-ton tracing , 2005, SIGGRAPH 2005.

[32]  Jean-Michel Dischler,et al.  Content-aware texture deformation with dynamic control , 2020, Comput. Graph..

[33]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[34]  Pat Hanrahan,et al.  Modeling and rendering of metallic patinas , 1996, SIGGRAPH.

[35]  B. Smith,et al.  Geometrical shadowing of a random rough surface , 1967 .

[36]  Carles Bosch,et al.  Controllable Image‐Based Transfer of Flow Phenomena , 2018, Comput. Graph. Forum.

[37]  ZhouKun,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003 .

[38]  Samir Akkouche,et al.  Simulating and modeling lichen growth , 2004, Comput. Graph. Forum.

[39]  Shree K. Nayar,et al.  Time-varying textures: definition, acquisition, and synthesis , 2005, SIGGRAPH '05.

[40]  E. Heitz.  Understanding the Masking-Shadowing Function in Microfacet-Based BRDFs , 2014 .

[41]  Yoshihiro Kanamori,et al.  Single Image Weathering via Exemplar Propagation , 2016, Comput. Graph. Forum.

[42]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[43]  Steve Marschner,et al.  Microfacet Models for Refraction through Rough Surfaces , 2007, Rendering Techniques.

[44]  Bo Sun,et al.  Time-varying BRDFs. , 2006, IEEE transactions on visualization and computer graphics.

[45]  George Drettakis,et al.  Image-guided weathering: A new approach applied to flow phenomena , 2011, TOGS.

[46]  Kun Zhou,et al.  Fast example-based surface texture synthesis via discrete optimization , 2006, The Visual Computer.

[47]  Julie Dorsey,et al.  Stone Weathering in a Photograph , 2011, EGSR '11.

[48]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[49]  Baining Guo,et al.  Image‐based Material Weathering , 2008, Comput. Graph. Forum.

[50]  Karol Myszkowski,et al.  Perceptually Motivated BRDF Comparison using Single Image , 2016, Comput. Graph. Forum.

[51]  Murat Kurt,et al.  Compact and intuitive data-driven BRDF models , 2019, The Visual Computer.

[52]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.