OctreeBTFs - A compact, seamless and distortion-free reflectance representation

A compact, accurate, seamless, distortion-free volumetric reflectance representation.A novel, biologically-inspired skeleton based derivation of local coordinate systems.A novel, efficient, real-time rendering algorithm for OctreeBTFs. Display Omitted Conventional reflectance acquisition techniques rely on the reconstruction of a closed surface geometry and a subsequent surface parametrization that is required to store the reflectance data parametrized over the surface. Among the main drawbacks of this approach is the need for a suitable surface parametrization which is particularly challenging for inaccuracies in the reconstruction or holes occurring due to missing observations. An inappropriate parametrization, in turn, leads to artifacts such as distortion effects and visible seams which severely decrease the visual quality of the digitized object appearance. Furthermore, standard reflectance representations are either compact and less expressive or not compact and expressive. In this paper, we introduce a compact, accurate, seamless and distortion-free volumetric reflectance representation to address these issues. This novel representation named OctreeBTFs is based on storing surface reflectance in terms of Apparent BRDFs in a grid structure that is adapted to the underlying object geometry. The local coordinate systems required to store and render the local reflectance behavior of anisotropic surface reflectance characteristics are computed based on a novel, biologically inspired local approach, instead of computing them based on the texture coordinates obtained from the uv-parameterization. The resulting octree-based data structure results in a more compact BTF representation that can be rendered in real-time with multiple light sources. Finally, our data structure can also be applied to other reflectance representations or to store other information such as physical properties.

[1]  Christopher Schwartz,et al.  Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage , 2011, VAST.

[2]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[3]  M. Goesele,et al.  Floating scale surface reconstruction , 2014, ACM Trans. Graph..

[4]  Reinhard Klein,et al.  Advances in geometry and reflectance acquisition (course notes) , 2015, SIGGRAPH Asia Courses.

[5]  Enrico Gobbetti,et al.  Far voxels: a multiresolution framework for interactive rendering of huge complex 3D models on commodity graphics platforms , 2005, ACM Trans. Graph..

[6]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[7]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[8]  Konstantin Mischaikow,et al.  Vector field design on surfaces , 2006, TOGS.

[9]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[10]  Kenshi Takayama,et al.  Data-driven interactive quadrangulation , 2015, ACM Trans. Graph..

[11]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[12]  Marco Tarini,et al.  Volume-encoded UV-maps , 2016, ACM Trans. Graph..

[13]  Paolo Cignoni,et al.  PolyCube-Maps , 2004, SIGGRAPH 2004.

[14]  Hans-Peter Seidel,et al.  Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions , 2010, SIGGRAPH 2010.

[15]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[16]  Olga Sorkine-Hornung,et al.  Instant field-aligned meshes , 2015, ACM Trans. Graph..

[17]  Ralf Sarlette,et al.  Data‐driven Local Coordinate Systems for Image‐Based Rendering , 2006, Comput. Graph. Forum.

[18]  Daniele Panozzo,et al.  Directional Field Synthesis, Design, and Processing , 2016, Comput. Graph. Forum.

[19]  Bruno Lévy,et al.  Geometry-aware direction field processing , 2009, TOGS.

[20]  Darwyn R. Peachey,et al.  Solid texturing of complex surfaces , 1985, SIGGRAPH.

[21]  Pierre Alliez,et al.  Integer-grid maps for reliable quad meshing , 2013, ACM Trans. Graph..

[22]  Denis Zorin,et al.  Global parametrization by incremental flattening , 2012, ACM Trans. Graph..

[23]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[24]  Jirí Filip,et al.  Bidirectional Texture Function Modeling: A State of the Art Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Paul A. Beardsley,et al.  Image-based 3D photography using opacity hulls , 2002, ACM Trans. Graph..

[26]  Sylvain Lefebvre,et al.  Rethinking Texture Mapping , 2017, SIGGRAPH Courses.

[27]  Tamy Boubekeur,et al.  Appearance preserving octree-textures , 2007, GRAPHITE '07.

[28]  Didier Stricker,et al.  Efficient Packing of Arbitrary Shaped Charts for Automatic Texture Atlas Generation , 2011, EGSR '11.

[29]  Pablo Bauszat,et al.  Geometry and Attribute Compression for Voxel Scenes , 2016, Comput. Graph. Forum.

[30]  Hujun Bao,et al.  Spectral Quadrangulation with Feature Curve Alignment and Element Size Control , 2014, ACM Trans. Graph..

[31]  Konrad Polthier,et al.  QuadCover ‐ Surface Parameterization using Branched Coverings , 2007, Comput. Graph. Forum.

[32]  Christopher Schwartz,et al.  Design and Implementation of Practical Bidirectional Texture Function Measurement Devices Focusing on the Developments at the University of Bonn , 2014, Sensors.

[33]  Balasubramanian Raman,et al.  Computing hierarchical curve-skeletons of 3D objects , 2005, The Visual Computer.

[34]  Daniele Panozzo,et al.  Directional Field Synthesis, Design, and Processing , 2016, Comput. Graph. Forum.

[35]  Sylvain Lefebvre,et al.  Invisible Seams , 2010, Comput. Graph. Forum.

[36]  Brent Burley,et al.  Ptex: Per‐Face Texture Mapping for Production Rendering , 2008, Comput. Graph. Forum.

[37]  Sylvain Lefebvre,et al.  GigaVoxels: ray-guided streaming for efficient and detailed voxel rendering , 2009, I3D '09.

[38]  Michal Haindl,et al.  Visual Texture: Accurate Material Appearance Measurement, Representation and Modeling , 2013 .

[39]  Christopher Schwartz,et al.  WebGL-based streaming and presentation of objects with bidirectional texture functions , 2013, JOCCH.

[40]  Bruno Lévy,et al.  ABF++: fast and robust angle based flattening , 2005, TOGS.

[41]  Enrico Puppo,et al.  Extraction of the Quad Layout of a Triangle Mesh Guided by Its Curve Skeleton , 2015, ACM Trans. Graph..

[42]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[43]  David Benson,et al.  Octree textures , 2002, SIGGRAPH.

[44]  Budirijanto Purnomo,et al.  Seamless texture atlases , 2004, SGP '04.

[45]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Bruno Lévy,et al.  Mesh parameterization: theory and practice , 2007, SIGGRAPH Courses.