Rapid Synchronous Acquisition of Geometry and Appearance of Cultural Heritage Artefacts

In order to produce visually appealing digital models of cultural heritage artefacts, a meticulous reconstruction of the 3D geometry alone is often not sufficient, as colour and reflectance information give essential clues of the object's material. Standard texturing methods are often only able to overcome this fact under strict material and lighting condition limitations. The realistic reconstruction of complex yet frequently encountered materials such as fabric, leather, wood or metal is still a challenge. In this paper, we describe a novel system to acquire the 3Dgeometry of an object using its visual hull, recorded in multiple 2D images with a multi-camera array. At the same time, the material properties of the object are measured into Bidirectional Texture Functions (BTF), that faithfully capture the mesostructure of the surface and reconstruct the look-and-feel of its material. The high rendering fidelity of the acquired BTF texture data with respect to reflectance and self-shadowing also alleviates the limited precision of the visual hull approach for 3D geometry acquisition.

[1]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[2]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[3]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[4]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[5]  Jean Ponce,et al.  Carved visual hulls for high-accuracy image-based modeling , 2005, SIGGRAPH '05.

[6]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[7]  Shree K. Nayar,et al.  Reflectance and Texture of Real-World Surfaces Authors , 1997, CVPR 1997.

[8]  Hans-Peter Seidel,et al.  Improved Hardware-Accelerated Visual Hull Rendering , 2003, VMV.

[9]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[10]  Stan Sclaroff,et al.  Stochastic refinement of the visual hull to satisfy photometric and silhouette consistency constraints , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[12]  Trevor Darrell,et al.  A Bayesian approach to image-based visual hull reconstruction , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Mark R. Stevens,et al.  Methods for Volumetric Reconstruction of Visual Scenes , 2004, International Journal of Computer Vision.

[14]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[15]  Anselmo Lastra,et al.  Online construction of surface light fields , 2005, EGSR '05.

[16]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Katsushi Ikeuchi,et al.  Appearance Based Object Modeling using Texture Database: Acquisition Compression and Rendering , 2002, Rendering Techniques.

[18]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[19]  Reinhard Klein,et al.  Fast environmental lighting for local-PCA encoded BTFs , 2004, Proceedings Computer Graphics International, 2004..

[20]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[21]  Reinhard Klein,et al.  An Adaptable Surface Parameterization Method , 2003, IMR.

[22]  Reinhard Klein,et al.  Image-Based Registration of 3D-Range Data Using Feature Surface Elements , 2004, VAST.

[23]  Paul E. Debevec,et al.  A dual light stage , 2005, EGSR '05.

[24]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[25]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Linda G. Shapiro,et al.  Surface Reconstruction and Display from Range and Color Data , 2000, Graph. Model..

[27]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[28]  Hans-Peter Seidel,et al.  Hardware-Accelerated Visual Hull Reconstruction and Rendering , 2003, Graphics Interface.

[29]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[30]  Wojciech Matusik,et al.  Acquisition and Rendering of Transparent and Refractive Objects , 2002, Rendering Techniques.

[31]  Paul E. Debevec,et al.  A photometric approach to digitizing cultural artifacts , 2001, VAST '01.