Photometric approach to surface reconstruction of artist paintings

We propose a method for surface reconstruction of artist paintings. In order to reproduce the appearance of a painting, including color, surface texture, and glossiness, it is essential to acquire the pixel-wise light reflection property and orientation of the surface and render an image under an arbitrary lighting condition. A photometric approach is used to estimate bidirectional reflectance distribution functions (BRDFs) and surface normals from a set of images photographed by a fixed camera with sparsely distributed point light sources. A robust and computationally less expensive nonlinear optimization algorithm is proposed that optimizes the small number of parameters to simultaneously determine all of the specular BRDF, diffuse albedo, and surface normal. The proposed method can be applied to moderately glossy surfaces without separating captured images into diffuse and specular reflections beforehand. Experiments were conducted using oil paintings with different surface glossiness. The effectiveness of the proposed method is validated by comparing captured and rendered images.

[1]  Edwin R. Hancock,et al.  Surface Reconstruction Using Polarization and Photometric Stereo , 2007, CAIP.

[2]  H Haneishi,et al.  System design for accurately estimating the spectral reflectance of art paintings. , 2000, Applied optics.

[3]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[4]  Roy S. Berns Lawrence A. Taplin Mahdi Nezamabadi Mahna Munsell Spectral imaging using a commercial color-filter array digital camera , 2004 .

[5]  Andrew Gardner,et al.  Linear light source reflectometry , 2003, ACM Trans. Graph..

[6]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[7]  Pieter Peers,et al.  Image-based separation of diffuse and specular reflections using environmental structured illumination , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[8]  Shoji Tominaga,et al.  Spectral Reflection Modeling for Image Rendering of Water Paint Surfaces , 2008, CGIV/MCS.

[9]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[10]  Roy S. Berns,et al.  High-accuracy digital imaging of cultural heritage without visual editing , 2005 .

[11]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[12]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[13]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[14]  Katsushi Ikeuchi,et al.  Light source position and reflectance estimation from a single view without the distant illumination assumption , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Tim Weyrich,et al.  Principles of appearance acquisition and representation , 2007, SIGGRAPH '08.

[16]  Csaba Kelemen,et al.  A Microfacet Based Coupled Specular-Matte BRDF Model with Importance Sampling , 2001, Eurographics.

[17]  Hans-Peter Seidel,et al.  3D acquisition of mirroring objects using striped patterns , 2005, Graph. Model..

[18]  Ying Chen,et al.  Model Evaluation for Computer Graphics Renderings of Artist Paint Surfaces , 2007, Color Imaging Conference.

[19]  Ravi Ramamoorthi,et al.  Reflectance sharing: predicting appearance from a sparse set of images of a known shape , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Paul E. Debevec,et al.  A photometric approach to digitizing cultural artifacts , 2001, VAST '01.

[21]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[22]  Donald P. Greenberg,et al.  A comprehensive physical model for light reflection , 1991, SIGGRAPH.

[23]  Yonghui Zhao,et al.  Spectral imaging using a commercial colour-filter array digital camera , 2005 .

[24]  Philippe Bekaert,et al.  Fast Normal Map Acquisition Using an LCD Screen Emitting Gradient Patterns , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[25]  Hans-Peter Seidel,et al.  Modulated phase-shifting for 3D scanning , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  André Gagalowicz,et al.  Inverse Rendering from a Single Image , 2002, CGIV.

[27]  Shoji Tominaga,et al.  Spectral image acquisition, analysis, and rendering for art paintings , 2008, J. Electronic Imaging.

[28]  Shree K. Nayar,et al.  Generalization of Lambert's reflectance model , 1994, SIGGRAPH.

[29]  Robert L. Stevenson,et al.  Dynamic range improvement through multiple exposures , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[30]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[31]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[32]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Katsushi Ikeuchi,et al.  Determining Reflectance Parameters and Illumination Distribution from a Sparse Set of Images for View-dependent Image Synthesis , 2001, ICCV.

[36]  Roy S. Berns,et al.  The Science of Digitizing Paintings for Color-Accurate Image Archives : A Review , 2001 .

[37]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[38]  Katsushi Ikeuchi,et al.  Extracting the Shape and Roughness of Specular Lobe Objects Using Four Light Photometric Stereo , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Jon Yngve Hardeberg,et al.  Multispectral Imaging Development at ENST , 2000 .

[40]  F. E. Nicodemus Directional Reflectance and Emissivity of an Opaque Surface , 1965 .

[41]  Hans-Peter Seidel,et al.  Validation of Color Managed 3D Appearance Acquisition , 2004, Color Imaging Conference.

[42]  Paul E. Debevec,et al.  Data-driven diffuse-specular separation of spherical gradient illumination , 2009, SIGGRAPH '09.

[43]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[44]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[45]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[46]  Peter Shirley,et al.  An Anisotropic Phong BRDF Model , 2000, J. Graphics, GPU, & Game Tools.