Spectral bidirectional texture function reconstruction by fusing multiple-color and spectral images.

Spectral bidirectional texture function (BTF) is essential for accurate reproduction of material appearance due to its nature of conveying both spatial and spectral information. A practical issue is that the acquisition of raw spectral BTFs is time-consuming. To resolve the limitation, this paper proposes a novel framework for efficient spectral BTF acquisition and reconstruction. The framework acquires red-green-blue (RGB) BTF images and just one spectral image. The full spectral BTFs are reconstructed by fusing the RGB and spectral images based on nonnegative matrix factorization (NMF). Experimental results indicate that the accuracy of spectral reflectance reconstruction is higher than that of existing algorithms. With the reconstructed spectral BTFs, the material appearance can be reproduced with high fidelity under various illumination conditions.

[1]  Masahiro Yamaguchi,et al.  Spectral reflectance estimation from multi-band image using color chart , 2001 .

[2]  Chao Liu,et al.  Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  H Haneishi,et al.  System design for accurately estimating the spectral reflectance of art paintings. , 2000, Applied optics.

[4]  Reinhard Klein,et al.  Compression and Real-Time Rendering of Measured BTFs Using Local PCA , 2003, VMV.

[5]  Hyunsoo Kim,et al.  Nonnegative Matrix Factorization Based on Alternating Nonnegativity Constrained Least Squares and Active Set Method , 2008, SIAM J. Matrix Anal. Appl..

[6]  L. Maloney.  Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[7]  Reinhard Klein,et al.  Rapid Synchronous Acquisition of Geometry and Appearance of Cultural Heritage Artefacts , 2005, VAST.

[8]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[9]  M. Koudelka,et al.  Acquisition , Compression , and Synthesis of Bidirectional Texture Functions , 2003 .

[10]  Glenn Healey,et al.  Using reflectance models for color scanner calibration. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Matthew Anderson,et al.  Proposal for a Standard Default Color Space for the Internet - sRGB , 1996, CIC.

[12]  N. Shimano,et al.  Recovery of spectral reflectances of objects being imaged without prior knowledge , 2006, IEEE Transactions on Image Processing.

[13]  Ralf Sarlette,et al.  Groundtruth Data for Multispectral Bidirectional Texture Functions , 2010, CGIV/MCS.

[14]  Zen-Chung Shih,et al.  K-clustered tensor approximation: A sparse multilinear model for real-time rendering , 2012, TOGS.

[15]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[16]  A. I. Negueruela,et al.  Use of three tristimulus values from surface reflectance spectra to calculate the principal components for reconstructing these spectra by using only three eigenvectors. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[18]  Hui-Liang Shen,et al.  Spectral characterization of a color scanner based on optimized adaptive estimation. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Jong-Il Park,et al.  Fast model-based multispectral imaging using nonnegative principal component analysis. , 2012, Optics letters.

[20]  Daniel Lyssi.  A reflectometer setup for spectral BTF measurement , 2009 .

[21]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[22]  Ralf Sarlette,et al.  Efficient and Realistic Visualization of Cloth , 2003, Rendering Techniques.

[23]  Hui-Liang Shen,et al.  Multispectral Image Out-of-Focus Deblurring Using Interchannel Correlation , 2015, IEEE Transactions on Image Processing.

[24]  Donald P. Greenberg,et al.  A comprehensive physical model for light reflection , 1991, SIGGRAPH.

[25]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[26]  Wei Wang,et al.  Autofocus for multispectral camera using focus symmetry. , 2012, Applied optics.

[27]  Jirí Filip,et al.  Rapid Material Appearance Acquisition Using Consumer Hardware , 2014, Sensors.

[28]  Changjun Li,et al.  Characterization of trichromatic color cameras by using a new multispectral imaging technique. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  Hui-Liang Shen,et al.  Improved reflectance reconstruction for multispectral imaging by combining different techniques. , 2007, Optics express.

[30]  Réjean Baribeau,et al.  Development of a robot-based gonioreflectometer for spectral BRDF measurement , 2009 .

[31]  Gino van den Bergen.  Efficient Collision Detection of Complex Deformable Models using AABB Trees , 1997, J. Graphics, GPU, & Game Tools.

[32]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[33]  Peter A. Rhodes,et al.  A study of digital camera colorimetric characterisation based on polynomial modelling , 2001 .

[34]  Roy S. Berns,et al.  A review of principal component analysis and its applications to color technology , 2005 .

[35]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[36]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Amnon Shashua,et al.  Nonnegative Sparse PCA , 2006, NIPS.

[38]  Hui-Liang Shen,et al.  Reflectance reconstruction for multispectral imaging by adaptive Wiener estimation. , 2007, Optics express.

[39]  Duck Bong Kim,et al.  Acquisition and representation of pearlescent paints using an image-based goniospectrophotometer , 2010 .