Measuring Spectral Reflectance and 3D Shape Using Multi-primary Image Projector

This paper presents a method to measure spectral reflectance and 3D shape of an object. For realizing these measurements, we applied a multi-primary image projector as a computational illumination system. This multi-primary image projector employs a light source which is programmable and can reproduce any spectral power distributions. In other words, the projector can reproduce 2D pattern projections with arbitrary spectra. In our actual measurements, we developed an imaging system by synchronizing the multi-primary image projector and a highspeed monochrome camera. First, the surface spectral reflectance of an object in a darkroom was obtained based on a finite-dimensional linear model of spectral reflectances. In the spectral reflectance measurements, nine basis images were projected and captured by the synchronized imaging system. Then spectral reflectance at each camera image coordinate was estimated from the captured nine images. Next, structured lights were projected for reconstructing 3D shape. We applied eight binary image projections and a conventional 3D shape reconstruction algorithm to our study. In summary, seventeen images were projected and captured for measuring spectral reflectance and 3D shape. The projection and capturing speed of the seventeen images is 0.085 s on the system specification. In the validation experiments, we could obtain spectral reflectance of X-rite ColorChecker with the average color difference \(\varDelta E_{ab}^{*}\) of approximately 4. We also confirmed that precise 3D shapes could be reconstructed by our method.

[1]  Keita Hirai,et al.  Development of a Dynamic Relighting System for Moving Planar Objects with Unknown Reflectance , 2015, CCIW.

[2]  Kunihiro Chihara,et al.  Three dimensional measurement using color structured patterns and imaging spectrograph , 2002, Object recognition supported by user interaction for service robots.

[3]  Javier Hernández-Andrés,et al.  Linear bases for representation of natural and artificial illuminants , 1997 .

[4]  Norimichi Tsumura,et al.  Development of goniophotometric imaging system for recording reflectance spectra of 3D objects , 2001, IS&T/SPIE Electronic Imaging.

[5]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[6]  Shoji Tominaga,et al.  Spectral image acquisition, analysis, and rendering for art paintings , 2008, J. Electronic Imaging.

[7]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[8]  Takahiko Horiuchi,et al.  Spectral imaging by synchronizing capture and illumination. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Keita Hirai,et al.  Multi-primary image projector using programmable spectral light source , 2016 .

[10]  Robert Sitnik,et al.  Archiving shape and appearance of cultural heritage objects using structured light projection and multispectral imaging , 2012 .

[11]  Keita Hirai,et al.  Photometric and geometric measurements based on multi-primary image projector , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[12]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[13]  Franck Marzani,et al.  Toward a 3D Multispectral Scanner: An Application to Multimedia , 2007, IEEE MultiMedia.

[14]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[15]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[17]  Franck Marzani,et al.  Registration of 3D and Multispectral Data for the Study of Cultural Heritage Surfaces , 2013, Sensors.

[18]  Ko Nishino,et al.  Shape and Reflectance from Natural Illumination , 2012, ECCV.

[19]  Keita Hirai,et al.  An LED-Based Spectral Imaging System for Surface Reflectance and Normal Estimation , 2013, 2013 International Conference on Signal-Image Technology & Internet-Based Systems.

[20]  Takahiro Okabe,et al.  Fast Spectral Reflectance Recovery Using DLP Projector , 2010, International Journal of Computer Vision.