Multispectral camera as spatio-spectrophotometer under uncontrolled illumination.

Multispectral constancy enables the illuminant invariant representation of multi-spectral data. This article proposes an experimental investigation of multispectral constancy through the use of multispectral camera as a spectrophotometer for the reconstruction of surface reflectance. Three images with varying illuminations are captured and the spectra of material surfaces is reconstructed. The acquired images are transformed into canonical representation through the use of diagonal transform and spectral adaptation transform. Experimental results show that use of multispectral constancy is beneficial for both filter-wheel and snapshot multi-spectral cameras. The proposed concept is robust to errors in illuminant estimation and is able to perform well with linear spectral reconstruction method. This work makes us one step closer to the use of multispectral imaging for computer vision.

[1]  J. Hernández-Andrés,et al.  Illuminant spectrum estimation at a pixel. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Keigo Hirakawa,et al.  Single-shot multispectral imager using spatially multiplexed Fourier spectral filters , 2018 .

[3]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[4]  Kinjiro Amano,et al.  Recovering spectral data from natural scenes with an RGB digital camera and colored filters , 2007 .

[5]  Jon Yngve Hardeberg,et al.  Illuminant estimation in multispectral imaging. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Hui-Liang Shen,et al.  Reflectance reconstruction for multispectral imaging by adaptive Wiener estimation. , 2007, Optics express.

[7]  J. Hernández-Andrés,et al.  Color and spectral analysis of daylight in southern Europe. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Javier Hernández-Andrés,et al.  Optimum sensors for color constancy in scenes illuminated by daylight. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[10]  Jon Yngve Hardeberg,et al.  Spectrogenic imaging: a novel approach to multispectral imaging in an uncontrolled environment. , 2014, Optics express.

[11]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[12]  Jon Yngve Hardeberg,et al.  Spectral Adaptation Transform for Multispectral Constancy , 2018 .

[13]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[14]  Hideaki Haneishi,et al.  Spectral reflectance estimation of ancient mexican codices, multispectral images approach , 2004 .

[15]  Jon Y. Hardeberg,et al.  Multispectral Constancy Based on Spectral Adaptation Transform , 2017, SCIA.

[16]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[17]  Brian V. Funt,et al.  A data set for color research , 2002 .

[18]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[19]  J. Parkkinen,et al.  Characteristic spectra of Munsell colors , 1989 .

[20]  Stephen Westland,et al.  Recovering spectral information using digital camera systems , 2001 .

[21]  Jon Yngve Hardeberg,et al.  Spatial arrangement of color filter array for multispectral image acquisition , 2011, Electronic Imaging.

[22]  Til Aach,et al.  Multispectral filter wheel cameras: modeling aberrations for filters in front of lens , 2011, Electronic Imaging.

[23]  J. Hernández-Andrés,et al.  Extending "color constancy" outside the visible region. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Johannes Brauers,et al.  Multispectral Filter-Wheel Cameras: Geometric Distortion Model and Compensation Algorithms , 2008, IEEE Transactions on Image Processing.

[25]  Jon Y. Hardeberg,et al.  HyTexiLa: High Resolution Visible and Near Infrared Hyperspectral Texture Images , 2018, Sensors.