Separating Reflective and Fluorescent Components Using High Frequency Illumination in the Spectral Domain

Hyper spectral imaging is beneficial to many applications but current methods do not consider fluorescent effects which are present in everyday items ranging from paper, to clothing, to even our food. Furthermore, everyday fluorescent items exhibit a mix of reflectance and fluorescence. So proper separation of these components is necessary for analyzing them. In this paper, we demonstrate efficient separation and recovery of reflective and fluorescent emission spectra through the use of high frequency illumination in the spectral domain. With the obtained fluorescent emission spectra from our high frequency illuminants, we then present to our knowledge, the first method for estimating the fluorescent absorption spectrum of a material given its emission spectrum. Conventional bispectral measurement of absorption and emission spectra needs to examine all combinations of incident and observed light wavelengths. In contrast, our method requires only two hyper spectral images. The effectiveness of our proposed methods are then evaluated through a combination of simulation and real experiments. We also demonstrate an application of our method to synthetic relighting of real scenes.

[1]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[2]  Hans-Peter Seidel,et al.  Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions , 2010, SIGGRAPH 2010.

[3]  Rafael Yuste,et al.  Fluorescence microscopy today , 2005, Nature Methods.

[4]  Shoji Tominaga,et al.  MULTICHANNEL VISION SYSTEM FOR ESTIMATING SURFACE AND ILLUMINATION FUNCTIONS , 1996 .

[5]  Shree K. Nayar,et al.  Removal of specularities using color and polarization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  F. J. Holler,et al.  Principles of Instrumental Analysis , 1973 .

[7]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[8]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[9]  Takahiro Okabe,et al.  Bispectral photometric stereo based on fluorescence , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[11]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[13]  Felipe Orihuela-Espina,et al.  Quantitative analysis of multi-spectral fundus images , 2006, Medical Image Anal..

[14]  Jan Kautz,et al.  Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions , 2009 .

[15]  A. Springsteen,et al.  Introduction to measurement of color of fluorescent materials , 1999 .

[16]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  David J. Kriegman,et al.  Shape from Fluorescence , 2012, ECCV.

[18]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[19]  Kobus Barnard.  Color Constancy with Fluorescent Surfaces , 1999, Color Imaging Conference.

[20]  Amit Gupta,et al.  Spectral imaging microscopy web sites and data , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[21]  Takahiko Horiuchi,et al.  Spectral Estimation of Fluorescent Objects Using Visible Lights and an Imaging Device , 2011, Color Imaging Conference.

[22]  Imari Sato,et al.  Separating reflective and fluorescent components of an image , 2011, CVPR 2011.

[23]  Mark D. Fairchild,et al.  Full-Spectral Color Calculations in Realistic Image Synthesis , 1999, IEEE Computer Graphics and Applications.

[24]  Bore-Kuen Lee,et al.  Spectral estimation and color appearance prediction of fluorescent materials , 2001 .

[25]  Yoav Y. Schechner,et al.  Multiplexed fluorescence unmixing , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[26]  Nicolas Papadakis,et al.  A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value , 2003 .

[27]  Moshe Ben-Ezra,et al.  Multi-Spectral Imaging by Optimized Wide Band Illumination , 2008, International Journal of Computer Vision.