Reflective and Fluorescent Separation Under Narrow-Band Illumination

In this paper, we address the separation of reflective and fluorescent components in RGB images taken under narrow-band light sources such as LEDs. First, we show that the fluorescent color per pixel can be estimated from at least two images under different light source colors, because the observed color at a surface point is represented by a convex combination of the light source color and the illumination-invariant fluorescent color. Second, we propose a method for robustly estimating the fluorescent color via MAP estimation by taking the prior knowledge with respect to fluorescent colors into consideration. We conducted a number of experiments by using both synthetic and real images, and confirmed that our proposed method works better than the closely related state-of-the-art method and enables us to separate reflective and fluorescent components even from a single image. Furthermore, we demonstrate that our method is effective for applications such as image-based material editing and relighting.

[1]  Takahiro Okabe,et al.  Simultaneous Estimation of Spectral Reflectance and Normal from a Small Number of Images , 2015, VISAPP.

[2]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[3]  David J. Kriegman,et al.  Shape from Fluorescence , 2012, ECCV.

[4]  Stephen H. Westin,et al.  Image-based bidirectional reflectance distribution function measurement. , 2000, Applied optics.

[5]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Takahiro Okabe,et al.  Camera spectral sensitivity estimation from a single image under unknown illumination by using fluorescence , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Kobus Barnard.  Color Constancy with Fluorescent Surfaces , 1999, Color Imaging Conference.

[9]  Amit Gupta,et al.  Spectral imaging microscopy web sites and data , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[10]  Takahiro Okabe,et al.  Separating Reflective and Fluorescent Components Using High Frequency Illumination in the Spectral Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chao Liu,et al.  Discriminative illumination: Per-pixel classification of raw materials based on optimal projections of spectral BRDF , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Takahiro Okabe,et al.  Reflectance and Fluorescence Spectral Recovery via Actively Lit RGB Images , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  A. Glassner.  A Model for Fluorescence and Phosphorescence , 1995 .

[14]  R Donaldson,et al.  Spectrophotometry of fluorescent pigments , 1954 .

[15]  Chao Liu,et al.  Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[17]  Imari Sato,et al.  Image-Based Separation of Reflective and Fluorescent Components Using Illumination Variant and Invariant Color , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  S. J.P..  Characteristic spectra of Munsell colors , 2002 .

[19]  Werner Purgathofer,et al.  A reflectance model for diffuse fluorescent surfaces , 2006, GRAPHITE '06.

[20]  Hendrik P. A. Lensch,et al.  Compressive Higher-order Sparse and Low-Rank Acquisition with a Hyperspectral Light Stage , 2012 .

[21]  David M. Jameson,et al.  Introduction to Fluorescence , 2014 .

[22]  H. Seidel,et al.  Fluorescent immersion range scanning , 2008, ACM Trans. Graph..

[23]  Andrew Jones,et al.  Practical multispectral lighting reproduction , 2016, ACM Trans. Graph..

[24]  Takahiro Okabe,et al.  Bispectral photometric stereo based on fluorescence , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Sabine Süsstrunk,et al.  What is the space of spectral sensitivity functions for digital color cameras? , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[26]  Hans-Peter Seidel,et al.  Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions , 2010, ACM Trans. Graph..