Towards Highlight Based Illuminant Estimation in Multispectral Images

We review the physics based illuminant estimation methods, which extract information from highlights in images. Such highlights are caused by specular reflection from the surface of dielectric materials, and according to the dichromatic reflection model, provide cues about the illumination. This paper analyzes different categories of highlight based illuminant estimation techniques for color images from the point of view of their extension to multispectral imaging. We find that the use of chromaticity space for multispectral imaging is not straightforward and imposing constraints on illuminants in the multispectral imaging domain may not be efficient either. We identify some methods that are feasible for extension to multispectral imaging, and discuss the advantage of using highlight information for illuminant estimation.

[1]  Yun-Tae Kim,et al.  Illumination estimation based on valid pixel selection in highlight region , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Stephen Lin,et al.  Separation of diffuse and specular reflection in color images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Takahiko Horiuchi,et al.  Estimation of multiple light sources from specular highlights , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[5]  Jon Y. Hardeberg,et al.  Analytical Survey of Highlight Detection in Color and Spectral Images , 2017, CCIW.

[6]  Djemel Ziou,et al.  Computational color constancy from maximal projections mean assumption , 2017, Multimedia Tools and Applications.

[7]  Marc Ebner,et al.  On Determining the Color of the Illuminant Using the Dichromatic Reflection Model , 2005, DAGM-Symposium.

[8]  Lilong Shi,et al.  Dichromatic Illumination Estimation via Hough Transforms in 3D , 2008, CGIV/MCS.

[9]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[11]  Javier Toro,et al.  A Multilinear Constraint on Dichromatic Planes for Illumination Estimation , 2007, IEEE Transactions on Image Processing.

[12]  Jon Yngve Hardeberg,et al.  Spectral Adaptation Transform for Multispectral Constancy , 2018 .

[13]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[14]  Yeong-Ho Ha,et al.  Estimation of illuminant chromaticity from single color image using Perceived Illumination and Highlight , 2001 .

[15]  Jon Y. Hardeberg,et al.  Multispectral Constancy Based on Spectral Adaptation Transform , 2017, SCIA.

[16]  Cong Phuoc Huynh,et al.  A Solution of the Dichromatic Model for Multispectral Photometric Invariance , 2010, International Journal of Computer Vision.

[17]  Keita Hirai,et al.  Estimation of Two Illuminant Spectral Power Distributions from Highlights of Overlapping Illuminants , 2013, 2013 International Conference on Signal-Image Technology & Internet-Based Systems.

[18]  T M Lehmann,et al.  Color line search for illuminant estimation in real-world scenes. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Christian Riess,et al.  Illuminant color estimation for real-world mixed-illuminant scenes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[20]  Ze-Nian Li,et al.  Illumination and Reflectance Spectra Separation of Hyperspectral Image Data under Multiple Illumination Conditions , 2017, Color Imaging: Displaying, Processing, Hardcopy, and Applications.

[21]  Kenji Hara,et al.  Variational estimation of inhomogeneous specular reflectance and illumination from a single view. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Mansour Moniri,et al.  Specular-based illumination estimation using blind signal separation techniques , 2012 .

[23]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[24]  Takahiko Horiuchi,et al.  Estimation of Multiple Illuminants Based on Specular Highlight Detection , 2011, CCIW.

[25]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gerald Schaefer,et al.  Solving for Colour Constancy using a Constrained Dichromatic Reflection Model , 2001, International Journal of Computer Vision.

[27]  Hsien-Che Lee,et al.  Auto white balance by surface reflection decomposition. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Hsien-Che Lee,et al.  Modeling Light Reflection for Computer Color Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Julie Delon,et al.  Illuminant Estimation from Projections on the Planckian Locus , 2012, ECCV Workshops.

[30]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[31]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[32]  Qionghai Dai,et al.  Illumination estimation from specular highlight in a multi-spectral image. , 2015, Optics express.

[33]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  Gerald Schaefer.  Robust Dichromatic Colour Constancy , 2004, ICIAR.

[35]  Jon Yngve Hardeberg,et al.  Illuminant estimation in multispectral imaging. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Yoichi Sato,et al.  Illumination and reflectance spectra separation of a hyperspectral image meets low-rank matrix factorization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Shigeru Kuriyama,et al.  Estimation of multiple illuminant colors using color lines of single image , 2017, 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA).

[38]  Mark S. Drew,et al.  The Zeta-image, illuminant estimation, and specularity manipulation , 2014, Comput. Vis. Image Underst..

[39]  Javier Toro.  Dichromatic illumination estimation without pre-segmentation , 2008, Pattern Recognit. Lett..

[40]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .