Flash Lightens Gray Pixe

In the real world, a scene is usually cast by multiple illuminants and herein we address the problem of spatial illumination estimation. Our solution is based on detecting gray pixels with the help of flash photography. We show that flash photography significantly improves the performance of gray pixel detection without illuminant prior, training data or calibration of the flash. We also introduce a novel flash photography dataset generated from the MIT intrinsic dataset.

[1]  Frédo Durand,et al.  Light mixture estimation for spatially varying white balance , 2008, ACM Trans. Graph..

[2]  D. Foster.  Color constancy , 2011, Vision Research.

[3]  Jiri Matas,et al.  Recurrent Color Constancy , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[5]  Kai-Fu Yang,et al.  Efficient illuminant estimation for color constancy using grey pixels , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Feng Xiao,et al.  Illuminating Illumination , 2001, CIC.

[7]  Stephen Lin,et al.  FC^4: Fully Convolutional Color Constancy with Confidence-Weighted Pooling , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[9]  Frédo Durand,et al.  User-guided white balance for mixed lighting conditions , 2012, ACM Trans. Graph..

[10]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[11]  Jiri Matas,et al.  Deep structured-output regression learning for computational color constancy , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[12]  Mark S. Drew,et al.  Exemplar-Based Color Constancy and Multiple Illumination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Graham D Finlayson,et al.  Colour and illumination in computer vision , 2018, Interface Focus.

[14]  Jiri Matas,et al.  On Finding Gray Pixels , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Marc Pollefeys,et al.  A Dataset of Flash and Ambient Illumination Pairs from the Crowd , 2018, ECCV.

[17]  Jiri Matas,et al.  Revisiting Gray Pixel for Statistical Illumination Estimation , 2019, VISIGRAPP.

[18]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[19]  Aswin C. Sankaranarayanan,et al.  White balance under mixed illumination using flash photography , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[20]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[21]  Christian Riess,et al.  Illuminant color estimation for real-world mixed-illuminant scenes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).