Light mixture estimation for spatially varying white balance

White balance is a crucial step in the photographic pipeline. It ensures the proper rendition of images by eliminating color casts due to differing illuminants. Digital cameras and editing programs provide white balance tools that assume a single type of light per image, such as daylight. However, many photos are taken under mixed lighting. We propose a white balance technique for scenes with two light types that are specified by the user. This covers many typical situations involving indoor/outdoor or flash/ambient light mixtures. Since we work from a single image, the problem is highly underconstrained. Our method recovers a set of dominant material colors which allows us to estimate the local intensity mixture of the two light types. Using this mixture, we can neutralize the light colors and render visually pleasing images. Our method can also be used to achieve post-exposure relighting effects.

[1]  Theo Gevers,et al.  Color Constancy using Natural Image Statistics , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[3]  Marc Ebner,et al.  Color Constancy Using Local Color Shifts , 2004, ECCV.

[4]  Michael Werman,et al.  Color lines: image specific color representation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[6]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[7]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, ACM Trans. Graph..

[8]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[9]  Joost van de Weijer,et al.  Color constancy based on the Grey-edge hypothesis , 2005, IEEE International Conference on Image Processing 2005.

[10]  Steven J. Gortler,et al.  The von Kries Hypothesis and a Basis for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Graham D. Finlayson,et al.  Color constancy in diagonal chromaticity space , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Brian V. Funt,et al.  Color Constancy for Scenes with Varying Illumination , 1997, Comput. Vis. Image Underst..

[13]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[14]  Katsushi Ikeuchi,et al.  Consistent surface color for texturing large objects in outdoor scenes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  M. Werman,et al.  Color lines: image specific color representation , 2004, CVPR 2004.

[16]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Graham D. Finlayson,et al.  Improving gamut mapping color constancy , 2000, IEEE Trans. Image Process..

[19]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.