Improving Color Reproduction Accuracy on Cameras

One of the key operations performed on a digital camera is to map the sensor-specific color space to a standard perceptual color space. This procedure involves the application of a white-balance correction followed by a color space transform. The current approach for this colorimetric mapping is based on an interpolation of pre-calibrated color space transforms computed for two fixed illuminations (i.e., two white-balance settings). Images captured under different illuminations are subject to less color accuracy due to the use of this interpolation process. In this paper, we discuss the limitations of the current colorimetric mapping approach and propose two methods that are able to improve color accuracy. We evaluate our approach on seven different cameras and show improvements of up to 30% (DSLR cameras) and 59% (mobile phone cameras) in terms of color reproduction error.

[1]  Ayan Chakrabarti,et al.  Color Constancy by Learning to Predict Chromaticity from Luminance , 2015, NIPS.

[2]  Maryam M. Darrodi,et al.  The Alternating Least Squares Technique for Nonuniform Intensity Color Correction , 2015 .

[3]  A. Robertson.  Computation of Correlated Color Temperature and Distribution Temperature , 1968 .

[4]  Michal Mackiewicz,et al.  Color Correction Using Root-Polynomial Regression , 2015, IEEE Transactions on Image Processing.

[5]  Michael S. Brown,et al.  A Software Platform for Manipulating the Camera Imaging Pipeline , 2016, ECCV.

[6]  Steven J. Gortler,et al.  The von Kries Hypothesis and a Basis for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Graham D. Finlayson,et al.  The Reproduction Angular Error for Evaluating the Performance of Illuminant Estimation Algorithms , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jonathan T. Barron,et al.  Convolutional Color Constancy , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Mark S. Drew,et al.  Color constancy: enhancing von Kries adaption via sensor transformations , 1993, Electronic Imaging.

[10]  Michael S. Brown,et al.  Effective learning-based illuminant estimation using simple features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Brian V. Funt,et al.  Simplifying irradiance independent color calibration , 2014, Electronic Imaging.

[12]  Joost van de Weijer,et al.  Generalized Gamut Mapping using Image Derivative Structures for Color Constancy , 2008, International Journal of Computer Vision.

[13]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W.E. Snyder,et al.  Color image processing pipeline , 2005, IEEE Signal Processing Magazine.

[15]  Michael S. Brown,et al.  Beyond White: Ground Truth Colors for Color Constancy Correction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Joseph Ernest Petavel,et al.  The colorimetric properties of the spectrum , 1931 .

[17]  Stephen Lin,et al.  FC^4: Fully Convolutional Color Constancy with Confidence-Weighted Pooling , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[19]  Michael S. Brown,et al.  RAW Image Reconstruction Using a Self-Contained sRGB-JPEG Image with Only 64 KB Overhead , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Arcangelo Bruna,et al.  Color space transformations for digital photography exploiting information about the illuminant estimation process. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Peter A. Rhodes,et al.  A study of digital camera colorimetric characterisation based on polynomial modelling , 2001 .

[22]  Mark S. Drew,et al.  Diagonal transforms suffice for color constancy , 1993, 1993 (4th) International Conference on Computer Vision.

[23]  Ayan Chakrabarti,et al.  An Empirical Camera Model for Internet Color Vision , 2009, BMVC.

[24]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[25]  Yun-Ta Tsai,et al.  Fast Fourier Color Constancy , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Robert B. Fisher,et al.  Color Homography Color Correction , 2016, ArXiv.

[27]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[28]  Brian V. Funt,et al.  A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data , 2002, IEEE Trans. Image Process..

[29]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  William R. Mathew,et al.  Color as a Science , 2005 .

[31]  Xiaoou Tang,et al.  Deep Specialized Network for Illuminant Estimation , 2016, ECCV.

[32]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[33]  Peter F. Sturm,et al.  Radiometric calibration using photo collections , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[34]  Seoung Wug Oh,et al.  Approaching the computational color constancy as a classification problem through deep learning , 2016, Pattern Recognit..

[35]  Trevor Darrell,et al.  From pixels to physics: Probabilistic color de-rendering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Kevin E. Spaulding,et al.  Reference Input/Output Medium Metric RGB Color Encoding (RIMM/ROMM RGB) , 2000, PICS.

[37]  Claudio Cusano,et al.  Single and Multiple Illuminant Estimation Using Convolutional Neural Networks , 2015, IEEE Transactions on Image Processing.

[38]  Dilip K Prasad,et al.  Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.