Formalizations of the retinex model and its variants with variational principles and partial differential equations

Abstract. Land and McCann introduced the retinex model as a computational theory of color vision. However, retinex details were described algorithmically rather than mathematically. Soon after the birth of retinex, Horn proposed a drastic simplification of the model, which, however, had the merit of being mathematically explicit and rigorous. As a consequence, at least two different interpretations of retinex appeared in the literature almost at the same time. This generated a lot of confusion about the name retinex that persists even now. The aim of this paper is to present an overview about the different interpretations and the corresponding mathematical formalizations of retinex in terms of variational principles and partial differential equations.

[1]  Roberto Cordone,et al.  On edge-aware path-based color spatial sampling for Retinex: from Termite Retinex to Light Energy-driven Termite Retinex , 2017, J. Electronic Imaging.

[2]  Alessandro Rizzi,et al.  Termite Retinex: a new implementation based on a colony of intelligent agents , 2014, J. Electronic Imaging.

[3]  Carlo Gatta,et al.  A Spatially Variant White-Patch and Gray-World Method for Color Image Enhancement Driven by Local Contrast , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Alessandro Rizzi,et al.  GRASS: A Gradient-Based Random Sampling Scheme for Milano Retinex , 2017, IEEE Transactions on Image Processing.

[5]  Edoardo Provenzi,et al.  A Wavelet Perspective on Variational Perceptually-Inspired Color Enhancement , 2013, International Journal of Computer Vision.

[6]  Alessandro Rizzi,et al.  Energy-driven path search for Termite Retinex. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Sven Loncaric,et al.  Light Random Sprays Retinex: Exploiting the Noisy Illumination Estimation , 2013, IEEE Signal Processing Letters.

[8]  G. Sapiro,et al.  Histogram Modification via Differential Equations , 1997 .

[9]  Alessandro Rizzi,et al.  A computational approach to color adaptation effects , 2000, Image Vis. Comput..

[10]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[11]  Ernesto Damiani,et al.  A Retinex model based on Absorbing Markov Chains , 2016, Inf. Sci..

[12]  Carlo Gatta,et al.  A new algorithm for unsupervised global and local color correction , 2003, Pattern Recognit. Lett..

[13]  John J. McCann,et al.  Retinex in Matlab , 2000, CIC.

[14]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[15]  Edoardo Provenzi,et al.  SLMRACE: a noise-free RACE implementation with reduced computational time , 2017, J. Electronic Imaging.

[16]  Alessandro Rizzi,et al.  Spatio-Temporal Retinex-Inspired Envelope with Stochastic Sampling: A Framework for Spatial Color Algorithms , 2011 .

[17]  Edoardo Provenzi.  Computational Color Science: Variational Retinex-like Methods , 2017 .

[18]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[19]  Jean-Michel Morel,et al.  A PDE Formalization of Retinex Theory , 2010, IEEE Transactions on Image Processing.

[20]  Alessandro Rizzi,et al.  A population-based approach to point-sampling spatial color algorithms. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Edoardo Provenzi,et al.  Issues About Retinex Theory and Contrast Enhancement , 2009, International Journal of Computer Vision.

[22]  Alessandro Rizzi,et al.  Mathematical definition and analysis of the retinex algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[24]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[25]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[26]  Ivar Farup,et al.  Spatio-Temporal Retinex-like Envelope with Total Variation , 2012, CGIV.

[27]  Alessandro Rizzi,et al.  Perceptual Color Correction Through Variational Techniques , 2007, IEEE Transactions on Image Processing.

[28]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[29]  Julie Delon,et al.  On the second order spatiochromatic structure of natural images , 2016, Vision Research.

[30]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[31]  Edoardo Provenzi,et al.  A Perceptually Inspired Variational Framework for Color Enhancement , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Farhan A. Baqai,et al.  Analysis and extensions of the Frankle-McCann Retinex algorithm , 2004, J. Electronic Imaging.

[33]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[34]  Alessandro Rizzi,et al.  QBRIX: a quantile-based approach to retinex. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  Alessandro Rizzi,et al.  Random Spray Retinex: A New Retinex Implementation to Investigate the Local Properties of the Model , 2007, IEEE Transactions on Image Processing.

[36]  Nikola Banić,et al.  Smart light random memory sprays Retinex: a fast Retinex implementation for high-quality brightness adjustment and color correction. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[37]  Edoardo Provenzi,et al.  An Algorithmic Analysis of Variational Models for Perceptual Local Contrast Enhancement , 2015, Image Process. Line.

[38]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[39]  Alessandro Rizzi,et al.  A fuzzy set approach to Retinex spray sampling , 2017, Multimedia Tools and Applications.

[40]  G. Gronchi,et al.  A variational model for context-driven effects in perception and cognition , 2017 .