A Local Flatness Based Variational Approach to Retinex

A topic of continued interest in Retinex over the years has been finding ways to implement it with computational models of improved accuracy and efficiency. We have devised a new approach to digitally implementing the Retinex using a local deviation based variational model. The new model leads to improvements in the computed image quality with respect to illumination correction and image enhancement. Several contributions are made: 1) a new prior constraint, which we call local flatness, is proposed, and a new measure of Local Deviation (LD) is developed to quantify the degree of local illumination flatness; 2) a variational problem is defined and the solution is found by a logical sequence of steps; 3) discrete implementation of the variational solution is shown to effectively estimate and remove uneven illumination, yielding an accurate recovered image. Unlike other physical prior based variational Retinex models, which use the L2 norm of the illumination gradient to enforce smoothness of illumination, our LD prior selectively imposes local flatness on illumination by calculating the deviation between the estimated illumination surface to a reference plane. In the experiments, pseudo ground truth images are created by superimposing uneven illumination on real scenes, providing an effective way to objectively assess algorithm performance. The experimental results show that our method can reconstruct more accurate recovered images than other state-of-the-art methods, while maintaining good contrast.

[1]  Michela Lecca,et al.  STAR: A Segmentation-Based Approximation of Point-Based Sampling Milano Retinex for Color Image Enhancement , 2018, IEEE Transactions on Image Processing.

[2]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[3]  John J. McCann,et al.  Retinex in Matlab , 2000, CIC.

[4]  Carlo Gatta,et al.  A new algorithm for unsupervised global and local color correction , 2003, Pattern Recognit. Lett..

[5]  Aichi Chien,et al.  An L1-based variational model for Retinex theory and its application to medical images , 2011, CVPR 2011.

[6]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[7]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[8]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[9]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Jean-Michel Morel,et al.  Multiscale Retinex , 2014, Image Process. Line.

[11]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2002, IS&T/SPIE Electronic Imaging.

[12]  Jean-Michel Morel,et al.  Retinex Poisson Equation: a Model for Color Perception , 2011, Image Process. Line.

[13]  Edoardo Provenzi,et al.  Formalizations of the retinex model and its variants with variational principles and partial differential equations , 2017, J. Electronic Imaging.

[14]  Edoardo Provenzi,et al.  An Algorithmic Analysis of Variational Models for Perceptual Local Contrast Enhancement , 2015, Image Process. Line.

[15]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[16]  Alessandro Rizzi,et al.  Spatio-Temporal Retinex-Inspired Envelope with Stochastic Sampling: A Framework for Spatial Color Algorithms , 2011 .

[17]  Edoardo Provenzi Computational Color Science: Variational Retinex-like Methods , 2017 .

[18]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[19]  Edoardo Provenzi,et al.  Issues About Retinex Theory and Contrast Enhancement , 2009, International Journal of Computer Vision.

[20]  D Marr,et al.  The computation of lightness by the primate retina. , 1974, Vision research.

[21]  Alessandro Rizzi,et al.  Perceptual Color Correction Through Variational Techniques , 2007, IEEE Transactions on Image Processing.

[22]  Gang Luo,et al.  Naturalness Preserved Image Enhancement Using a Priori Multi-Layer Lightness Statistics , 2018, IEEE Transactions on Image Processing.

[23]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[24]  Edoardo Provenzi,et al.  A Perceptually Inspired Variational Framework for Color Enhancement , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Stanley Osher,et al.  Non-Local Retinex - A Unifying Framework and Beyond , 2015, SIAM J. Imaging Sci..

[26]  A Hurlbert,et al.  Formal connections between lightness algorithms. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[27]  Alessandro Rizzi,et al.  GREAT: a gradient-based color-sampling scheme for Retinex. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[29]  S. Osher,et al.  A TV Bregman iterative model of Retinex theory , 2012 .

[30]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[31]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[33]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  K. Hohn,et al.  Determining Lightness from an Image , 2004 .

[35]  Stefano Messelodi,et al.  SuPeR: Milano Retinex implementation exploiting a regular image grid. , 2019, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Sven Loncaric,et al.  Light Random Sprays Retinex: Exploiting the Noisy Illumination Estimation , 2013, IEEE Signal Processing Letters.

[37]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[38]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.

[39]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[40]  Jean-Michel Morel,et al.  A PDE Formalization of Retinex Theory , 2010, IEEE Transactions on Image Processing.

[41]  Carlo Gatta,et al.  A Spatially Variant White-Patch and Gray-World Method for Color Image Enhancement Driven by Local Contrast , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Edoardo Provenzi,et al.  A Wavelet Perspective on Variational Perceptually-Inspired Color Enhancement , 2013, International Journal of Computer Vision.

[43]  Alessandro Rizzi,et al.  A computational approach to color adaptation effects , 2000, Image Vis. Comput..

[44]  Soo-Chang Pei,et al.  Uneven illumination removal and image enhancement using empirical mode decomposition , 2013, J. Electronic Imaging.

[45]  Lao Dazhong On the Variational Problems of the Complete Functional , 2006 .

[46]  Alessandro Rizzi,et al.  Random Spray Retinex: A New Retinex Implementation to Investigate the Local Properties of the Model , 2007, IEEE Transactions on Image Processing.

[47]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.