Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model

Low-light image enhancement methods based on classic Retinex model attempt to manipulate the estimated illumination and to project it back to the corresponding reflectance. However, the model does not consider the noise, which inevitably exists in images captured in low-light conditions. In this paper, we propose the robust Retinex model, which additionally considers a noise map compared with the conventional Retinex model, to improve the performance of enhancing low-light images accompanied by intensive noise. Based on the robust Retinex model, we present an optimization function that includes novel regularization terms for the illumination and reflectance. Specifically, we use $\ell _{1}$ norm to constrain the piece-wise smoothness of the illumination, adopt a fidelity term for gradients of the reflectance to reveal the structure details in low-light images, and make the first attempt to estimate a noise map out of the robust Retinex model. To effectively solve the optimization problem, we provide an augmented Lagrange multiplier based alternating direction minimization algorithm without logarithmic transformation. Experimental results demonstrate the effectiveness of the proposed method in low-light image enhancement. In addition, the proposed method can be generalized to handle a series of similar problems, such as the image enhancement for underwater or remote sensing and in hazy or dusty conditions.

[1]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[2]  Christian Theobalt,et al.  Live intrinsic video , 2016, ACM Trans. Graph..

[3]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[4]  Chunhong Pan,et al.  Enhancement of Low Light Level Images with coupled dictionary learning , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[5]  Juan Song,et al.  Enhancement and noise reduction of very low light level images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.

[7]  Jitendra Malik,et al.  Color Constancy, Intrinsic Images, and Shape Estimation , 2012, ECCV.

[8]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[9]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[11]  Adrien Bousseau,et al.  Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views , 2013, IEEE Trans. Vis. Comput. Graph..

[12]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[13]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[14]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[15]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[16]  Alessandro Rizzi,et al.  Mathematical definition and analysis of the retinex algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Siwei Luo,et al.  A novel Retinex based enhancement algorithm considering noise , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[18]  Minghui Wang,et al.  Novel Retinex algorithm by interpolation and adaptive noise suppression , 2012 .

[19]  Keith E. Muller,et al.  Contrast-limited adaptive histogram equalization: speed and effectiveness , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[20]  Wen Gao,et al.  A low-light image enhancement method for both denoising and contrast enlarging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[21]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Noah Snavely,et al.  Intrinsic images in the wild , 2014, ACM Trans. Graph..

[24]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  Michael S. Brown,et al.  Single Image Layer Separation Using Relative Smoothness , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Edward H. Adelson,et al.  Ground truth dataset and baseline evaluations for intrinsic image algorithms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Yin Zhang,et al.  An alternating direction algorithm for matrix completion with nonnegative factors , 2011, Frontiers of Mathematics in China.

[29]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[30]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[31]  Xiao-Ping Zhang,et al.  A retinex-based enhancing approach for single underwater image , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[32]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[33]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[34]  M. Abdullah-Al-Wadud,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[35]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[36]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[37]  Wang Chao,et al.  Variational enhancement for infrared images , 2006 .

[38]  Vladlen Koltun,et al.  A Simple Model for Intrinsic Image Decomposition with Depth Cues , 2013, 2013 IEEE International Conference on Computer Vision.

[39]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[40]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Wen Gao,et al.  Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure , 2016, IEEE Transactions on Multimedia.