Low-Light Image Enhancement With Semi-Decoupled Decomposition

Low-light image enhancement is important for high-quality image display and other visual applications. However, it is a challenging task as the enhancement is expected to improve the visibility of an image while keeping its visual naturalness. Retinex-based methods have well been recognized as a representative technique for this task, but they still have the following limitations. First, due to less-effective image decomposition or strong imaging noise, various artifacts can still be brought into enhanced results. Second, although the priori information can be explored to partially solve the first issue, it requires to carefully model the priori by a regularization term and usually makes the optimization process complicated. In this paper, we address these issues by proposing a novel Retinex-based low-light image enhancement method, in which the Retinex image decomposition is achieved in an efficient semi-decoupled way. Specifically, the illumination layer <inline-formula><tex-math notation="LaTeX">$I$</tex-math></inline-formula> is gradually estimated only with the input image <inline-formula><tex-math notation="LaTeX">$S$</tex-math></inline-formula> based on the proposed Gaussian Total Variation model, while the reflectance layer <inline-formula><tex-math notation="LaTeX">$R$</tex-math></inline-formula> is jointly estimated by <inline-formula><tex-math notation="LaTeX">$S$</tex-math></inline-formula> and the intermediate <inline-formula><tex-math notation="LaTeX">$I$</tex-math></inline-formula>. In addition, the imaging noise can be simultaneously suppressed during the estimation of <inline-formula><tex-math notation="LaTeX">$R$</tex-math></inline-formula>. Experimental results on several public datasets demonstrate that our method produces images with both higher visibility and better visual quality, which outperforms the state-of-the-art low-light enhancement methods in terms of several objective and subjective evaluation metrics.

[1]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[2]  Xiao-Ping Zhang,et al.  A fusion-based method for single backlit image enhancement , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Zhengguo Li,et al.  Intelligent Detail Enhancement for Exposure Fusion , 2017, IEEE Transactions on Multimedia.

[4]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Qing Zhang,et al.  High-Quality Exposure Correction of Underexposed Photos , 2018, ACM Multimedia.

[6]  Chul Lee,et al.  Contrast enhancement based on layered difference representation , 2012, 2012 19th IEEE International Conference on Image Processing.

[7]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Junping Du,et al.  Low-Light Image Enhancement via a Deep Hybrid Network , 2019, IEEE Transactions on Image Processing.

[9]  Yanrong Guo,et al.  Lightness-aware contrast enhancement for images with different illumination conditions , 2018, Multimedia Tools and Applications.

[10]  Xiaoyan Sun,et al.  Contrast Enhancement Based on Intrinsic Image Decomposition , 2017, IEEE Transactions on Image Processing.

[11]  Yang Yang,et al.  Robust (Semi) Nonnegative Graph Embedding , 2014, IEEE Transactions on Image Processing.

[12]  Chul Lee,et al.  Contrast Enhancement Based on Layered Difference Representation of 2D Histograms , 2013, IEEE Transactions on Image Processing.

[13]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[14]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[15]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[16]  Dacheng Tao,et al.  A Joint Intrinsic-Extrinsic Prior Model for Retinex , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[18]  Ding Liu,et al.  EnlightenGAN: Deep Light Enhancement Without Paired Supervision , 2019, IEEE Transactions on Image Processing.

[19]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[20]  Tat-Seng Chua,et al.  Learning from Collective Intelligence , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[21]  Xiaoyan Sun,et al.  Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model , 2018, IEEE Transactions on Image Processing.

[22]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[23]  Hitoshi Kiya,et al.  Scene Segmentation-Based Luminance Adjustment for Multi-Exposure Image Fusion , 2019, IEEE Transactions on Image Processing.

[24]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[25]  Liang Li,et al.  Structure-Texture Decomposition via Joint Structure Discovery and Texture Smoothing , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[26]  Yu Li,et al.  Mutually Guided Image Filtering , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Yanrong Guo,et al.  Enhancing Low-Light Images with JPEG Artifact Based on Image Decomposition , 2018, PCM.

[28]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[29]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[30]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[31]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[32]  Hai-Miao Hu,et al.  Naturalness Preserved Nonuniform Illumination Estimation for Image Enhancement Based on Retinex , 2017, IEEE Transactions on Multimedia.

[33]  Wen-Huang Cheng,et al.  Joint Enhancement and Denoising Method via Sequential Decomposition , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[34]  Xiangmin Xu,et al.  Edge/structure preserving smoothing via relativity-of-Gaussian , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[35]  Huimin Lu,et al.  Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain , 2018, IEEE Transactions on Multimedia.

[36]  Jiangtao Wen,et al.  Fast efficient algorithm for enhancement of low lighting video , 2010, 2011 IEEE International Conference on Multimedia and Expo.

[37]  Chi-Wing Fu,et al.  Underexposed Photo Enhancement Using Deep Illumination Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Michael S. Brown,et al.  A Contrast Enhancement Framework with JPEG Artifacts Suppression , 2014, ECCV.

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[41]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[42]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[43]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Minyi Guo,et al.  Personalized Exposure Control Using Adaptive Metering and Reinforcement Learning , 2019, IEEE Transactions on Visualization and Computer Graphics.