SCENS: Simultaneous Contrast Enhancement and Noise Suppression for Low-Light Images

Imaging in low-light conditions often suffers from degradations, such as low visibility, low contrast, and noticeable noise, which significantly reduces the performance of various vision-based applications. While various methods are proposed to enhance image contrast, inevitable noise is also amplified notably. Consequently, it is highly desired to take both contrast enhancement and noise suppression into consideration simultaneously. In this article, we propose a novel and unified framework SCENS to simultaneously enhance contrast and suppress noise for low-light images. An observed low-light image is decomposed into illumination, reflectance, and noise components. More specifically, the illumination is estimated using the second-order total generalized variation to preserve the spatial smoothness and the overall structure. In contrast, the piecewise continuity and fine detail of reflectance are maintained by minimizing the residual of gradients between the reflectance and the scene. Experimental results demonstrate the effectiveness of the proposed SCENS on contrast enhancement and noise mitigation. In addition, both subjective and objective comparisons with state-of-the-art algorithms indicate the superiority of the proposed method.

[1]  Aichi Chien,et al.  An L1-based variational model for Retinex theory and its application to medical images , 2011, CVPR 2011.

[2]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[3]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[5]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[6]  Chee Seng Chan,et al.  Getting to Know Low-light Images with The Exclusively Dark Dataset , 2018, Comput. Vis. Image Underst..

[7]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[8]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[9]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[10]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2002, IS&T/SPIE Electronic Imaging.

[11]  Xiaoyan Sun,et al.  Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model , 2018, IEEE Transactions on Image Processing.

[12]  Zhengguo Li,et al.  Single Image De-Hazing Using Globally Guided Image Filtering , 2018, IEEE Transactions on Image Processing.

[13]  Zhou Wang,et al.  A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images , 2015, IEEE Signal Processing Letters.

[14]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[15]  Xiaojie Guo,et al.  Kindling the Darkness: A Practical Low-light Image Enhancer , 2019, ACM Multimedia.

[16]  Zhengguo Li,et al.  Local Inverse Tone Mapping for Scalable High Dynamic Range Image Coding , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[20]  Julien Mairal,et al.  Proximal Methods for Sparse Hierarchical Dictionary Learning , 2010, ICML.

[21]  Susanto Rahardja,et al.  A Tone-Mapping Technique Based on Histogram Using a Sensitivity Model of the Human Visual System , 2018, IEEE Transactions on Industrial Electronics.

[22]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[24]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[25]  Jonathan T. Barron,et al.  Burst Denoising with Kernel Prediction Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Narendra Ahuja,et al.  Constant Time Median and Bilateral Filtering , 2014, International Journal of Computer Vision.

[27]  Joonki Paik,et al.  Dual Autoencoder Network for Retinex-Based Low-Light Image Enhancement , 2018, IEEE Access.

[28]  S. Osher,et al.  A TV Bregman iterative model of Retinex theory , 2012 .

[29]  Sangkeun Lee,et al.  Artifact-Free Low-Light Video Enhancement Using Temporal Similarity and Guide Map , 2017, IEEE Transactions on Industrial Electronics.

[30]  Zhengguo Li,et al.  Single image brightening via exposure fusion , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[32]  Hongyi Liu,et al.  Variational Bayesian Method for Retinex , 2014, IEEE Transactions on Image Processing.

[33]  Jia Xu,et al.  Learning to See in the Dark , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[35]  Zhengguo Li,et al.  Detail-Enhanced Multi-Scale Exposure Fusion , 2017, IEEE Transactions on Image Processing.

[36]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[37]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[38]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[39]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[40]  Zhengguo Li,et al.  Gradient Domain Guided Image Filtering , 2015, IEEE Transactions on Image Processing.

[41]  Joonki Paik,et al.  Low-light image enhancement using variational optimization-based Retinex model , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[42]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[43]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Chunping Hou,et al.  Blind Quality Assessment of Tone-Mapped Images Considering Colorfulness, Naturalness, and Structure , 2019, IEEE Transactions on Industrial Electronics.

[45]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[46]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[47]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[48]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[49]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[50]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[51]  Chuanjiang He,et al.  A Variational Model with Barrier Functionals for Retinex , 2015, SIAM J. Imaging Sci..

[52]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[53]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[54]  Dacheng Tao,et al.  A Joint Intrinsic-Extrinsic Prior Model for Retinex , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[55]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[56]  Yasuyuki Matsushita,et al.  Noise suppression in low-light images through joint denoising and demosaicing , 2011, CVPR 2011.

[57]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.