Low-Light Image Enhancement by Principal Component Analysis

Under extreme low-lighting conditions, images have low contrast, low brightness, and high noise. In this paper, we propose a principal component analysis framework to enhance low-light-level images with decomposed luminance–chrominance components. A multi-scale retinex-based adaptive filter is developed for the luminance component to enhance contrast and brightness significantly. Noise is attenuated by a proposed collaborative filtering employed to both the luminance and chrominance components that reveal every finest detail by preserving the unique features in the image. To evaluate the effectiveness of the proposed algorithm, a simulation model is proposed to generate nighttime images for various levels of contrast and noise. The proposed algorithm can process a wide range of images without introducing ghosting and halo artifacts. The quantitative performance of the algorithm is measured in terms of both full-reference and blind performance metrics. It shows that the proposed method delivers state-of-the-art performance both in terms of objective criteria and visual quality compared to the existing methods.

[1]  Yan Liang,et al.  Adaptive extended piecewise histogram equalisation for dark image enhancement , 2015, IET Image Process..

[2]  Shih-Chia Huang,et al.  Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting Distribution , 2013, IEEE Transactions on Image Processing.

[3]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[4]  Mohammed S. Sayed,et al.  Low complexity contrast enhancement algorithm for nighttime visual surveillance , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[5]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[6]  C.-C. Jay Kuo,et al.  Improved image denoising with adaptive nonlocal means (ANL-means) algorithm , 2010, IEEE Transactions on Consumer Electronics.

[7]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[8]  Jie Yang Enhancement of LLLIs with improved BCP and matrix completion , 2017 .

[9]  M. C. Hanumantharaju,et al.  Natural Color Image Enhancement Based on Modified Multiscale Retinex Algorithm and Performance Evaluation Using Wavelet Energy , 2013, ISI.

[10]  Juan Song,et al.  Enhancement and noise reduction of very low light level images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[12]  Wenjun Zhang,et al.  Automatic Contrast Enhancement Technology With Saliency Preservation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  David R. Bull,et al.  Automatic contrast enhancement of low-light images based on local statistics of wavelet coefficients , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[15]  Xiongkuo Min,et al.  Objective Quality Evaluation of Dehazed Images , 2019, IEEE Transactions on Intelligent Transportation Systems.

[16]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[17]  Wenjun Zhang,et al.  Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images , 2014, IEEE Transactions on Broadcasting.

[18]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[19]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[20]  Hanseok Ko,et al.  A novel approach for denoising and enhancement of extremely low-light video , 2015, IEEE Transactions on Consumer Electronics.

[21]  Roy S. Berns,et al.  A review of principal component analysis and its applications to color technology , 2005 .

[22]  Mateu Sbert,et al.  A novel approach for enhancing very dark image sequences , 2014, Signal Process..

[23]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[24]  Yutao Liu,et al.  Blind Image Quality Estimation via Distortion Aggravation , 2018, IEEE Transactions on Broadcasting.

[25]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[26]  Wen Gao,et al.  A low-light image enhancement method for both denoising and contrast enlarging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[27]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[28]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[29]  Chul Lee,et al.  Enhancement of noisy low-light images via structure-texture-noise decomposition , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[30]  Takeo Kanade,et al.  Denighting: Enhancement of nighttime images for a surveillance camera , 2008, 2008 19th International Conference on Pattern Recognition.

[31]  Yuan-Kai Wang,et al.  Contrast enhancement of night images , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[32]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[33]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[35]  L. McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, SIGGRAPH 2005.

[36]  Byungyong Ryu,et al.  Content-Aware Dark Image Enhancement Through Channel Division , 2012, IEEE Transactions on Image Processing.

[37]  Wuzhen Shi,et al.  Group-based sparse representation for low lighting image enhancement , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[38]  Yuan-Kai Wang,et al.  A CUDA-enabled parallel algorithm for accelerating retinex , 2012, Journal of Real-Time Image Processing.