LECARM: Low-Light Image Enhancement Using the Camera Response Model

Low-light image enhancement algorithms can improve the visual quality of low-light images and support the extraction of valuable information for some computer vision techniques. However, existing techniques inevitably introduce color and lightness distortions when enhancing the images. To lower the distortions, we propose a novel enhancement framework using the response characteristics of cameras. First, we discuss how to determine a reasonable camera response model and its parameters. Then, we use the illumination estimation techniques to estimate the exposure ratio for each pixel. Finally, the selected camera response model is used to adjust each pixel to the desired exposure according to the estimated exposure ratio map. Experiments show that our method can obtain enhancement results with fewer color and lightness distortions compared with the several state-of-the-art methods.

[1]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[2]  E. Peli.  Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[3]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[4]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[5]  Zhengguo Li,et al.  Single image brightening via exposure fusion , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[7]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[9]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[10]  M. Abdullah-Al-Wadud,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[11]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[12]  Steve Mann,et al.  Comparametric equations with practical applications in quantigraphic image processing , 2000, IEEE Trans. Image Process..

[13]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[14]  Rafal Mantiuk,et al.  Subjective and Objective Evaluation of Multi-exposure High Dynamic Range Image Deghosting Methods , 2016, Eurographics.

[15]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[16]  Haidi Ibrahim,et al.  Brightness Preserving Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[17]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Zhenyang Wu,et al.  Natural color image enhancement and evaluation algorithm based on human visual system , 2006, Comput. Vis. Image Underst..

[19]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[20]  Ali M. Reza,et al.  Realization of the Contrast Limited Adaptive Histogram Equalization (CLAHE) for Real-Time Image Enhancement , 2004, J. VLSI Signal Process..

[21]  Heung-Yeung Shum,et al.  Radiometric calibration from a single image , 2004, CVPR 2004.

[22]  Jean-Michel Morel,et al.  Multiscale Retinex , 2014, Image Process. Line.

[23]  Gabriel Eilertsen,et al.  HDR image reconstruction from a single exposure using deep CNNs , 2017, ACM Trans. Graph..

[24]  Eli Shechtman,et al.  Robust patch-based hdr reconstruction of dynamic scenes , 2012, ACM Trans. Graph..

[25]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[26]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Zhengguo Li,et al.  Edge-Preserving Decomposition-Based Single Image Haze Removal , 2015, IEEE Transactions on Image Processing.

[28]  Yao Lu,et al.  Fast efficient algorithm for enhancement of low lighting video , 2011, ICME.

[29]  Stephen Lin,et al.  Determining the radiometric response function from a single grayscale image , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  Pieter Peers,et al.  CRF-net: Single Image Radiometric Calibration using CNNs , 2017, CVMP.

[31]  Antonios Gasteratos,et al.  Fast centre- surround contrast modification , 2008 .

[32]  Wen Gao,et al.  A low-light image enhancement method for both denoising and contrast enlarging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[33]  Ronggang Wang,et al.  A New Low-Light Image Enhancement Algorithm Using Camera Response Model , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[34]  Zhou Wang,et al.  A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images , 2015, IEEE Signal Processing Letters.

[35]  Hongyi Liu,et al.  Variational Bayesian Method for Retinex , 2014, IEEE Transactions on Image Processing.

[36]  Katsushi Ikeuchi,et al.  Radiometric Calibration by Rank Minimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Azeddine Beghdadi,et al.  Contrast enhancement technique based on local detection of edges , 1989, Comput. Vis. Graph. Image Process..

[39]  Abd. Rahman Ramli,et al.  Minimum mean brightness error bi-histogram equalization in contrast enhancement , 2003, IEEE Trans. Consumer Electron..

[40]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[41]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Chao Wang,et al.  Brightness preserving histogram equalization with maximum entropy: a variational perspective , 2005, IEEE Trans. Consumer Electron..

[43]  Cheolkon Jung,et al.  Low light image enhancement with dual-tree complex wavelet transform , 2017, J. Vis. Commun. Image Represent..

[44]  Shih-Hsin Chang,et al.  Improved measurement of camera response function and its performance evaluation. , 2014, Applied optics.

[45]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[46]  Zhengguo Li,et al.  Detail-Enhanced Multi-Scale Exposure Fusion , 2017, IEEE Transactions on Image Processing.

[47]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[48]  Shih-Fu Chang,et al.  Using Geometry Invariants for Camera Response Function Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[50]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[51]  Ronggang Wang,et al.  A New Image Contrast Enhancement Algorithm Using Exposure Fusion Framework , 2017, CAIP.

[52]  David R. Bull,et al.  Automatic contrast enhancement of low-light images based on local statistics of wavelet coefficients , 2010, 2010 IEEE International Conference on Image Processing.

[53]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..