A Bio-Inspired Multi-Exposure Fusion Framework for Low-light Image Enhancement

Low-light images are not conducive to human observation and computer vision algorithms due to their low visibility. Although many image enhancement techniques have been proposed to solve this problem, existing methods inevitably introduce contrast under- and over-enhancement. Inspired by human visual system, we design a multi-exposure fusion framework for low-light image enhancement. Based on the framework, we propose a dual-exposure fusion algorithm to provide an accurate contrast and lightness enhancement. Specifically, we first design the weight matrix for image fusion using illumination estimation techniques. Then we introduce our camera response model to synthesize multi-exposure images. Next, we find the best exposure ratio so that the synthetic image is well-exposed in the regions where the original image is under-exposed. Finally, the enhanced result is obtained by fusing the input image and the synthetic image according to the weight matrix. Experiments show that our method can obtain results with less contrast and lightness distortion compared to that of several state-of-the-art methods.

[1]  Turgay Çelik,et al.  Contextual and Variational Contrast Enhancement , 2011, IEEE Transactions on Image Processing.

[2]  Turgay Çelik,et al.  Spatial Entropy-Based Global and Local Image Contrast Enhancement , 2014, IEEE Transactions on Image Processing.

[3]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[4]  M. Abdullah-Al-Wadud,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[5]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[6]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Transactions on Graphics.

[7]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[8]  Chul Lee,et al.  Contrast enhancement based on layered difference representation , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[10]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[11]  Hongyi Liu,et al.  Variational Bayesian Method for Retinex , 2014, IEEE Transactions on Image Processing.

[12]  Sos S. Agaian,et al.  Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[14]  Jian Sun,et al.  Automatic Exposure Correction of Consumer Photographs , 2012, ECCV.

[15]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[16]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[17]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[18]  Antonios Gasteratos,et al.  On the evaluation of illumination compensation algorithms , 2018, Multimedia Tools and Applications.

[19]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[20]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[21]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[22]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[23]  Xuelong Li,et al.  Exposure Fusion Using Boosting Laplacian Pyramid , 2014, IEEE Transactions on Cybernetics.

[24]  Sos S. Agaian,et al.  Parameterized Logarithmic Framework for Image Enhancement , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[26]  Chao Wang,et al.  Brightness preserving histogram equalization with maximum entropy: a variational perspective , 2005, IEEE Trans. Consumer Electron..

[27]  Nafis Uddin Khan,et al.  Histogram statistics based variance controlled adaptive threshold in anisotropic diffusion for low contrast image enhancement , 2013, Signal Process..

[28]  Y. Rao,et al.  Generalized Equalization Model for Image Enhancement , 2016 .

[29]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[30]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[31]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[32]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[33]  Wen Gao,et al.  A low-light image enhancement method for both denoising and contrast enlarging , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[34]  Jiajun Bu,et al.  Automatic local exposure correction using bright channel prior for under-exposed images , 2013, Signal Process..

[35]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[36]  Guang Deng,et al.  A Generalized Unsharp Masking Algorithm , 2011, IEEE Transactions on Image Processing.

[37]  Abd. Rahman Ramli,et al.  Minimum mean brightness error bi-histogram equalization in contrast enhancement , 2003, IEEE Trans. Consumer Electron..

[38]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[39]  Abd. Rahman Ramli,et al.  Contrast enhancement using recursive mean-separate histogram equalization for scalable brightness preservation , 2003, IEEE Trans. Consumer Electron..

[40]  Haidi Ibrahim,et al.  Brightness Preserving Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[41]  Chul Lee,et al.  Power-Constrained Contrast Enhancement for Emissive Displays Based on Histogram Equalization , 2012, IEEE Transactions on Image Processing.

[42]  Yücel Altunbasak,et al.  A Histogram Modification Framework and Its Application for Image Contrast Enhancement , 2009, IEEE Transactions on Image Processing.

[43]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..