A fusion-based enhancing method for weakly illuminated images

We propose a straightforward and efficient fusion-based method for enhancing weakly illumination images that uses several mature image processing techniques. First, we employ an illumination estimating algorithm based on morphological closing to decompose an observed image into a reflectance image and an illumination image. We then derive two inputs that represent luminance-improved and contrast-enhanced versions of the first decomposed illumination using the sigmoid function and adaptive histogram equalization. Designing two weights based on these inputs, we produce an adjusted illumination by fusing the derived inputs with the corresponding weights in a multi-scale fashion. Through a proper weighting and fusion strategy, we blend the advantages of different techniques to produce the adjusted illumination. The final enhanced image is obtained by compensating the adjusted illumination back to the reflectance. Through this synthesis, the enhanced image represents a trade-off among detail enhancement, local contrast improvement and preserving the natural feel of the image. In the proposed fusion-based framework, images under different weak illumination conditions such as backlighting, non-uniform illumination and nighttime can be enhanced. HighlightsA fusion-based method for enhancing various weakly illuminated images is proposed.The proposed method requires only one input to obtain the enhanced image.Different mature image processing techniques can be blended in our framework.Our method has an efficient computation time for practical applications.

[1]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[2]  Cewu Lu,et al.  Contrast preserving decolorization , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[3]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[4]  Joongkyu Kim,et al.  Retinex method based on adaptive smoothing for illumination invariant face recognition , 2008, Signal Process..

[5]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[6]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[7]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[8]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[9]  Michael S. Brown,et al.  A Contrast Enhancement Framework with JPEG Artifacts Suppression , 2014, ECCV.

[10]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[11]  Codruta O. Ancuti,et al.  Enhancing by saliency-guided decolorization , 2011, CVPR 2011.

[12]  Sos S. Agaian,et al.  Non-Linear Direct Multi-Scale Image Enhancement Based on the Luminance and Contrast Masking Characteristics of the Human Visual System , 2013, IEEE Transactions on Image Processing.

[13]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Guang Deng,et al.  A Generalized Unsharp Masking Algorithm , 2011, IEEE Transactions on Image Processing.

[15]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[16]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[17]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[18]  O. A. K. Reddy,et al.  Power-Constrained Contrast Enhancement for Emissive Displays Based on Histogram Equalization , 2013 .

[19]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[20]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[21]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[22]  Xiaolin Wu,et al.  Generalized Equalization Model for Image Enhancement , 2014, IEEE Transactions on Multimedia.

[23]  Wei Liu,et al.  Image Fusion with Local Spectral Consistency and Dynamic Gradient Sparsity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[25]  C BovikAlan,et al.  Gradient Magnitude Similarity Deviation , 2014 .

[26]  Susanto Rahardja,et al.  Detail-Enhanced Exposure Fusion , 2012, IEEE Transactions on Image Processing.

[27]  Raanan Fattal,et al.  Dehazing Using Color-Lines , 2014, ACM Trans. Graph..

[28]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[29]  Sankar K. Pal,et al.  Thresholding for edge detection using human psychovisual phenomena , 1986, Pattern Recognit. Lett..

[30]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[31]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[32]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[33]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[34]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[35]  Hongyi Liu,et al.  Variational Bayesian Method for Retinex , 2014, IEEE Transactions on Image Processing.

[36]  Yücel Altunbasak,et al.  A Histogram Modification Framework and Its Application for Image Contrast Enhancement , 2009, IEEE Transactions on Image Processing.

[37]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[38]  Nafis Uddin Khan,et al.  Histogram statistics based variance controlled adaptive threshold in anisotropic diffusion for low contrast image enhancement , 2013, Signal Process..

[39]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Michael K. Ng,et al.  A Total Variation Model for Retinex , 2011, SIAM J. Imaging Sci..

[41]  F. Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, ACM Trans. Graph..

[42]  Jiajun Bu,et al.  Automatic local exposure correction using bright channel prior for under-exposed images , 2013, Signal Process..

[43]  Chul Lee,et al.  Contrast Enhancement Based on Layered Difference Representation of 2D Histograms , 2013, IEEE Transactions on Image Processing.

[44]  Michael S. Brown,et al.  Single Image Layer Separation Using Relative Smoothness , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[46]  Turgay Çelik,et al.  Spatial Entropy-Based Global and Local Image Contrast Enhancement , 2014, IEEE Transactions on Image Processing.

[47]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[48]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[49]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[50]  Turgay Çelik,et al.  Contextual and Variational Contrast Enhancement , 2011, IEEE Transactions on Image Processing.

[51]  Jian Sun,et al.  Automatic Exposure Correction of Consumer Photographs , 2012, ECCV.

[52]  Leonard McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, ACM Trans. Graph..