Generation of high dynamic range illumination from a single image for the enhancement of undesirably illuminated images

This paper presents an algorithm that enhances undesirably illuminated images by generating and fusing multi-level illuminations from a single image. The input image is first decomposed into illumination and reflectance components by using an edge-preserving smoothing filter. Then the reflectance component is scaled up to improve the image details in bright areas. The illumination component is scaled up and down to generate several illumination images that correspond to certain camera exposure values different from the original. The virtual multi-exposure illuminations are blended into an enhanced illumination, where we also propose a method to generate appropriate weight maps for the tone fusion. Finally, an enhanced image is obtained by multiplying the equalized illumination and enhanced reflectance. Experiments show that the proposed algorithm produces visually pleasing output and also yields comparable objective results to the conventional enhancement methods, while requiring modest computational loads.

[1]  F. Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, ACM Trans. Graph..

[2]  Abhinandan H. Patil,et al.  Automatic Number Plate Recognition , 2018, 2018 International Conference on Advances in Computing, Communication Control and Networking (ICACCCN).

[3]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[4]  Nam Ik Cho,et al.  Block-Matching Convolutional Neural Network for Image Denoising , 2017, ArXiv.

[5]  Jiajun Bu,et al.  Automatic local exposure correction using bright channel prior for under-exposed images , 2013, Signal Process..

[6]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[7]  Guang Deng,et al.  A Generalized Unsharp Masking Algorithm , 2011, IEEE Transactions on Image Processing.

[8]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[9]  Jaeseok Kim,et al.  Natural hdr image tone mapping based on retinex , 2011, IEEE Transactions on Consumer Electronics.

[10]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[11]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[12]  Kurt Debattista,et al.  Expanding low dynamic range videos for high dynamic range applications , 2008, SCCG.

[13]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[14]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[15]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[16]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[17]  Turgay Çelik,et al.  Contextual and Variational Contrast Enhancement , 2011, IEEE Transactions on Image Processing.

[18]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[19]  Nam Ik Cho,et al.  A multi-exposure image fusion algorithm without ghost effect , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Yücel Altunbasak,et al.  A Histogram Modification Framework and Its Application for Image Contrast Enhancement , 2009, IEEE Transactions on Image Processing.

[21]  Touradj Ebrahimi,et al.  Crowdsourcing-based evaluation of privacy in HDR images , 2014, Photonics Europe.

[22]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  Wei-Kang Wang,et al.  Image contrast enhancement using classified virtual exposure image fusion , 2012, IEEE Transactions on Consumer Electronics.

[24]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[25]  Nam Ik Cho,et al.  Probabilistic motion pixel detection for the reduction of ghost artifacts in high dynamic range images from multiple exposures , 2014, EURASIP J. Image Video Process..

[26]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[27]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[28]  Chul Lee,et al.  Contrast Enhancement Based on Layered Difference Representation of 2D Histograms , 2013, IEEE Transactions on Image Processing.

[29]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[30]  Francesco Banterle,et al.  Inverse tone mapping , 2006, GRAPHITE '06.

[31]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[32]  Du-Yih Tsai,et al.  Information Entropy Measure for Evaluation of Image Quality , 2008, Journal of Digital Imaging.

[33]  Leonard McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, ACM Trans. Graph..

[34]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, ACM Trans. Graph..

[35]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[36]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[37]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[38]  Gregory A. Baxes,et al.  Digital image processing - principles and applications , 1994 .

[39]  Nam Ik Cho,et al.  Reduction of ghost effect in exposure fusion by detecting the ghost pixels in saturated and non-saturated regions , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Laurence Meylan,et al.  Color Image Enhancement Using A Retinex-Based Adaptive Filter , 2004, CGIV.

[41]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[42]  Ching-Te Chiu,et al.  Inverse Tone Mapping Operators Evaluation Using Blind Image Quality Assessment , 2011 .

[43]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[44]  Sebastiano Battiato,et al.  Image quality improvement by adaptive exposure correction techniques , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[45]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[46]  Laurence Meylan,et al.  The Reproduction of Specular Highlights on High Dynamic Range Displays , 2006, CIC.

[47]  Erhu Zhang,et al.  A Novel Tone Mapping Method for High Dynamic Range Image by Incorporating Edge-Preserving Filter Into Method Based on Retinex , 2015 .

[48]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[49]  Ching-Te Chiu,et al.  Pseudo-Multiple-Exposure-Based Tone Fusion With Local Region Adjustment , 2015, IEEE Transactions on Multimedia.