Details-preserving multi-exposure image fusion based on dual-pyramid using improved exposure evaluation

Abstract Due to a limited dynamic range of widely used image recorders, it is difficult to record complete information on real scenes using a single image, and a restricted range of contrast, brightness and chromaticity can only be recorded. To mitigate this matter, a set of images of the identical scenery could be firstly captured at different exposure situations, and next be merged into an informative image via image fusion. In the paper, we present a well details-preserving image fusion technique via improved exposure evaluation and dual-pyramid model. The proposed method owning to its advantages of cost-effective, computation-stable and adaptive image processing can achieve a high dynamic range image from a set of multiple exposure sequences even for extremely complicated scenes. Experimental results demonstrated that the proposed method has richer details and better visual effects compared with the other commonly used techniques in most cases. Therefore, it could provide useful help and inspiration for image processing and enhancement field such as digital photography, remote sensing and medical imaging.

[1]  Zhengguo Li,et al.  Multi-scale exposure fusion via gradient domain guided image filtering , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[2]  Ahmed A. Shalaby,et al.  Digital imaging devices as sensors for iron determination. , 2019, Food chemistry.

[3]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[4]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[5]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[6]  S. Habbal,et al.  Iterative Phase Correlation Algorithm for High-precision Subpixel Image Registration , 2020, The Astrophysical Journal Supplement Series.

[7]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[8]  Shutao Li,et al.  Fast multi-exposure image fusion with median filter and recursive filter , 2012, IEEE Transactions on Consumer Electronics.

[9]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[10]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[11]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[12]  Beibei Sun,et al.  A novel multi-scale fusion framework for detail-preserving low-light image enhancement , 2021, Inf. Sci..

[13]  Beibei Sun,et al.  Multi-focus image fusion using learning based matting with sum of the Gaussian-based modified Laplacian , 2020, Digit. Signal Process..

[14]  Beibei Sun,et al.  Color-compensated multi-scale exposure fusion based on physical features , 2020 .

[15]  Xiaokang Yang,et al.  Fusion of multispectral and panchromatic satellite images based on contourlet transform and local average gradient , 2007 .

[16]  Ajith Abraham,et al.  A survey on region based image fusion methods , 2019, Inf. Fusion.

[17]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[18]  Feiniu Yuan,et al.  Remote Sensing Image Fusion Based on Adaptive IHS and Multiscale Guided Filter , 2016, IEEE Access.

[19]  M. Prema Kumar,et al.  Weighted Averaging SWT Technique for Enhanced Image Fusion in X-ray Mammography , 2018 .

[20]  Qi Li,et al.  Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition , 2015 .

[21]  Anup Basu,et al.  QoE-Based Multi-Exposure Fusion in Hierarchical Multivariate Gaussian CRF , 2013, IEEE Transactions on Image Processing.

[22]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[23]  Pingkun Yan,et al.  Deep learning in medical image registration: a survey , 2020, Machine Vision and Applications.

[24]  Gabriel Eilertsen,et al.  HDR image reconstruction from a single exposure using deep CNNs , 2017, ACM Trans. Graph..

[25]  Wai-kuen Cham,et al.  Reference-guided exposure fusion in dynamic scenes , 2012, J. Vis. Commun. Image Represent..

[26]  WU Ci-fang,et al.  The laws of the information entropy values of land use composition , 2003 .

[27]  Zhengguo Li,et al.  Detail-Enhanced Multi-Scale Exposure Fusion , 2017, IEEE Transactions on Image Processing.

[28]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.

[29]  Alan Conrad Bovik,et al.  Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment , 2017, Signal Process. Image Commun..

[30]  Sebastiano Battiato,et al.  High dynamic range imaging for digital still camera: an overview , 2003, J. Electronic Imaging.

[31]  Yi Chai,et al.  Multifocus image fusion scheme using focused region detection and multiresolution , 2011 .

[32]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[33]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[34]  Henry Leung,et al.  Variable augmented neural network for decolorization and multi-exposure fusion , 2019, Inf. Fusion.

[35]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[36]  Didier Dubois,et al.  Heuristic methods based on mean-value analysis for flexible manufacturing systems performance evaluation , 1982, 1982 21st IEEE Conference on Decision and Control.

[37]  Licheng Jiao,et al.  High dynamic range imaging on mobile devices using fusion of multiexposure images , 2013 .

[38]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[39]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[40]  Kejia Zhang,et al.  Multi-focus image fusion algorithm based on Laplacian pyramids. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[41]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[42]  Masahiro Okuda,et al.  Multiple Exposure Fusion for High Dynamic Range Image Acquisition , 2012, IEEE Transactions on Image Processing.

[43]  Hai-hui Wang,et al.  A New Multiwavelet-Based Approach to Image Fusion , 2004, Journal of Mathematical Imaging and Vision.

[44]  Gang Xiao,et al.  VIFB: A Visible and Infrared Image Fusion Benchmark , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[45]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[46]  Zongju Peng,et al.  Multi-exposure high dynamic range imaging with informative content enhanced network , 2020, Neurocomputing.

[47]  Yuhua Qian,et al.  3D shape reconstruction from multifocus image fusion using a multidirectional modified Laplacian operator , 2020, Pattern Recognit..

[48]  Hungngai Chuk.  The Effects of High Dynamic Range on Fingerprint Images Processed by Photoshop , 2018, Journal of forensic sciences.