Ghost Removal via Channel Attention in Exposure Fusion

Abstract High dynamic range (HDR) imaging is to reconstruct high-quality images with a broad range of illuminations from a set of differently exposed images. Some existing algorithms align the input images before merging them into an HDR image, but artifacts of the registration appear due to misalignment. Recent works try to remove the ghosts by detecting motion region or skipping the registered process, however, the result still suffers from ghost artifacts for scenes with significant motions. In this paper, we propose a novel Multi-scale Channel Attention guided Network (MCANet) to address the ghosting problem. We use multi-scale blocks consisting of dilated convolution layers to extract informative features. The channel attention blocks suppress undesired components and guide the network to refine features to make full use of feature maps. The proposed MCANet recovers the occluded or saturated details and reduces artifacts due to misalignment. Experiments show that the proposed MCANet can achieve state-of-the-art quantitative and qualitative results.

[1]  Yanning Zhang,et al.  Robust artifact-free high dynamic range imaging of dynamic scenes , 2018, Multimedia Tools and Applications.

[2]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[3]  Yoshihiro Kanamori,et al.  Deep reverse tone mapping , 2017, ACM Trans. Graph..

[4]  Yanning Zhang,et al.  High dynamic range imaging by sparse representation , 2017, Neurocomputing.

[5]  Jun Hu,et al.  Locally non-rigid registration for mobile HDR photography , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Yanning Zhang,et al.  Enhancing image visuality by multi-exposure fusion , 2019, Pattern Recognit. Lett..

[7]  Gabriel Eilertsen,et al.  HDR image reconstruction from a single exposure using deep CNNs , 2017, ACM Trans. Graph..

[8]  Eli Shechtman,et al.  Robust patch-based hdr reconstruction of dynamic scenes , 2012, ACM Trans. Graph..

[9]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[10]  Ravi Ramamoorthi,et al.  Deep high dynamic range imaging of dynamic scenes , 2017, ACM Trans. Graph..

[11]  Tae-Hyun Oh,et al.  Robust High Dynamic Range Imaging by Rank Minimization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Chul Lee,et al.  Ghost-Free High Dynamic Range Imaging via Rank Minimization , 2014, IEEE Signal Processing Letters.

[13]  Yanning Zhang,et al.  Attention-Guided Network for Ghost-Free High Dynamic Range Imaging , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yu Zhu,et al.  Deep HDR Imaging via A Non-Local Network , 2020, IEEE Transactions on Image Processing.

[15]  Alexander J. Smola,et al.  Stacked Attention Networks for Image Question Answering , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Miguel Granados,et al.  Automatic noise modeling for ghost-free HDR reconstruction , 2013, ACM Trans. Graph..

[17]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.