Robust ghost-free multiexposure fusion for dynamic scenes

Abstract. Ghosts always appear in the multiexposure fusion for dynamic scenes. Most of the existing deghosting methods require complicated and subjective parameter settings, easily resulting in many artifacts. A robust exposure fusion method that removes ghosts while preserving the details of the image is presented. The proposed method first detects the motion area by bidirectional intensity mapping and calculates the motion weight. Then, the latent images are generated by weighted optimization in gradient domain, and ghosts are removed automatically. After removing the ghosts, fusion weights are calculated using a patch-based fusion method, and exposure fusion is performed with details retained and outlier values suppressed. Experiments show that the proposed method can remove ghosts effectively, which demonstrates strong robustness to ghosts in a variety of circumstances. It also avoids influence from complicated and subjective parameter settings.

[1]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[2]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[3]  Sang Uk Lee,et al.  Ghost-Free High Dynamic Range Imaging , 2010, ACCV.

[4]  Subhasis Chaudhuri,et al.  Bottom-up segmentation for ghost-free reconstruction of a dynamic scene from multi-exposure images , 2010, ICVGIP '10.

[5]  Anna Tomaszewska,et al.  Image Registration for Multi-exposure High Dynamic Range Image Acquisition , 2007 .

[6]  Chul Lee,et al.  Ghost-Free High Dynamic Range Imaging via Rank Minimization , 2014, IEEE Signal Processing Letters.

[7]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  William Puech,et al.  Ghost detection and removal in High Dynamic Range Images , 2009, 2009 17th European Signal Processing Conference.

[9]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[10]  Susanto Rahardja,et al.  A robust and fast anti-ghosting algorithm for high dynamic range imaging , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[12]  Ahmet Oguz Akyüz Photographically Guided Alignment for HDR Images , 2011, Eurographics.

[13]  Jun Hu,et al.  HDR Deghosting: How to Deal with Saturation? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[15]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[16]  Wai-kuen Cham,et al.  Gradient-directed composition of multi-exposure images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Susanto Rahardja,et al.  Real-time ghost removal for composing high dynamic range images , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[18]  Hans-Peter Seidel,et al.  Background estimation from non-time sequence images , 2008, Graphics Interface.

[19]  Susanto Rahardja,et al.  Movement detection for the synthesis of high dynamic range images , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[21]  Joachim Weickert,et al.  Simultaneous HDR and Optic Flow Computation , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[23]  Tae-Hyun Oh,et al.  Robust High Dynamic Range Imaging by Rank Minimization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Kan Liu,et al.  Patch-Based correlation for deghosting in exposure fusion , 2017, Inf. Sci..

[25]  Joachim Weickert,et al.  Freehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement , 2011, Comput. Graph. Forum.

[26]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[27]  Eli Shechtman,et al.  Robust patch-based hdr reconstruction of dynamic scenes , 2012, ACM Trans. Graph..

[28]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[29]  Leiting Chen,et al.  Detail-enhanced and brightness-adjusted exposure image fusion , 2015, J. Electronic Imaging.

[30]  Richard Szeliski,et al.  Multigrid and multilevel preconditioners for computational photography , 2011, ACM Trans. Graph..

[31]  Aykut Erdem,et al.  The State of the Art in HDR Deghosting: A Survey and Evaluation , 2015, Comput. Graph. Forum.

[32]  Jan Kautz,et al.  Bitmap Movement Detection: HDR for Dynamic Scenes , 2010, 2010 Conference on Visual Media Production.

[33]  Wei Zhang,et al.  Motion-free exposure fusion based on inter-consistency and intra-consistency , 2017, Inf. Sci..

[34]  Jun Hu,et al.  Locally non-rigid registration for mobile HDR photography , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[36]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Erik Reinhard,et al.  Ghost Removal in High Dynamic Range Images , 2006, 2006 International Conference on Image Processing.

[38]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .