Detail-preserving exposure fusion using subband architecture

In this paper, we present a novel detail-preserving fusion approach from multiple exposure images using subband architecture. Given a sequence of different exposures, the Quadrature Mirror Filter (QMF) based subband architecture is first employed to decompose the original sequence into different frequency subbands. After that, we compute the importance weight maps according to the image appearance measurements, such as exposure, contrast, and saturation. In order to preserve the details of the subband signals, we compute the gain control maps and improve these subbands. Finally, the coefficients of subbands are blended into a high-quality detail-preserving fusion image. Experimental results demonstrate that the proposed approach successfully creates a visually pleasing exposure fusion image.

[1]  Vishal Kumar,et al.  Blind de-ghosting for automatic multi-exposure compositing , 2009, SIGGRAPH ASIA '09.

[2]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[3]  Erik Reinhard,et al.  Ghost Removal in High Dynamic Range Images , 2006, 2006 International Conference on Image Processing.

[4]  Sang Uk Lee,et al.  Ghost-Free High Dynamic Range Imaging , 2010, ACCV.

[5]  P. Vaidyanathan,et al.  Theory and design of uniform DFT, parallel, quadrature mirror filter banks , 1986 .

[6]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[7]  Wen-Chung Kao,et al.  Integrating image fusion and motion stabilization for capturing still images in high dynamic range scenes , 2006, IEEE Transactions on Consumer Electronics.

[8]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[9]  Sumanta N. Pattanaik,et al.  Segmentation and adaptive assimilation for detail-preserving display of high-dynamic range images , 2003, The Visual Computer.

[10]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, ACM Trans. Graph..

[11]  Subhasis Chaudhuri,et al.  Bilateral Filter Based Compositing for Variable Exposure Photography , 2009, Eurographics.

[12]  James D. Johnston,et al.  A filter family designed for use in quadrature mirror filter banks , 1980, ICASSP.

[13]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[14]  Subhasis Chaudhuri,et al.  Bottom-up segmentation for ghost-free reconstruction of a dynamic scene from multi-exposure images , 2010, ICVGIP '10.

[15]  Wai-kuen Cham,et al.  Gradient-directed composition of multi-exposure images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[17]  Shing-Chow Chan,et al.  New design and realization techniques for a class of perfect reconstruction two-channel FIR filterbanks and wavelets bases , 2004, IEEE Transactions on Signal Processing.

[18]  John W. Woods,et al.  Subband coding of images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[19]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[20]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[21]  Greg Ward,et al.  Automatic High-Dynamic Range Image Generation for Dynamic Scenes , 2008, IEEE Computer Graphics and Applications.

[22]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[24]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[25]  Ramesh Raskar,et al.  Image fusion for context enhancement and video surrealism , 2004, NPAR '04.

[26]  P. J. Narayanan,et al.  Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing , 2010 .

[27]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[28]  Qingtang Jiang,et al.  Optimal multifilter banks: design, related symmetric extension transform, and application to image compression , 1999, IEEE Trans. Signal Process..

[29]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[30]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[31]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[32]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[33]  I. GharachorlooS.GuptaR.Sproull A multiresolution Spline with application to image mosaics , .

[34]  Jamie P. Heather,et al.  A review of image fusion technology in 2005 , 2005, SPIE Defense + Commercial Sensing.

[35]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[36]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  John W. Woods,et al.  Subband Image Coding , 1990 .

[38]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.