Ringing artifacts in wavelet based image fusion: Analysis, measurement and remedies

Abstract In this paper, we investigate an issue of the ringing artifacts inherent to wavelet based image fusion. A thorough analysis of the ringing phenomenon, by experimenting with different types of images and different wavelet families, with varying lengths of filters and varying levels of decomposition is performed to obtain deeper insights of the ringing artifacts. It is experimentally shown that wavelet based fusion results in the modification of the intra- and inter-scale dependencies, with the inter-scale dependency being the dominating factor causing the ringing artifacts. Also, these ringing artifacts are localized in the Fourier domain. Subsequently, a quantitative measure using structural dissimilarity is proposed to measure the ringing artifacts due to wavelet based fusion. Two possible solutions to compensate for the ringing artifacts are then proposed. In the first strategy, a filtering based method is proposed to reduce these ringing artifacts. It takes advantage of the localized nature of the ringing artifacts. Furthermore, the intra- and inter-scale dependencies are modeled using order-zero entropy. A second strategy using the inter-scale dependency is then proposed to reduce the ringing artifacts. Experimental results show that both these methods are able to reduce the ringing artifacts significantly and have further scope for improvement. Another critical finding of this work is selection of the wavelet filter and its levels of decomposition for the process of fusion.

[1]  Michael T. Orchard,et al.  Image coding based on a morphological representation of wavelet data , 1999, IEEE Trans. Image Process..

[2]  Madhuri Khambete,et al.  Blur and Ringing Artifact Measurement in Image Compression using Wavelet Transform , 2007 .

[3]  Arthur Petrosian,et al.  Wavelets in signal and image analysis : from theory to practice , 2001 .

[4]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[5]  Aleksandra Pizurica,et al.  A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising , 2002, IEEE Trans. Image Process..

[6]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[7]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[8]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Thierry Blu,et al.  Sure-Based Wavelet Thresholding Integrating Inter-Scale Dependencies , 2006, 2006 International Conference on Image Processing.

[11]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[12]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[13]  LiShutao,et al.  Pixel-level image fusion , 2017 .

[14]  Shutao Li,et al.  Super-resolution of hyperspectral image via superpixel-based sparse representation , 2018, Neurocomputing.

[15]  Francesc Auli-Llinas Entropy-Based Evaluation of Context Models for Wavelet-Transformed Images , 2015, IEEE Transactions on Image Processing.

[16]  Ingrid Heynderickx,et al.  A No-Reference Metric for Perceived Ringing Artifacts in Images , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Aleksandra Pizurica,et al.  Removal of Correlated Noise by Modeling Spatial Correlations and Interscale Dependencies in the Complex Wavelet Domain , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Ingrid Heynderickx,et al.  A Perceptually Relevant Approach to Ringing Region Detection , 2010, IEEE Transactions on Image Processing.

[19]  Raanan Fattal Edge-avoiding wavelets and their applications , 2009, SIGGRAPH 2009.

[20]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[21]  M. Malik,et al.  Wavelet Based Exposure Fusion , 2008 .

[22]  Jiayi Zhou,et al.  A novel multi-focus image fusion approach based on image decomposition , 2017, Inf. Fusion.

[23]  Sabine Dippel,et al.  Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform , 2002, IEEE Transactions on Medical Imaging.

[24]  Lei Zhang,et al.  Hybrid inter- and intra-wavelet scale image restoration , 2003, Pattern Recognit..

[25]  Zhi Cui,et al.  Ultrasonic Signal De-noising Based on Wavelet Entropy and Inter-Scale Correlation , 2016, MUE 2016.

[26]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[27]  Jan P. Allebach,et al.  Measurement of ringing artifacts in JPEG images , 2006, Electronic Imaging.