Multi-scale image fusion through rolling guidance filter

Abstract Image fusion is essential in enhancing visual quality by blending complementary images, which are derived from different captured conditions or different sensors in the same scene. The role of image fusion in the Internet of Things has become considerably important in the future. For instance, data captured by multiple visual sensors need further computation or fusion, which is based on a network of making a decision or an analysis. A new image fusion method is proposed by using rolling guidance filter and joint bilateral filter in this paper. First, the saliency maps of two source images are extracted by the Kirsch operator. Subsequently, the two source images are decomposed by rolling guidance filter to obtain multi-scale images. Second, joint bilateral filter and optimal correction are utilized to optimize the saliency maps and obtain the final weight maps. Finally, two fusion rules are used to restore the final fused image. The proposed method not only preserves the details of source images, but also suppresses the artifacts effectively. Experimental results prove that our method generates better effects on both visual perception and objective quantization than traditional methods.

[1]  Gwanggil Jeon,et al.  A Rank-Ordered Marginal Filter for Deinterlacing , 2013, Sensors.

[2]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[3]  Salvatore Cuomo,et al.  A Smart GPU Implementation of an Elliptic Kernel for an Ocean Global Circulation Model , 2013 .

[4]  Fred Godtliebsen,et al.  A nonlinear gaussian filter applied to images with discontinuities , 1997 .

[5]  Sun Li,et al.  Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters , 2016, Inf. Fusion.

[6]  Salvatore Cuomo,et al.  IoT-based collaborative reputation system for associating visitors and artworks in a cultural scenario , 2017, Expert Syst. Appl..

[7]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[8]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Zhili Zhou,et al.  Fast and accurate near-duplicate image elimination for visual sensor networks , 2017, Int. J. Distributed Sens. Networks.

[10]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[11]  Yun Q. Shi,et al.  An integer wavelet transform based scheme for reversible data hiding in encrypted images , 2018, Multidimens. Syst. Signal Process..

[12]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Salvatore Cuomo,et al.  A Regularized MRI Image Reconstruction based on Hessian Penalty Term on CPU/GPU Systems , 2013, ICCS.

[14]  Shiguo Lian,et al.  Hybrid multiplicative multi-watermarking in DWT domain , 2017, Multidimens. Syst. Signal Process..

[15]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[16]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[17]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[18]  Qi Li,et al.  Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition , 2013 .

[19]  T. Lindeberg Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[20]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[21]  Jian Shen,et al.  A lightweight multi-layer authentication protocol for wireless body area networks , 2018, Future Gener. Comput. Syst..

[22]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[23]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[24]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[25]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[26]  Ernesto Damiani,et al.  Bayer Demosaicking With Polynomial Interpolation , 2016, IEEE Transactions on Image Processing.

[27]  Yuesheng Gu,et al.  Data fusion in the Internet of Things , 2011 .

[28]  S. G. Bhirud,et al.  Image Fusion of Digital Images , 2009 .

[29]  C Y Wen,et al.  Multi-resolution image fusion technique and its application to forensic science. , 2004, Forensic science international.

[30]  Hua Zong,et al.  Infrared and visible image fusion based on visual saliency map and weighted least square optimization , 2017 .

[31]  Miki Haseyama,et al.  [Paper] Extended Joint Bilateral Filter for the Reduction of Color Bleeding in Compressed Image and Video , 2015 .

[32]  Xingming Sun,et al.  Fast Motion Estimation Based on Content Property for Low-Complexity H.265/HEVC Encoder , 2016, IEEE Transactions on Broadcasting.

[33]  Gwanggil Jeon,et al.  Fast reference frame selection algorithm for H.264/AVC , 2009, IEEE Transactions on Consumer Electronics.

[34]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[35]  Xiaohai He,et al.  Infrared and visible image fusion with the use of multi-scale edge-preserving decomposition and guided image filter , 2015 .

[36]  Yan Wang,et al.  Image fusion based on nonsubsampled contourlet transform for infrared and visible light image , 2013 .