A multi-focus image fusion method via region mosaicking on Laplacian pyramids

In this paper, a method named Region Mosaicking on Laplacian Pyramids (RMLP) is proposed to fuse multi-focus images that is captured by microscope. First, the Sum-Modified-Laplacian is applied to measure the focus of multi-focus images. Then the density-based region growing algorithm is utilized to segment the focused region mask of each image. Finally, the mask is decomposed into a mask pyramid to supervise region mosaicking on a Laplacian pyramid. The region level pyramid keeps more original information than the pixel level. The experiment results show that RMLP has best performance in quantitative comparison with other methods. In addition, RMLP is insensitive to noise and can reduces the color distortion of the fused images on two datasets.

[1]  P. L. Deepa,et al.  Multi-focus color image fusion using NSCT and PCNN , 2016, 2016 International Conference on Communication Systems and Networks (ComNet).

[2]  M. Yazdi,et al.  An efficient image fusion method based on dual tree complex wavelet transform , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[3]  Hulya Dogan,et al.  Auto-focusing with multi focus color image fusion based on curvelet transform on microscopic imaging , 2015, 2015 9th International Conference on Electrical and Electronics Engineering (ELECO).

[4]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Xin Jin,et al.  Block medical image fusion based on adaptive PCNN , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[6]  A. Khare,et al.  Multifocus noisy image fusion using contourlet transform , 2015 .

[7]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[8]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[9]  Homer H. Chen,et al.  Reciprocal Focus Profile , 2012, IEEE Transactions on Image Processing.

[10]  Gaurav Bhatnagar,et al.  Mutual spectral residual approach for multifocus image fusion , 2013, Digit. Signal Process..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[13]  Kiyoharu Aizawa,et al.  Reconstructing arbitrarily focused images from two differently focused images using linear filters , 2005, IEEE Transactions on Image Processing.

[14]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[15]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[16]  Yingjie Zhang,et al.  Efficient fusion scheme for multi-focus images by using blurring measure , 2009, Digit. Signal Process..

[17]  Mongi A. Abidi,et al.  An Adaptive Focal Connectivity Algorithm for Multifocus Fusion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[19]  Jing Tian,et al.  Multi-focus image fusion using wavelet-domain statistics , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[21]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[22]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[23]  Zheng Qin,et al.  PCNN-Based Image Fusion in Compressed Domain , 2015 .

[24]  No Value,et al.  IEEE International Conference on Image Processing , 2003 .

[25]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[26]  Yu Bing Dong,et al.  Image Fusion Algorithm Based on Contrast Pyramid and its Performance Evaluation , 2014 .

[27]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[28]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[29]  Stefano Soatto,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE IEEE TRANSACTION OF PATTERN RECO , 2022 .

[30]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[31]  P. M. Pradnya,et al.  Wavelet based image fusion techniques , 2013, 2013 International Conference on Intelligent Systems and Signal Processing (ISSP).

[32]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[33]  Tanya Vladimirova,et al.  Novel PCA based pixel-level multi-focus image fusion algorithm , 2014, 2014 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[34]  Pan Lin,et al.  Multifocus Image Fusion Based on NSCT and Focused Area Detection , 2014, IEEE Sensors Journal.

[35]  Xingming Sun,et al.  Segmentation-Based Image Copy-Move Forgery Detection Scheme , 2015, IEEE Transactions on Information Forensics and Security.

[36]  R. Hariharan,et al.  Shape-From-Focus by Tensor Voting , 2012, IEEE Transactions on Image Processing.

[37]  Yi Chai,et al.  A novel sparse-representation-based multi-focus image fusion approach , 2016, Neurocomputing.

[38]  Dong-Ling Xu,et al.  Circuit Tolerance Design Using Belief Rule Base , 2015 .

[39]  Yi Chai,et al.  Multifocus image fusion scheme based on feature contrast in the lifting stationary wavelet domain , 2012, EURASIP Journal on Advances in Signal Processing.

[40]  Yilun Shang,et al.  Influence of the number of topologically interacting neighbors on swarm dynamics , 2014, Scientific Reports.

[41]  Cheng Zhang,et al.  An effective fusion defogging approach for single sea fog image , 2016, Neurocomputing.

[42]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[43]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[44]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[45]  Yang Hu,et al.  Signal-Level Information Fusion for Less Constrained Iris Recognition Using Sparse-Error Low Rank Matrix Factorization , 2016, IEEE Transactions on Information Forensics and Security.

[46]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[47]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[48]  Abdul Majid,et al.  Developing learning based intelligent fusion for deblurring confocal microscopic images , 2016, Eng. Appl. Artif. Intell..