Multi-focus image fusion algorithm based on Laplacian pyramids.

In this paper, we propose a method named region mosaicking on Laplacian pyramids (RMLP) to fuse multi-focus images that are captured by microscope. First, we apply the sum-modified Laplacian to measure the focus of multi-focus images. Then the density-based region growing algorithm is utilized to segment the focused region mask of each image. Finally, the mask is decomposed into a mask pyramid to supervise region mosaicking on a Laplacian pyramid. The region level pyramid keeps more original information than the pixel level. The experiment results show that RMLP has the best performance in quantitative comparison with other methods. In addition, RMLP is insensitive to noise and can reduce the color distortion of the fused images on two datasets.

[1]  Xingming Sun,et al.  Segmentation-Based Image Copy-Move Forgery Detection Scheme , 2015, IEEE Transactions on Information Forensics and Security.

[2]  Xin Jin,et al.  Block medical image fusion based on adaptive PCNN , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[3]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[4]  A. Khare,et al.  Multifocus noisy image fusion using contourlet transform , 2015 .

[5]  Gaurav Bhatnagar,et al.  Mutual spectral residual approach for multifocus image fusion , 2013, Digit. Signal Process..

[6]  Abdul Majid,et al.  Developing learning based intelligent fusion for deblurring confocal microscopic images , 2016, Eng. Appl. Artif. Intell..

[7]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[8]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[9]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[10]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[13]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[14]  Mongi A. Abidi,et al.  An Adaptive Focal Connectivity Algorithm for Multifocus Fusion , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Tanya Vladimirova,et al.  Novel PCA based pixel-level multi-focus image fusion algorithm , 2014, 2014 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[16]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[17]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[18]  P. M. Pradnya,et al.  Wavelet based image fusion techniques , 2013, 2013 International Conference on Intelligent Systems and Signal Processing (ISSP).

[19]  Stefano Soatto,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE IEEE TRANSACTION OF PATTERN RECO , 2022 .

[20]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[21]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[22]  Zheng Qin,et al.  PCNN-Based Image Fusion in Compressed Domain , 2015 .

[23]  Dong-Ling Xu,et al.  Circuit Tolerance Design Using Belief Rule Base , 2015 .

[24]  Yi Chai,et al.  Multifocus image fusion scheme based on feature contrast in the lifting stationary wavelet domain , 2012, EURASIP Journal on Advances in Signal Processing.

[25]  Veysel Aslantas,et al.  A pixel based multi-focus image fusion method , 2014 .

[26]  Yu Bing Dong,et al.  Image Fusion Algorithm Based on Contrast Pyramid and its Performance Evaluation , 2014 .

[27]  Yang Hu,et al.  Signal-Level Information Fusion for Less Constrained Iris Recognition Using Sparse-Error Low Rank Matrix Factorization , 2016, IEEE Transactions on Information Forensics and Security.

[28]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[29]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[30]  Cheng Zhang,et al.  An effective fusion defogging approach for single sea fog image , 2016, Neurocomputing.

[31]  Homer H. Chen,et al.  Reciprocal Focus Profile , 2012, IEEE Transactions on Image Processing.

[32]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[33]  R. Hariharan,et al.  Shape-From-Focus by Tensor Voting , 2012, IEEE Transactions on Image Processing.

[34]  Yi Chai,et al.  A novel sparse-representation-based multi-focus image fusion approach , 2016, Neurocomputing.

[35]  Gastón A Ayubi,et al.  All-in-focus image reconstruction under severe defocus. , 2015, Optics letters.

[36]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[37]  Gastón A Ayubi,et al.  Optical implementation of the generalized Hough transform with totally incoherent light. , 2015, Optics letters.

[38]  Pan Lin,et al.  Multifocus Image Fusion Based on NSCT and Focused Area Detection , 2014, IEEE Sensors Journal.

[39]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[40]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[41]  Yingjie Zhang,et al.  Efficient fusion scheme for multi-focus images by using blurring measure , 2009, Digit. Signal Process..

[42]  Jing Tian,et al.  Multi-focus image fusion using wavelet-domain statistics , 2010, 2010 IEEE International Conference on Image Processing.

[43]  Marc Moonen,et al.  Joint DOA and multi-pitch estimation based on subspace techniques , 2012, EURASIP J. Adv. Signal Process..

[44]  M. Yazdi,et al.  An efficient image fusion method based on dual tree complex wavelet transform , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[45]  Hulya Dogan,et al.  Auto-focusing with multi focus color image fusion based on curvelet transform on microscopic imaging , 2015, 2015 9th International Conference on Electrical and Electronics Engineering (ELECO).

[46]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[48]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[49]  P. L. Deepa,et al.  Multi-focus color image fusion using NSCT and PCNN , 2016, 2016 International Conference on Communication Systems and Networks (ComNet).

[50]  Kiyoharu Aizawa,et al.  Reconstructing arbitrarily focused images from two differently focused images using linear filters , 2005, IEEE Transactions on Image Processing.