Biological image fusion using a NSCT based variable-weight method

Biological image fusion, as a powerful tool for the protein study, has developed with the advent of various imaging modalities in molecular biology. Combining the fluorescent image and its corresponding phase contrast image will benefit the localization of the protein. However, resulting images of traditional methods are always difficult to compromise between multimodalities. This paper has solved this problem by a variable-weight fusion rule based on the nonsubsampled contourlet transform (NSCT). The intensity components of original images are combined in the multiscaled space and the fused image is obtained in the generalized intensity-hue-saturation (GIHS) frame. Validation experiments on 117 sets of Arabidopsis images are for two purposes: the comparison among different fusion rules and the impact of the multiscaled analysis in biological image fusion. Region-based quantified indexes reveal the similarity between fused images and original ones, and therefore demonstrate the superiority of the proposed method over traditional methods.

[1]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[2]  Thomas F. Quatieri,et al.  McClellan transformations for two-dimensional digital filtering. I - Design , 1976 .

[3]  Russell M. Mersereau,et al.  McClellan transformations for two-dimensional digital filtering. II - Implementation , 1976 .

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[5]  M. Do.  Directional multiresolution image representations , 2002 .

[6]  U. Raff,et al.  Image fusion in neuroradiology: Three clinical examples including MRI of Parkinson disease , 2007, Comput. Medical Imaging Graph..

[7]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[8]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[9]  Xiao-Hui Yang,et al.  Fusion Algorithm for Remote Sensing Images Based on Nonsubsampled Contourlet Transform , 2008 .

[10]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[11]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[12]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[13]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[14]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[15]  M. C. Lee,et al.  Fusion of coregistered cross-modality images using a temporally alternating display method , 2000, Medical and Biological Engineering and Computing.

[16]  I. Pippi,et al.  Quality assessment of decision-driven pyramid-based fusion of high resolution multispectral with panchromatic image data , 2001, IEEE/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas (Cat. No.01EX482).

[17]  R. M. Mersereau,et al.  McClellan transformations for two-dimensional digital filtering-Part I: Design , 1976 .

[18]  Jingwen Yan,et al.  Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain: Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2009 .

[19]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[20]  Andrzej Krol,et al.  Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets , 2008, Journal of Digital Imaging.

[21]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[22]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[23]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[24]  Dimitris Visvikis,et al.  Contrast enhancement in emission tomography by way of synergistic PET/CT image combination , 2008, Comput. Methods Programs Biomed..

[25]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[26]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[27]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[28]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[29]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[30]  Peter Shaw,et al.  High-throughput protein localization in Arabidopsis using Agrobacterium-mediated transient expression of GFP-ORF fusions. , 2004, The Plant journal : for cell and molecular biology.