A General Framework for the Fusion of Anatomical and Functional Medical Images

The collection of various data coming from anatomical and functional imagery is becoming very common for the study of a given pathology, and their aggregation generally allows for a better medical decision in clinical studies. A fusion process is described in this article for the modeling of this aggregation. The process is illustrated in the case of anatomical and functional images of the brain, but the general principle may be extended to other organs. The whole three-step fusion process based on possibilistic logic is detailed and a new class of fusion operator is introduced. The use of fuzziness in the process in general and in the operator in particular allows for the management of uncertainty and imprecision inherent to the images. The fusion process is illustrated in two clinical cases: the study of Alzheimer's disease by MR/SPECT fusion and the study of epilepsy by MR/SPECT/PET fusion. Results are presented and evaluated, and a preliminary clinical validation is achieved. The assessment of the method is encouraging, allowing its application on several clinical problems.

[1]  Vincent Barra,et al.  Aggregation of anatomical and functional information by a MR/SPECT fusion process: application to neurodegenerative pathologies , 2000, NeuroImage.

[2]  J Y Boire,et al.  Tissue segmentation on MR images of the brain by possibilistic clustering on a 3D wavelet representation , 2000, Journal of magnetic resonance imaging : JMRI.

[3]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[4]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[5]  Isabelle Bloch Information combination operators for data fusion: a comparative review with classification , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[6]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .

[9]  L. Wahlund,et al.  MRI-guided SPECT-measurements of medial temporal lobe blood flow in Alzheimer's disease , 1997, Psychiatry Research: Neuroimaging.

[10]  Alan C. Evans,et al.  An Extensible MRI Simulator for Post-Processing Evaluation , 1996, VBC.

[11]  J. Rapoport,et al.  Cerebral magnetic resonance image segmentation using data fusion. , 1996, Journal of computer assisted tomography.

[12]  Vito Di Gesù,et al.  An application of integrated clustering to MRI segmentation , 1994, Pattern Recognit. Lett..

[13]  H. Kooy,et al.  Automatic three-dimensional correlation of CT-CT, CT-MRI, and CT-SPECT using chamfer matching. , 1994, Medical physics.

[14]  J Y Boire,et al.  MRI-SPECT fusion for the synthesis of high resolution 3D functional brain images: a preliminary study. , 1999, Computer methods and programs in biomedicine.

[15]  J S Duncan,et al.  Imaging and epilepsy. , 1997, Brain : a journal of neurology.