Medical Applications of NDT Data Fusion

The fusion of different sources of information has always been a component of medical practice. The complexity of biological phenomena is such that they cannot be explained with a single exploration. The complementary nature of the available exploration techniques (modalities) helps the physician in refining his diagnosis, preparing or performing therapeutic procedures. In this respect it is interesting to note that the development of new medical modalities has not led to the replacement of former ones, and that obviously there is no single modality providing the clinician with all possible sources of information. Before the development of computerised registration tools, data fusion involved pure mental matching of the data sets based on well-known common structures, the matching of the rest of the data being mentally interpolated from this initial step. The parallel emergence of new digital medical imaging devices, communication networks and powerful workstations has made it possible not only to display images but also to transfer and process them. Image processing methods have recently been developed to perform direct, automatic data matching. These methods define the multimodal data fusion topic. They have modified the way multimodal matching is performed as well as the way multimodal information is used; moving from a mental to a computer assisted fusion process. This evolution has led to a more accurate, more visual, more quantitative and therefore more objective fusion process.

[1]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Fabrice Heitz,et al.  Registration of MR/MR and MR/SPECT Brain Images by Fast Stochastic Optimization of Robust Voxel Similarity Measures , 1998, NeuroImage.

[3]  I. Germano,et al.  Frameless stereotaxy for surgery of the epilepsies: preliminary experience. Technical note. , 1994, Journal of neurosurgery.

[4]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[5]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[6]  Jürgen Weese,et al.  Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery , 1997, IEEE Transactions on Information Technology in Biomedicine.

[7]  G. Glover,et al.  Characterization of spatial distortion in magnetic resonance imaging and its implications for stereotactic surgery. , 1994, Neurosurgery.

[8]  Jürgen Weese,et al.  An approach to 2D/3D registration of a vertebra in 2D X-ray fluoroscopies with 3D CT images , 1997, CVRMed.

[9]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[10]  Frédéric Zana,et al.  A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform , 1999, IEEE Transactions on Medical Imaging.

[11]  R. Duncan SPECT imaging in focal epilepsy , 1997 .

[12]  Lawrence B. Wolff,et al.  Image fusion for enhanced visualization of brain imaging , 1999, Medical Imaging.

[13]  D J Hawkes,et al.  Algorithms for radiological image registration and their clinical application , 1998, Journal of anatomy.

[14]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[15]  Benoit M. Dawant,et al.  Comparison and evaluation of retrospective intermodality image registration techniques , 1996, Medical Imaging.

[16]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[17]  Nicholas Ayache,et al.  Steps towards automatic building of anatomical atlases , 1994, Other Conferences.

[18]  Max A. Viergever,et al.  Automatic registration of CT and MR brain images using correlation of geometrical features , 1995, IEEE Trans. Medical Imaging.

[19]  Haiying Liu,et al.  Investigation of intraoperative brain deformation using a 1.5-T interventional MR system: preliminary results , 1998, IEEE Transactions on Medical Imaging.

[20]  Pierre Jannin,et al.  A new concept of stereotactic room with multimodal imaging , 1999 .

[21]  Michael J. Ackerman,et al.  Toward a Common Validation Methodology for Segmentation and Registration Algorithms , 2000, MICCAI.

[22]  Terry M. Peters,et al.  3D statistical neuroanatomical models from 305 MRI volumes , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[23]  Jean-Marie Scarabin,et al.  Visual matching between real and virtual images in image-guided neurosurgery , 1997, Medical Imaging.

[24]  Arthur W. Toga,et al.  A Probabilistic Atlas of the Human Brain: Theory and Rationale for Its Development The International Consortium for Brain Mapping (ICBM) , 1995, NeuroImage.

[25]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[26]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[27]  William H. Press,et al.  Numerical recipes in C , 2002 .

[28]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[29]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[30]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[31]  Eldon D. Lehmann,et al.  Preliminary Work on the Interpretation of SPECT Images with the Aid of Registered MR Images and an MR Derived 3D Neuro-anatomical Atlas , 1990 .

[32]  Joan Serrat,et al.  Creaseness-based computer tomography and magnetic resonance registration: Comparison with the mutual information method , 1999, J. Electronic Imaging.

[33]  B H Brinkmann,et al.  Quantitative and clinical analysis of SPECT image registration for epilepsy studies. , 1999, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[34]  Charles R. Meyer,et al.  Multi-variate Mutual Information for Registration , 1999, MICCAI.

[35]  S. James Zinreich,et al.  An optical 3D digitizer for frameless stereotactic surgery , 1996, IEEE Computer Graphics and Applications.

[36]  R Stokking,et al.  Integration of functional and anatomical brain images. , 1997, Biophysical chemistry.

[37]  G H Barnett,et al.  Application of frameless stereotaxy to pedicle screw fixation of the spine. , 1995, Journal of neurosurgery.

[38]  K Abraham-Fuchs,et al.  Ictal and Interictal Activity in Partial Epilepsy Recorded with Multichannel Magnetoelectroencephalography: Correlation of Electroencephalography/Electrocorticography, Magnetic Resonance Imaging, Single Photon Emission Computed Tomography, and Positron Emission Tomography Findings , 1992, Epilepsia.

[39]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[40]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[42]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[43]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[44]  P. Jannin,et al.  A data fusion environment for multimodal and multi-informational neuronavigation. , 2000, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[45]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[46]  A K Liu,et al.  Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography data: Monte Carlo simulations. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[47]  N. Ayache,et al.  Multimodal Image Registration by Maximization of the Correlation Ratio , 1998 .

[48]  Jean-Philippe Thirion,et al.  Non-rigid matching using demons , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Paul M. Thompson,et al.  A surface-based technique for warping three-dimensional images of the brain , 1996, IEEE Trans. Medical Imaging.

[50]  Patrick Pérez,et al.  Medical Image Registration with Robust Multigrid Techniques , 1999, MICCAI.

[51]  D. Louis Collins,et al.  Automated 3D nonlinear deformation procedure for determination of gross morphometric variability in human brain , 1994, Other Conferences.

[52]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[53]  Richard M. Satava,et al.  Current and future applications of virtual reality for medicine , 1998, Proc. IEEE.

[54]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[55]  D. Louis Collins,et al.  Automated extraction and variability analysis of sulcal neuroanatomy , 1999, IEEE Transactions on Medical Imaging.

[56]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[57]  T Kanade,et al.  Techniques for fast and accurate intrasurgical registration. , 1995, Journal of image guided surgery.

[58]  D. Dormont,et al.  Registration in neurosurgery and neuroradiotherapy applications. , 1995, Journal of image guided surgery.

[59]  Nicholas Ayache,et al.  Unifying maximum likelihood approaches in medical image registration , 2000 .

[60]  Max A. Viergever,et al.  Physically realistic visualization of embedded volume structures for medical image data , 1999, Medical Imaging.

[61]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[62]  H Kober,et al.  Functional 3D localization of cerebrovascular accidents by magnetoencephalography (MEG). , 1992, Neurological research.

[63]  Michael Brady,et al.  MRI-Mammography 2D/3D Data Fusion for Breast Pathology Assessment , 2000, MICCAI.

[64]  Richard M. Leahy,et al.  Surface-based labeling of cortical anatomy using a deformable atlas , 1997, IEEE Transactions on Medical Imaging.

[65]  Denis Schwartz Localisation des generateurs intra-cerebraux de l'activite meg et eeg : evaluation de la precision spatiale et temporelle (doctorat genie biologique et medical) , 1998 .

[66]  J Y Boire,et al.  MRI-SPECT fusion for the synthesis of high resolution 3D functional brain images: a preliminary study. , 1999, Computer methods and programs in biomedicine.

[67]  D. Louis Collins,et al.  Non-linear Cerebral Registration with Sulcal Constraints , 1998, MICCAI.

[68]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  T. Peters,et al.  Intraoperative US in interactive image-guided neurosurgery. , 1998, Radiographics : a review publication of the Radiological Society of North America, Inc.

[70]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  C. Taylor,et al.  Predictive medicine: computational techniques in therapeutic decision-making. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[72]  N. Ayache,et al.  Multimodal Brain Warping Using the Demons Algorithm and Adaptative Intensity Corrections , 1999 .

[73]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[74]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[75]  B H Brinkmann,et al.  Subtraction ictal SPET co‐registered to MRI in partial epilepsy: Description and technical validation of the method with phantom and patient studies , 1998, Nuclear medicine communications.

[76]  Arvid Lundervold,et al.  Segmentation of brain parenchyma and cerebrospinal fluid in multispectral magnetic resonance images , 1995, IEEE Trans. Medical Imaging.

[77]  Karl J. Friston,et al.  Analysis of functional MRI time‐series , 1994, Human Brain Mapping.