Coregistration of Structural and Functional Images

Images are spatial distributions of information. Accurately relating information from several images requires image registration. Alignment of a PET image with a high-resolution image such as a Magnetic Resonance (MR) image has successfully allowed anatomical or structural context to be inferred from the coarser-resolution PET image. PET to MRI registration was one of the earliest successful examples of image registration to find widespread application. Since then, image registration has become a major area of research in medical imaging, spawning a wide range of applications and a large number of papers in the medical and scientific literature. Recent reviews are provided in Maintz et al. [1] and Hill et al. [2]. Much of this chapter is a summary of information in the latter plus a recent textbook on image registration [3]. Further algorithmic and implementation details are contained in these two sources. This chapter addresses the software approach to image registration. The first section classifies registration applications and outlines the process of registration. It then discusses some concepts of correspondence inherent in image registration and summarises frequently used transformations. Methods for aligning images based on landmarks or geometric features and recent advances using the statistics of image intensities directly to align images – the so-called “voxel similarity” measures – are described. Some details are given on image preparation, optimization, image sampling, common pitfalls and validation. A Classification of Registration Applications

[1]  Nicholas Ayache,et al.  Medical image registration using geometric hashing , 1997 .

[2]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[3]  Max A. Viergever,et al.  Evaluation of Ridge Seeking Operators for Multimodality Medical Image Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Colin Studholme,et al.  Visual assessment of the accuracy of retrospective registration of MR and CT images of the brain , 1998, IEEE Transactions on Medical Imaging.

[5]  C R Ramsey,et al.  Magnetic resonance imaging based digitally reconstructed radiographs, virtual simulation, and three-dimensional treatment planning for brain neoplasms. , 1998, Medical physics.

[6]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[7]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[9]  T. Netsch,et al.  Towards real-time multi-modality 3-D medical image registration , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  J. Fitzpatrick,et al.  Correcting scaling errors in tomographic images using a nine degree of freedom registration algorithm. , 1998, Journal of computer assisted tomography.

[11]  H. Kooy,et al.  Automatic three-dimensional correlation of CT-CT, CT-MRI, and CT-SPECT using chamfer matching. , 1994, Medical physics.

[12]  Birgit Westermann,et al.  Non-invasive 3-D patient registration for image-guided skull base surgery , 1996, Comput. Graph..

[13]  Alan C. Evans,et al.  Anatomical-Functional Correlative Analysis Of The Human Brain Using Three Dimensional Imaging Systems , 1989, Medical Imaging.

[14]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[15]  S Napel,et al.  Quantifying MRI geometric distortion in tissue , 1994, Magnetic resonance in medicine.

[16]  A Collignon,et al.  Automated multimodality image registration using information theory , 1995 .

[17]  Gene H. Golub,et al.  Matrix computations , 1983 .

[18]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[19]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[20]  Michael I. Miller,et al.  Volumetric transformation of brain anatomy , 1997, IEEE Transactions on Medical Imaging.

[21]  Max A. Viergever,et al.  Automatic registration of CT and MR brain images using correlation of geometrical features , 1995, IEEE Trans. Medical Imaging.

[22]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[23]  L Lemieux,et al.  Voxel-based localization in frame-based and frameless stereotaxy and its accuracy. , 1994, Medical physics.

[24]  G. Bydder,et al.  Magnetic Resonance Scanning and Epilepsy , 1994, NATO ASI Series.

[25]  Paul F. Hemler,et al.  Grey value correlation techniques used for automatic matching of CT and MR brain and spine images , 1994, Other Conferences.

[26]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[27]  Max A. Viergever,et al.  Marker Guided Registration of Electromagnetic Dipole Data with Tomographic Images , 1991, IPMI.

[28]  Max A. Viergever,et al.  Geometry driven multimodality matching of brain images , 2005, Brain Topography.

[29]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[30]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[31]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[32]  R Probst,et al.  Noninvasive Tracking of Patient's Head Movements During Computer‐Assisted Intranasal Microscopic Surgery , 1997, The Laryngoscope.

[33]  Olivier Monga,et al.  Using Partial Derivatives of 3D Images to Extract Typical Surface Features , 1995, Comput. Vis. Image Underst..

[34]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[35]  Richard A. Robb,et al.  New approach to 3-D registration of multimodality medical images by surface matching , 1992, Other Conferences.

[36]  A. Jusczyzck,et al.  Locking acrylic resin dental stent for image-guided surgery. , 2000, The Journal of prosthetic dentistry (Print).

[37]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[38]  J. Michael Fitzpatrick,et al.  A technique for accurate magnetic resonance imaging in the presence of field inhomogeneities , 1992, IEEE Trans. Medical Imaging.

[39]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[40]  U Pietrzyk,et al.  An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies. , 1994, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[41]  R. Mccoll,et al.  Spatial and temporal registration of cardiac SPECT and MR images: methods and evaluation. , 1991, Radiology.

[42]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[43]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[44]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  David J. Hawkes,et al.  Voxel Similarity Measures for 3D Serial MR Brain Image Registration , 2000, IEEE Trans. Medical Imaging.

[46]  D. Louis Collins,et al.  Automated 3D nonlinear deformation procedure for determination of gross morphometric variability in human brain , 1994, Other Conferences.

[47]  Colin Studholme,et al.  Voxel similarity measures for automated image registration , 1994, Other Conferences.

[48]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[49]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[50]  David J. Hawkes,et al.  Incorporating connected region labelling into automated image registration using mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[51]  Benoit M. Dawant,et al.  Comparison and evaluation of retrospective intermodality image registration techniques , 1996, Medical Imaging.

[52]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[53]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[54]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[55]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[57]  Colin Studholme,et al.  Measures of 3D medical image alignment , 1997 .

[58]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[59]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.