Medical Image Registration

Over the last decade, image registration has emerged as one of key technologies in medical image computing with applications ranging from computer assisted diagnosis to computer aided therapy and surgery. This chapter introduces the theory of medical image registration, its implementation and application. In particular, the three key components of any image registration algorithm are described: transformation models, similarity measures, and optimization techniques. The evaluation and validation of image registration is crucial in clinical applications and the chapter discusses techniques for the validation of image registration algorithms. Finally, the chapter illustrates the use of image registration techniques for image segmentation, shape modeling and clinical applications.

[1]  J. Meinguet.  Multivariate interpolation at arbitrary points made simple , 1979 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[5]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[6]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[7]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. Ardeshir Goshtasby,et al.  Registration of images with geometric distortions , 1988 .

[9]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[10]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[12]  G. Wahba.  Spline models for observational data , 1990 .

[13]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[14]  Yoshio Ohno,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[15]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .

[16]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[17]  Jane Wilhelms,et al.  Octrees for faster isosurface generation , 1992, TOGS.

[18]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Daniel Rueckert,et al.  Image segmentation by stochastically relaxing contour fitting , 1994, Medical Imaging.

[21]  Nira Dyn,et al.  Image Warping by Radial Basis Functions: Application to Facial Expressions , 1994, CVGIP Graph. Model. Image Process..

[22]  Yali Amit,et al.  A Nonlinear Variational Problem for Image Matching , 1994, SIAM J. Sci. Comput..

[23]  James C. Gee,et al.  Finite element approach to warping of brain images , 1994, Medical Imaging.

[24]  J. Hajnal,et al.  Detection of Subtle Brain Changes Using Subvoxel Registration and Subtraction of Serial MR Images , 1995, Journal of computer assisted tomography.

[25]  J. Hajnal,et al.  A Registration and Interpolation Procedure for Subvoxel Matching of Serially Acquired MR Images , 1995, Journal of computer assisted tomography.

[26]  A Collignon,et al.  Automated multimodality image registration using information theory , 1995 .

[27]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[28]  Sung Yong Shin,et al.  Image Metamorphosis with Scattered Feature Constraints , 1996, IEEE Trans. Vis. Comput. Graph..

[29]  R.J. Maciunas,et al.  An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head , 1996, IEEE Transactions on Biomedical Engineering.

[30]  Colin Studholme,et al.  Automated 3-D registration of MR and CT images of the head , 1996, Medical Image Anal..

[31]  Benoit M. Dawant,et al.  Comparison and evaluation of retrospective intermodality image registration techniques , 1996, Medical Imaging.

[32]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[33]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[34]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[35]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[36]  David J. Hawkes,et al.  Deformations Incorporating Rigid Structures , 1996, Comput. Vis. Image Underst..

[37]  A. Khotanzad,et al.  A physics-based coordinate transformation for 3-D image matching , 1997, IEEE Transactions on Medical Imaging.

[38]  Christos Davatzikos,et al.  Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models , 1997, Comput. Vis. Image Underst..

[39]  D. Louis Collins,et al.  Animal: Validation and Applications of Nonlinear Registration-Based Segmentation , 1997, Int. J. Pattern Recognit. Artif. Intell..

[40]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[41]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[42]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.

[43]  Nick C Fox,et al.  Modeling brain deformations in Alzheimer disease by fluid registration of serial 3D MR images. , 1998, Journal of computer assisted tomography.

[44]  U. Grenander,et al.  Computational anatomy: an emerging discipline , 1998 .

[45]  Karl J. Friston,et al.  Identifying global anatomical differences: Deformation‐based morphometry , 1998 .

[46]  Colin Studholme,et al.  Visual assessment of the accuracy of retrospective registration of MR and CT images of the brain , 1998, IEEE Transactions on Medical Imaging.

[47]  Daniel Rueckert,et al.  Non-rigid Registration of Breast MR Images Using Mutual Information , 1998, MICCAI.

[48]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[49]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[50]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[51]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[52]  Alan C. Evans,et al.  Structural maturation of neural pathways in children and adolescents: in vivo study. , 1999, Science.

[53]  Hervé Delingette,et al.  Automatic Detection and Segmentation of Evolving Processes in 3D Medical Images: Application to Multiple Sclerosis , 1999, IPMI.

[54]  R. Bajcsy,et al.  Elastic Matching: Continuum Mechanical and Probabilistic Analysis , 1999 .

[55]  D. Rueckert,et al.  Comparison and evaluation of rigid, affine, and nonrigid registration of breast MR images. , 1999, Journal of computer assisted tomography.

[56]  Guido Gerig,et al.  Elastic model-based segmentation of 3-D neuroradiological data sets , 1999, IEEE Transactions on Medical Imaging.

[57]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[58]  David J. Hawkes,et al.  Voxel Similarity Measures for 3D Serial MR Brain Image Registration , 2000, IEEE Trans. Medical Imaging.

[59]  Alan C. Evans,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2000, Nature.

[60]  Tony Fitzpatrick.  ‘New’ Social Divisions , 2001 .

[61]  Nick C Fox,et al.  Imaging of onset and progression of Alzheimer's disease with voxel-compression mapping of serial magnetic resonance images , 2001, The Lancet.

[62]  Karl Rohr,et al.  Evaluation of 3D Operators for the Detection of Anatomical Point Landmarks in MR and CT Images , 2002, Comput. Vis. Image Underst..

[63]  Timothy F. Cootes,et al.  3D Statistical Shape Models Using Direct Optimisation of Description Length , 2002, ECCV.

[64]  Alejandro F. Frangi,et al.  Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling , 2002, IEEE Transactions on Medical Imaging.

[65]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[66]  Torsten Rohlfing,et al.  Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees , 2003, IEEE Transactions on Information Technology in Biomedicine.

[67]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[68]  David J. Hawkes,et al.  Validation of nonrigid image registration using finite-element methods: application to breast MR images , 2003, IEEE Transactions on Medical Imaging.

[69]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[70]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[72]  Torsten Rohlfing,et al.  Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint , 2003, IEEE Transactions on Medical Imaging.

[73]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[74]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[75]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[76]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[77]  Torsten Rohlfing,et al.  Multi-classifier framework for atlas-based image segmentation , 2005, Pattern Recognit. Lett..

[78]  Fred L. Bookstein,et al.  A feature space for edgels in images with landmarks , 1993, Journal of Mathematical Imaging and Vision.

[79]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[80]  David J. Hawkes,et al.  A New Validation Method for X-ray Mammogram Registration Algorithms Using a Projection Model of Breast X-ray Compression , 2007, IEEE Transactions on Medical Imaging.

[81]  Nick C. Fox,et al.  Accuracy assessment of global and local atrophy measurement techniques with realistic simulated longitudinal Alzheimer's disease images , 2008, NeuroImage.

[82]  Quan Chen,et al.  Objective assessment of deformable image registration in radiotherapy: A multi-institution study , 2008 .

[83]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.