A pyramid approach to subpixel registration based on intensity

We present an automatic subpixel registration algorithm that minimizes the mean square intensity difference between a reference and a test data set, which can be either images (two-dimensional) or volumes (three-dimensional). It uses an explicit spline representation of the images in conjunction with spline processing, and is based on a coarse-to-fine iterative strategy (pyramid approach). The minimization is performed according to a new variation (ML*) of the Marquardt-Levenberg algorithm for nonlinear least-square optimization. The geometric deformation model is a global three-dimensional (3-D) affine transformation that can be optionally restricted to rigid-body motion (rotation and translation), combined with isometric scaling. It also includes an optional adjustment of image contrast differences. We obtain excellent results for the registration of intramodality positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) data. We conclude that the multiresolution refinement strategy is more robust than a comparable single-stage method, being less likely to be trapped into a false local optimum. In addition, our improved version of the Marquardt-Levenberg algorithm is faster.

[1]  Eric Walter,et al.  Automated registration of dissimilar images: Application to medical imagery , 1989, Comput. Vis. Graph. Image Process..

[2]  Richard M. Leahy,et al.  Automatic anatomical labelling of magnetic resonance brain images , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[4]  Rama Chellappa,et al.  A computational vision approach to image registration , 1993, IEEE Trans. Image Process..

[5]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[6]  Michael I. Miller,et al.  Individualizing Neuroanatomic Atlases Using a Massively Parallel Computer , 1996, Computer.

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Rama Chellappa,et al.  Motion detection in image sequences acquired from a moving platform , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[10]  Gerald Q. Maguire,et al.  Techniques for multimodality image registration , 1993, 1993 IEEE Annual Northeast Bioengineering Conference.

[11]  J Noack,et al.  An algorithm for the fast registration of image sequences obtained with a scanning laser ophthalmoscope. , 1994, Physics in medicine and biology.

[12]  Cleve Moler,et al.  Mathematical Handbook for Scientists and Engineers , 1961 .

[13]  Maurilio Marcacci,et al.  Interactive identification of marker position on 3D CT-based model , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Eric Walter,et al.  Comments about the coincident bit counting (CBC) criterion for image registration , 1994, IEEE Trans. Medical Imaging.

[15]  A. Ardeshir Goshtasby,et al.  Matching of tomographic slices for interpolation , 1992, IEEE Trans. Medical Imaging.

[16]  J. Hajnal,et al.  A Registration and Interpolation Procedure for Subvoxel Matching of Serially Acquired MR Images , 1995, Journal of computer assisted tomography.

[17]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[18]  Michael Unser,et al.  Cardinal spline filters: Stability and convergence to the ideal sinc interpolator , 1992, Signal Process..

[19]  J. Fitzpatrick,et al.  Adaptive search space scaling in digital image registration. , 1989, IEEE transactions on medical imaging.

[20]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .

[21]  Aggelos K. Katsaggelos,et al.  Motion estimation of skeletonized angiographic images using elastic registration , 1994, IEEE Trans. Medical Imaging.

[22]  Jan Flusser,et al.  An adaptive method for image registration , 1992, Pattern Recognit..

[23]  S. P. Kim,et al.  Subpixel accuracy image registration by spectrum cancellation , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[25]  E ChristensenGary,et al.  Individualizing Neuroanatomical Atlases Using a Massively Parallel Computer , 1996 .

[26]  Mark D. Pritt.  Automated subpixel image registration of remotely sensed imagery , 1994, IBM J. Res. Dev..

[27]  Yves Bizais,et al.  Registration of multimodality medical images using a region overlap criterion , 1992, CVGIP Graph. Model. Image Process..

[28]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[29]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART II-EFFICIENT DESIGN AND APPLICATIONS , 1993 .

[30]  Yali Amit,et al.  A Nonlinear Variational Problem for Image Matching , 1994, SIAM J. Sci. Comput..

[31]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[32]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[33]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[34]  E. Micheli-Tzanakou,et al.  Study of the precision of registration in 3-D multimodality imaging with external markers using simulated images , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  E. Micheli-Tzanakou,et al.  Effect of the spatial resolution on the precision of parameter estimation in 3-D image registration with external markers , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  John C. Mazziotta,et al.  Automated image registration using a 105 parameter non-linear model , 1996, NeuroImage.

[37]  William H. Press,et al.  Numerical recipes , 1990 .

[38]  Yukio Kosugi,et al.  Medical image mapping using collaborative genetic algorithm , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  David J. Hawkes,et al.  Medical Image Registration Using Knowledge of Adjacency of Anatomical Structures , 1994, BMVC.

[40]  Michael Unser,et al.  Multiresolution image registration procedure using spline pyramids , 1993, Optics & Photonics.

[41]  Ingemar J. Cox,et al.  Predicting and Estimating the Accuracy of a Subpixel Registration Algorithm , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[44]  John Y. Chiang,et al.  Coincident bit counting-a new criterion for image registration , 1993, IEEE Trans. Medical Imaging.

[45]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[46]  Akram Aldroubi,et al.  B-spline signal processing. II. Efficiency design and applications , 1993, IEEE Trans. Signal Process..

[47]  Michael Unser,et al.  The L2-Polynomial Spline Pyramid , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Michael Unser,et al.  Statistical analysis of image differences by wavelet decomposition , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Michael Unser,et al.  A pyramid approach to sub-pixel image fusion based on mutual information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[50]  Urs E. Ruttimann,et al.  Head motion during positron emission tomography: is it significant? , 1995, Psychiatry Research: Neuroimaging.