FAIR: a hardware architecture for real-time 3-D image registration

Mutual information-based image registration, shown to be effective in registering a range of medical images, is a computationally expensive process, with a typical execution time on the order of minutes on a modern single-processor computer. Accelerated execution of this process promises to enhance efficiency and therefore promote routine use of image registration clinically. This paper presents details of a hardware architecture for real-time three-dimensional (3-D) image registration. Real-time performance can be achieved by setting up a network of processing units, each with three independent memory buses: one each for the two image memories and one for the mutual histogram memory. Memory access parallelization and pipelining, by design, allow each processing unit to be 25 times faster than a processor with the same bus speed, when calculating mutual information using partial volume interpolation. Our architecture provides superior per-processor performance at a lower cost compared to a parallel supercomputer.

[1]  Ron Kikinis,et al.  A High Performance Computing Approach to the Registration of Medical Imaging Data , 1998, Parallel Comput..

[2]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[3]  R. Killiany,et al.  Quantitative follow‐up of patients with multiple sclerosis using MRI: Reproducibility , 1999, Journal of magnetic resonance imaging : JMRI.

[4]  Nicholas Ayache,et al.  Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information , 2001, IEEE Transactions on Medical Imaging.

[5]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[6]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[7]  A. Convit,et al.  Hippocampal formation glucose metabolism and volume losses in MCI and AD , 2001, Neurobiology of Aging.

[8]  David J. Hawkes,et al.  Voxel similarity measures for 3-D serial MR brain image registration , 1999, IEEE Transactions on Medical Imaging.

[9]  Raj Shekhar,et al.  3D Stress echocardiography: a novel application based on registration of real-time 3D ultrasound images , 2002 .

[10]  J Mazziotta,et al.  A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[12]  T. Netsch,et al.  Towards real-time multi-modality 3-D medical image registration , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  David A. Patterson,et al.  Computer Architecture - A Quantitative Approach, 5th Edition , 1996 .

[14]  Günter Knittel,et al.  VERVE: Voxel Engine for Real-time Visualization and Examination , 1993, Comput. Graph. Forum.

[15]  Tohru Shiga,et al.  Image fusion between 18FDG-PET and MRI/CT for radiotherapy planning of oropharyngeal and nasopharyngeal carcinomas. , 2002, International journal of radiation oncology, biology, physics.

[16]  D. Rubens,et al.  Three-dimensional registration and fusion of ultrasound and MRI using major vessels as fiducial markers , 2001, IEEE Transactions on Medical Imaging.

[17]  Michael C. Doggett,et al.  A memory addressing and access design for real time volume rendering , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[18]  S M Larson,et al.  Overview of clinical radioimmunodetection of human tumors , 1994, Cancer.

[19]  Reinhard Männer,et al.  Latency- and hazard-free volume memory architecture for direct volume rendering , 1997, Comput. Graph..

[20]  Colin Studholme,et al.  Measures of 3D medical image alignment , 1997 .

[21]  Ron Kikinis,et al.  Real-time registration of volumetric brain MRI by biomechanical simulation of deformation during image guided neurosurgery , 2002 .

[22]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[23]  E ChristensenGary,et al.  Individualizing Neuroanatomical Atlases Using a Massively Parallel Computer , 1996 .

[24]  Raj Shekhar,et al.  Mutual information-based rigid and nonrigid registration of ultrasound volumes , 2002, IEEE Transactions on Medical Imaging.

[25]  G. Tracton,et al.  Image registration: an essential part of radiation therapy treatment planning. , 1998, International journal of radiation oncology, biology, physics.

[26]  I. Kaplan,et al.  Real time MRI-ultrasound image guided stereotactic prostate biopsy. , 2002, Magnetic resonance imaging.

[27]  Hanspeter Pfister,et al.  Cube-4-a scalable architecture for real-time volume rendering , 1996, Proceedings of 1996 Symposium on Volume Visualization.

[28]  Torsten Rohlfing,et al.  Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees , 2003, IEEE Transactions on Information Technology in Biomedicine.

[29]  Michael I. Miller,et al.  Individualizing Neuroanatomic Atlases Using a Massively Parallel Computer , 1996, Computer.

[30]  Benoit M. Dawant,et al.  Brain Atlas Deformation in the Presence of Large Space-occupying Tumors , 1999, MICCAI.

[31]  S. Winter,et al.  Registration of 3D CT and ultrasound datasets of the spine using bone structures. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.