Iterative x-ray/ct registration using accelerated volume rendering

Recent years have seen exciting advances in Computer Assisted Surgery (CAS). CAS systems are currently in use which provide data to the surgeon, provide passive feedback and motion constraint, and even automate parts of the surgery by manipulating cutters and endoscopic cameras. For most of these systems, accurate registration between the patient's anatomy and the CAS system is crucial: if the position of the surgical target is not known with sufficient accuracy, therapies cannot be applied precisely, and treatment efficacy falls. This thesis presents a system for recovering the position and orientation of the target anatomy in 3D space based on iterative comparison of 2D planar radiographs with preoperative CT data. More specifically, this system uses X-ray images acquired at the time of treatment, and iteratively compares them with synthetic images, known as Digitally Reconstructed Radiographs (DRRs), in order to estimate the position and orientation of the target anatomy. An intermediate data representation called a Transgraph is presented. The Transgraph is similar to the Lumigraph, or Light Field, and extends the computer graphics field called image-based rendering to transmission imaging. This representation speeds up computation of DRRs by over an order of magnitude compared to ray-casting techniques, without the use of special graphics hardware. A hardware based volume rendering technique is also presented. This approach is based on new texture mapping techniques which enable DRR generation using off the shelf consumer grade computer graphics hardware. These techniques permit computation of full resolution (512 x 512) DRRs based on 256 x 256 x 256 CT data in roughly 70 ms. The registration system is evaluated for application to frameless stereotactic radiosurgery, and phantom studies are presented demonstrating accuracy comparable to state of the art immobilization systems. Additional phantom studies are presented in which the registration system is used to measure implant orientation following total hip replacement surgery, improving on current practice by a factor of two.

[1]  J. Lewis,et al.  Dislocations after total hip-replacement arthroplasties. , 1978, The Journal of bone and joint surgery. American volume.

[2]  K L Lam,et al.  Automated localization of the prostate at the time of treatment using implanted radiopaque markers: technical feasibility. , 1995, International journal of radiation oncology, biology, physics.

[3]  Russell H. Taylor,et al.  On homogeneous transforms, quaternions, and computational efficiency , 1990, IEEE Trans. Robotics Autom..

[4]  P. Remeijer,et al.  Set-up verification using portal imaging; review of current clinical practice. , 2001, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[5]  Marc Levoy,et al.  Gaze-directed volume rendering , 1990, I3D '90.

[6]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[7]  Peter Kazanzides,et al.  Anatomy-based registration of CT-scan and intraoperative X-ray images for guiding a surgical robot , 1998, IEEE Transactions on Medical Imaging.

[8]  Peter Kazanzides,et al.  An image-directed robotic system for precise orthopaedic surgery , 1994, IEEE Trans. Robotics Autom..

[9]  M van Herk,et al.  Interactive three dimensional inspection of patient setup in radiation therapy using digital portal images and computed tomography data. , 1996, International journal of radiation oncology, biology, physics.

[10]  Jacques Demongeot,et al.  Automated Registration of Ultrasound with CT Images: Application to Computer Assisted Prostate Radiotherapy and Orthopedics , 1999, MICCAI.

[11]  W. Eric L. Grimson,et al.  Evaluating and Validating an Automated Registration System for Enhanced Reality Visualization in Surgery , 1995, CVRMed.

[12]  G W Sherouse,et al.  Computation of digitally reconstructed radiographs for use in radiotherapy treatment design. , 1990, International journal of radiation oncology, biology, physics.

[13]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[14]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[15]  J. H. Hubbell,et al.  Photon cross sections, attenuation coefficients, and energy absorption coefficients from 10 keV to 100 GeV , 1969 .

[16]  Marie-Odile Berger,et al.  Fully Automatic 3D/2D Subtracted Angiography Registration , 1999, MICCAI.

[17]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[18]  D. McCollum,et al.  Dislocation after total hip arthroplasty. Causes and prevention. , 1990, Clinical orthopaedics and related research.

[19]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[20]  L. Joskowicz,et al.  FRACAS: a system for computer-aided image-guided long bone fracture surgery. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[21]  T Kanade,et al.  Techniques for fast and accurate intrasurgical registration. , 1995, Journal of image guided surgery.

[22]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[23]  R. Penrose.  On best approximate solutions of linear matrix equations , 1956, Mathematical Proceedings of the Cambridge Philosophical Society.

[24]  M Wannenmacher,et al.  Combined error of patient positioning variability and prostate motion uncertainty in 3D conformal radiotherapy of localized prostate cancer. , 1996, International journal of radiation oncology, biology, physics.

[25]  R Komistek,et al.  An interactive system for kinematic analysis of artificial joint implants. , 1999, Biomedical sciences instrumentation.

[26]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[27]  Graeme P. Penney,et al.  2D/3D registration and motion tracking for surgical interventions , 1998 .

[28]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[29]  Robert E. Huffman,et al.  Photon Cross Sections , 1992 .

[30]  F. Spiers.  Physics of Radiology , 1968, Nature.

[31]  Rachid Deriche,et al.  Fast algorithms for low-level vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[32]  M. Murphy.  An automatic six-degree-of-freedom image registration algorithm for image-guided frameless stereotaxic radiosurgery. , 1997, Medical physics.

[33]  Branislav Jaramaz,et al.  CupAlign: Computer-Assisted Postoperative Radiographic Measurement of Acetabular Components Following Total Hip Arthroplasty , 1999, MICCAI.

[34]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[35]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[36]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[37]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[39]  T. Kanade,et al.  Accuracy Validation in Image-Guided Orthopaedic Surgery , 1995 .

[40]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[41]  D. R. Fish,et al.  A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs. , 1994, Medical physics.

[42]  Arie E. Kaufman,et al.  High-quality volume rendering using texture mapping hardware , 1998, Workshop on Graphics Hardware.

[43]  B. Jaramaz,et al.  Computer Assisted Measurement of Cup Placement in Total Hip Replacement , 1998, Clinical orthopaedics and related research.

[44]  L. Verhey,et al.  Computer-assisted positioning of radiotherapy patients using implanted radiopaque fiducials. , 1993, Medical physics.

[45]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[46]  M van Herk,et al.  Automatic three-dimensional inspection of patient setup in radiation therapy using portal images, simulator images, and computed tomography data. , 1996, Medical physics.