Intraoperative Image-based Multiview 2D/3D Registration for Image-Guided Orthopaedic Surgery: Incorporation of Fiducial-Based C-Arm Tracking and GPU-Acceleration

Intraoperative patient registration may significantly affect the outcome of image-guided surgery (IGS). Image-based registration approaches have several advantages over the currently dominant point-based direct contact methods and are used in some industry solutions in image-guided radiation therapy with fixed X-ray gantries. However, technical challenges including geometric calibration and computational cost have precluded their use with mobile C-arms for IGS. We propose a 2D/3D registration framework for intraoperative patient registration using a conventional mobile X-ray imager combining fiducial-based C-arm tracking and graphics processing unit (GPU)-acceleration. The two-stage framework 1) acquires X-ray images and estimates relative pose between the images using a custom-made in-image fiducial, and 2) estimates the patient pose using intensity-based 2D/3D registration. Experimental validations using a publicly available gold standard dataset, a plastic bone phantom and cadaveric specimens have been conducted. The mean target registration error (mTRE) was 0.34±0.04 mm (success rate: 100%, registration time: 14.2 s) for the phantom with two images 90° apart, and 0.99±0.41 mm (81%, 16.3 s) for the cadaveric specimen with images 58.5° apart. The experimental results showed the feasibility of the proposed registration framework as a practical alternative for IGS routines.

[1]  T. Peters,et al.  2D-3D registration of coronary angiograms for cardiac procedure planning and guidance. , 2005, Medical physics.

[2]  Peter Kazanzides,et al.  An Iterative Framework for Improving the Accuracy of Intraoperative Intensity-Based 2D/3D Registration for Image-Guided Orthopedic Surgery , 2010, IPCAI.

[3]  Takeo Kanade,et al.  Transgraph: interactive intensity-based 2D/3D registration of x-ray and CT data , 2000, Medical Imaging: Image Processing.

[4]  Wolfgang Birkfellner,et al.  Fast DRR splat rendering using common consumer graphics hardware. , 2007, Medical physics.

[5]  Frank Sauer,et al.  Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy , 2006, Medical Image Anal..

[6]  Andre dos Santos Cardoso.  Generation of planar radiographs from 3D anatomical models using the GPU , 2011 .

[7]  Torsten Rohlfing,et al.  Fast intensity-based 2D-3D image registration of clinical data using light , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Daniel Rueckert,et al.  Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration , 2005, IEEE Transactions on Medical Imaging.

[9]  W. Eric L. Grimson,et al.  2D-3D rigid registration of X-ray fluoroscopy and CT images using mutual information and sparsely sampled histogram estimators , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Fang Xu.  Fast Implementation of Iterative Reconstruction with Exact Ray-Driven Projector on GPUs , 2010 .

[11]  Xiaohu Guo,et al.  Real-Time GPU-Aided Lung Tumor Tracking , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[12]  Graeme P. Penney,et al.  Standardized evaluation methodology for 2-D-3-D registration , 2005, IEEE Transactions on Medical Imaging.

[13]  M. Figl,et al.  Validation for 2D/3D registration. I: A new gold standard data set. , 2011, Medical physics.

[14]  Guoyan Zheng,et al.  Precise Estimation of Postoperative Cup Alignment from Single Standard X-Ray Radiograph with Gonadal Shielding , 2007, MICCAI.

[15]  Gabor Fichtinger,et al.  C-arm Tracking by Intensity-Based Registration of a Fiducial in Prostate Brachytherapy , 2010, IPCAI.

[16]  Russell H. Taylor,et al.  Deformable 2D-3D Registration of the Pelvis with a Limited Field of View, Using Shape Statistics , 2007, MICCAI.

[17]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[18]  J. Balter,et al.  Imaging and alignment for image-guided radiation therapy. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[19]  Peter Kazanzides,et al.  Computer-integrated revision total hip replacement surgery: concept and preliminary results , 1999, Medical Image Anal..

[20]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[21]  Peter Kazanzides,et al.  An image-guided femoroplasty system: development and initial cadaver studies , 2010, Medical Imaging.

[22]  Petros Koumoutsakos,et al.  A Method for Handling Uncertainty in Evolutionary Optimization With an Application to Feedback Control of Combustion , 2009, IEEE Transactions on Evolutionary Computation.

[23]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[24]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[25]  Ameet K. Jain,et al.  FTRAC--a robust fluoroscope tracking fiducial. , 2005, Medical physics.

[26]  L. Joskowicz,et al.  Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT , 2003, IEEE Transactions on Medical Imaging.

[27]  Guoyan Zheng,et al.  Statistical shape model-based reconstruction of a scaled, patient-specific surface model of the pelvis from a single standard AP x-ray radiograph. , 2010, Medical physics.

[28]  Russell H. Taylor,et al.  Statistical Atlases of Bone Anatomy: Construction, Iterative Improvement and Validation , 2007, MICCAI.

[29]  Daniel B. Russakoff,et al.  Intensity-based 2D-3D spine image registration incorporating a single fiducial marker. , 2005, Academic radiology.

[30]  Bostjan Likar,et al.  3D/2D Image Registration: The Impact of X-Ray Views and Their Number , 2007, MICCAI.

[31]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[32]  Paul Suetens,et al.  GPU-accelerated digitally reconstructed radiographs , 2008 .

[33]  Jürgen Weese,et al.  Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery , 1997, IEEE Transactions on Information Technology in Biomedicine.

[34]  B. Fei,et al.  Automatic 3D-to-2D registration for CT and dual-energy digital radiography for calcification detection. , 2007, Medical physics.

[35]  M. Kessler.  Image registration and data fusion in radiation therapy. , 2006, The British journal of radiology.

[36]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[37]  J. Wong,et al.  Flat-panel cone-beam computed tomography for image-guided radiation therapy. , 2002, International journal of radiation oncology, biology, physics.

[38]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[39]  Minho Kim,et al.  Evaluation of similarity measures for use in the intensity-based rigid 2D-3D registration for patient positioning in radiotherapy. , 2009, Medical physics.

[40]  Kirsten Schmieder,et al.  Registration of CT and Intraoperative 3-D Ultrasound Images of the Spine Using Evolutionary and Gradient-Based Methods , 2008, IEEE Transactions on Evolutionary Computation.

[41]  D. R. Fish,et al.  A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs. , 1994, Medical physics.

[42]  Gabor Fichtinger,et al.  C-arm Tracking and Reconstruction Without an External Tracker , 2006, MICCAI.

[43]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[44]  Russell H. Taylor,et al.  Image registration and hybrid volume reconstruction of bone anatomy using a statistical shape atlas , 2009 .

[45]  Tomaz Slivnik,et al.  3-D/2-D registration of CT and MR to X-ray images , 2003, IEEE Transactions on Medical Imaging.

[46]  B. Wilson,et al.  Volume CT with a flat-panel detector on a mobile, isocentric C-arm: pre-clinical investigation in guidance of minimally invasive surgery. , 2005, Medical physics.

[47]  Russell H. Taylor,et al.  Hybrid Cone-Beam Tomographic Reconstruction: Incorporation of Prior Anatomical Models to Compensate for Missing Data , 2011, IEEE Transactions on Medical Imaging.

[48]  J H Siewerdsen,et al.  Geometric calibration of a mobile C-arm for intraoperative cone-beam CT. , 2008, Medical physics.

[49]  D. Paulus,et al.  2D/3D image registration on the GPU , 2008, Pattern Recognition and Image Analysis.

[50]  R L Siddon,et al.  Calculation of the radiological depth. , 1985, Medical physics.

[51]  Achim Schweikard,et al.  Motion and Positional Error Correction for Cone Beam 3D-Reconstruction with Mobile C-Arms , 2007, MICCAI.

[52]  A Bel,et al.  Accelerated ray tracing for radiotherapy dose calculations on a GPU. , 2009, Medical physics.

[53]  G. Widmann,et al.  Errors and error management in image-guided craniomaxillofacial surgery. , 2009, Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics.

[54]  Ren Hui Gong,et al.  2D/3D registration with the CMA-ES method , 2008, SPIE Medical Imaging.

[55]  G Fichtinger,et al.  Technical note: unsupervised C-arm pose tracking with radiographic fiducial. , 2011, Medical physics.

[56]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[57]  D. Jaffray,et al.  Advances in image-guided radiation therapy. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[58]  Bostjan Likar,et al.  Validation for 2D/3D registration. II: The comparison of intensity- and gradient-based merit functions using a new gold standard data set. , 2011, Medical physics.

[59]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[60]  Julien Jomier,et al.  3D/2D Model-to-Image Registration Applied to TIPS Surgery , 2006, MICCAI.

[61]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[62]  J. Kettenbach,et al.  Stochastic rank correlation: a robust merit function for 2D/3D registration of image data obtained at different energies. , 2009, Medical physics.

[63]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.