An Accuracy Certified Augmented Reality System for Therapy Guidance

Our purpose is to provide an augmented reality system for Radio-Frequency guidance that could superimpose a 3D model of the liver, its vessels and tumors (reconstructed from CT images) on external video images of the patient. In this paper, we point out that clinical usability not only need the best affordable registration accuracy, but also a certification that the required accuracy is met, since clinical conditions change from one intervention to the other. Beginning by addressing accuracy performances, we show that a 3D/2D registration based on radio-opaque fiducials is more adapted to our application constraints than other methods. Then, we outline a lack in their statistical assumptions which leads us to the derivation of a new extended 3D/2D criterion. Careful validation experiments on real data show that an accuracy of 2 mm can be achieved in clinically relevant conditions, and that our new criterion is up to 9% more accurate, while keeping a computation time compatible with real-time at 20 to 40 Hz.

[1]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[3]  Sundaram Ganapathy,et al.  Decomposition of transformation matrices for robot vision , 1984, Pattern Recognit. Lett..

[4]  José Santos-Victor,et al.  Uncertainty analysis of 3D reconstruction from uncalibrated views , 2000, Image Vis. Comput..

[5]  Hervé Delingette,et al.  Surgery Simulation and Soft Tissue Modeling , 2003, Lecture Notes in Computer Science.

[6]  J. McGahan,et al.  Radiofrequency ablation of the liver: current status. , 2001, AJR. American journal of roentgenology.

[7]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  K. Lam,et al.  Improvement of CT-based treatment-planning models of abdominal targets using static exhale imaging. , 1998, International journal of radiation oncology, biology, physics.

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Tomas Lozano-Perez,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1996 .

[11]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[12]  Luc Soler,et al.  Evaluation of a New 3D/2D Registration Criterion for Liver Radio-Frequencies Guided by Augmented Reality , 2003, IS4TH.

[13]  N. Ayache,et al.  Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery , 2001 .

[14]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[15]  Radu Horaud,et al.  Object pose from 2-D to 3-D point and line correspondences , 1995, International Journal of Computer Vision.

[16]  Xavier Pennec,et al.  A Framework for Uncertainty and Validation of 3-D Registration Methods Based on Points and Frames , 2004, International Journal of Computer Vision.

[17]  Yacov Hel-Or,et al.  Corrections to 'Pose Estimation by Fusing Noisy Data of Different Dimensions' , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Nicholas Ayache,et al.  Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information , 2001, IEEE Transactions on Medical Imaging.

[19]  Xavier Pennec,et al.  Feature-Based Registration of Medical Images: Estimation and Validation of the Pose Accuracy , 1998, MICCAI.

[20]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[21]  J. Wong,et al.  The use of active breathing control (ABC) to reduce margin for breathing motion. , 1999, International journal of radiation oncology, biology, physics.