C-ARM POSE ESTIMATION AND NAVIGATION IN SURGERIES FOR AUGMENTED REALITY APPLICATION

Abstract. C-arm X-ray imaging systems are widely applied in surgeries. Overlaying X-ray with optical images during the surgery has been shown to be an efficient approach. Moreover, overlaying needed data from different modalities in an augmented reality (AR) manner can improve the accuracy of surgical procedures, decrease the variability of surgical outcomes, reduce trauma to the critical structures, increase the reproducibility of surgeons’ performance, and reduce radiation exposure. C-Arm geometric calibration and recovering the C-arm pose are essential for surgical navigation and AR applications in operating rooms. Therefore, in this paper, existing researches for calibration and pose estimation of C-arm devices in surgical AR applications are evaluated from photogrammetric point of view. Then, a proposed marker-based method for C-arm pose estimation is introduced. For this purpose, a marker is designed to facilitate tracking and pose estimation in mixed reality based on golden section principle, and perspective invariants such as cross-ratios, collinearity, and intersection. Moreover, a procedure is also proposed for fast determination of these fiducial markers. The experiments show benefits of such a structure which has a limited occlusion with consistency to different conditions such as narrow field of view and at the same time, even in images with high projectivity. It also results that the distortion correction step is important and the effect of distortion of X-ray images can cause inconsistency in the perspective invariants.

[1]  Lejing Wang,et al.  Closed-Form Inverse Kinematics for Interventional C-Arm X-Ray Imaging With Six Degrees of Freedom: Modeling and Application , 2012, IEEE Transactions on Medical Imaging.

[2]  Leo Joskowicz,et al.  Robust Automatic C-Arm Calibration for Fluoroscopy-Based Navigation: A Practical Approach , 2002, MICCAI.

[3]  J. Shuhaiber,et al.  Augmented reality in surgery. , 2004, Archives of surgery.

[4]  Takeo Kanade,et al.  Augmented reality imaging technology for orthopaedic surgery , 2000 .

[5]  Nassir Navab,et al.  Improved interventional X-ray appearance , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[6]  Éric Marchand,et al.  Pose Estimation for Augmented Reality: A Hands-On Survey , 2016, IEEE Transactions on Visualization and Computer Graphics.

[7]  Gabor Fichtinger,et al.  C-arm rotation encoding with accelerometers , 2010, International Journal of Computer Assisted Radiology and Surgery.

[8]  K Bouazza-Marouf,et al.  Robotic-assisted internal fixation of hip fractures: A fluoroscopy-based intraoperative registration technique , 2000, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[9]  L P Nolte,et al.  Fluoroscopy as an imaging means for computer-assisted surgical navigation. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[10]  H Broers,et al.  Photogrammetric calibration of a C-arm X-ray system as a verification tool for orthopaedic navigation systems , 2002 .

[11]  Lejing Wang,et al.  Novel techniques for integrating video augmented X-ray imaging into orthopedic and trauma surgery , 2012 .

[12]  Nassir Navab,et al.  Inverse visualization concept for RGB-D augmented C-arms , 2016, Comput. Biol. Medicine.

[13]  Rafael Beyar,et al.  Prospective motion correction of X-ray images for coronary interventions , 2005, IEEE Transactions on Medical Imaging.

[14]  Bernhard Kainz,et al.  Fast Marker Based C-Arm Pose Estimation , 2008, MICCAI.

[15]  Volker Willert,et al.  Robustness of control point configurations for homography and planar pose estimation , 2018, ArXiv.

[16]  Olivier Ecabert,et al.  Image-based Co-Registration of Angiography and Intravascular Ultrasound Images , 2013, IEEE Transactions on Medical Imaging.

[17]  Hyunseok Choi,et al.  Perspective pinhole model with planar source for augmented reality surgical navigation based on C-arm imaging , 2018, International Journal of Computer Assisted Radiology and Surgery.

[18]  Guy Shechter,et al.  Respiratory motion of the heart: Implications for magnetic resonance coronary angiography , 2004 .

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[21]  Tapani Koivukangas,et al.  Technical accuracy of optical and the electromagnetic tracking systems , 2013, SpringerPlus.

[22]  Gabor Fichtinger,et al.  C-arm Tracking and Reconstruction Without an External Tracker , 2006, MICCAI.

[23]  Russell H. Taylor,et al.  Statistical characterization of C-arm distortion with application to intra-operative distortion correction , 2007, SPIE Medical Imaging.

[24]  G. Hindricks,et al.  Ablation of typical atrial flutter using a novel non-fluoroscopic electromagnetic catheter tracking system , 2014 .

[25]  Shahram Amiri,et al.  A low-cost tracked C-arm (TC-arm) upgrade system for versatile quantitative intraoperative imaging , 2014, International Journal of Computer Assisted Radiology and Surgery.

[26]  Séverine Habert,et al.  Multi-Modal Visualization Paradigms for RGBD augmented X-ray Imaging , 2018 .

[27]  Nassir Navab,et al.  Camera-Augmented Mobile C-arm (CAMC) Application: 3D Reconstruction Using a Low-Cost Mobile C-arm , 1999, MICCAI.

[28]  Meng Ma,et al.  [POSTER] RGB-D/C-arm Calibration and Application in Medical Augmented Reality , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[29]  Angela E. Kedgley,et al.  Image intensifier distortion correction for fluoroscopic RSA: the need for independent accuracy assessment , 2012, Journal of applied clinical medical physics.

[30]  Lejing Wang,et al.  Intra-op Measurement of the Mechanical Axis Deviation: An Evaluation Study on 19 Human Cadaver Legs , 2012, MICCAI.

[31]  Nassir Navab,et al.  Recovering the X-ray projection geometry for three-dimensional tomographic reconstruction with additional sensors: Attached camera versus external navigation system , 2003, Medical Image Anal..

[32]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[33]  Nassir Navab,et al.  Precise 3D/2D calibration between a RGB-D sensor and a C-arm fluoroscope , 2016, International Journal of Computer Assisted Radiology and Surgery.

[34]  Ève Coste-Manière,et al.  Temporal tracking of 3D coronary arteries in projection angiograms , 2002, SPIE Medical Imaging.

[35]  K. Shelburne,et al.  A comparison of calibration methods for stereo fluoroscopic imaging systems. , 2011, Journal of biomechanics.

[36]  Nassir Navab,et al.  Dynamic geometrical calibration for 3D cerebral angiography , 1996, Medical Imaging.

[37]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Adrien Bartoli,et al.  Infinitesimal Plane-Based Pose Estimation , 2014, International Journal of Computer Vision.

[39]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..