Pivot calibration concept for sensor attached mobile c-arms

Medical augmented reality has been actively studied for decades and many methods have been proposed torevolutionize clinical procedures. One example is the camera augmented mobile C-arm (CAMC), which providesa real-time video augmentation onto medical images by rigidly mounting and calibrating a camera to the imagingdevice. Since then, several CAMC variations have been suggested by calibrating 2D/3D cameras, trackers, andmore recently a Microsoft HoloLens to the C-arm. Different calibration methods have been applied to establishthe correspondence between the rigidly attached sensor and the imaging device. A crucial step for these methodsis the acquisition of X-Ray images or 3D reconstruction volumes; therefore, requiring the emission of ionizingradiation. In this work, we analyze the mechanical motion of the device and propose an alternatative methodto calibrate sensors to the C-arm without emitting any radiation. Given a sensor is rigidly attached to thedevice, we introduce an extended pivot calibration concept to compute the fixed translation from the sensor tothe C-arm rotation center. The fixed relationship between the sensor and rotation center can be formulated as apivot calibration problem with the pivot point moving on a locus. Our method exploits the rigid C-arm motiondescribing a Torus surface to solve this calibration problem. We explain the geometry of the C-arm motion andits relation to the attached sensor, propose a calibration algorithm and show its robustness against noise, as wellas trajectory and observed pose density by computer simulations. We discuss this geometric-based formulationand its potential extensions to different C-arm applications.

[1]  Nassir Navab,et al.  Interactive Flying Frustums (IFFs): spatially aware surgical data visualization , 2019, International Journal of Computer Assisted Radiology and Surgery.

[2]  Nassir Navab,et al.  Technical note: an augmented reality system for total hip arthroplasty , 2018, Medical Imaging.

[3]  Daniel Mirota,et al.  An on-board surgical tracking and video augmentation system for C-arm image guidance , 2012, International Journal of Computer Assisted Radiology and Surgery.

[4]  Nassir Navab,et al.  Closing the Calibration Loop: An Inside-out-tracking Paradigm for Augmented Reality in Orthopedic Surgery , 2018, MICCAI.

[5]  Alberto Corbi,et al.  Geometrical Calibration of X-Ray Imaging With RGB Cameras for 3D Reconstruction , 2016, IEEE Transactions on Medical Imaging.

[6]  Nassir Navab,et al.  RGBDX: First Design and Experimental Validation of a Mirror-Based RGBD X-ray Imaging System , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[7]  Dietrich Manzey,et al.  Impact of image-guided surgery on surgeons' performance: a literature review , 2016 .

[8]  R. Sanders,et al.  The effects, risks, and guidelines for radiation use in orthopaedic surgery. , 2000, Clinical orthopaedics and related research.

[9]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[10]  Lejing Wang,et al.  Parallax-free intra-operative X-ray image stitching , 2010, Medical Image Anal..

[11]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[12]  Lejing Wang,et al.  First Deployments of Augmented Reality in Operating Rooms , 2012, Computer.

[13]  Nassir Navab,et al.  Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization , 2016, International Journal of Computer Assisted Radiology and Surgery.

[14]  Nassir Navab,et al.  Merging visible and invisible: two Camera-Augmented Mobile C-arm (CAMC) applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[15]  Simon Weidert,et al.  Relevance-Based Visualization to Improve Surgeon Perception , 2014, IPCAI.