Parallax-free intra-operative X-ray image stitching

We present a novel method to generate parallax-free panoramic X-ray images during surgery by enabling the mobile C-arm to rotate around its X-ray source center, relative to the patient's table. Rotating the mobile C-arm around its X-ray source center is impractical and sometimes impossible due to the mechanical design of mobile C-arm systems. In order to ensure that the C-arm motion is a relative pure rotation around its X-ray source center, we propose to move the table to compensate for the translational part of the motion based on C-arm pose estimation. For this we employ a visual marker pattern and a Camera Augmented Mobile C-arm system that is a standard mobile C-arm augmented by a video camera and mirror construction. We are able to produce a parallax-free panoramic X-ray image independent of the geometric configuration of imaged anatomical structures. Our method does not require a fronto-parallel setup or any overlap between the acquired X-ray images. This generated parallax-free panoramic X-ray image preserves the linear perspective projection property. It also presents a negligible difference (below 2 pixels) in the overlapping area between two consecutive individual X-ray images and has a high visual quality. This promises suitability for intra-operative clinical applications in orthopedic and trauma surgery. The experiments on phantoms and ex-vivo bone structure demonstrate both the functionality and accuracy of the method.

[1]  Kenichi Kanatani,et al.  Analysis of 3-D Rotation Fitting , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Gabor Fichtinger,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, 11th International Conference, New York, NY, USA, September 6-10, 2008, Proceedings, Part I , 2008, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[4]  S. Chaganti,et al.  A language for effective communication between surgeons and radiographers in trauma theatre. , 2009, Annals of the Royal College of Surgeons of England.

[5]  J Persliden,et al.  Digital radiography of scoliosis with a scanning method: initial evaluation. , 2001, Radiology.

[6]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[9]  Achim Schweikard,et al.  Closed-form inverse kinematic solution for fluoroscopic C-arms , 2007, Adv. Robotics.

[10]  P. Ostermann,et al.  Length and angle measurements of the lower extremity in digital composite overview images , 2004, European Radiology.

[11]  A. Jacob,et al.  Image Fusion for Intraoperative Control of Axis in Long Bone Fracture Treatment , 2006, European Journal of Trauma.

[12]  Frans A. Gerritsen,et al.  A novel method for digital X-ray imaging of the complete spine , 1997, CVRMed.

[13]  Nassir Navab,et al.  Merging visible and invisible: two Camera-Augmented Mobile C-arm (CAMC) applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[14]  Lejing Wang,et al.  Parallax-Free Long Bone X-ray Image Stitching , 2009, MICCAI.

[15]  Nicholas Ayache,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2007, 10th International Conference, Brisbane, Australia, October 29 - November 2, 2007, Proceedings, Part I , 2007, MICCAI.

[16]  Bernhard Kainz,et al.  Fast Marker Based C-Arm Pose Estimation , 2008, MICCAI.

[17]  Roy Sanders,et al.  Fractures of the proximal third of the tibial shaft treated with intramedullary nails and blocking screws. , 2008 .

[18]  Bruno Siciliano,et al.  Modelling and Control of Robot Manipulators , 1997, Advanced Textbooks in Control and Signal Processing.

[19]  Leo Joskowicz,et al.  Long bone panoramas from fluoroscopic X-ray images , 2004 .

[20]  W. Obremskey,et al.  Comparison of intramedullary nailing of distal third tibial shaft fractures: before and after traumatologists. , 2004, Orthopedics.

[21]  R. Sanders,et al.  Angular Malalignment After Intramedullary Nailing of Femoral Shaft Fractures , 2001, Journal of orthopaedic trauma.

[22]  Christopher J. Taylor,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009 , 2009, Lecture Notes in Computer Science.

[23]  Lejing Wang,et al.  Long Bone X-Ray Image Stitching Using Camera Augmented Mobile C-Arm , 2008, MICCAI.

[24]  Rachid Deriche,et al.  Using geometric corners to build a 2D mosaic from a set of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Nassir Navab,et al.  A Multi-view Opto-Xray Imaging System , 2007, MICCAI.

[26]  N. Verdonschot,et al.  Rotational Malalignment After Intramedullary Nailing of Femoral Fractures , 2004, Journal of orthopaedic trauma.

[27]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[28]  Markus Völk,et al.  Amorphous Silicon, Flat-Panel, X-ray Detector: Reliability of Digital Image Fusion Regarding Angle and Distance Measurements in Long-Leg Radiography , 2004, Investigative radiology.

[29]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[30]  Richard Szeliski,et al.  Seamless Stitching using Multi-Perspective Plane Sweep , 2004 .

[31]  Nassir Navab,et al.  Camera-Augmented Mobile C-arm (CAMC) Application: 3D Reconstruction Using a Low-Cost Mobile C-arm , 1999, MICCAI.

[32]  Jeremy R. Cooperstock,et al.  Overcoming Parallax and Sampling Density Issues in Image Mosaicing of Non-Planar Scenes , 2007, BMVC.