Preclinical usability study of multiple augmented reality concepts for K-wire placement

PurposeIn many orthopedic surgeries, there is a demand for correctly placing medical instruments (e.g., K-wire or drill) to perform bone fracture repairs. The main challenge is the mental alignment of X-ray images acquired using a C-arm, the medical instruments, and the patient, which dramatically increases in complexity during pelvic surgeries. Current solutions include the continuous acquisition of many intra-operative X-ray images from various views, which will result in high radiation exposure, long surgical durations, and significant effort and frustration for the surgical staff. This work conducts a preclinical usability study to test and evaluate mixed reality visualization techniques using intra-operative X-ray, optical, and RGBD imaging to augment the surgeon’s view to assist accurate placement of tools.MethodWe design and perform a usability study to compare the performance of surgeons and their task load using three different mixed reality systems during K-wire placements. The three systems are interventional X-ray imaging, X-ray augmentation on 2D video, and 3D surface reconstruction augmented by digitally reconstructed radiographs and live tool visualization.ResultsThe evaluation criteria include duration, number of X-ray images acquired, placement accuracy, and the surgical task load, which are observed during 21 clinically relevant interventions performed by surgeons on phantoms. Finally, we test for statistically significant improvements and show that the mixed reality visualization leads to a significantly improved efficiency.ConclusionThe 3D visualization of patient, tool, and DRR shows clear advantages over the conventional X-ray imaging and provides intuitive feedback to place the medical tools correctly and efficiently.

[1]  H. Goitz,et al.  Percutaneous screw fixation of acetabular fractures with CT guidance: preliminary results of a new technique. , 1992, AJR. American journal of roentgenology.

[2]  Regina Nuzzo,et al.  Scientific method: Statistical errors , 2014, Nature.

[3]  C Krettek,et al.  [Cost-benefit analysis of intraoperative 3D imaging]. , 2007, Der Unfallchirurg.

[4]  M. Synowitz,et al.  Surgeon's radiation exposure during percutaneous vertebroplasty. , 2006, Journal of neurosurgery. Spine.

[5]  H. Britton Sanderford Special feature: The TORC TP — III , 1974, Computer.

[6]  Lejing Wang,et al.  First Deployments of Augmented Reality in Operating Rooms , 2012, Computer.

[7]  Simon Weidert,et al.  Machine learning-based augmented reality for improved surgical scene understanding , 2015, Comput. Medical Imaging Graph..

[8]  Nassir Navab,et al.  Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization , 2016, International Journal of Computer Assisted Radiology and Surgery.

[9]  Jens Dreyhaupt,et al.  Computer-Aided Surgery Does Not Increase the Accuracy of Dorsal Pedicle Screw Placement in the Thoracic and Lumbar Spine: A Retrospective Analysis of 2,003 Pedicle Screws in a Level I Trauma Center , 2015, Global spine journal.

[10]  Werner Panzer,et al.  Fluoroscopic radiation exposure of the kyphoplasty patient , 2006, European Spine Journal.

[11]  Daniel Mirota,et al.  An on-board surgical tracking and video augmentation system for C-arm image guidance , 2012, International Journal of Computer Assisted Radiology and Surgery.

[12]  W. Mills,et al.  Percutaneous fixation of pelvic ring disruptions. , 2000, Clinical orthopaedics and related research.

[13]  Nassir Navab,et al.  A Multi-view Opto-Xray Imaging System , 2007, MICCAI.

[14]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[15]  A J Starr,et al.  Preliminary results and complications following limited open reduction and percutaneous screw fixation of displaced fractures of the acetabulum. , 2001, Injury.

[16]  W. Mills,et al.  Iliosacral screw fixation: early complications of the percutaneous technique. , 1997, Journal of orthopaedic trauma.

[17]  Meng Ma,et al.  [POSTER] Augmenting Mobile C-arm Fluoroscopes via Stereo-RGBD Sensors for Multimodal Visualization , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Ulrich Stöckle,et al.  Image guidance in pelvic and acetabular surgery--expectations, success and limitations. , 2007, Injury.

[19]  Nassir Navab,et al.  RGBDX: First Design and Experimental Validation of a Mirror-Based RGBD X-ray Imaging System , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[20]  M. Artés Statistical errors. , 1977, Medicina clinica.

[21]  A. Jones,et al.  Percutaneous fixation of the columns of the acetabulum: a new technique. , 1998, Journal of orthopaedic trauma.

[22]  Laurent Audigé,et al.  Worldwide survey on the use of navigation in spine surgery. , 2013, World neurosurgery.

[23]  Lejing Wang,et al.  Radiation-Free Drill Guidance in Interlocking of Intramedullary Nails , 2012, MICCAI.

[24]  Ivan Marintschev,et al.  Screw Placement for Acetabular Fractures: Which Navigation Modality (2-Dimensional vs. 3-Dimensional) Should Be Used? An Experimental Study , 2012, Journal of orthopaedic trauma.

[25]  Simon Weidert,et al.  Intra-operative augmented reality in distal locking , 2015, International Journal of Computer Assisted Radiology and Surgery.

[26]  D. Mears,et al.  Surgical treatment of acetabular fractures in elderly patients with osteoporotic bone. , 1999, The Journal of the American Academy of Orthopaedic Surgeons.

[27]  T. Hüfner,et al.  Kosten- und Nutzenanalyse der intraoperativen 3D-Bildgebung , 2006, Der Unfallchirurg.

[28]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[29]  M. F. Swiontkowski Closed reduction and iliosacral percutaneous fixation of unstable pelvic ring fractures , 2009 .

[30]  Pierre Guy,et al.  The ‘Safe Zone’ for Extra-Articular Screw Placement During Intra-Pelvic Acetabular Surgery , 2010, Journal of orthopaedic trauma.

[31]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[32]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[33]  P. Simonian,et al.  Preliminary Report: The Retrograde Medullary Superior Pubic Ramus Screw for the Treatment of Anterior Pelvic Ring Disruptions: A New Technique , 1995, Journal of orthopaedic trauma.

[34]  Nassir Navab,et al.  Camera-Augmented Mobile C-arm (CAMC) Application: 3D Reconstruction Using a Low-Cost Mobile C-arm , 1999, MICCAI.

[35]  Hendrik Schöll,et al.  Integration of fluoroscopy-based guidance in orthopaedic trauma surgery - a prospective cohort study. , 2013, Injury.

[36]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[37]  Lothar Kinzl,et al.  Does Computer-Assisted Spine Surgery Reduce Intraoperative Radiation Doses? , 2006, Spine.

[38]  Mark R. Wilson,et al.  Development and Validation of a Surgical Workload Measure: The Surgery Task Load Index (SURG-TLX) , 2011, World Journal of Surgery.