Usability of a real-time tracked augmented reality display system in musculoskeletal injections

PURPOSE: Image-guided needle interventions are seldom performed with augmented reality guidance in clinical practice due to many workspace and usability restrictions. We propose a real-time optically tracked image overlay system to make image-guided musculoskeletal injections more efficient and assess its usability in a bed-side clinical environment. METHODS: An image overlay system consisting of an optically tracked viewbox, tablet computer, and semitransparent mirror allows users to navigate scanned patient volumetric images in real-time using software built on the open-source 3D Slicer application platform. A series of experiments were conducted to evaluate the latency and screen refresh rate of the system using different image resolutions. To assess the usability of the system and software, five medical professionals were asked to navigate patient images while using the overlay and completed a questionnaire to assess the system. RESULTS: In assessing the latency of the system with scanned images of varying size, screen refresh rates were approximately 5 FPS. The study showed that participants found using the image overlay system easy, and found the table-mounted system was significantly more usable and effective than the handheld system. CONCLUSION: It was determined that the system performs comparably with scanned images of varying size when assessing the latency of the system. During our usability study, participants preferred the table-mounted system over the handheld. The participants also felt that the system itself was simple to use and understand. With these results, the image overlay system shows promise for use in a clinical environment.

[1]  Gabor Fichtinger,et al.  OpenIGTLink: an open network protocol for image‐guided therapy environment , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[2]  Andras Lasso,et al.  Real-time self-calibration of a tracked augmented reality display , 2016, SPIE Medical Imaging.

[3]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[4]  Gabor Fichtinger,et al.  Augmented reality visualization with use of image overlay technology for MR imaging-guided interventions: assessment of performance in cadaveric shoulder and hip arthrography at 1.5 T. , 2012, Radiology.

[5]  G. Fichtinger,et al.  Augmented reality visualisation using an image overlay system for MR-guided interventions: technical performance of spine injection procedures in human cadavers at 1.5 Tesla , 2012, European Radiology.

[6]  Ken Masamune,et al.  Image overlay guidance for needle insertion in CT scanner , 2005, IEEE Transactions on Biomedical Engineering.

[7]  Gabor Fichtinger,et al.  MRI image overlay: Application to arthrography needle insertion , 2007, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[8]  Gabor Fichtinger,et al.  Augmented reality visualization with image overlay for MRI-guided intervention: accuracy for lumbar spinal procedures with a 1.5-T MRI system. , 2012, AJR. American journal of roentgenology.

[9]  Gabor Fichtinger,et al.  Augmented reality needle guidance improves facet joint injection training , 2011, Medical Imaging.

[10]  Andras Lasso,et al.  Open-source platforms for navigated image-guided interventions , 2016, Medical Image Anal..

[11]  Gabor Fichtinger,et al.  The Effect of Augmented Reality Training on Percutaneous Needle Placement in Spinal Facet Joint Injections , 2011, IEEE Transactions on Biomedical Engineering.