Comparison of Projective Augmented Reality Concepts to Support Medical Needle Insertion

Augmented reality (AR) is a promising tool to improve instrument navigation in needle-based interventions. Limited research has been conducted regarding suitable navigation visualizations. In this work, three navigation concepts based on existing approaches were compared in a user study using a projective AR setup. Each concept was implemented with three different scales for accuracy-to-color mapping and two methods of navigation indicator scaling. Participants were asked to perform simulated needle insertion tasks with each of the resulting 18 prototypes. Insertion angle and insertion depth accuracies were measured and analyzed, as well as task completion time and participants’ subjectively perceived task difficulty. Results show a clear ranking of visualization concepts across variables. Less consistent results were obtained for the color and indicator scaling factors. Results suggest that logarithmic indicator scaling achieved better accuracy, but participants perceived it to be more difficult than linear scaling. With specific results for angle and depth accuracy, our study contributes to the future composition of improved navigation support and systems for precise needle insertion or similar applications.

[1]  Gabor Fichtinger,et al.  Augmented reality visualization with image overlay for MRI-guided intervention: accuracy for lumbar spinal procedures with a 1.5-T MRI system. , 2012, AJR. American journal of roentgenology.

[2]  Gerlig Widmann,et al.  Accuracy and diagnostic yield of CT-guided stereotactic liver biopsy of primary and secondary liver tumors , 2011, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[3]  G. Strauß,et al.  Image‐guided navigation: the surgeon's perspective on performance consequences and human factors issues , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[4]  Arianeb Mehrabi,et al.  Towards markerless navigation for percutaneous needle insertions , 2015, International Journal of Computer Assisted Radiology and Surgery.

[5]  Lena Maier-Hein,et al.  In-vitro evaluation of a novel needle-based soft tissue navigation system with a respiratory liver motion simulator , 2007, SPIE Medical Imaging.

[6]  Ron Kikinis,et al.  Augmented reality visualization for CT-guided interventions: system description, feasibility, and initial evaluation in an abdominal phantom. , 2006, Radiology.

[7]  Pheng-Ann Heng,et al.  Visualization of Needle Access Pathway and a Five-DoF Evaluation , 2014, IEEE Journal of Biomedical and Health Informatics.

[8]  Guy Brock,et al.  Experience With More Than 500 Minimally Invasive Hepatic Procedures , 2008, Annals of surgery.

[9]  Christian Hansen,et al.  Concepts for augmented reality visualisation to support needle guidance inside the MRI , 2018, Healthcare technology letters.

[10]  Debdoot Sheet,et al.  Immersive augmented reality system for assisting needle positioning during ultrasound guided intervention , 2016, ICVGIP '16.

[11]  Frank Sauer,et al.  An augmented reality system for MR image-guided needle biopsy: initial results in a swine model. , 2006, Radiology.

[12]  David J. Hawkes,et al.  Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas , 2018, Medical Imaging.

[13]  G. Toporek,et al.  Stereotactic CT-Guided Percutaneous Microwave Ablation of Liver Tumors With the Use of High-Frequency Jet Ventilation: An Accuracy and Procedural Safety Study. , 2017, AJR. American journal of roentgenology.

[14]  Nassir Navab,et al.  Auditory and Visio-Temporal Distance Coding for 3-Dimensional Perception in Medical Augmented Reality , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[15]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[16]  Stefan Weber,et al.  Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies , 2012, International Journal of Computer Assisted Radiology and Surgery.

[17]  Mark R. Cutkosky,et al.  HoloNeedle: Augmented Reality Guidance System for Needle Placement Investigating the Advantages of Three-Dimensional Needle Shape Reconstruction , 2018, IEEE Robotics and Automation Letters.

[18]  Emiliano Schena,et al.  Percutaneous lung biopsy: comparison between an augmented reality CT navigation system and standard CT-guided technique , 2013, International Journal of Computer Assisted Radiology and Surgery.

[19]  Christian Hansen,et al.  CT-Based Navigation Guidance for Liver Tumor Ablation , 2017, VCBM.

[20]  Timo Ropinski,et al.  Visually Supporting Multiple Needle Placement in Irreversible Electroporation Interventions , 2018, Comput. Graph. Forum.

[21]  Christoph Walter,et al.  Towards safe physical human-robot collaboration: A projection-based safety system , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  J. Debus,et al.  Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. , 2008, International journal of radiation oncology, biology, physics.

[23]  David Black,et al.  Auditory support for resection guidance in navigated liver surgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[24]  Lutz-Peter Nolte,et al.  A navigation system for percutaneous needle interventions based on PET/CT images: Design, workflow and error analysis of soft tissue and bone punctures , 2011, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[25]  Dieter Schmalstieg,et al.  Crepuscular Rays for Tumor Accessibility Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[26]  Sarthak Misra,et al.  Biomechanics-Based Curvature Estimation for Ultrasound-guided Flexible Needle Steering in Biological Tissues , 2014, Annals of Biomedical Engineering.

[27]  Christian Hansen,et al.  Projector‐based augmented reality system for interventional visualization inside MRI scanners , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[28]  Frank Fischbach,et al.  MR-Guided Freehand Biopsy of Liver Lesions With Fast Continuous Imaging Using a 1.0-T Open MRI Scanner: Experience in 50 Patients , 2011, CardioVascular and Interventional Radiology.