Augmented Reality Guided Needle Biopsy of Soft Tissue: A Pilot Study

Percutaneous biopsies are popular for extracting suspicious tissue formations (primarily for cancer diagnosis purposes) due to the: relatively low cost, minimal invasiveness, quick procedure times, and low risk for the patient. Despite the advantages provided by percutaneous biopsies, poor needle and tumor visualization is a problem that can result in the clinicians classifying the tumor as benign when it was malignant (false negative). The system developed by the authors aims to address the concern of poor needle and tumor visualization through two virtualization setups. This system is designed to track and visualize the needle and tumor in three-dimensional space using an electromagnetic tracking system. User trials were conducted in which the 10 participants, who were not medically trained, performed a total of 6 tests, each guiding the biopsy needle to the desired location. The users guided the biopsy needle to the desired point on an artificial spherical tumor (diameters of 30, 20, and 10 mm) using the 3D augmented reality (AR) overlay for three trials and a projection on a second monitor (TV) for the other three trials. From the randomized trials, it was found that the participants were able to guide the needle tip 6.5 ± 3.3 mm away from the desired position with an angle deviation of 1.96 ± 1.10° in the AR trials, compared to values of 4.5 ± 2.3 mm and 2.70 ± 1.67° in the TV trials. The results indicate that for simple stationary surgical procedures, an AR display is non-inferior a TV display.

[1]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[2]  I. Howard Other mechanisms of depth perception , 2012 .

[3]  L. Liberman,et al.  Centennial dissertation. Percutaneous imaging-guided core breast biopsy: state of the art at the millennium. , 2000, AJR. American journal of roentgenology.

[4]  L. Liberman,et al.  Percutaneous Imaging-Guided Core Breast Biopsy , 2012 .

[5]  Carl-Fredrik Westin,et al.  Towards real time 2D to 3D registration for ultrasound-guided endoscopic and laparoscopic procedures , 2009, International Journal of Computer Assisted Radiology and Surgery.

[6]  Robert D. Howe,et al.  Robotic Motion Compensation for Beating Heart Intracardiac Surgery , 2009, Int. J. Robotics Res..

[7]  R. J. Jackman,et al.  Needle-localized breast biopsy: why do we fail? , 1997, Radiology.

[8]  L. Liberman,et al.  Learning curve for stereotactic breast biopsy: how many cases are enough? , 2001, AJR. American journal of roentgenology.

[9]  A. Fenster,et al.  Real‐time registration of 3D to 2D ultrasound images for image‐guided prostate biopsy , 2017, Medical physics.

[10]  J. Kettenbach,et al.  Robot-assisted biopsy using ultrasound guidance: initial results from in vitro tests , 2005, European Radiology.

[11]  Qinghua Huang,et al.  A Review on Real-Time 3D Ultrasound Imaging Technology , 2017, BioMed research international.

[12]  Gabor Fichtinger,et al.  Electromagnetic tracking in surgical and interventional environments: usability study , 2015, International Journal of Computer Assisted Radiology and Surgery.

[13]  Mahdi Tavakoli,et al.  Ultrasound image guidance and robot impedance control for beating-heart surgery , 2018, Control Engineering Practice.

[14]  Mahdi Tavakoli,et al.  Improving User Performance in Haptics-Based Rehabilitation Exercises by Colocation of User's Visual and Motor Axes via a Three-Dimensional Augmented-Reality Display , 2019, IEEE Robotics and Automation Letters.

[15]  G. W. Eklund,et al.  Percutaneous large-core breast biopsy: a multi-institutional study. , 1994, Radiology.

[16]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[17]  Simon Moosburner,et al.  Mixed Reality in Visceral Surgery d Evaluation of Intraoperative Use-cases Development of a Suitable Workflow an , 2017 .

[18]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[19]  Matthias Harders,et al.  Multimodal Augmented Reality in Medicine , 2007, HCI.

[20]  Andras Lasso,et al.  Open-source platforms for navigated image-guided interventions , 2016, Medical Image Anal..

[21]  Carlos Rossa,et al.  Brachytherapy Needle Steering Guidance Using Image Overlay , 2018 .

[22]  J. Ball,et al.  Statistics review 4: Sample size calculations , 2002, Critical care.

[23]  Yong-Ping Zheng,et al.  Volume reconstruction of freehand three-dimensional ultrasound using median filters. , 2008, Ultrasonics.

[24]  Mahdi Tavakoli,et al.  A Robot with an Augmented-Reality Display for Functional Capacity Evaluation and Rehabilitation of Injured Workers , 2019, 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

[25]  A Uneri,et al.  Real-time, image-based slice-to-volume registration for ultrasound-guided spinal intervention , 2018, Physics in medicine and biology.

[26]  Robert Kooima Generalized Perspective Projection , 2011 .

[27]  D'nardo Colucci,et al.  Perception in HMDs: what is it in head-mounted displays (HMDs) that really make them all so terrible? , 1998, Defense, Security, and Sensing.

[28]  L. Liberman,et al.  Analysis of cancers not diagnosed at stereotactic core breast biopsy. , 1997, Radiology.

[29]  Oliver Bimber,et al.  Interactive rendering for projection-based augmented reality displays , 2002 .

[30]  A. Kaviani,et al.  Ultrasound Accuracy in Determining the Tumor Depth for Boost Field Radiotherapy in Breast Cancer in Comparison With CT Scan Plus Clips , 2015 .

[31]  John V Frangioni,et al.  New technologies for human cancer imaging. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[32]  Prokar Dasgupta,et al.  The effectiveness of Google GLASS as a vital signs monitor in surgery: A simulation study. , 2016, International journal of surgery.

[33]  Ian P. Howard,et al.  Perceiving in DepthVolume 1 Basic Mechanisms , 2012 .

[34]  Eun-Kyung Kim,et al.  Missed breast cancers at US-guided core needle biopsy: how to reduce them. , 2007, Radiographics : a review publication of the Radiological Society of North America, Inc.

[35]  E. Chmielik,et al.  False-negative results of breast core needle biopsies – retrospective analysis of 988 biopsies , 2011, Polish journal of radiology.

[36]  W. P. Evans,et al.  Percutaneous core biopsy of the breast: effect of operator experience and number of samples on diagnostic accuracy. , 1996, AJR. American journal of roentgenology.