Application of a New Wearable Augmented Reality Video See-Through Display to Aid Percutaneous Procedures in Spine Surgery

In mini-invasive surgery, the surgeon operates without a direct visualization of the patient’s anatomy. In image-guided surgery, solutions based on augmented reality (AR) represent the most promising ones. The aim of this study was to evaluate the efficacy of a new wearable AR system as aid in the performance of percutaneous procedures in spine surgery. Our solution is based on a video see-through head mounted display (HMD) and it allows the augmentation of video frames acquired by two external cameras with the rendering of patient-specific 3D models obtained elaborating radiological images. We tested the system on an in vitro setup intended to simulate the reaching of a lumbar pedicle. An experienced surgeon performed the percutaneous task wearing the HMD. System accuracy was evaluated through post-operative CT scan, measuring the maximum distance between the planned and obtained trajectories inside the pedicle canal. The mean insertion error was of 1.18 ±0.16 mm.

[1]  Vincenzo Ferrari,et al.  A 3-D Mixed-Reality System for Stereoscopic Visualization of Medical Dataset , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Nassir Navab,et al.  Stepping into the operating theater: ARAV — Augmented Reality Aided Vertebroplasty , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Mark A. Reiley,et al.  New Technologies in Spine: Kyphoplasty and Vertebroplasty for the Treatment of Painful Osteoporotic Compression Fractures , 2001, Spine.

[4]  D. Louis Collins,et al.  DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  N. Navab,et al.  Advanced Medical Displays: A Literature Review of Augmented Reality , 2008, Journal of Display Technology.

[6]  David J Nuckley,et al.  Comparison of nonnavigated and 3-dimensional image-based computer navigated balloon kyphoplasty. , 2015, Orthopedics.

[7]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[8]  J. H. Oppenheimer,et al.  Minimally invasive spine technology and minimally invasive spine surgery: a historical review. , 2009, Neurosurgical focus.

[9]  Mauro Ferrari,et al.  Value of multidetector computed tomography image segmentation for preoperative planning in general surgery , 2011, Surgical Endoscopy.

[10]  D. Louis Collins,et al.  The state of the art of visualization in mixed reality image guided surgery , 2013, Comput. Medical Imaging Graph..

[11]  Nassir Navab,et al.  Camera Augmented Mobile C-Arm (CAMC): Calibration, Accuracy Study, and Clinical Applications , 2010, IEEE Transactions on Medical Imaging.

[12]  Fabrizio Cutolo,et al.  Video see through AR head-mounted display for medical procedures , 2014, International Symposium on Mixed and Augmented Reality.

[13]  S. Pollack,et al.  Significantly reduced radiation exposure to operators during kyphoplasty and vertebroplasty procedures: methods and techniques. , 2006, AJNR. American journal of neuroradiology.

[14]  Fabrizio Cutolo,et al.  Human-PnP: Ergonomic AR Interaction Paradigm for Manual Placement of Rigid Bodies , 2015, AE-CAI.

[15]  E G Shifrin,et al.  Laparoscopic assisted aortic surgery. A review. , 2006, The Journal of cardiovascular surgery.

[16]  Richard W. Kobylinski,et al.  Increased cholecystectomy rate after the introduction of laparoscopic cholecystectomy , 1993 .

[17]  Fabrizio Cutolo,et al.  [Poster] HMD Video see though AR with unfixed cameras vergence , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[18]  Paolo Dario,et al.  EndoCAS navigator platform: a common platform for computer and robotic assistance in minimally invasive surgery , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[19]  Hyun-Chul Choi,et al.  Fluoroscopic Radiation Exposure during Percutaneous Kyphoplasty. , 2011, Journal of Korean Neurosurgical Society.

[20]  J. Sebert,et al.  Destructive spondyloarthropathy in chronic haemodialysis patients. Current data and radiological aspects. , 1987, Journal of neuroradiology. Journal de neuroradiologie.

[21]  Oliver Beuing,et al.  Kyphoplasty interventions using a navigation system and C-arm CT data: first clinical results , 2009, Medical Imaging.

[22]  Manabu Ito,et al.  A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. , 2013, Journal of neurosurgery. Spine.

[23]  Gabor Fichtinger,et al.  MR-Guided Vertebroplasty With Augmented Reality Image Overlay Navigation , 2014, CardioVascular and Interventional Radiology.

[24]  N J Soper,et al.  Laparoscopic cholecystectomy. The new 'gold standard'? , 1992, Archives of surgery.

[25]  Fabrizio Cutolo,et al.  Augmented reality system for freehand guide of magnetic endovascular devices , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  D. Caramella,et al.  Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. , 2014, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[27]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  H. Aerts,et al.  Feasibility Study of Needle Placement in Percutaneous Vertebroplasty: Cone-Beam Computed Tomography Guidance Versus Conventional Fluoroscopy , 2013, CardioVascular and Interventional Radiology.

[29]  L A Gilula,et al.  Percutaneous vertebroplasty: indications, contraindications, and technique. , 2003, The British journal of radiology.

[30]  V Ferrari,et al.  How to build patient‐specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[31]  Fabrizio Cutolo,et al.  Augmented reality visualization of deformable tubular structures for surgical simulation , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.