Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results.

BACKGROUND Use of an augmented reality (AR)-based soft tissue navigation system in urologic laparoscopic surgery is an evolving technique. OBJECTIVE To evaluate a novel soft tissue navigation system developed to enhance the surgeon's perception and to provide decision-making guidance directly before initiation of kidney resection for laparoscopic partial nephrectomy (LPN). DESIGN, SETTING, AND PARTICIPANTS Custom-designed navigation aids, a mobile C-arm capable of cone-beam imaging, and a standard personal computer were used. The feasibility and reproducibility of inside-out tracking principles were evaluated in a porcine model with an artificially created intraparenchymal tumor in vitro. The same algorithm was then incorporated into clinical practice during LPN. INTERVENTIONS Evaluation of a fully automated inside-out tracking system was repeated in exactly the same way for 10 different porcine renal units. Additionally, 10 patients underwent retroperitoneal LPNs under manual AR guidance by one surgeon. MEASUREMENTS The navigation errors and image-acquisition times were determined in vitro. The mean operative time, time to locate the tumor, and positive surgical margin were assessed in vivo. RESULTS AND LIMITATIONS The system was able to navigate and superpose the virtually created images and real-time images with an error margin of only 0.5 mm, and fully automated initial image acquisition took 40 ms. The mean operative time was 165 min (range: 135-195 min), and mean time to locate the tumor was 20 min (range: 13-27 min). None of the cases required conversion to open surgery. Definitive histology revealed tumor-free margins in all 10 cases. CONCLUSIONS This novel AR tracking system proved to be functional with a reasonable margin of error and image-to-image registration time. Mounting the pre- or intraoperative imaging properties on real-time videoendoscopic images in a real-time manner will simplify and increase the precision of laparoscopic procedures.

[1]  Ralph V Clayman,et al.  Laparoscopic partial nephrectomy for renal masses: effect of tumor location. , 2006, Urology.

[2]  Osamu Ukimura,et al.  Real-time transrectal ultrasound guidance during laparoscopic radical prostatectomy: impact on surgical margins. , 2006, The Journal of urology.

[3]  Grant D. Taylor,et al.  Development of a renal tumor mimic model for learning minimally invasive nephron sparing surgical techniques. , 2004, The Journal of urology.

[4]  Dogu Teber,et al.  Robotic and imaging in urological surgery , 2009, Current opinion in urology.

[5]  Silke Dodel,et al.  Analysis of correlated activity in fMRI data by artificial neural networks , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[6]  Jocelyne Troccaz,et al.  POD-02.08: Aid to percutaneous renal access by virtual projection of the ultrasound puncture tract onto fluoroscopic images , 2007 .

[7]  Shyr Yu,et al.  Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery , 2000, IEEE Transactions on Medical Imaging.

[8]  Pierre Mozer,et al.  AID TO PERCUTANEOUS RENAL ACCESS BY VIRTUAL PROJECTION OF THE ULTRASOUND PUNCTURE TRACT ONTO FLUOROSCOPIC IMAGES , 2008 .

[9]  Logan W. Clements,et al.  Feasibility study for image-guided kidney surgery: assessment of required intraoperative surface for accurate physical to image space registrations. , 2008, Medical physics.

[10]  S. Faraone,et al.  Stimulants and Attention-Deficit/Hyperactivity Disorder—Reply , 2004 .

[11]  Wolfgang Birkfellner,et al.  Calibration of tracking systems in a surgical environment , 1998, IEEE Transactions on Medical Imaging.

[12]  Russell H. Taylor,et al.  Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. , 2009, Urology.

[13]  Philippe Poignet,et al.  3D Heart Motion Estimation Using Endoscopic Monocular Vision System , 2006 .

[14]  David I. Lee,et al.  Fibrin glue-oxidized cellulose sandwich for laparoscopic wedge resection of small renal lesions. , 2005, The Journal of urology.

[15]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2005, Medical Image Anal..

[16]  M. Feuerstein,et al.  Navigation in endoscopic soft tissue surgery: perspectives and limitations. , 2008, Journal of endourology.

[17]  J. Marescaux,et al.  Augmented-reality-assisted laparoscopic adrenalectomy. , 2004, JAMA.

[18]  J. Jakimowicz.  Intraoperative ultrasonography in open and laparoscopic abdominal surgery: an overview , 2006, Surgical Endoscopy And Other Interventional Techniques.

[19]  T Frede,et al.  Geometry of laparoscopic suturing and knotting techniques. , 1999, Journal of endourology.

[20]  Hans-Peter Meinzer,et al.  Soft tissue navigation for laparoscopic prostatectomy: evaluation of camera pose estimation for enhanced visualization , 2007, SPIE Medical Imaging.

[21]  I. Gill,et al.  Imaging-assisted endoscopic surgery: Cleveland Clinic experience. , 2008, Journal of endourology.

[22]  J. Lam,et al.  Importance of surgical margins in the management of renal cell carcinoma , 2008, Nature Clinical Practice Urology.

[23]  Yuan-Fang Wang,et al.  Image-based rendering and modeling in video-endoscopy , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[24]  Nassir Navab,et al.  Automatic Patient Registration for Port Placement in Minimally Invasixe Endoscopic Surgery , 2005, MICCAI.