GPU-Accelerated Robotic Intra-operative Laparoscopic 3D Reconstruction

In this paper we present a real-time intra-operative reconstruction system for laparoscopic surgery. The system builds upon a surgical robot for laparoscopy that has previously been developed by us. Such a system is valuable for surgeons, who can get a three dimensional visualization of the scene online, without having to postprocess data. We gain a significant speed increase over existing such systems by carefully parallelizing tasks and using the GPU for computationally expensive subtasks, making real-time reconstruction and visualization possible. Our implementation is also robust with respect to outliers and can potentially be extended to be used with non-robotic surgery. We demonstrate the performance of our system on ex-vivo samples and compare it to alternative implementations.

[1]  Pierre Alliez,et al.  Computational geometry algorithms library , 2008, SIGGRAPH '08.

[2]  Michel Dhome,et al.  3D reconstruction of complex structures with bundle adjustment: an incremental approach , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Yuan-Fang Wang,et al.  Image-based rendering and modeling in video-endoscopy , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Antti Oulasvirta,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[6]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[7]  Hong Zhang,et al.  Quantitative Evaluation of Feature Extractors for Visual SLAM , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[8]  Jan-Michael Frahm,et al.  Fast gain-adaptive KLT tracking on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Pascal Fua,et al.  Convex Optimization for Deformable Surface 3-D Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Heinrich Niemann,et al.  Efficient Feature Tracking for Long Video Sequences , 2004, DAGM-Symposium.

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Yuan-Fang Wang,et al.  Robust and Real-Time Image Stabilization and Rectification , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[13]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.