FPGA-Based High-Performance Collision Detection: An Enabling Technique for Image-Guided Robotic Surgery

Collision detection, which refers to the computational problem of finding the relative placement or con-figuration of two or more objects, is an essential component of many applications in computer graphics and robotics. In image-guided robotic surgery, real-time collision detection is critical for preserving healthy anatomical structures during the surgical procedure. However, the computational complexity of the problem usually results in algorithms that operate at low speed. In this paper, we present a fast and accurate algorithm for collision detection between Oriented-Bounding-Boxes (OBBs) that is suitable for real-time implementation. Our proposed Sweep and Prune algorithm can perform a preliminary filtering to reduce the number of objects that need to be tested by the classical Separating Axis Test algorithm, while the OBB pairs of interest are preserved. These OBB pairs are re-checked by the Separating Axis Test algorithm to obtain accurate overlapping status between them. To accelerate the execution, our Sweep and Prune algorithm is tailor-made for the proposed method. Meanwhile, a high performance scalable hardware architecture is proposed by analyzing the intrinsic parallelism of our algorithm, and is implemented on FPGA platform. Results show that our hardware design on the FPGA platform can achieve around 8X higher running speed than the software design on a CPU platform. As a result, the proposed algorithm can achieve a collision frame rate of 1 KHz, and fulfill the requirement for the medical surgery scenario of Robot Assisted Laparoscopy.

[1]  Wayne Luk,et al.  Ieee Transactions on Computer-aided Design of Integrated Circuits and Systems Accuracy Guaranteed Bit-width Optimization Abstract— We Present Minibit, an Automated Static Approach for Optimizing Bit-widths of Fixed-point Feedforward Designs with Guaranteed Accuracy. Methods to Minimize Both the In- , 2022 .

[2]  Tomas Akenine-Möller,et al.  Fast 3D triangle-box overlap testing , 2002, J. Graphics, GPU, & Game Tools.

[3]  Kevin Skadron,et al.  Accelerating Compute-Intensive Applications with GPUs and FPGAs , 2008, 2008 Symposium on Application Specific Processors.

[4]  Liyanage C. De Silva,et al.  Multimodal Approach to Human-Face Detection and Tracking , 2008, IEEE Transactions on Industrial Electronics.

[5]  N. Sudha,et al.  Hardware-Efficient Image-Based Robotic Path Planning in a Dynamic Environment and Its FPGA Implementation , 2011, IEEE Transactions on Industrial Electronics.

[6]  Olivier Roy,et al.  A multi-FPGA architecture-based real-time TFM ultrasound imaging , 2016, Journal of Real-Time Image Processing.

[7]  Sariel Har-Peled,et al.  Efficiently approximating the minimum-volume bounding box of a point set in three dimensions , 1999, SODA '99.

[8]  Rajni V. Patel,et al.  Needle insertion into soft tissue: a survey. , 2007, Medical engineering & physics.

[9]  Arnaud Tisserand,et al.  Power Consumption of GPUs from a Software Perspective , 2009, ICCS.

[10]  Wayne Luk,et al.  Have GPUs made FPGAs redundant in the field of video processing? , 2005, Proceedings. 2005 IEEE International Conference on Field-Programmable Technology, 2005..

[11]  Eric Monmasson,et al.  FPGA Design Methodology for Industrial Control Systems—A Review , 2007, IEEE Transactions on Industrial Electronics.

[12]  Suvranu De,et al.  Computationally efficient techniques for real time surgical simulation with force feedback , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[13]  Guang-Zhong Yang,et al.  Intra-Operative Visualizations: Perceptual Fidelity and Human Factors , 2008, Journal of Display Technology.

[14]  Iain Bate,et al.  Real-time embedded systems , 2002 .

[15]  Paolo Fiorini,et al.  Simulation of deformable environment with haptic feedback on GPU , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[17]  Gabriel Zachmann,et al.  Collision Detection Based on Fuzzy Scene Subdivision , 2015 .

[18]  Christos-Savvas Bouganis,et al.  Performance comparison of GPU and FPGA architectures for the SVM training problem , 2009, 2009 International Conference on Field-Programmable Technology.

[19]  Lena Maier-Hein,et al.  Comparative Validation of Single-Shot Optical Techniques for Laparoscopic 3-D Surface Reconstruction , 2014, IEEE Transactions on Medical Imaging.

[20]  Allison M. Okamura,et al.  Haptic Virtual Fixtures for Robot-Assisted Manipulation , 2005, ISRR.

[21]  Bin Tian,et al.  Fast double-parallel image processing based on FPGA , 2011, Proceedings of 2011 IEEE International Conference on Vehicular Electronics and Safety.

[22]  Thomas Nolte,et al.  Real-Time in Embedded Systems , 2005, Embedded Systems Handbook.

[23]  Tomas Akenine-Möller.  Fast 3D Triangle-Box Overlap Testing , 2001, J. Graphics, GPU, & Game Tools.

[24]  Christian Duriez,et al.  GPU-based real-time soft tissue deformation with cutting and haptic feedback. , 2010, Progress in biophysics and molecular biology.

[25]  Marc O Schurr,et al.  Review on aspects of artificial tactile feedback in laparoscopic surgery. , 2009, Medical engineering & physics.

[26]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[27]  Dinesh Manocha,et al.  Fast continuous collision detection for articulated models , 2004, SM '04.

[28]  Takahiro Harada,et al.  Real-time collision culling of a million bodies on graphics processing units , 2010, ACM Trans. Graph..

[29]  Mohamed Abid,et al.  An FPGA-based accelerator for Fourier Descriptors computing for color object recognition using SVM , 2007, Journal of Real-Time Image Processing.

[30]  Xin Wang,et al.  A quasi-static model of wheel-tissue interaction for surgical robotics. , 2013, Medical engineering & physics.

[31]  Wolfgang Straßer,et al.  Fast and Scalable CPU/GPU Collision Detection for Rigid and Deformable Surfaces , 2010, Comput. Graph. Forum.

[32]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[33]  Yuan Chen,et al.  Multi-FPGA digital hardware design for detailed large-scale real-time electromagnetic transient simulation of power systems , 2013 .

[34]  W. Eric L. Grimson,et al.  Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback , 1997, CVRMed.

[35]  Jiri Filipovic,et al.  Distributed Construction of Configuration Spaces for Real-Time Haptic Deformation Modeling , 2011, IEEE Transactions on Industrial Electronics.

[36]  Guang-Zhong Yang,et al.  Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery , 2004, MICCAI.

[37]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[38]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[39]  Maxime Sermesant,et al.  Application of soft tissue modelling to image-guided surgery. , 2005, Medical engineering & physics.

[40]  Fan Yang,et al.  Flexible VLIW processor based on FPGA for efficient embedded real-time image processing , 2012, Journal of Real-Time Image Processing.

[41]  Wayne Luk,et al.  Mixed Precision Processing in Reconfigurable Systems , 2011, 2011 IEEE 19th Annual International Symposium on Field-Programmable Custom Computing Machines.

[42]  Bruno Arnaldi,et al.  Dynamic adaptation of broad phase collision detection algorithms , 2011, 2011 IEEE International Symposium on VR Innovation.

[43]  John D. Davis,et al.  BLAS Comparison on FPGA, CPU and GPU , 2010, 2010 IEEE Computer Society Annual Symposium on VLSI.

[44]  Lena Maier-Hein,et al.  Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery , 2013, Medical Image Anal..

[45]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Mariano Fons,et al.  Real-time embedded systems powered by FPGA dynamic partial self-reconfiguration: a case study oriented to biometric recognition applications , 2010, Journal of Real-Time Image Processing.

[47]  Guang-Zhong Yang,et al.  Dimensionality Reduction in Controlling Articulated Snake Robot for Endoscopy Under Dynamic Active Constraints , 2013, IEEE Transactions on Robotics.

[48]  Guang-Zhong Yang,et al.  Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery , 2010, MICCAI.

[49]  Danica Kragic,et al.  Minimum volume bounding box decomposition for shape approximation in robot grasping , 2008, 2008 IEEE International Conference on Robotics and Automation.

[50]  Satoru Yamamoto,et al.  Multi-FPGA Accelerator for Scalable Stencil Computation with Constant Memory Bandwidth , 2014, IEEE Transactions on Parallel and Distributed Systems.

[51]  Brian L. Davies,et al.  Active Constraints/Virtual Fixtures: A Survey , 2014, IEEE Transactions on Robotics.

[52]  Dinesh Manocha,et al.  Fast and reliable collision culling using graphics hardware , 2006, IEEE Transactions on Visualization and Computer Graphics.

[53]  Danail Stoyanov,et al.  Surgical Vision , 2011, Annals of Biomedical Engineering.

[54]  Cagatay Basdogan,et al.  Haptics in minimally invasive surgical simulation and training , 2004, IEEE Computer Graphics and Applications.

[55]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[56]  A. Darzi,et al.  Image-guided robotic interventions for prostate cancer , 2013, Nature Reviews Urology.

[57]  K. Sridharan,et al.  Efficient FPGA Realization of CORDIC With Application to Robotic Exploration , 2009, IEEE Transactions on Industrial Electronics.