An Open-Source Framework for Rapid Development of Interactive Soft-Body Simulations for Real-Time Training

We present an open-source framework that provides a low barrier to entry for real-time simulation, visualization, and interactive manipulation of user-specifiable soft-bodies, environments, and robots (using a human-readable front-end interface). The simulated soft-bodies can be interacted by a variety of input interface devices including commercially available haptic devices, game controllers, and the Master Tele-Manipulators (MTMs) of the da Vinci Research Kit (dVRK) with real-time haptic feedback. We propose this framework for carrying out multi-user training, user-studies, and improving the control strategies for manipulation problems. In this paper, we present the associated challenges to the development of such a framework and our proposed solutions. We also demonstrate the performance of this framework with examples of soft-body manipulation and interaction with various input devices.

[1]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[2]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Luiz Velho,et al.  A Dynamic Adaptive Mesh Library Based on Stellar Operators , 2004, J. Graphics, GPU, & Game Tools.

[4]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Sanju Lama,et al.  Surgical Skill Assessment Using Motion Quality and Smoothness. , 2017, Journal of surgical education.

[6]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[7]  L. Sentis,et al.  The CHAI Libraries , 2003 .

[8]  Yi Su,et al.  Volume Preserved Mass–Spring Model with Novel Constraints for Soft Tissue Deformation , 2016, IEEE Journal of Biomedical and Health Informatics.

[9]  Matyka Maciej,et al.  Pressure Model of Soft Body Simulation , 2004, physics/0407003.

[10]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[11]  Yan Wang,et al.  A Real-Time Dynamic Simulator and an Associated Front-End Representation Format for Simulating Complex Robots and Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Hang Si,et al.  TetGen, a Delaunay-Based Quality Tetrahedral Mesh Generator , 2015, ACM Trans. Math. Softw..

[13]  Gregory S. Fischer,et al.  An Asynchronous Multi-Body Simulation Framework for Real-Time Dynamics, Haptics and Learning with Application to Surgical Robots , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Ratan K. Guha,et al.  Simulation of Soft Bodies with Pressure Force and the Implicit Method , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[15]  Suvranu De,et al.  Using the PhysX engine for physics‐based virtual surgery with force feedback , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[16]  Erwin Coumans,et al.  Bullet physics simulation , 2015, SIGGRAPH Courses.

[17]  C. Karen Liu,et al.  Soft body locomotion , 2012, ACM Trans. Graph..

[18]  Rytis Maskeliunas,et al.  A Soft Body Physics Simulator with Computational Offloading to the Cloud , 2018, Inf..