Data-Driven Contact Clustering for Robot Simulation

We propose a novel data-driven learning-based contact clustering (i.e., of contact points and contact normals) framework for rigid-body robot simulation, with its accuracy established/verified by real experimental data. We first construct an experimental robotic setup with force/torque (F/T) sensors to collect real contact motion/force data. We then design a multilayer perceptron (MLP) network for the contact clustering based on the full motion and force/torque information of the contacts. We also adopt the constraint-based optimization contact solver to facilitate the learning of our MLP network during the training. Our proposed data-driven/learning-based contact clustering framework is then verified against the experimental setup, compared with other techniques/simulators and shown to significantly (or meaningfully) enhance the accuracy of contact simulation as compared to them.

[1]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Marcin Andrychowicz,et al.  Sim-to-Real Transfer of Robotic Control with Dynamics Randomization , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Sergey Levine,et al.  Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Dylan A. Shell,et al.  Modeling Contact Friction and Joint Friction in Dynamic Robotic Simulation Using the Principle of Maximum Dissipation , 2010, WAFR.

[5]  David Baraff,et al.  Fast contact force computation for nonpenetrating rigid bodies , 1994, SIGGRAPH.

[6]  Alessio Rocchi,et al.  Stable simulation of underactuated compliant hands , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Miguel A. Otaduy,et al.  Position-based Methods for the Simulation of Solid Objects in Computer Graphics , 2013, Eurographics.

[8]  Stefan Leutenegger,et al.  Deep learning a grasp function for grasping under gripper pose uncertainty , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[10]  David Baraff,et al.  Linear-time dynamics using Lagrange multipliers , 1996, SIGGRAPH.

[11]  Dinesh Manocha,et al.  Fast and exact continuous collision detection with Bernstein sign classification , 2014, ACM Trans. Graph..

[12]  Christian Duriez,et al.  Realistic haptic rendering of interacting deformable objects in virtual environments , 2008, IEEE Transactions on Visualization and Computer Graphics.

[13]  Nima Fazeli,et al.  Empirical evaluation of common contact models for planar impact , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[14]  John E. Lloyd,et al.  Fast Implementation of Lemke's Algorithm for Rigid Body Contact Simulation , 2005, ICRA.

[15]  Emanuel Todorov,et al.  A convex, smooth and invertible contact model for trajectory optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Roy S. Smith,et al.  Parameter Identification of the KUKA LBR iiwa Robot Including Constraints on Physical Feasibility , 2017 .

[17]  Marco Hutter,et al.  Per-Contact Iteration Method for Solving Contact Dynamics , 2018, IEEE Robotics and Automation Letters.

[18]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[19]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[21]  Dongjun Lee,et al.  Haptic rendering and interactive simulation using passive midpoint integration , 2017, Int. J. Robotics Res..

[22]  Evan Drumwright,et al.  A Fast and Stable Penalty Method for Rigid Body Simulation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[23]  Jernej Barbic,et al.  Six-DoF Haptic Rendering of Contact Between Geometrically Complex Reduced Deformable Models , 2008, IEEE Transactions on Haptics.

[24]  Dinesh K. Pai,et al.  Post-stabilization for rigid body simulation with contact and constraints , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Dongjun Lee,et al.  On the passivity of mechanical integrators in haptic rendering , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Hervé Delingette,et al.  Haptic rendering of hyperelastic models with friction , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Ming C. Lin,et al.  A modular haptic rendering algorithm for stable and transparent 6-DOF manipulation , 2006, IEEE Transactions on Robotics.

[28]  Ed Colgate,et al.  Minimum Mass for Haptic Display Simulations , 1998, Dynamic Systems and Control.

[29]  Jeffrey C. Trinkle,et al.  A Geometrically Exact Contact Model for Polytopes in Multirigid-Body Simulation , 2017 .

[30]  D. Stewart,et al.  AN IMPLICIT TIME-STEPPING SCHEME FOR RIGID BODY DYNAMICS WITH INELASTIC COLLISIONS AND COULOMB FRICTION , 1996 .

[31]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[32]  Abderrahmane Kheddar,et al.  Fast Continuous Collision Detection between Rigid Bodies , 2002, Comput. Graph. Forum.