FEM-Based Deformation Control for Dexterous Manipulation of 3D Soft Objects

In this paper, a method for dexterous manipulation of 3D soft objects for real-time deformation control is presented, relying on Finite Element modelling. The goal is to generate proper forces on the fingertips of an anthropomorphic device during in-hand manipulation to produce desired displacements of selected control points on the object. The desired motions of the fingers are computed in real-time as an inverse solution of a Finite Element Method (FEM), the forces applied by the fingertips at the contact points being modelled by Lagrange multipliers. The elasticity parameters of the model are preliminarly estimated using a vision system and a force sensor. Experimental results are shown with an underactuated anthropomorphic hand that performs a manipulation task on a soft cylindrical object.

[1]  Jérémie Dequidt,et al.  Software toolkit for modeling, simulation, and control of soft robots , 2017, Adv. Robotics.

[2]  Anibal T. de Almeida,et al.  Adaptive under-actuated anthropomorphic hand: ISR-SoftHand , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Christian Duriez,et al.  SOFA: A Multi-Model Framework for Interactive Physical Simulation , 2012 .

[4]  Vincenzo Lippiello,et al.  Tracking elastic deformable objects with an RGB-D sensor for a pizza chef robot , 2017, Robotics Auton. Syst..

[5]  Jérémie Dequidt,et al.  Framework for online simulation of soft robots with optimization-based inverse model , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[6]  Stephane Cotin,et al.  EP4A: Software and Computer Based Simulator Research: Development and Outlook SOFA—An Open Source Framework for Medical Simulation , 2007, MMVR.

[7]  Danfei Xu,et al.  Folding deformable objects using predictive simulation and trajectory optimization , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[9]  Fanny Ficuciello,et al.  Synergy-Based Control of Underactuated Anthropomorphic Hands , 2019, IEEE Transactions on Industrial Informatics.

[10]  Jia Pan,et al.  Three-Dimensional Deformable Object Manipulation Using Fast Online Gaussian Process Regression , 2017, IEEE Robotics and Automation Letters.

[11]  Yunhui Liu,et al.  On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments , 2014, Int. J. Robotics Res..

[12]  Dmitry Berenson,et al.  Manipulation of deformable objects without modeling and simulating deformation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[14]  Robert Davis Cook,et al.  Finite Element Modeling for Stress Analysis , 1995 .

[15]  Jadav Das,et al.  Passivity-based target manipulation inside a deformable object by a robotic system with noncollocated feedback , 2013, Adv. Robotics.

[16]  Shigeki Sugano,et al.  Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning , 2017, IEEE Robotics and Automation Letters.

[17]  Ron Alterovitz,et al.  Motion Planning Under Uncertainty In Highly Deformable Environments , 2011, Robotics: Science and Systems.

[18]  Ron Alterovitz,et al.  Toward automated tissue retraction in robot-assisted surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Vincenzo Lippiello,et al.  Real-time tracking of 3D elastic objects with an RGB-D sensor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Alexandru Patriciu,et al.  Deformation Planning for Robotic Soft Tissue Manipulation , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[21]  Trevor Darrell,et al.  A geometric approach to robotic laundry folding , 2012, Int. J. Robotics Res..

[22]  Yunhui Liu,et al.  Uncalibrated vision-based deformation control of compliant objects with online estimation of the Jacobian matrix , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Dylan Hadfield-Menell,et al.  Beyond lowest-warping cost action selection in trajectory transfer , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Masayoshi Tomizuka,et al.  Robotic manipulation of deformable objects by tangent space mapping and non-rigid registration , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[26]  Yunhui Liu,et al.  Automatic 3-D Manipulation of Soft Objects by Robotic Arms With an Adaptive Deformation Model , 2016, IEEE Transactions on Robotics.

[27]  Zhongkui Wang,et al.  Modeling and estimation of rheological properties of food products for manufacturing simulations , 2011 .

[28]  J. Schulman,et al.  Generalization in Robotic Manipulation Through The Use of Non-Rigid Registration , 2013 .

[29]  Jérémie Dequidt,et al.  Real-time control of soft-robots using asynchronous finite element modeling , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Timothy Bretl,et al.  Quasi-static manipulation of a Kirchhoff elastic rod based on a geometric analysis of equilibrium configurations , 2014, Int. J. Robotics Res..