In-hand recognition and manipulation of elastic objects using a servo-tactile control strategy

Abstract Grasping and manipulating objects with robotic hands depend largely on the features of the object to be used. Especially, features such as softness and deformability are crucial to take into account during the manipulation tasks. Indeed, positions of the fingers and forces to be applied by the robot hand when manipulating an object must be adapted to the caused deformation. For unknown objects, a previous recognition stage is usually needed to get the features of the object, and the manipulation strategies must be adapted depending on that recognition stage. To obtain a precise control in the manipulation task, a complex object model is usually needed and performed, for example using the Finite Element Method. However, these models require a complete discretization of the object and they are time-consuming for the performance of the manipulation tasks. For that reason, in this paper a new control strategy, based on a minimal spring model of the objects, is presented and used for the control of the robot hand. This paper also presents an adaptable tactile-servo control scheme that can be used in in-hand manipulation tasks of deformable objects. Tactile control is based on achieving and maintaining a force value at the contact points which changes according to the object softness, a feature estimated in an initial recognition stage.

[1]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[2]  M. Gross,et al.  Flexible simulation of deformable models using discontinuous Galerkin FEM , 2008, SCA 2008.

[3]  Fernando Torres Medina,et al.  Finger Readjustment Algorithm for Object Manipulation Based on Tactile Information , 2013 .

[4]  Helge J. Ritter,et al.  Integrating vision, haptics and proprioception into a feedback controller for in-hand manipulation of unknown objects , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Mathieu Desbrun,et al.  Interactive Animation of Structured Deformable Objects , 1999, Graphics Interface.

[6]  Yanhong Luo,et al.  Fusing force and vision feedback for manipulating deformable objects , 2001, J. Field Robotics.

[7]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[8]  Tsuneo Yoshikawa,et al.  Multifingered robot hands: Control for grasping and manipulation , 2010, Annu. Rev. Control..

[9]  Helge J. Ritter,et al.  A Control Framework for Tactile Servoing , 2013, Robotics: Science and Systems.

[10]  Pierre Payeur,et al.  Dexterous Robotic Manipulation of Deformable Objects with Multi-Sensory Feedback - a Review , 2010 .

[11]  Shinichi Hirai,et al.  Robust manipulation of deformable objects by a simple PID feedback , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  Véronique Perdereau,et al.  Fingertip force control based on max torque adjustment for dexterous manipulation of an anthropomorphic hand , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Dinesh K. Pai,et al.  Author manuscript, published in "ACM Transactions on Graphics (2011)" Sparse Meshless Models of Complex Deformable Solids , 2011 .

[14]  Gerald E. Loeb,et al.  Haptic feature extraction from a biomimetic tactile sensor: Force, contact location and curvature , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[15]  Wolfram Burgard,et al.  Efficient motion planning for manipulation robots in environments with deformable objects , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Pablo Gil,et al.  Visual perception for the 3D recognition of geometric pieces in robotic manipulation , 2016 .

[18]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .