Adaptive control for pivoting with visual and tactile feedback

In this work we present an adaptive control approach for pivoting, which is an in-hand manipulation maneuver that consists of rotating a grasped object to a desired orientation relative to the robot's hand. We perform pivoting by means of gravity, allowing the object to rotate between the fingers of a one degree of freedom gripper and controlling the gripping force to ensure that the object follows a reference trajectory and arrives at the desired angular position. We use a visual pose estimation system to track the pose of the object and force measurements from tactile sensors to control the gripping force. The adaptive controller employs an update law that accommodates for errors in the friction coefficient, which is one of the most common sources of uncertainty in manipulation. Our experiments confirm that the proposed adaptive controller successfully pivots a grasped object in the presence of uncertainty in the object's friction parameters.

[1]  Alberto Rodriguez,et al.  A two-phase gripper to reorient and grasp , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[2]  Danica Kragic,et al.  In-hand manipulation using gravity and controlled slip , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  David L. Brock,et al.  Enhancing the dexterity of a robot hand using controlled slip , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[4]  Carlos Canudas de Wit,et al.  A new model for control of systems with friction , 1995, IEEE Trans. Autom. Control..

[5]  Siddhartha S. Srinivasa,et al.  Extrinsic dexterity: In-hand manipulation with external forces , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jeffrey C. Trinkle,et al.  A framework for planning dexterous manipulation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[7]  Jeffrey C. Trinkle,et al.  Dextrous manipulation by rolling and finger gaiting , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  J. Kenneth.  Kinematic and force analysis of articulated hands , 1985 .

[9]  Pushkin Kachroo,et al.  Sliding mode measurement feedback control for antilock braking systems , 1999, IEEE Trans. Control. Syst. Technol..

[10]  Imin Kao,et al.  Modeling of Contact Mechanics and Friction Limit Surfaces for Soft Fingers in Robotics, with Experimental Results , 1999, Int. J. Robotics Res..

[11]  Jian Shi,et al.  Dynamic in-hand sliding manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[13]  Mark R. Cutkosky,et al.  Estimating friction using incipient slip sensing during a manipulation task , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[14]  Danica Kragic,et al.  SimTrack: A simulation-based framework for scalable real-time object pose detection and tracking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Alberto Rodriguez,et al.  Prehensile pushing: In-hand manipulation with push-primitives , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Matthew T. Mason,et al.  A general framework for open-loop pivoting , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Mark R. Cutkosky,et al.  Practical Force-Motion Models for Sliding Manipulation , 1996, Int. J. Robotics Res..

[18]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[19]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[20]  Claudio Melchiorri,et al.  Slip detection and control using tactile and force sensors , 2000 .

[21]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[22]  Friedrich M. Wahl,et al.  On-line rigid object recognition and pose estimation based on inertial parameters , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).