Autonomous manipulation of deformable objects based on teleoperated demonstrations

While humans can manipulate deformable objects smoothly and naturally, this is still a challenge for autonomous robots due to the complex object dynamics. The presence of rigid environment constraints and altering contact phases between the deformable object, the manipulator, and the environment makes this problem even more challenging. This paper presents a framework for deformable object manipulation that makes use of a single human demonstration of the task. The recorded trajectories are automatically segmented into a sequence of haptic control primitives involving contact with the rigid environment and vision-guided grasp primitives. The recorded motion/force trajectories serve as reference for a compliant control scheme in contact situations. In order to cope with positioning uncertainties a variable admittance control is proposed. The proposed approach is validated in an experimental mounting task for a deformable linear object with multiple re-grasping. The task is demonstrated with a multimodal teleoperation system and transfered to a robotic platform with a pair of seven degrees of freedom manipulators.

[1]  Bartlomiej Stanczyk,et al.  Development of a telerobotic system for exploration of hazardous environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Sandra Hirche,et al.  A Framework for Information Distribution, Task Execution and Decision Making in Multi-Robot Systems , 2010, IEICE Trans. Inf. Syst..

[3]  Martin Buss,et al.  Robust stability analysis of a bilateral teleoperation system using the parameter space approach , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  M. Goebl,et al.  A Real-Time-capable Hard-and Software Architecture for Joint Image and Knowledge Processing in Cognitive Automobiles , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[5]  Hidefumi Wakamatsu,et al.  Static Modeling of Linear Object Deformation Based on Differential Geometry , 2004, Int. J. Robotics Res..

[6]  Fumiharu Fujiwara,et al.  Realization of skill controllers for manipulation of deformable objects based on hybrid automata , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Dominik Henrich,et al.  Manipulation of Deformable Linear Objects: From Geometric Model Towards Program Generation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Martin Buss,et al.  VISHARD10, a novel hyper-redundant haptic interface , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[9]  Uwe D. Hanebeck,et al.  A modular wheel system for mobile robot applications , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[10]  Hidefumi Wakamatsu,et al.  Dynamic Modeling of Linear Object Deformation Considering Contact with Obstacles , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[11]  Martin Buss,et al.  Development of a Multi-modal Multi-user Telepresence and Teleaction System , 2010, Int. J. Robotics Res..

[12]  Mitul Saha,et al.  Manipulation Planning for Deformable Linear Objects , 2007, IEEE Transactions on Robotics.

[13]  Sandra Hirche,et al.  An Architecture for Real-Time Control in Multi-robot Systems , 2009, Human Centered Robot Systems, Cognition, Interaction, Technology.