Understanding users intention: programming fine manipulation tasks by demonstration

The Programming by Demonstration (PbD) paradigm enable programming of service robots by inexperienced human users. The main goal of these systems is to allow the inexperienced human user to easily integrate motion and perception skills or complex problem solving strategies. Unfortunately, actual PbD systems deal only with manipulation based on Pick & Place operations. For complex service tasks these are insufficient. Therefore, this paper describes how fine manipulations like detecting screw movements can be recognized by a PbD system. In order to do this, finger movements and forces on the fingertips are gathered and analyzed while an object is grasped. This assumes sensory employment like a data glove and integrated tactile sensors. An overview of the used tactile sensors and the gathered signals is given. Furthermore the segmentation of users demonstration and the classification of the recognized dynamic grasp is pointed out. For classifying dynamic grasps a time delay method based on a Support Vector Machine (SVM) is used. Finally the symbolic representation of service tasks is briefly illustrated.

[1]  Ales Ude,et al.  Rekonstruktion von Trajektorien aus Stereobildfolgen für die Programmierung von Roboterbahnen , 1996 .

[2]  J. Elliott,et al.  A CLASSIFICATION OF MANIPULATIVE HAND MOVEMENTS , 1984, Developmental medicine and child neurology.

[3]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[4]  Rüdiger Dillmann,et al.  A comparison of four fast vision based object recognition methods for programming by demonstration applications , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[6]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[7]  Josef Pauli,et al.  VISION BASED LEARNING OF GRIPPER TRAJECTORIES FOR A ROBOT ARM. , 1997 .

[8]  Peter Steinhaus,et al.  A multisensor system for observation of user actions in programming by demonstration , 1999, Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No.99TH8480).

[9]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[10]  Holger Friedrich,et al.  Interaktive Programmierung von Manipulationssequenzen , 1998 .

[11]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[12]  Sing Bing Kang,et al.  Robot instruction by human demonstration , 1995 .

[13]  R. Dillmann,et al.  Sensor fusion approaches for observation of user actions in programming by demonstration , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[15]  Miriam Zacksenhouse,et al.  Inherent structure of manipulative hand movements and its discriminative power , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[16]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[17]  R. Dillmann,et al.  An efficient image processing algorithm for high-level skill acquisition , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[18]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[19]  Rüdiger Dillmann,et al.  Integration of tactile sensors in a programming by demonstration system , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .