Determination of motion breakpoints in a task sequence from human hand motion

This paper describes the authors' work on the temporal segmentation of grasping task sequences based on human hand motion. The segmentation process results in the identification of motion breakpoints separating the different constituent phases of the grasping task. A grasping task is composed of three basic phases: pregrasp phase, static grasp phase, and manipulation phase. The authors show that by analyzing the fingertip polygon (preshape) area and the speed of hand movement, they can divide a task into meaningful action segments such as approach object, grasp object, manipulate object, place object, and depart. The authors introduce a measure called the volume sweep rate, which is the product of the fingertip polygon area and the hand speed. The profile of this measure is also used in the determination of the task breakpoints. The temporal task segmentation process is important as it serves as a preprocessing step to the characterization of the task phases. Once the breakpoints have been identified, further analyses such as grasp recognition and object motion extraction can then be carried out.<<ETX>>

[1]  Tomás Lozano-Pérez,et al.  Automatic Planning of Manipulator Transfer Movements , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Huan Liu,et al.  The multi-dimensional quality of task requirements for dextrous robot hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[3]  Katsushi Ikeuchi,et al.  Grasp Recognition Using The Contact Web , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  M. Jeannerod The timing of natural prehension movements. , 1984, Journal of motor behavior.

[5]  George A. Bekey,et al.  A strategy for grasp synthesis with multifingered robot hands , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[6]  Damian M. Lyons,et al.  A simple set of grasps for a dextrous hand , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[7]  M. Jeannerod Intersegmental coordination during reaching at natural visual objects , 1981 .

[8]  Katsushi Ikeuchi,et al.  A grasp abstraction hierarchy for recognition of grasping tasks from observation , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[9]  A. Wing,et al.  Grasp size and accuracy of approach in reaching. , 1986, Journal of motor behavior.

[10]  Katsushi Ikeuchi,et al.  Towards an assembly plan from observation. I. Assembly task recognition using face-contact relations (polyhedral objects) , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[11]  H. Harry Asada,et al.  The direct teaching of tool manipulation skills via the impedance identification of human motions , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[12]  M. Arbib Coordinated control programs for movements of the hand , 1985 .

[13]  J. Landsmeer Power Grip and Precision Handling , 1962, Annals of the rheumatic diseases.