Prediction of Target Object Based on Human Hand Movement for Handing-Over between Human and Self-Moving Trays

We aim to realize a robotic system that hands over a necessary object to a user as soon as he/she attempts to reach out for it. In order to realize such system, the following is required: 1) detection of the reaching movement, 2) prediction of the target object among multiple objects, and 3) handing over the object to a user. In this paper, the first two of them are described and discussed. We apply the smoothness and the speed of the hand movement to distinguish whether the movement is for reaching or not. And in order to predict the target object, we define the certainty according to the relative movement of the hand to each object. To evaluate the performance of the proposed method, we compare the method with the minimum jerk model based approach. A description of the experimental results demonstrates the usefulness of the method proposed here

[1]  P. Morasso Spatial control of arm movements , 2004, Experimental Brain Research.

[2]  S. Iiajiliawa,et al.  Motion Planning for Hand-Over between Human and Robot , 1995 .

[3]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.

[4]  Kiyoshi Kotani,et al.  Attentive Workbench: An Intelligent Production Cell Supporting Human Workers , 2004, DARS.

[5]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[6]  J. Ota,et al.  Deskwork support system based on the estimation of human intentions , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[7]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Yasushi Nakauchi,et al.  Intelligent kitchen: cooking support by LCD and mobile robot with IC-labeled objects , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Kazuo Tanie,et al.  Human interaction with a service robot: mobile-manipulator handing over an object to a human , 1997, Proceedings of International Conference on Robotics and Automation.

[10]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[11]  R.A. Brooks,et al.  The Intelligent Room project , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.

[12]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[13]  Hiroshi Mizoguchi,et al.  Robotic room: Symbiosis with human through behavior media , 1996, Robotics Auton. Syst..