Estimation of user’s intention inherent in the movements of hand and eyes for the deskwork support system

We aim to realize a robotic system that hands over a necessary object to a user as soon as he/she attempts to reach out his/her hand for it. In order to realize such system, the following is required: 1) detection of the reaching movements, 2) prediction of the target object among multiple objects, and 3) handing-over the object to a user. In this paper, the first two of them are discussed. To detect the reaching movements, we use the speed of a hand movement, the smoothness of the hand trajectory, and the relation between a position of hand and a gaze point. To predict the target object, we use a probabilistic model based on the user's hand movements and his/her gaze direction. The proposed system can detect reaching movements and predict the target object at a very early stage. A description of the experimental results demonstrates the advantage of the method proposed here.

[1]  E. Gumbel,et al.  The Circular Normal Distribution: Theory and Tables , 1953 .

[2]  J. Ota,et al.  Deskwork support system based on the estimation of human intentions , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[3]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[5]  Jun Ota,et al.  Prediction of Target Object Based on Human Hand Movement for Handing-Over between Human and Self-Moving Trays , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Hiroshi Mizoguchi,et al.  Robotic room: Symbiosis with human through behavior media , 1996, Robotics Auton. Syst..

[7]  P. Morasso.  Spatial control of arm movements , 2004, Experimental Brain Research.

[8]  Yasushi Nakauchi,et al.  Intelligent kitchen: cooking support by LCD and mobile robot with IC-labeled objects , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[10]  Kiyoshi Kotani,et al.  Attentive Workbench: An Intelligent Production Cell Supporting Human Workers , 2004, DARS.

[11]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[12]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.

[13]  R.A. Brooks,et al.  The Intelligent Room project , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.