Online, interactive learning of gestures for human/robot interfaces

We have developed a gesture recognition system, based on hidden Markov models, which can interactively recognize gestures and perform online learning of new gestures. In addition, it is able to update its model of a gesture iteratively with each example it recognizes. This system has demonstrated reliable recognition of 14 different gestures after only one or two examples of each. The system is currently interfaced to a Cyberglove for use in recognition of gestures from the sign language alphabet. The system is being implemented as part of an interactive interface for robot teleoperation and programming by example.

[1]  Pradeep K. Khosla,et al.  Tactile gestures for human/robot interaction , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[2]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[3]  Katsushi Ikeuchi,et al.  Robot task programming by human demonstration , 1994, IROS.

[4]  Jie Yang,et al.  Towards human-robot coordination: skill modeling and transferring via hidden Markov model , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[5]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application in telerobotics , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[6]  Allen Gersho,et al.  On the structure of vector quantizers , 1982, IEEE Trans. Inf. Theory.

[7]  Geoffrey E. Hinton,et al.  Glove-Talk: a neural network interface between a data-glove and a speech synthesizer , 1993, IEEE Trans. Neural Networks.

[8]  Avinash C. Kak,et al.  Automatic learning of assembly tasks using a DataGlove system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.