Visual detection of objects in a robotic work area using hand gestures

A system for rapidly developing industrial robotic applications with visual hand gestures and voice commands is being developed. This paper reports on the hand gesture recognition component of the system which has been designed and implemented in C# using OpenCV. Seventy two test subjects interacted with the hand gesture component of the system and the empirical results of these experiments are reported. Screenshots of the hand gesture component are presented as well as known system limitations.

[1]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[2]  Chin-Chen Chang,et al.  New Approach for Static Gesture Recognition , 2006, J. Inf. Sci. Eng..

[3]  J. Norberto Pires.  Robot-by-voice: experiments on commanding an industrial robot using the human voice , 2005, Ind. Robot.

[4]  Yoichi Sato,et al.  Fast tracking of hands and fingertips in infrared images for augmented desk interface , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  J. C. Bartholomew,et al.  Voice control for noisy industrial environments , 1988, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[7]  Martin Hägele,et al.  Robot Assistants at Manual Workplaces: Effective Co-operation and Safety Aspects , 2002 .

[8]  Miroslav Holada,et al.  The Robot Voice-control System with Interactive Learning , 2008 .