Robotic Gesture Recognition by Cue Combination

Automatic gesture recognition holds the promise of making man-machine interfaces more natural and intuitive. We discuss six requirements for gesture recognition by robots. We present computer vision techniques developed at our lab which are suited to meet the requirements. The techniques owe their robustness to the combination of several cues for a particular task instead of relying on a single cue alone. We demonstrate this in a sample application employing a real robot in a pick-and-place scenario.

[1]  Alex Pentland,et al.  Invariant features for 3-D gesture recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  Markus Kohler,et al.  Videobasierte Mensch-Maschine Interaktion , 1996, Informationstechnik Tech. Inform..

[3]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Jochen Triesch,et al.  Robotic Gesture Recognition , 1997, Gesture Workshop.

[6]  Jochen Triesch,et al.  GripSee: A Robot for Visually-Guided Grasping , 1998 .

[7]  John R. Kender,et al.  Toward the use of gesture in traditional user interfaces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[8]  Michael J. Swain,et al.  Happy patrons make better tippers: creating a robot waiter using Perseus and the Animate Agent architecture , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[9]  Jochen Triesch,et al.  Object Recognition with Multiple Feature Types , 1998 .

[10]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[11]  Yuntao Cui,et al.  Hand sign recognition from intensity image sequences with complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  David C. Hogg,et al.  Towards 3D hand tracking using a deformable model , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Markus Kohler.  Technical Details and Ergonomical Aspects of Gesture Recognition Applied in Intelligent Home Environments , 1997 .

[15]  Jochen Triesch,et al.  GripSee: A Gesture-Controlled Robot for Object Perception and Manipulation , 1999, Auton. Robots.

[16]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[17]  Ipke Wachsmuth,et al.  Gesture and Sign Language in Human-Computer Interaction , 1997, Lecture Notes in Computer Science.

[18]  Jochen Triesch,et al.  A gesture interface for human-robot-interaction , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.