Gesture recognition with a Time-Of-Flight camera

This paper presents a new approach for gesture classification using x- and y- projections of the image and optional depth features. The system uses a 3D Time-Of-Flight (TOF) sensor which has the big advantage of simplifying hand segmentation. For the presented system, a Photonic-Mixer-Device (PMD) camera with a resolution of 160 × 120 pixels and a frame rate of 15 frames per second is used. The goal of our system is to recognise 12 different static hand gestures. The x- and y- projections and the depth features of the captured image are good enough to use a simple nearest neighbour classifier, resulting in a fast classification. To evaluate the system, a set of 408 images is recorded, 12 gestures from 34 persons. With a 'Leave-One-Out' evaluation, the recognition rate of the system is 94.61% and the classification time is about 30 msec on a standard PC.

[1]  Klaus Bengler,et al.  Gestensteuerung für Fahrzeugbordsysteme , 2000, DAGM-Symposium.

[2]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[3]  Chin-Chen Chang,et al.  Hand pose recognition using curvature scale space , 2002, Object recognition supported by user interaction for service robots.

[4]  Heinrich Niemann,et al.  Probabilistic Modeling and Recognition of 3-D Objects , 2000, International Journal of Computer Vision.

[5]  Stefan Müller,et al.  Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera-A Pilot Study , 2007, MIRAGE.

[6]  Christoph Maggioni,et al.  Virtual Touchscreen - a novel User Interface made of Light - Principles, metaphors and experiences , 1999, HCI.

[7]  Stan Sclaroff,et al.  Estimating 3D hand pose from a cluttered image , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..