Supervised training based hand gesture recognition system

We have developed a hand gesture recognition system, based on the shape analysis of static gestures, for human computer interaction purposes. Our appearance-based recognition uses modified Fourier descriptors for the classification of hand shapes. As always found in literature, such recognition systems consist of two phases: training and recognition. In our new practical approach, following the chosen appearance-based model, training and recognition is done in an interactive supervised way: the adaptation for untrained gestures is also solved by hand signals. Our experimental results with three different users are reported. Besides describing the recognition itself we demonstrate our interactive training method in a practical application.

[1]  Stanley M. Dunn,et al.  Learning Shape Classes , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Franz L. Alt,et al.  Digital Pattern Recognition by Moments , 1962, JACM.

[3]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[4]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[5]  Thomas S. Huang,et al.  A Modified Fourier Descriptor for Shape Matching in MARS , 1998, Image Databases and Multi-Media Search.

[6]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[7]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[8]  Tsutomu Miyasato,et al.  Hand gesture recognition system using multiple cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  谷口 倫一郎,et al.  Appearance-based Recognition of Hand Shapes for Sign Language in Low Resolution Image , 2000 .

[10]  Edward Hunter,et al.  Vision based hand gesture interpretation using recursive estimation , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.