Motion primitives for designing flexible gesture set in Human-Robot Interface

This paper proposes motion primitives for designing a gesture set in a gesture recognition system as Human-Robot Interface (HRI). Based on statistical analyses of angular tendency of hand movements in sign languages and hand motions in practical gestures, we construct four motion primitives as building blocks for basic hand motions. By combining these motion primitives, we design a discernable ‘fundamental hand motion set’ toward improving machine based hand signal recognition. Novelty of combining the proposed motion primitives is demonstrated by a ‘fundamental hand motion set’ recognizer based on Hidden Markov Model (HMM). The recognition system shows 99.40% recognition rate on the proposed language set. For connected recognition of the ‘fundamental motion set’, the recognition system shows 97.95% recognition rate. The results validate that using the proposed motion primitives ensures flexibility and discernability of a gesture set. It is thus promising candidate for standardization when designing gesture sets for human-robot interface.

[1]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[2]  David Kortenkamp,et al.  Recognizing and Interpreting Gestures on a Mobile Robot , 1996, AAAI/IAAI, Vol. 2.

[3]  KwangYun Wohn,et al.  Recognition of space-time hand-gestures using hidden Markov model , 1996, VRST.

[4]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[5]  Agnès Just,et al.  A comparative study of two state-of-the-art sequence processing techniques for hand gesture recognition , 2009, Comput. Vis. Image Underst..

[6]  Tosiyasu L. Kunii,et al.  Model-based analysis of hand posture , 1995, IEEE Computer Graphics and Applications.

[7]  Hermann Ney,et al.  Speech recognition techniques for a sign language recognition system , 2007, INTERSPEECH.

[8]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Dong Hyun Kim,et al.  Simple high-order approximations for unsteady-state diffusion, adsorption and reaction in catalyst: A unified method by a continued fraction , 2011, 2011 11th International Conference on Control, Automation and Systems.

[10]  N S Seixas,et al.  A review of crane safety in the construction industry. , 2001, Applied occupational and environmental hygiene.

[11]  Sin Kim,et al.  Development of liquid level control system using web cam , 2011, 2011 11th International Conference on Control, Automation and Systems.

[12]  Dimitris N. Metaxas,et al.  Parallel hidden Markov models for American sign language recognition , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Mubarak Shah,et al.  Recognizing Hand Gestures , 1994, ECCV.

[14]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[15]  Hang Joon Kim,et al.  HMM-Based Gesture Recognition for Robot Control , 2005, IbPRIA.

[16]  L. Baum,et al.  An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process , 1972 .

[17]  Keechul Jung,et al.  Recognition-based gesture spotting in video games , 2004, Pattern Recognit. Lett..

[18]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[19]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.