Head nod and shake recognition based on multi-view model and hidden Markov model

Head gestures such as nodding and shaking are often used as one of human body languages for communication with each other, and their recognition plays an important role in the advancement of human-computer interaction. As head gesture is the continuous motion on the sequential time series, the key problems of recognition are to track multi-view head and understand the head pose switch. This paper presents a novel approach to recognize the nod and shake in the interactive computer environment. First, head poses are detected by multi-view model (MVM) and then hidden Markov model (HMM) are used as head gesture statistic inference model for gesture recognition. Experimental results show that the approach is effective and real time.

[1]  Liyanage C. De Silva,et al.  Head gestures recognition , 2001, ICIP.

[2]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[3]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[4]  Shaogang Gong,et al.  An investigation into face pose distributions , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Shinjiro Kawato,et al.  Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes" , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .