Multi-HMM classification for hand gesture recognition using two differing modality sensors

This paper presents a multi-Hidden Markov Model (HMM) classification approach for hand gesture recognition by utilizing two differing modality and low-cost sensors. The sensors consist of a Kinect depth camera and a wearable inertial sensor. It is shown that the multi-HMM classification based on nine signals that are simultaneously captured by these two sensors leads to a more robust recognition compared to the situation when only a single HMM classification is used to generate the likelihood probabilities of hand gestures. This approach is applied to the hand gestures of the $1Unistroke Recognizer application and the results obtained indicate a 7% improvement in the overall classification rate over a single HMM classification under realistic conditions.

[1]  Yuan Yao,et al.  Fingerprint Classification with Combinations of Support Vector Machines , 2001, AVBPA.

[2]  Anil K. Jain,et al.  Online handwriting recognition using multiple pattern class models , 2000 .

[3]  Cheng-Lin Liu,et al.  Classification and Learning Methods for Character Recognition: Advances and Remaining Problems , 2008, Machine Learning in Document Analysis and Recognition.

[4]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[5]  William M. Campbell,et al.  A multi-class MLLR kernel for SVM speaker recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Nasser Kehtarnavaz,et al.  Home-based Senior Fitness Test measurement system using collaborative inertial and depth sensors , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Roozbeh Jafari,et al.  Low power programmable architecture for periodic activity monitoring , 2013, 2013 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[8]  Nasser Kehtarnavaz,et al.  Comparison of two real-time hand gesture recognition systems involving stereo cameras, depth camera, and inertial sensor , 2014, Photonics Europe.

[9]  Nasser Kehtarnavaz,et al.  Fusion of Inertial and Depth Sensor Data for Robust Hand Gesture Recognition , 2014, IEEE Sensors Journal.

[10]  Nasser Kehtarnavaz,et al.  A medication adherence monitoring system for pill bottles based on a wearable inertial sensor , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Nasser Kehtarnavaz,et al.  Real-time human action recognition based on depth motion maps , 2013, Journal of Real-Time Image Processing.