A Personalized Gesture Interaction System with User Identification Using Kinect

In this paper, we present a Kinect-based real time personalized gesture interaction system with user identification targeting for tiled-display environments. By applying a HMM-GSS model and DTW algorithm respectively during user identification and personalized gesture recognition, the system offers more intuitive and user-friendly experience. Our experiment shows that the HMM-GSS model achieves nearly 13.95% accuracy increment than the conventional HMM-based classifier. With feature selection and classifying strategy comparisons, over 95.7% accuracy is obtained by the DTW classifier. Finally, the prototype system can demonstrate a high gesture recognition accuracy in both phases of user identification and real-time interaction with a tiled-display based visualization application.

[1]  Ricardo Gutierrez-Osuna,et al.  Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation , 2011, International journal of health geographics.

[2]  Elena Mugellini,et al.  Context-Aware 3D Gesture Interaction Based on Multiple Kinects , 2011 .

[3]  Sergio Escalera,et al.  Featureweighting in dynamic timewarping for gesture recognition in depth data , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[5]  Jason I. Hong,et al.  Wave to me: user identification using body lengths and natural gestures , 2014, CHI.

[6]  Chi-Man Pun,et al.  Real-time Hand Gesture Recognition from Depth Image Sequences , 2012, 2012 Ninth International Conference on Computer Graphics, Imaging and Visualization.

[7]  Nassir Navab,et al.  Simultaneous categorical and spatio-temporal 3D gestures using Kinect , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[8]  Arko Lucieer,et al.  Gestural navigation in Google Earth , 2011, OZCHI.

[9]  Mariusz Oszust,et al.  Polish sign language words recognition with Kinect , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[10]  Wenjun Wu,et al.  A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment , 2013, SEKE.

[11]  Wenyuan Xu,et al.  KinWrite: Handwriting-Based Authentication Using Kinect , 2013, NDSS.

[12]  Hui Li,et al.  Kinect Based Dynamic Hand Gesture Recognition Algorithm Research , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.