Model and implementation of body movement recognition using Support Vector Machines and Finite State Machines with Cartesian coordinates input for gesture-based interaction

The growth in the use of gesture-based interaction in video games has highlighted the potential for the use of such interaction method for a wide range of applications. This paper presents the implementation of an enhanced model for gesture recognition as input method for software applications. The model uses Support Vector Machines (SVM) and Finite State Machines (FSM) and the implementation was based on a Kinect R device. The model uses data input based on Cartesian coordinates. The use of Cartesian coordinates enables more flexibility to generalise the use of the model to different applications, when compared to related work encountered in the literature based on accelerometer devices for data input. The results showed that the use of SVM and FSM with Cartesian coordinates as input for gesture-based interaction is very promising. The success rate in gesture recognition was 98%, from a training corpus of 9 sets obtained by recording real users’ gestures. A proof-of-concept implementation of the gesture recognition interaction was performed using the application Google Earth R . A preliminary acceptance evaluation with users indicated that the interaction with the system via the implementation reported was satisfactory.

[1]  Bozena Kostek,et al.  Gesture-based computer control system applied to the interactive whiteboard , 2010, 2010 2nd International Conference on Information Technology, (2010 ICIT).

[2]  Ian D. Walker,et al.  Use of kinect depth data and Growing Neural Gas for gesture based robot control , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[3]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .

[4]  Yale Song,et al.  Continuous body and hand gesture recognition for natural human-computer interaction , 2012, TIIS.

[5]  Kok Wai Wong,et al.  Non-contact multi-hand gestures interaction techniques for architectural design in a virtual environment , 2011, ICIMU 2011 : Proceedings of the 5th international Conference on Information Technology & Multimedia.

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  Steve J. Young,et al.  HMM-based architecture for face identification , 1994, Image Vis. Comput..

[8]  Marco Roccetti,et al.  Recognizing intuitive pre-defined gestures for cultural specific interactions: An image-based approach , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[11]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[12]  Aaron F. Bobick,et al.  A State-Based Approach to the Representation and Recognition of Gesture , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[14]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Masaki Oshita,et al.  Automatic Learning of Gesture Recognition Model Using SOM and SVM , 2010, ISVC.

[16]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[17]  Maziar Palhang,et al.  Generalization performance of support vector machines and neural networks in runoff modeling , 2009, Expert Syst. Appl..

[18]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[19]  Thomas S. Huang,et al.  Gesture modeling and recognition using finite state machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[20]  Junsong Yuan,et al.  Robust hand gesture recognition with kinect sensor , 2011, ACM Multimedia.

[21]  Marti A. Hearst.  Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[22]  Norbert Schnell,et al.  Continuous Realtime Gesture Following and Recognition , 2009, Gesture Workshop.

[23]  Kanad K. Biswas,et al.  Gesture recognition using Microsoft Kinect® , 2011, The 5th International Conference on Automation, Robotics and Applications.

[24]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Kenneth C. Louden.  Compiler Construction: Principles and Practice , 1997 .

[26]  Kamer Ali Yüksel,et al.  Prototyping input controller for touch-less interaction with ubiquitous environments , 2011, Mobile HCI.

[27]  Takefumi Matsunaga,et al.  Recognition of Walking Motion Using Support Vector Machine , 2007 .

[28]  Siddharth Swarup Rautaray,et al.  Real Time Multiple Hand Gesture Recognition System for Human Computer Interaction , 2012 .