Vision-based hand gesture spotting and recognition

In this paper, we propose a dynamic gesture spotting and recognition algorithm using our stereovision system. The 3D trajectories of hand gestures are first reconstructed by a stereovision-based motion capture platform. Hand gestures can then be segmented from the trajectory in real time by using proposed gesture spotting algorithm. Discrete cosine transforms coefficients, complex index and gesture entropy features are extracted to represent the gestures. With these features, one-class SVM is adopted for gesture classification. The experimental results demonstrate the feasibility of proposed spotting and recognition algorithm.

[1]  Namgyu Kim,et al.  POSTRACK: a low cost real-time motion tracking system for VR application , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[2]  Keechul Jung,et al.  Recognition-based gesture spotting in video games , 2004, Pattern Recognit. Lett..

[3]  Bisser Raytchev,et al.  User-independent online gesture recognition by relative motion extraction , 2000, Pattern Recognit. Lett..

[4]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Seong-Whan Lee,et al.  Gesture Spotting and Recognition for Human–Robot Interaction , 2007, IEEE Transactions on Robotics.

[6]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Narendra Ahuja,et al.  Recognizing hand gesture using motion trajectories , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[9]  Daijin Kim,et al.  Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  David Alan Becker,et al.  Sensei, a real-time recognition, feedback and training system for T'ai chi gestures , 1997 .

[11]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[13]  Jani Mäntyjärvi,et al.  Online gesture recognition system for mobile interaction , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[14]  Jin Ryong Kim,et al.  Vision Based Motion Tracking System for Interactive Entertainment Applications , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[15]  Steven K. Feiner,et al.  UIST'007 (panel): where will we be ten years from now? , 1997, UIST '97.

[16]  Jani Mäntyjärvi,et al.  Enabling fast and effortless customisation in accelerometer based gesture interaction , 2004, MUM '04.

[17]  Steven K. Feiner,et al.  UIST'007: Where Will We Be Ten Years from Now? (Panel). , 1997 .

[18]  Zoltán Prekopcsák,et al.  Accelerometer Based Real-Time Gesture Recognition , 2008 .

[19]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).