Non-Accidental Features for Gesture Spotting

In this paper we argue that gestures based on non-accidental motion features can be reliably detected amongst unconstrained background motion. Specifically, we demonstrate that humans can perform non-accidental motions with high accuracy, and that these trajectories can be extracted from video with sufficient accuracy to reliably distinguish them from the background motion. We demonstrate this by learning Gaussian mixture models of the features associated with gesture. Non-accidental features result in compact, heavily-weighted, mixture component distributions. We demonstrate reliable detection by using the mixture models to discriminate non-accidental features from the background.

[1]  Michael J. Black,et al.  Recognizing temporal trajectories using the condensation algorithm , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[2]  Allan D. Jepson,et al.  Trajectory segmentation using dynamic programming , 2002, Object recognition supported by user interaction for service robots.

[3]  P. Nurmi.  Mixture Models , 2008 .

[4]  Allan D. Jepson,et al.  Qualitative probabilities for image interpretation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[6]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[8]  Allan D. Jepson,et al.  What Makes a Good Feature , 1992 .

[9]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[10]  Patrice D. Tremoulet,et al.  Perception of Animacy from the Motion of a Single Object , 2000, Perception.

[11]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[12]  David R. Cheriton,et al.  Maestro : Direct Manipulation Through Gesture Alone , 2009 .

[13]  Daijin Kim,et al.  Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Jacob Feldman,et al.  Constructing perceptual categories , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Richard Mann,et al.  Categorization and learning of pen motion using hidden Markov models , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[16]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[17]  Allan D. Jepson,et al.  Detection and classification of motion boundaries , 2002, AAAI/IAAI.

[18]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[19]  Allan D. Jepson,et al.  A Biased View of PerceiversCommentary on ` Observer theory , Bayes theory , and psychophysics , ' by , 1995 .

[20]  Yangsheng Xu,et al.  Hidden Markov Model for Gesture Recognition , 1994 .