Gesture recognition based on the detection of periodic motion

In this paper, we propose a method to recognize periodic gestures from images. The proposed method uses a amplitude spectrum and a phase spectrum that are obtained by applying Fast Fourier Transform (FFT) to a time series of intensity images. FFT is applied to each pixel of low-resolution images. The method consists of 2 steps. First, the method detects p eriodic motion regions from the amplitude spectrum. Secondly, the method uses the phase spectrum in the detected periodic motion region to classify the gestures. The proposed method is robust to lighting conditions and individual differences in skin color because it does not rely on color information. Several experiments are performed to demonstrate the effectiveness of the proposed method.

[1]  William H. Press,et al.  Numerical recipes , 1990 .

[2]  James M. Rehg,et al.  Quasi-periodic event analysis for social game retrieval , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Kazunori Umeda,et al.  Construction of an intelligent room based on gesture recognition: operation of electric appliances with hand gestures , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Yoichi Sato,et al.  Real-time input of 3D pose and gestures of a user's hand and its applications for HCI , 2001, Proceedings IEEE Virtual Reality 2001.

[8]  Dimitris N. Metaxas,et al.  ASL recognition based on a coupling between HMMs and 3D motion analysis , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Aaron F. Bobick,et al.  Parametric Hidden Markov Models for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Kazunori Umeda,et al.  Detection of Waving Hands from Images : Application of FFT to time series of low-resolution images , 2002 .

[12]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Yihong Gong,et al.  Action detection in complex scenes with spatial and temporal ambiguities , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Narendra Ahuja,et al.  Estimation of Multiple Periodic Motions from Video , 2006, ECCV.

[15]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[17]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[20]  William H. Press,et al.  Numerical recipes in C , 2002 .

[21]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.