Recognition of human periodic movements from unstructured information using a motion-based frequency domain approach

Feature-based motion cues play an important role in biological visual perception. We present a motion-based frequency-domain scheme for human periodic motion recognition. As a baseline study of feature based recognition we use unstructured feature-point kinematic data obtained directly from a marker-based optical motion capture (MoCap) system, rather than accommodate bootstrapping from the low-level image processing of feature detection. Motion power spectral analysis is applied to a set of unidentified trajectories of feature points representing whole body kinematics. Feature power vectors are extracted from motion power spectra and mapped to a low dimensionality of feature space as motion templates that offer frequency domain signatures to characterise different periodic motions. Recognition of a new instance of periodic motion against pre-stored motion templates is carried out by seeking best motion power spectral similarity. We test this method through nine examples of human periodic motion using MoCap data. The recognition results demonstrate that feature-based spectral analysis allows classification of periodic motions from low-level, un-structured interpretation without recovering underlying kinematics. Contrasting with common structure-based spatio-temporal approaches, this motion-based frequency-domain method avoids a time-consuming recovery of underlying kinematic structures in visual analysis and largely reduces the parameter domain in the presence of human motion irregularities.

[1]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[3]  Ian D. Reid,et al.  Automatic partitioning of high dimensional search spaces associated with articulated body motion capture , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Jitendra Malik,et al.  Recovering human body configurations using pairwise constraints between parts , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Randal C. Nelson,et al.  Detecting activities , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Tieniu Tan,et al.  Automatic gait recognition based on statistical shape analysis , 2003, IEEE Trans. Image Process..

[7]  Mubarak Shah,et al.  Motion-Based Recognition , 1997, Computational Imaging and Vision.

[8]  Mark S. Nixon,et al.  Recognising humans by gait via parametric canonical space , 1999, Artif. Intell. Eng..

[9]  Mark S. Nixon,et al.  Automatic extraction and description of human gait models for recognition purposes , 2003, Comput. Vis. Image Underst..

[10]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  J. Little,et al.  Global versus structured interpretation of motion: moving light displays , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[12]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[13]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Wei Sun,et al.  Whole-body modelling of people from multiview images to populate virtual worlds , 2000, The Visual Computer.

[15]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[16]  L. Davis,et al.  el-based tracking of humans in action: , 1996 .

[17]  J. Richards,et al.  The measurement of human motion: A comparison of commercially available systems , 1999 .

[18]  Larry S. Davis,et al.  Robust periodic motion and motion symmetry detection , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  P. Mrazek,et al.  Marker based motion capture in biomedical applications , 1999 .

[20]  I Söderkvist,et al.  Determining the movements of the skeleton using well-configured markers. , 1993, Journal of biomechanics.

[21]  Ioannis A. Kakadiaris,et al.  3D human body model acquisition from multiple views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[22]  D. E. Krebs,et al.  Frequency content of whole body gait kinematic data , 1994 .

[23]  Mark S. Nixon,et al.  Automated person recognition by walking and running via model-based approaches , 2004, Pattern Recognit..

[24]  Tieniu Tan,et al.  Articulated model based people tracking using motion models , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[25]  Chiraz Ben Abdelkader Motion-Based Recognition of People in EigenGait Space , 2002 .

[26]  Yi Li,et al.  A relaxation algorithm for real-time multiple view 3D-tracking , 2002, Image Vis. Comput..

[27]  YingLiang Ma Brain Inspired Cognitive Systems , 2004 .

[28]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[29]  F. Pollick,et al.  Exaggerating Temporal Differences Enhances Recognition of Individuals from Point Light Displays , 2000, Psychological science.

[30]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[31]  G. Ferrigno,et al.  Procedure to automatically classify markers in biomechanical analysis of whole-body movement in different sports activities , 2006, Medical and Biological Engineering and Computing.

[32]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[33]  Dieter Merkl,et al.  Things we observed when watching people walk: Classification of gait patterns with self-organizing maps , 1996 .

[34]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[36]  Mubarak Shah,et al.  Cyclic motion detection for motion based recognition , 1994, Pattern Recognit..

[37]  Klaus Dorfmüller,et al.  Robust tracking for augmented reality using retroreflective markers , 1999, Comput. Graph..

[38]  Michael Gleicher,et al.  Animation from observation: Motion capture and motion editing , 1999, COMG.

[39]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Human Body Model Acquisition from Multiple Views , 1998, International Journal of Computer Vision.

[40]  J. Cutting,et al.  Temporal and spatial factors in gait perception that influence gender recognition , 1978, Perception & psychophysics.

[41]  J B King,et al.  Gait Analysis. An Introduction , 1992 .

[42]  Mubarak Shah,et al.  A survey of motion analysis from moving light displays , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Nigel Goddard,et al.  The Perception of Articulated Motion: Recognizing Moving Light Displays , 1992 .

[44]  G. Johansson Visual motion perception. , 1975, Scientific American.