Detection of Unnatural Movement Using Epitomic Analysis

Epitomic analysis, a recent statistical approach to form a generative model, has been applied to image, video and audio processing applications. We apply the epitomic analysis to motion capture data and define it as a motion epitome, a probabilistic model representing a finite set of primitive movements which retain various lengths of local dynamics. We review the generation, inference and learning procedures of an epitome, adapt them for motion capture data and utilize the epitomic analysis to detect unnatural movements given only positive (natural) training data. We introduce a multi-resolution of motion epitomes as well as a full body and an ensemble of epitomes, then present experimental results and compare the performance with other conventional classification methods, including Hidden Markov Models and Switching Linear Dynamic Systems.

[1]  Brendan J. Frey,et al.  Epitomic analysis of appearance and shape , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[3]  Vladimir Pavlovic,et al.  Learning Switching Linear Models of Human Motion , 2000, NIPS.

[4]  David A. Forsyth,et al.  Enriching a motion collection by transplanting limbs , 2004, SCA '04.

[5]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[6]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[7]  Brendan J. Frey,et al.  Video Epitomes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Nancy S. Pollard,et al.  Perceptual metrics for character animation: sensitivity to errors in ballistic motion , 2003, ACM Trans. Graph..

[9]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[10]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.

[11]  Ashish Kapoor,et al.  The audio epitome: a new representation for modeling and classifying auditory phenomena , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[12]  Bobby Bodenheimer,et al.  Computing the duration of motion transitions: an empirical approach , 2004, SCA '04.

[13]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[14]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, SIGGRAPH '05.

[15]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[16]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..