Action classification from motion capture data using topological data analysis

This paper proposes a novel framework for activity recognition from 3D motion capture data using topological data analysis (TDA). We extract point clouds describing the oscillatory patterns of body joints from the principal components of their time series using Taken's delay embedding. Topological persistence from TDA is exploited to extract topological invariants of the constructed point clouds. We propose a feature extraction method from persistence diagrams in order to generate robust low dimensional features used for classification of different activities. Our experimental results demonstrate high separability of generated features, and as a result a high accuracy of classification.

[1]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[2]  Dimitrios Makris,et al.  Hierarchical transfer learning for online recognition of compound actions , 2016, Comput. Vis. Image Underst..

[3]  Konstantin Mischaikow,et al.  Topological data analysis of contagion maps for examining spreading processes on networks , 2015, Nature communications.

[4]  F. Takens Detecting strange attractors in turbulence , 1981 .

[5]  Nikos Nikolaidis,et al.  Action recognition on motion capture data using a dynemes and forward differences representation , 2014, J. Vis. Commun. Image Represent..

[6]  Edgar J. Lobaton,et al.  Mapping of unknown environments using minimal sensing from a stochastic swarm , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[8]  Schahram Dustdar,et al.  Incorporating Unsupervised Learning in Activity Recognition , 2011, Activity Context Representation.

[9]  Konstantin Mischaikow,et al.  Topological data analysis of contagion maps for examining spreading processes on networks , 2014, Nature Communications.

[10]  Jose A. Perea,et al.  Sliding Windows and Persistence: An Application of Topological Methods to Signal Analysis , 2013, Found. Comput. Math..

[11]  References , 1971 .

[12]  Jose A. Perea,et al.  SW1PerS: Sliding windows and 1-persistence scoring; discovering periodicity in gene expression time series data , 2015, BMC Bioinformatics.

[13]  Leonidas J. Guibas,et al.  Persistence-based segmentation of deformable shapes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[15]  Hamid Krim,et al.  Persistent Homology of Delay Embeddings and its Application to Wheeze Detection , 2014, IEEE Signal Processing Letters.

[16]  Wanqing Li,et al.  Action recognition based on a bag of 3D points , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[17]  Roozbeh Jafari,et al.  Robust activity recognition using wearable IMU sensors , 2014, IEEE SENSORS 2014 Proceedings.

[18]  H. Edelsbrunner,et al.  Persistent Homology — a Survey , 2022 .

[19]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[20]  Guodong Guo,et al.  A survey on still image based human action recognition , 2014, Pattern Recognit..

[21]  Erin W. Chambers,et al.  Vietoris–Rips Complexes of Planar Point Sets , 2009, Discret. Comput. Geom..

[22]  David Cohen-Steiner,et al.  Stability of Persistence Diagrams , 2005, Discret. Comput. Geom..

[23]  Herbert Edelsbrunner,et al.  Computational Topology - an Introduction , 2009 .

[24]  Edgar J. Lobaton,et al.  Topological mapping of unknown environments using an unlocalized robotic swarm , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  N. Stergiou,et al.  Human movement variability, nonlinear dynamics, and pathology: is there a connection? , 2011, Human movement science.

[26]  Yi Zhao,et al.  Persistent topological features of dynamical systems. , 2015, Chaos.

[27]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, SIGGRAPH '05.

[28]  Konstantin Mischaikow,et al.  Morse Theory for Filtrations and Efficient Computation of Persistent Homology , 2013, Discret. Comput. Geom..

[29]  Pavan K. Turaga,et al.  Attractor-Shape for Dynamical Analysis of Human Movement: Applications in Stroke Rehabilitation and Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Herbert Edelsbrunner,et al.  Topological Persistence and Simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.