A Two-Stage Approach for Commonality-Based Temporal Localization of Periodic Motions

We present an unsupervised method for the detection of all temporal segments of videos or motion capture data, that correspond to periodic motions. The proposed method is based on the detection of similar segments (commonalities) in different parts of the input sequence and employs a two-stage approach that operates on the matrix of pairwise distances of all input frames. The quantitative evaluation of the proposed method on three standard ground-truth-annotated datasets (two video datasets, one 3D human motion capture dataset) demonstrate its improved performance in comparison to existing approaches.

[1]  Lior Wolf,et al.  Live Repetition Counting , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[3]  Cordelia Schmid,et al.  Dense Trajectories and Motion Boundary Descriptors for Action Recognition , 2013, International Journal of Computer Vision.

[4]  Norbert Marwan,et al.  Recurrence Quantification Analysis at work: Quasi-periodicity based interpretation of gait force profiles for patients with Parkinson disease , 2018, Scientific Reports.

[5]  Walid G. Aref,et al.  WARP: time warping for periodicity detection , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[6]  Jiawei Han,et al.  ePeriodicity: Mining Event Periodicity from Incomplete Observations , 2015, IEEE Transactions on Knowledge and Data Engineering.

[7]  Arnold W. M. Smeulders,et al.  Repetition Estimation , 2018, International Journal of Computer Vision.

[8]  Walid G. Aref,et al.  Periodicity detection in time series databases , 2005, IEEE Transactions on Knowledge and Data Engineering.

[9]  Emmanuel Ramasso,et al.  Unsupervised Consensus Clustering of Acoustic Emission Time-Series for Robust Damage Sequence Estimation in Composites , 2015, IEEE Transactions on Instrumentation and Measurement.

[10]  Antonis A. Argyros,et al.  Unsupervised Detection of Periodic Segments in Videos , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[11]  Antonis A. Argyros,et al.  A graph-based approach for detecting common actions in motion capture data and videos , 2018, Pattern Recognit..

[12]  Jose A. Perea,et al.  (Quasi)Periodicity Quantification in Video Data, Using Topology , 2017, SIAM J. Imaging Sci..

[13]  Denis Pellerin,et al.  Human action recognition in videos based on the Transferable Belief Model , 2007, Pattern Analysis and Applications.

[14]  James M. Rehg,et al.  Quasi-periodic event analysis for social game retrieval , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Antonis A. Argyros,et al.  Temporal Action Co-Segmentation in 3D Motion Capture Data and Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Antonios Gasteratos,et al.  Fast loop-closure detection using visual-word-vectors from image sequences , 2018, Int. J. Robotics Res..

[17]  Antonis A. Argyros,et al.  Localizing Periodicity in Time Series and Videos , 2016, BMVC.