Human Action Recognition Using Laban Movement Analysis and Dynamic Time Warping

Abstract Bilateral interaction between humans and robots is one of the areas that has attracted much attention in recent years. Automation of human behavior recognition is one of the main steps in achieving this goal. In this regard, in this paper we have designed a process for automatic identification of human gestures. The process consists of two main parts. In the first part, by using the Laban Movement Analysis method, we define a robust descriptor, and in the second part, we determine the robustness of the descriptor using the Dynamic time Warping algorithm. The method proposed in this paper has been tested on four public data-sets namely MSR Action 3D, Florence 3D actions, UTKinect-Action3D and SYSU 3D HUMAN-OBJECT INTERACTION data-sets. Given the results obtained from previous work, the efficiency of the proposed method can be more accurately understood. The results obtained confirm the effectiveness and the performance of our model which outperforms results presented in similar works on action recognition.

[1]  Wenming Cao,et al.  Physiological Function Assessment Based on Kinect V2 , 2019, IEEE Access.

[2]  Jean-Yves Didier,et al.  Human motions and emotions recognition inspired by LMA qualities , 2018, The Visual Computer.

[3]  Yi Zhang,et al.  Mining Key Skeleton Poses with Latent SVM for Action Recognition , 2017, Appl. Comput. Intell. Soft Comput..

[4]  Jean-Yves Didier,et al.  Expressive motions recognition and analysis with learning and statistical methods , 2018, Multimedia Tools and Applications.

[5]  Anuj Srivastava,et al.  Accurate 3D action recognition using learning on the Grassmann manifold , 2015, Pattern Recognit..

[6]  Baochang Zhang,et al.  Hierarchical residual stochastic networks for time series recognition , 2019, Inf. Sci..

[7]  Nanning Zheng,et al.  Learning Composite Latent Structures for 3D Human Action Representation and Recognition , 2019, IEEE Transactions on Multimedia.

[8]  Liang Yan,et al.  Group Sparse Regression-Based Learning Model for Real-Time Depth-Based Human Action Prediction , 2018 .

[9]  Pichao Wang,et al.  Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks , 2016, ACM Multimedia.

[10]  Nasser Kehtarnavaz,et al.  Fusion of Video and Inertial Sensing for Deep Learning–Based Human Action Recognition , 2019, Sensors.

[11]  Yang Yang,et al.  Self-feeding frequency estimation and eating action recognition from skeletal representation using Kinect , 2018, World Wide Web.

[12]  Alberto Del Bimbo,et al.  Submitted to Ieee Transactions on Cybernetics 1 3d Human Action Recognition by Shape Analysis of Motion Trajectories on Riemannian Manifold , 2022 .

[13]  Partha Paul,et al.  A Computer Vision-Based Gesture Recognition Using Hidden Markov Model , 2019, Innovations in Soft Computing and Information Technology.

[14]  Juan José Pantrigo,et al.  Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition , 2018, Pattern Recognit..

[15]  Cemal Köse,et al.  Improving bag-of-poses with semi-temporal pose descriptors for skeleton-based action recognition , 2018, The Visual Computer.

[16]  Daxi Xiong,et al.  A remote quantitative Fugl-Meyer assessment framework for stroke patients based on wearable sensor networks , 2016, Comput. Methods Programs Biomed..

[17]  Zhiquan He,et al.  Geometric Algebra Representation and Ensemble Action Classification Method for 3D Skeleton Orientation Data , 2019, IEEE Access.

[18]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.