Human Pose Estimation for Training Assistance: a Systematic Literature Review

Human pose estimation is an important field of Computer Vision that aims to predict poses of individuals from videos and images. It has been used in many different areas including human-computer interaction, motion analysis, surveillance, action prediction, action correction, augmented reality, virtual reality, and healthcare. This review is focused on the most significant contributions in human pose estimation for training assistance. Executing movements correctly is crucial in all kinds of physical activities, both to increase performance and reduce risk of injury. Human pose estimation is poised to help athletes better analyse the quality of their movements. The systematic review study was conducted in five databases including articles from January 2011 to March 2021. The initial search resulted in 129 articles, of which 8 were selected after applying the filtering criteria. Moreover this study presents the challenges related to pose estimation, which pose estimation methods have been used in recent years, in which specific activities the selected articles have focused on, and a taxonomy of human pose estimation methods.

[1]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[2]  Songlin Sun,et al.  Intelligent Fitness Trainer System Based on Human Pose Estimation , 2018, ICSINC 2018 Fall.

[3]  Margrit Betke,et al.  Home-Based Physical Therapy with an Interactive Computer Vision System , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[4]  Pourya Shamsolmoali,et al.  AMIL , 2020, ACM Transactions on Multimedia Computing, Communications, and Applications.

[5]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[6]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[7]  Hadi Seyedarabi,et al.  Pose estimation of soccer players using multiple uncalibrated cameras , 2015, Multimedia Tools and Applications.

[8]  Cewu Lu,et al.  RMPE: Regional Multi-person Pose Estimation , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Hans-Peter Seidel,et al.  VNect , 2017 .

[10]  Gaurav Harit,et al.  Detecting Missed and Anomalous Action Segments Using Approximate String Matching Algorithm , 2017, NCVPRIPG.

[11]  Hon Wai Leong,et al.  3-D–2-D spatiotemporal registration for sports motion analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Adrian Hilton,et al.  Visual Analysis of Humans - Looking at People , 2013 .

[13]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Pourya Shamsolmoali,et al.  AMIL: Adversarial Multi Instance Learning for Human Pose Estimation , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[16]  Miguel Cazorla,et al.  EVA: EVAluating at-home rehabilitation exercises using augmented reality and low-cost sensors , 2019, Virtual Reality.

[17]  S. Perrault,et al.  Pose Estimation for Facilitating Movement Learning from Online Videos , 2020, AVI.

[18]  Dah-Jye Lee,et al.  Body Motion Analysis for Golf Swing Evaluation , 2020, ISVC.

[19]  Jitendra Malik,et al.  End-to-End Recovery of Human Shape and Pose , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Jianke Zhu,et al.  AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance , 2019, ACM Multimedia.

[21]  Cristian Sminchisescu,et al.  3D Human Motion Analysis in Monocular Video Techniques and Challenges , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[22]  Ioannis A. Kakadiaris,et al.  3D Human pose estimation: A review of the literature and analysis of covariates , 2016, Comput. Vis. Image Underst..

[23]  Ying Xu,et al.  2-D Human Pose Estimation from Images Based on Deep Learning: A Review , 2018, 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC).

[24]  Gang Hua,et al.  Multi-scale visual tracking by sequential belief propagation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Nasser Kehtarnavaz,et al.  Deep Learning-based Human Pose Estimation: A Survey , 2020, ACM Comput. Surv..

[26]  Wanggen Wan,et al.  A Review of Human Pose Estimation from Single Image , 2018, 2018 International Conference on Audio, Language and Image Processing (ICALIP).

[27]  Jinxiang Chai,et al.  Accurate realtime full-body motion capture using a single depth camera , 2012, ACM Trans. Graph..

[28]  G. Hua,et al.  Multi-scale visual tracking by sequential belief propagation , 2004, CVPR 2004.

[29]  Xin Jiang,et al.  Sport training action correction by using convolutional neural network , 2020 .

[30]  Sridha Sridharan,et al.  Fine-grained action recognition of boxing punches from depth imagery , 2017, Comput. Vis. Image Underst..

[31]  B. D. Wilson.  Development in video technology for coaching , 2008 .

[32]  Hongxin Zhang,et al.  PhyCoVIS: A visual analytic tool of physical coordination for cheer and dance training , 2020 .