Recent developments in human gait research: parameters, approaches, applications, machine learning techniques, datasets and challenges

Human gait provides a way of locomotion by combined efforts of the brain, nerves, and muscles. Conventionally, the human gait has been considered subjectively through visual observations but now with advanced technology, human gait analysis can be done objectively and empirically for the better quality of life. In this paper, the literature of the past survey on gait analysis has been discussed. This is followed by discussion on gait analysis methods. Vision-based human motion analysis has the potential to provide an inexpensive, non-obtrusive solution for the estimation of body poses. Data parameters for gait analysis have been discussed followed by preprocessing steps. Then the implemented machine learning techniques have been discussed in detail. The objective of this survey paper is to present a comprehensive analysis of contemporary gait analysis. This paper presents a framework (parameters, techniques, available database, machine learning techniques, etc.) for researchers in identifying the infertile areas of gait analysis. The authors expect that the overview presented in this paper will help advance the research in the field of gait analysis. Introduction to basic taxonomies of human gait is presented. Applications in clinical diagnosis, geriatric care, sports, biometrics, rehabilitation, and industrial area are summarized separately. Available machine learning techniques are also presented with available datasets for gait analysis. Future prospective in gait analysis are discussed in the end.

[1]  Richard Baker,et al.  GaitaBase: Web-based repository system for gait analysis , 2010, Comput. Biol. Medicine.

[2]  J. Kamruzzaman,et al.  Neural networks for detection and classification of walking pattern changes due to ageing , 2006, Australasian Physics & Engineering Sciences in Medicine.

[3]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[4]  Pawel Wawrzynski,et al.  Autonomous Reinforcement Learning with Experience Replay for Humanoid Gait Optimization , 2012, INNS-WC.

[5]  J Biosens Bioelectron,et al.  A Review on Techniques for Diagnosing and Monitoring Patients with Parkinson’s disease , 2016 .

[6]  D H Sutherland,et al.  The evolution of clinical gait analysis part III--kinetics and energy assessment. , 2005, Gait & posture.

[7]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[8]  Yunhong Wang,et al.  A Survey of Advances in Biometric Gait Recognition , 2011, CCBR.

[9]  H. Ranu,et al.  Therapeutic Exercise: Foundations and Techniques. 2nd Edn , 1992 .

[10]  Kee-Chaing Chua,et al.  A real-time exercise feedback utility with body sensor networks , 2008, 2008 5th International Summer School and Symposium on Medical Devices and Biosensors.

[11]  Nissan Kunju,et al.  EMG Signal Analysis for Identifying Walking Patterns of Normal Healthy Individuals , 2009 .

[12]  M.M. Skelly,et al.  Real-time gait event detection for paraplegic FES walking , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Yuhui Shi,et al.  Handbook of Swarm Intelligence: Concepts, Principles and Applications , 2011 .

[14]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[15]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[16]  Namita Mittal,et al.  Fuzzy Logic-Based Gait Phase Detection Using Passive Markers , 2015, SocProS.

[17]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[18]  Gang Wang,et al.  Human Identity and Gender Recognition From Gait Sequences With Arbitrary Walking Directions , 2014, IEEE Transactions on Information Forensics and Security.

[19]  Raziel Riemer,et al.  Biomechanical energy harvesting from human motion: theory, state of the art, design guidelines, and future directions , 2011, Journal of NeuroEngineering and Rehabilitation.

[20]  T P Andriacchi,et al.  Studies of human locomotion: past, present and future. , 2000, Journal of biomechanics.

[21]  R Begg,et al.  A machine learning approach for automated recognition of movement patterns using basic, kinetic and kinematic gait data. , 2005, Journal of biomechanics.

[22]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[23]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[24]  C. Vaughan,et al.  Fuzzy clustering of children with cerebral palsy based on temporal-distance gait parameters. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  Rama Chellappa,et al.  A framework for activity-specific human identification , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  Jih-Gau Juang,et al.  Fuzzy neural network approaches for robotic gait synthesis , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[27]  Sally McClean,et al.  Machine Learning and Statistical Approaches to Support the Discrimination of Neuro-degenerative Diseases Based on Gait Analysis , 2009 .

[28]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Fernando Santos Osório,et al.  Gait Control Generation for Physically Based Simulated Robots Using Genetic Algorithms , 2006, IBERAMIA-SBIA.

[30]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[31]  D.B. Popovic,et al.  Design of a Control for a Neural Prosthesis for Walking: Use of Artificial Neural Networks , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[32]  Christopher W. Geib,et al.  The meaning of action: a review on action recognition and mapping , 2007, Adv. Robotics.

[33]  Gilbert Owusu,et al.  AI and computer-based methods in performance evaluation of sporting feats: an overview , 2008, Artificial Intelligence Review.

[34]  Marimuthu Palaniswami,et al.  Automatic Recognition of Gait Patterns Exhibiting Patellofemoral Pain Syndrome Using a Support Vector Machine Approach , 2009, IEEE Transactions on Information Technology in Biomedicine.

[35]  Ángel Carmona Poyato,et al.  Comparing evolutionary algorithms and particle filters for Markerless Human Motion Capture , 2014, Appl. Soft Comput..

[36]  T Chau,et al.  A review of analytical techniques for gait data. Part 2: neural network and wavelet methods. , 2001, Gait & posture.

[37]  Wei Liu,et al.  Science Museum Mixed Reality Digital Media Exhibitions for Children , 2007, Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007).

[38]  Wanneng Shu,et al.  Optimal Resource Allocation on Grid Computing Using a Quantum Chromosomes Genetic Algorithm , 2007, Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007).

[39]  Namita Mittal,et al.  Identification of gait parameters from silhouette images , 2015, 2015 Eighth International Conference on Contemporary Computing (IC3).

[40]  C. Nester,et al.  Cluster analysis for the extraction of sagittal gait patterns in children with cerebral palsy. , 2007, Gait & posture.

[41]  Yasushi Makihara,et al.  The largest inertial sensor-based gait database and performance evaluation of gait-based personal authentication , 2014, Pattern Recognit..

[42]  Marcos Duarte,et al.  Support vector machines for detecting age-related changes in running kinematics. , 2011, Journal of biomechanics.

[43]  Namita Mittal,et al.  Identification of spatio-temporal and kinematics parameters for 2-D optical gait analysis system using passive markers , 2015, 2015 International Conference on Advances in Computer Engineering and Applications.

[44]  J B King,et al.  Gait Analysis. An Introduction , 1992 .

[45]  Rama Chellappa,et al.  Combining multiple evidences for gait recognition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[46]  Ju-Jang Lee,et al.  Gait adaptation method of biped robot for various terrains using central pattern generator (CPG) and learning mechanism , 2007, 2007 International Conference on Control, Automation and Systems.

[47]  George Chryssolouris,et al.  An approach to human motion analysis and modelling , 2006 .

[48]  Thompson Sarkodie-Gyan,et al.  Application of wearable sensors for human gait analysis using fuzzy computational algorithm , 2011, Eng. Appl. Artif. Intell..

[49]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion , 2006 .

[50]  Jian Zhang,et al.  Classifying Lower Extremity Muscle Fatigue During Walking Using Machine Learning and Inertial Sensors , 2013, Annals of Biomedical Engineering.

[51]  Tao Liu,et al.  Gait Analysis Using Wearable Sensors , 2012, Sensors.

[52]  Alex Fridman,et al.  Learning Human Identity from Motion Patterns , 2015, IEEE Access.

[53]  Ramachandran Baskaran,et al.  Automated human behavior analysis from surveillance videos: a survey , 2014, Artificial Intelligence Review.

[54]  Yanqing Zhang,et al.  Combining SVM Classifiers Using Genetic Fuzzy Systems Based on AUC for Gene Expression Data Analysis , 2007, ISBRA.

[55]  Lei Chen,et al.  Deep Structured Models For Group Activity Recognition , 2015, BMVC.

[56]  Jake K. Aggarwal,et al.  Articulated and elastic non-rigid motion: a review , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[57]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[58]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[59]  Zheng Zhang,et al.  Particle Swarm Optimization for Markerless Full Body Motion Capture , 2011 .

[60]  Saeid Sanei,et al.  A comprehensive review of past and present vision-based techniques for gait recognition , 2013, Multimedia Tools and Applications.

[61]  João Manuel,et al.  HUMAN MOTION ANALYSIS: METHOD OLOGIES AND APPLICATIONS , 2008 .

[62]  W. Heiser,et al.  The identification of Parkinson's disease subtypes using cluster analysis: A systematic review , 2010, Movement disorders : official journal of the Movement Disorder Society.

[63]  Muhammad Hussain,et al.  Improving Human Gait Recognition Using Feature Selection , 2014, ISVC.

[64]  Kamal Shah,et al.  Literature Review: Model Free Human Gait Recognition , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[65]  Adrian Lees,et al.  Gait quality assessment using self-organising artificial neural networks. , 2007, Gait & posture.

[66]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion , 2010, International Journal of Computer Vision.

[67]  R. Baker Gait analysis methods in rehabilitation , 2006, Journal of NeuroEngineering and Rehabilitation.

[68]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Treadmill Dataset , 2012, IPSJ Trans. Comput. Vis. Appl..

[69]  Yanchun Zhang,et al.  Mining Gait Pattern for Clinical Locomotion Diagnosis Based on Clustering Techniques , 2006, ADMA.

[70]  Alfred D. Grant Gait Analysis: Normal and Pathological Function , 2010 .

[71]  Ahmed Bouridane,et al.  Improved Human Gait Recognition , 2015, ICIAP.

[72]  Yunhong Wang,et al.  Estimation of view angles for gait using a robust regression method , 2013, Multimedia Tools and Applications.

[73]  Andi Isra Mahyuddin,et al.  DEVELOPMENT OF INDONESIAN GAIT DATABASE USING 2D OPTICAL MOTION ANALYZER SYSTEM , 2012, ASEAN Engineering Journal.

[74]  Nikolaos V. Boulgouris,et al.  Gait Recognition Using Radon Transform and Linear Discriminant Analysis , 2007, IEEE Transactions on Image Processing.

[75]  Olivier Beauchet,et al.  Gait analysis in demented subjects: Interests and perspectives , 2008, Neuropsychiatric disease and treatment.

[76]  Min K. Chung,et al.  A comparison of gait characteristics between Korean and Western people for establishing Korean gait reference data , 2006 .

[77]  Thompson Sarkodie-Gyan,et al.  Analysis of muscle activity during gait cycle using fuzzy rule-based reasoning , 2010 .

[78]  Jeffrey Richard Crandall,et al.  Crash reconstruction of pedestrian accidents using optimization techniques , 2009 .

[79]  Emdad Hossain,et al.  Multimodal Biometric Gait Database: A Comparison Study , 2014 .

[80]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[81]  Jong-Hoon Youn,et al.  Biometric gait recognition based on wireless acceleration sensor using k-nearest neighbor classification , 2014, 2014 International Conference on Computing, Networking and Communications (ICNC).

[82]  N. Siddaiah,et al.  A Review on Techniques for Diagnosing and Monitoring Patients with Parkinsons Disease , 2016 .

[83]  Taku Komura,et al.  Interactive animation of virtual humans based on motion capture data , 2009, Comput. Animat. Virtual Worlds.

[84]  Namita Mittal,et al.  A framework for human recognition using a multimodel Gait analysis approach , 2016, 2016 International Conference on Computing, Communication and Automation (ICCCA).

[85]  Vijay Laxmi,et al.  Passive Marker Based Optical System for Gait Kinematics for Lower Extremity , 2015 .

[86]  B. Auvinet,et al.  Reference data for normal subjects obtained with an accelerometric device. , 2002, Gait & posture.

[87]  C. Marsden,et al.  Human walking and higher‐level gait disorders, particularly in the elderly , 1993, Neurology.

[88]  Haifeng Li,et al.  Human gait recognition: Approaches, datasets and challenges , 2011, ICDP.

[89]  Wei Jia,et al.  Survey of Gait Recognition , 2009, ICIC.

[90]  Donald Y. C. Lie,et al.  An Efficient and Robust Fall Detection System Using Wireless Gait Analysis Sensor with Artificial Neural Network (ANN) and Support Vector Machine (SVM) Algorithms , 2014 .

[91]  K. Webster,et al.  The application of support vector machines for detecting recovery from knee replacement surgery using spatio-temporal gait parameters. , 2009, Gait & posture.

[92]  Hyun-Chul Kim,et al.  Statistical method for prediction of gait kinematics with Gaussian process regression. , 2014, Journal of biomechanics.

[93]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[94]  Angkoon Phinyomark,et al.  Gender and Age-Related Differences in Bilateral Lower Extremity Mechanics during Treadmill Running , 2014, PloS one.

[95]  Debra E Hurwitz,et al.  Normalization of joint moments during gait: a comparison of two techniques. , 2003, Journal of biomechanics.

[96]  D. Sutherland The evolution of clinical gait analysis part l: kinesiological EMG. , 2001, Gait & posture.

[97]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[98]  MittalNamita,et al.  Recent developments in human gait research , 2018 .

[99]  Ira Gaba,et al.  Gait analysis for identification by using BPNN with LDA and MDA techniques , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[100]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[101]  Mechthilde Fuhrer Disability Inclusive Disaster Risk Reduction , 2014 .

[102]  Jake K. Aggarwal,et al.  Human motion: modeling and recognition of actions and interactions , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[103]  Hilary Buxton,et al.  Learning and understanding dynamic scene activity: a review , 2003, Image Vis. Comput..

[104]  Roger Bartlett,et al.  Routledge Handbook of Biomechanics and Human Movement Science , 2008 .

[105]  Roger Bartlett,et al.  Artificial intelligence in sports biomechanics: new dawn or false hope? , 2006, Journal of sports science & medicine.

[106]  Jianning Wu,et al.  The Novel Quantitative Technique for Assessment of Gait Symmetry Using Advanced Statistical Learning Algorithm , 2015, BioMed research international.

[107]  Kishore Kothapalli,et al.  2015 Eighth International Conference on Contemporary Computing (IC3) , 2015 .

[108]  Manuela Galli,et al.  Summary measures for clinical gait analysis: a literature review. , 2014, Gait & posture.

[109]  D. Sutherland The evolution of clinical gait analysis. Part II kinematics. , 2002, Gait & posture.

[110]  Ian D. Walker,et al.  Kinematics for multisection continuum robots , 2006, IEEE Transactions on Robotics.

[111]  A E Patla,et al.  Artificial neural network model for the generation of muscle activation patterns for human locomotion. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[112]  M P Kadaba,et al.  Measurement of lower extremity kinematics during level walking , 1990, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[113]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[114]  Arnold Baca,et al.  Artificial intelligence in sports on the example of weight training. , 2013, Journal of sports science & medicine.

[115]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[116]  Wei Liu,et al.  Real-time 3D human capture system for mixed-reality art and entertainment , 2005, IEEE Transactions on Visualization and Computer Graphics.

[117]  Jake K. Aggarwal,et al.  Human motion analysis: a review , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[118]  Wolfgang I. Schöllhorn,et al.  Artificial neural network models of sports motions , 2008 .

[119]  Saeid Nahavandi,et al.  A Review of Vision-Based Gait Recognition Methods for Human Identification , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[120]  Longbing Cao,et al.  On Discovering the Correlated Relationship between Static and Dynamic Data in Clinical Gait Analysis , 2013, ECML/PKDD.

[121]  Marimuthu Palaniswami,et al.  Computational Intelligence in Gait Research: A Perspective on Current Applications and Future Challenges , 2009, IEEE Transactions on Information Technology in Biomedicine.

[122]  Nadia Bianchi-Berthouze,et al.  Continuous Recognition of Player's Affective Body Expression as Dynamic Quality of Aesthetic Experience , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[123]  Sinziana Mazilu,et al.  Feature Learning for Detection and Prediction of Freezing of Gait in Parkinson's Disease , 2013, MLDM.

[124]  Jeffrey M. Hausdorff,et al.  Altered fractal dynamics of gait: reduced stride-interval correlations with aging and Huntington's disease. , 1997, Journal of applied physiology.

[125]  Yoshinori Doi,et al.  Vertical ground reaction force shape is associated with gait parameters, timed up and go, and functional reach in elderly females. , 2004, Journal of rehabilitation medicine.

[126]  Lei Chen,et al.  Learning Action Primitives for Multi-level Video Event Understanding , 2014, ECCV Workshops.

[127]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[128]  Bok-Min Goi,et al.  Recognizing Human Gender in Computer Vision: A Survey , 2012, PRICAI.

[129]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[130]  Roger Bartlett,et al.  Introduction to sports biomechanics , 2007 .

[131]  Eadweard Muybridge,et al.  Muybridge's Complete human and animal locomotion : all 781 plates from the 1887 Animal locomotion , 1979 .

[132]  Ivan Jordanov,et al.  Intelligent Approaches in Locomotion - A Review , 2015, J. Intell. Robotic Syst..

[133]  Hiroaki Yano,et al.  Gait rehabilitation for stair climbing with a locomotion interface , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[134]  D. Janssen,et al.  Recognition of Emotions in Gait Patterns by Means of Artificial Neural Nets , 2008 .

[135]  Angkoon Phinyomark,et al.  Kinematic gait patterns in healthy runners: A hierarchical cluster analysis. , 2015, Journal of biomechanics.

[136]  Qing Guo,et al.  The Application of Machine-Learning on Lower Limb Motion Analysis in Human Exoskeleton System , 2012, ICSR.

[137]  Sheng-Che Yen,et al.  A reinforcement learning approach to gait training improves retention , 2015, Front. Hum. Neurosci..

[138]  S. Simon Gait Analysis, Normal and Pathological Function. , 1993 .

[139]  Jeffrey M. Hausdorff,et al.  Effect of gait speed on gait rhythmicity in Parkinson's disease: variability of stride time and swing time respond differently , 2005, Journal of NeuroEngineering and Rehabilitation.

[140]  Sandhya Joshi,et al.  Classification of Alzheimer's Disease and Parkinson's Disease by Using Machine Learning and Neural Network Methods , 2010, 2010 Second International Conference on Machine Learning and Computing.