Simultaneous Bayesian Recognition of Locomotion and Gait Phases With Wearable Sensors

Recognition of movement is a crucial process to assist humans in activities of daily living, such as walking. In this work, a high-level method for the simultaneous recognition of locomotion and gait phases using wearable sensors is presented. A Bayesian formulation is employed to iteratively accumulate evidence to reduce uncertainty, and to improve the recognition accuracy. This process uses a sequential analysis method to autonomously make decisions, whenever the recognition system perceives that there is enough evidence accumulated. We use data from three wearable sensors, attached to the thigh, shank, and foot of healthy humans. Level-ground walking, ramp ascent and descent activities are used for data collection and recognition. In addition, an approach for segmentation of the gait cycle for recognition of stance and swing phases is presented. Validation results show that the simultaneous Bayesian recognition method is capable to recognize walking activities and gait phases with mean accuracies of 99.87% and 99.20%. This process requires a mean of 25 and 13 sensor samples to make a decision for locomotion mode and gait phases, respectively. The recognition process is analyzed using different levels of confidence to show that our method is highly accurate, fast, and adaptable to specific requirements of accuracy and speed. Overall, the simultaneous Bayesian recognition method demonstrates its benefits for recognition using wearable sensors, which can be employed to provide reliable assistance to humans in their walking activities.

[1]  D. Winter Biomechanics and motor control of human gait: normal, elderly and pathological - 2nd edition , 1991 .

[2]  Conor J. Walsh,et al.  Stronger, Smarter, Softer: Next-Generation Wearable Robots , 2014, IEEE Robotics & Automation Magazine.

[3]  A. M. Khan,et al.  Accelerometer signal-based human activity recognition using augmented autoregressive model coefficients and artificial neural nets , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Andrea Parri,et al.  Fuzzy-logic-based hybrid locomotion mode classification for an active pelvis orthosis: Preliminary results , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Michael Goldfarb,et al.  Multiclass Real-Time Intent Recognition of a Powered Lower Limb Prosthesis , 2010, IEEE Transactions on Biomedical Engineering.

[6]  Neil D. Lawrence,et al.  An integrated probabilistic framework for robot perception, learning and memory , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[7]  Marco Morana,et al.  Human Activity Recognition Process Using 3-D Posture Data , 2015, IEEE Transactions on Human-Machine Systems.

[8]  Giorgio Metta,et al.  Active contour following to explore object shape with robot touch , 2013, 2013 World Haptics Conference (WHC).

[9]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[10]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  R. Brand,et al.  The biomechanics and motor control of human gait: Normal, elderly, and pathological , 1992 .

[12]  Uriel Martinez-Hernandez,et al.  Multisensory Wearable Interface for Immersion and Telepresence in Robotics , 2017, IEEE Sensors Journal.

[13]  Mona Ghassemian,et al.  An Adaptive Algorithm to Improve Energy Efficiency in Wearable Activity Recognition Systems , 2017, IEEE Sensors Journal.

[14]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[15]  Pramod K. Varshney,et al.  Autonomous Fall Detection With Wearable Cameras by Using Relative Entropy Distance Measure , 2017, IEEE Transactions on Human-Machine Systems.

[16]  Paola Pierleoni,et al.  A High Reliability Wearable Device for Elderly Fall Detection , 2015, IEEE Sensors Journal.

[17]  Matthew Todd Farrell Pattern classification of terrain during amputee walking , 2013 .

[18]  Tony J. Dodd,et al.  Active sensorimotor control for tactile exploration , 2017, Robotics Auton. Syst..

[19]  Todd A Kuiken,et al.  Non-weight-bearing neural control of a powered transfemoral prosthesis , 2013, Journal of NeuroEngineering and Rehabilitation.

[20]  Yoshiyuki Sankai,et al.  Power assist method for HAL-3 estimating operator's intention based on motion information , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[21]  Tony J. Dodd,et al.  Feeling the Shape: Active Exploration Behaviors for Object Recognition With a Robotic Hand , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[23]  Yoshiyuki Sankai,et al.  Comfortable power assist control method for walking aid by HAL-3 , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[24]  Tony J. Dodd,et al.  Active Bayesian perception for angle and position discrimination with a biomimetic fingertip , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  John Staudenmayer,et al.  An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. , 2009, Journal of applied physiology.

[26]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[27]  B. Heller,et al.  Recognizing Human Activity in Free-Living Using Multiple Body-Worn Accelerometers , 2017, IEEE Sensors Journal.

[28]  Aaron J. Young,et al.  Analysis of using EMG and mechanical sensors to enhance intent recognition in powered lower limb prostheses , 2014, Journal of neural engineering.

[29]  Sherif E Hussein,et al.  Intention detection using a neuro-fuzzy EMG classifier. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[30]  Gu-Min Jeong,et al.  Classification of Three Types of Walking Activities Regarding Stairs Using Plantar Pressure Sensors , 2017, IEEE Sensors Journal.

[31]  Kuan Zhang,et al.  Assessment of human locomotion by using an insole measurement system and artificial neural networks. , 2005, Journal of biomechanics.

[32]  Hafiz Farhan Maqbool,et al.  Real-time gait event detection for transfemoral amputees during ramp ascending and descending , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Nicholas P. Fey,et al.  Intent Recognition in a Powered Lower Limb Prosthesis Using Time History Information , 2013, Annals of Biomedical Engineering.

[34]  G Van der Perre,et al.  Development of EMG-based mode and intent recognition algorithms for a computer-controlled above-knee prosthesis. , 1990, Journal of biomedical engineering.

[35]  Radhika Nagpal,et al.  Design and control of a bio-inspired soft wearable robotic device for ankle–foot rehabilitation , 2014, Bioinspiration & biomimetics.

[36]  Fan Zhang,et al.  Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular–Mechanical Fusion , 2011, IEEE Transactions on Biomedical Engineering.

[37]  He Huang,et al.  A Strategy for Identifying Locomotion Modes Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[38]  Adrian Rubio Solis,et al.  Bayesian perception of touch for control of robot emotion , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[39]  Angelica Munoz-Melendez,et al.  Wearable Inertial Sensors for Human Motion Analysis: A Review , 2016, IEEE Sensors Journal.

[40]  G.F. Inbar,et al.  Classification of finger activation for use in a robotic prosthesis arm , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Christopher Kirtley,et al.  Clinical Gait Analysis: Theory and Practice , 2006 .

[42]  Fan Zhang,et al.  Preliminary study of the effect of user intent recognition errors on volitional control of powered lower limb prostheses , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.