Acceleration Magnitude at Impact Following Loss of Balance Can Be Estimated Using Deep Learning Model

Pre-impact fall detection can detect a fall before a body segment hits the ground. When it is integrated with a protective system, it can directly prevent an injury due to hitting the ground. An impact acceleration peak magnitude is one of key measurement factors that can affect the severity of an injury. It can be used as a design parameter for wearable protective devices to prevent injuries. In our study, a novel method is proposed to predict an impact acceleration magnitude after loss of balance using a single inertial measurement unit (IMU) sensor and a sequential-based deep learning model. Twenty-four healthy participants participated in this study for fall experiments. Each participant worn a single IMU sensor on the waist to collect tri-axial accelerometer and angular velocity data. A deep learning method, bi-directional long short-term memory (LSTM) regression, is applied to predict a fall’s impact acceleration magnitude prior to fall impact (a fall in five directions). To improve prediction performance, a data augmentation technique with increment of dataset is applied. Our proposed model showed a mean absolute percentage error (MAPE) of 6.69 ± 0.33% with r value of 0.93 when all three different types of data augmentation techniques are applied. Additionally, there was a significant reduction of MAPE by 45.2% when the number of training datasets was increased by 4-fold. These results show that impact acceleration magnitude can be used as an activation parameter for fall prevention such as in a wearable airbag system by optimizing deployment process to minimize fall injury in real time.

[1]  D. Winter,et al.  Gait in the elderly , 1997 .

[2]  L. Rubenstein Falls in older people: epidemiology, risk factors and strategies for prevention. , 2006, Age and ageing.

[3]  Mark Speechley,et al.  Defining a fall and reasons for falling: comparisons among the views of seniors, health care providers, and the research literature. , 2006, The Gerontologist.

[4]  C. Hrysomallis Relationship Between Balance Ability, Training and Sports Injury Risk , 2007, Sports medicine.

[5]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  B E Groen,et al.  The relation between hip impact velocity and hip impact force differs between sideways fall techniques. , 2008, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  Kiyoshi Fukaya,et al.  Protection against impact with the ground using wearable airbags. , 2008, Industrial health.

[8]  M. Kangas,et al.  Sensitivity and specificity of fall detection in people aged 40 years and over. , 2009, Gait & Posture.

[9]  Toshiyo Tamura,et al.  A Wearable Airbag to Prevent Fall Injuries , 2009, IEEE Transactions on Information Technology in Biomedicine.

[10]  Yufeng Jin,et al.  Mobile Human Airbag System for Fall Protection Using MEMS Sensors and Embedded SVM Classifier , 2009, IEEE Sensors Journal.

[11]  Changjing Shang,et al.  USING MACHINE LEARNING TECHNIQUES , 2011 .

[12]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[13]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[14]  Jian Liu,et al.  Development and Evaluation of a Prior-to-Impact Fall Event Detection Algorithm , 2014, IEEE Transactions on Biomedical Engineering.

[15]  Eduardo Casilari-Pérez,et al.  Comparison and Characterization of Android-Based Fall Detection Systems , 2014, Sensors.

[16]  Billur Barshan,et al.  Detecting Falls with Wearable Sensors Using Machine Learning Techniques , 2014, Sensors.

[17]  Edward J. Park,et al.  The effect of window size and lead time on pre-impact fall detection accuracy using support vector machine analysis of waist mounted inertial sensor data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Jung Keun Lee,et al.  Inertial Sensing-Based Pre-Impact Detection of Falls Involving Near-Fall Scenarios , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Vincent Caccese,et al.  Measurement of Head Impact Due to Standing Fall in Adults Using Anthropomorphic Test Dummies , 2015, Annals of Biomedical Engineering.

[20]  Filip De Turck,et al.  Towards a social and context-aware multi-sensor fall detection and risk assessment platform , 2015, Comput. Biol. Medicine.

[21]  S. N. Robinovitch,et al.  Kinematic analysis of video-captured falls experienced by older adults in long-term care. , 2015, Journal of biomechanics.

[22]  Paola Pierleoni,et al.  A High Reliability Wearable Device for Elderly Fall Detection , 2015, IEEE Sensors Journal.

[23]  David B. Camarillo,et al.  Modeling and Optimization of Airbag Helmets for Preventing Head Injuries in Bicycling , 2017, Annals of Biomedical Engineering.

[24]  Julian L. Davis,et al.  Tripping Elicits Earlier and Larger Deviations in Linear Head Acceleration Compared to Slipping , 2016, PloS one.

[25]  A. Sabatini,et al.  Prior-to- and Post-Impact Fall Detection Using Inertial and Barometric Altimeter Measurements , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Ahnryul Choi,et al.  Biomechanical Evaluation of Dynamic Balance Control Ability During Golf Swing , 2016 .

[27]  Xinyao Hu,et al.  Pre-impact fall detection , 2016, BioMedical Engineering OnLine.

[28]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[29]  Ahnryul Choi,et al.  Improved determination of dynamic balance using the centre of mass and centre of pressure inclination variables in a complete golf swing cycle , 2016, Journal of sports sciences.

[30]  Xiang Li,et al.  Deep learning architecture for air quality predictions , 2016, Environmental Science and Pollution Research.

[31]  Geoff Nitschke,et al.  Improving Deep Learning using Generic Data Augmentation , 2017 .

[32]  Luis González Abril,et al.  Mobile activity recognition and fall detection system for elderly people using Ameva algorithm , 2017, Pervasive Mob. Comput..

[33]  Y. Luo,et al.  Sideways fall-induced impact force and its effect on hip fracture risk: a review , 2017, Osteoporosis International.

[34]  Kai-Chun Liu,et al.  Novel Hierarchical Fall Detection Algorithm Using a Multiphase Fall Model , 2017, Sensors.

[35]  S. Liew,et al.  Visuomotor adaptation in head-mounted virtual reality versus conventional training , 2017, Scientific Reports.

[36]  Lili Liu,et al.  The state of knowledge on technologies and their use for fall detection: A scoping review , 2018, Int. J. Medical Informatics.

[37]  Dong Seog Han,et al.  Feature Representation and Data Augmentation for Human Activity Classification Based on Wearable IMU Sensor Data Using a Deep LSTM Neural Network , 2018, Sensors.

[38]  Gursel Serpen,et al.  Real-time Detection of Human Falls in Progress: Machine Learning Approach , 2018 .

[39]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[40]  Manjiang Hu,et al.  Design and Occupant-Protection Performance Analysis of a New Tubular Driver Airbag , 2018 .

[41]  Tao Xu,et al.  New Advances and Challenges of Fall Detection Systems: A Survey , 2018 .

[42]  Alaa El. Sagheer,et al.  Time series forecasting of petroleum production using deep LSTM recurrent networks , 2019, Neurocomputing.

[43]  Maurizio Rebaudengo,et al.  A Review on Fall Prediction and Prevention System for Personal Devices: Evaluation and Experimental Results , 2019, Adv. Hum. Comput. Interact..

[44]  Ahnryul Choi,et al.  Machine learning approach to predict center of pressure trajectories in a complete gait cycle: a feedforward neural network vs. LSTM network , 2019, Medical & Biological Engineering & Computing.

[45]  Ahnryul Choi,et al.  Machine learning-based pre-impact fall detection model to discriminate various types of fall. , 2019, Journal of biomechanical engineering.

[46]  Khandakar M. Rashid,et al.  Times-series data augmentation and deep learning for construction equipment activity recognition , 2019, Adv. Eng. Informatics.

[47]  Matteo Massaro,et al.  Investigation on Wearable Airbags for Motorcyclists Through Simulations and Experimental Tests , 2018 .

[48]  Ning Yu,et al.  Wearable-sensor-based pre-impact fall detection system with a hierarchical classifier , 2019, Measurement.

[49]  Eduardo Casilari-Pérez,et al.  A comprehensive study on the use of artificial neural networks in wearable fall detection systems , 2019, Expert Syst. Appl..

[50]  Ahnryul Choi,et al.  Single Inertial Sensor-Based Neural Networks to Estimate COM-COP Inclination Angle During Walking , 2019, Sensors.

[51]  Zhaoshuo Jiang,et al.  Detection of Human Fall Using Floor Vibration and Multi-Features Semi-Supervised SVM , 2019, Sensors.

[52]  Shuping Xiong,et al.  A Novel Hybrid Deep Neural Network to Predict Pre-impact Fall for Older People Based on Wearable Inertial Sensors , 2020, Frontiers in Bioengineering and Biotechnology.

[53]  Lin Gao,et al.  Predict New Therapeutic Drugs for Hepatocellular Carcinoma Based on Gene Mutation and Expression , 2020, Frontiers in Bioengineering and Biotechnology.

[54]  Mariusz Oszust,et al.  Data Augmentation with Suboptimal Warping for Time-Series Classification , 2019, Sensors.

[55]  Ahnryul Choi,et al.  Predicting Center of Gravity Displacement During Walking Using a Single Inertial Sensor and Deep Learning Technique , 2020, J. Medical Imaging Health Informatics.