Towards Musculoskeletal Simulation-Aware Fall Injury Mitigation: Transfer Learning with Deep CNN for Fall Detection

This paper presents early work on a fall detection method using transfer learning method, in conjunction with a long-term effort to combine efficient machine learning and prior personalized musculoskeletal modeling to deploy fall injury mitigation in geriatric subjects. Inspired by the tremendous progress in image-based object recognition with deep convolutional neural networks (DCNNs), we opt for a pre-trained kinematics-based machine learning approach through existing large-scale annotated accelerometry datasets. The accelerometry datasets are converted to images using time-frequency analysis, based on scalograms, by computing the continuous wavelet transform filter bank. Subsequently, data augmentation is performed on these scalogram images to increase accuracy, thereby complementing limited labeled fall sensor data, enabling transfer learning from the existing pre-trained model. The experimental results on publicly available URFD datasets demonstrate that transfer learning leads to a better performance than the existing methods in the case of scarce labeled training data.

[1]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[3]  Alessio Vecchio,et al.  A smartphone-based fall detection system , 2012, Pervasive Mob. Comput..

[4]  Isabel N. Figueiredo,et al.  Exploring smartphone sensors for fall detection , 2016, mUX: The Journal of Mobile User Experience.

[5]  Dong Xuan,et al.  PerFallD: A pervasive fall detection system using mobile phones , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[6]  Sang-Hoon Kim,et al.  Fall-Detection Algorithm Using 3-Axis Acceleration: Combination with Simple Threshold and Hidden Markov Model , 2014, J. Appl. Math..

[7]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[8]  Yufeng Jin,et al.  Mobile Human Airbag System for Fall Protection Using MEMS Sensors and Embedded SVM Classifier , 2009, IEEE Sensors Journal.

[9]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[10]  Billur Barshan,et al.  Detecting Falls with Wearable Sensors Using Machine Learning Techniques , 2014, Sensors.

[11]  Guang-Zhong Yang,et al.  Deep learning for human activity recognition: A resource efficient implementation on low-power devices , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[12]  Nadia Magnenat-Thalmann,et al.  Medical image analysis , 1999, Medical Image Anal..

[13]  Raymond Y. W. Lee,et al.  Detection of falls using accelerometers and mobile phone technology. , 2011, Age and ageing.

[14]  Wan Young Chung,et al.  Activity monitoring from real-time triaxial accelerometer data using sensor network , 2007, 2007 International Conference on Control, Automation and Systems.

[15]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.

[16]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[18]  Rein Vesilo,et al.  Window-size impact on detection rate of wearable-sensor-based fall detection using supervised machine learning , 2017, 2017 IEEE Life Sciences Conference (LSC).

[19]  Philip Heng Wai Leong,et al.  Development of a Human Airbag System for Fall Protection Using MEMS Motion Sensing Technology , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Antonio Torralba,et al.  Visualizing Object Detection Features , 2015, International Journal of Computer Vision.

[21]  M. Kangas,et al.  Sensitivity and specificity of fall detection in people aged 40 years and over. , 2009, Gait & Posture.

[22]  Yunjian Ge,et al.  HMM-Based Human Fall Detection and Prediction Method Using Tri-Axial Accelerometer , 2013, IEEE Sensors Journal.

[23]  Petros Daras,et al.  Human Fall Detection from Acceleration Measurements Using a Recurrent Neural Network , 2018 .

[24]  Michel A. Audette,et al.  Statistical Shape Model Construction of Lumbar Vertebrae and Intervertebral Discs in Segmentation for Discectomy Surgery Simulation , 2015, CSI@MICCAI.

[25]  L. Rubenstein,et al.  Falls in the nursing home: are they preventable? , 2005, Journal of the American Medical Directors Association.

[26]  Takuro Tamura,et al.  BodyParts3D: 3D structure database for anatomical concepts , 2008, Nucleic Acids Res..

[27]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[28]  Elena I. Gaura,et al.  Data set for fall events and daily activities from inertial sensors , 2015, MMSys.

[29]  Jesús Francisco Vargas-Bonilla,et al.  SisFall: A Fall and Movement Dataset , 2017, Sensors.