Change detection and convolution neural networks for fall recognition

Accurate fall detection is a crucial research challenge since the time delay from fall to first aid is a key factor that determines the consequences of a fall. Wearable sensors allow a reliable way for motion tracking, allowing immediate detection of high-risk falls via a machine learning framework. Toward this direction, accelerometer devices are widely used for the assessment of fall risk. Although there exist a plethora of studies under this perspective, several challenges still remain, such as dealing simultaneously with extremely demanding data management, power consumption and prediction accuracy. In this work, we propose a complete methodology based on the cooperation of deep learning for signal classification along with a lightweight control chart method for change detection. Our basic assumption is that it is possible to control computational resources by selectively allowing the operation of a relatively heavyweight, but very efficient classifier, when it is truly required. The proposed methodology was applied to real experimental data providing the reliable results that justify the original hypothesis.

[1]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[2]  Yunjian Ge,et al.  HMM-Based Human Fall Detection and Prediction Method Using Tri-Axial Accelerometer , 2013, IEEE Sensors Journal.

[3]  T. Heller,et al.  Risk factors for injuries and falls among adults with developmental disabilities. , 2001, Journal of intellectual disability research : JIDR.

[4]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[5]  Harshita Patel,et al.  A review on classification of imbalanced data for wireless sensor networks , 2020, Int. J. Distributed Sens. Networks.

[6]  Himanshu Thapliyal,et al.  IoT-Based Fall Detection for Smart Home Environments , 2016, 2016 IEEE International Symposium on Nanoelectronic and Information Systems (iNIS).

[7]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.

[8]  L. Zhang,et al.  A non parametric CUSUM control chart based on the Mann–Whitney statistic , 2013, 1305.4318.

[9]  Pierre Granjon,et al.  The CUSUM algorithm a small review , 2012 .

[10]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Ilias Maglogiannis,et al.  Intelligent Health Monitoring Based on Pervasive Technologies and Cloud Computing , 2014, Int. J. Artif. Intell. Tools.

[12]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[13]  Tao Xu,et al.  New Advances and Challenges of Fall Detection Systems: A Survey , 2018 .

[14]  Paola Pierleoni,et al.  A High Reliability Wearable Device for Elderly Fall Detection , 2015, IEEE Sensors Journal.

[15]  Léon Bottou,et al.  On-line learning and stochastic approximations , 1999 .

[16]  Davide Carneiro,et al.  A multi-modal approach for activity classification and fall detection , 2014, Int. J. Syst. Sci..

[17]  Lih-Jen Kau,et al.  A Smart Phone-Based Pocket Fall Accident Detection, Positioning, and Rescue System , 2015, IEEE Journal of Biomedical and Health Informatics.

[18]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[19]  Joseph J. Pignatiello,et al.  Estimating the time of step change with Poisson CUSUM and EWMA control charts , 2011 .

[20]  Vangelis Metsis,et al.  SmartFall: A Smartwatch-Based Fall Detection System Using Deep Learning , 2018, Sensors.

[21]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[22]  Bin Li,et al.  An enhanced fall detection system for elderly person monitoring using consumer home networks , 2014, IEEE Transactions on Consumer Electronics.

[23]  Tom Fawcett,et al.  Analysis and Visualization of Classifier Performance: Comparison under Imprecise Class and Cost Distributions , 1997, KDD.

[24]  Bogdan Kwolek,et al.  Fall detection using ceiling-mounted 3D depth camera , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[25]  R. McClure,et al.  A review of CDC's Web-based Injury Statistics Query and Reporting System (WISQARS™): Planning for the future of injury surveillance. , 2017, Journal of safety research.

[26]  Muhammad Riaz,et al.  Enhanced Cumulative Sum Charts for Monitoring Process Dispersion , 2015, PloS one.

[27]  Shubham Ranakoti,et al.  Human Fall Detection System over IMU Sensors Using Triaxial Accelerometer , 2018, Computational Intelligence: Theories, Applications and Future Directions - Volume I.

[28]  Francisco Herrera,et al.  An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics , 2013, Inf. Sci..

[29]  S. K. Tasoulis,et al.  Statistical data mining of streaming motion data for activity and fall recognition in assistive environments , 2013, Neurocomputing.

[30]  Youakim Badr,et al.  Internet of Medical Things: A Review of Recent Contributions Dealing With Cyber-Physical Systems in Medicine , 2018, IEEE Internet of Things Journal.

[31]  Vassilis P. Plagianakos,et al.  On-Line Fall Detection via Mobile Accelerometer Data , 2015, AIAI.

[32]  J. Stevens,et al.  Medical Costs of Fatal and Nonfatal Falls in Older Adults , 2018, Journal of the American Geriatrics Society.

[33]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[34]  K. Sacco,et al.  Shared “Core” Areas between the Pain and Other Task-Related Networks , 2012, PloS one.

[35]  Inês Sousa,et al.  Accelerometer-based fall detection for smartphones , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[36]  Tianmiao Wang,et al.  A wearable wireless fall detection system with accelerators , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[37]  Chung-Lin Huang,et al.  A Real-Time Model-Based Human Motion Tracking and Analysis for Human-Computer Interface Systems , 2004, EURASIP J. Adv. Signal Process..

[38]  Panayiotis Tsanakas,et al.  Fall detection and activity identification using wearable and hand-held devices , 2016, Integr. Comput. Aided Eng..

[39]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[40]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[41]  Petros Daras,et al.  Human Fall Detection from Acceleration Measurements Using a Recurrent Neural Network , 2018 .

[42]  Daniele De Martini,et al.  Online Fall Detection Using Recurrent Neural Networks on Smart Wearable Devices , 2018, IEEE Transactions on Emerging Topics in Computing.

[43]  Victor R. L. Shen,et al.  A Novel Fall Prediction System on Smartphones , 2017, IEEE Sensors Journal.

[44]  Vassilis P. Plagianakos,et al.  Efficient change detection for high dimensional data streams , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[45]  Luís Torgo,et al.  A Survey of Predictive Modeling on Imbalanced Domains , 2016, ACM Comput. Surv..

[46]  Jesús Francisco Vargas-Bonilla,et al.  SisFall: A Fall and Movement Dataset , 2017, Sensors.

[47]  Jeffrey M. Hausdorff,et al.  Evaluation of Accelerometer-Based Fall Detection Algorithms on Real-World Falls , 2012, PloS one.

[48]  Hannu Tenhunen,et al.  IoT-based fall detection system with energy efficient sensor nodes , 2016, 2016 IEEE Nordic Circuits and Systems Conference (NORCAS).

[49]  Kim Phuc Tran,et al.  The efficiency of CUSUM schemes for monitoring the coefficient of variation , 2016 .

[50]  Elisson Rocha,et al.  Accelerometer-Based Human Fall Detection Using Convolutional Neural Networks , 2019, Sensors.

[51]  TranPhuong Hanh,et al.  The efficiency of CUSUM schemes for monitoring the coefficient of variation , 2016 .