A Lightweight Neural-Net with Assistive Mobile Robot for Human Fall Detection System

Falls are a major health issue, particularly among the elderly. Increasing fall events require high service quality and dedicated medical treatment which is an economic burden. In the lack of appropriate care and support, serious injuries caused by fall will cost lives. Therefore, tracking systems with fall detection capabilities are required. Static-view sensors with machine learning techniques for human fall detection have been widely studied and achieved significant results. However, these systems unable to monitor a person if he or she is out of viewing angle which greatly impedes its performance. Mobile robots are an alternative for keeping the person in sight. However, existing mobile robots are unable to operate for a long time due to battery issues and movement constraints in complex environments. In this paper, we proposed a lightweight deep learning vision-based model for human fall detection with an assistive robot to provide assistance when a fall happens. The proposed detection system requires less computational power which can be implemented in a low-cost 2D camera and GPU board for real-time monitoring. The assistive robot equipped with various sensors that can perform SLAM, obstacle avoidance and navigation autonomously. Our proposed system integrates these two sub-systems to compensate for the weakness of each other to constitute a system that robust, adaptable, and high performance. The proposed method has been validated through a series of experiments.

[1]  Stephen J. McKenna,et al.  Learning spatial context from tracking using penalised likelihoods , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Jitendra Malik,et al.  SlowFast Networks for Video Recognition , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Roland Siegwart,et al.  Simultaneous localization and odometry self calibration for mobile robot , 2007, Auton. Robots.

[4]  S. Cerutti,et al.  Barometric Pressure and Triaxial Accelerometry-Based Falls Event Detection , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Lucian Busoniu,et al.  Vision and Control for UAVs: A Survey of General Methods and of Inexpensive Platforms for Infrastructure Inspection , 2015, Sensors.

[6]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Shehroz S. Khan,et al.  Review of Fall Detection Techniques: A Data Availability Perspective , 2016, Medical engineering & physics.

[8]  Midori Sugaya,et al.  A Mobile Robot for Fall Detection for Elderly-Care , 2015, KES.

[9]  Li Zhang,et al.  Falling detection of lonely elderly people based on NAO humanoid robot , 2016, 2016 IEEE International Conference on Information and Automation (ICIA).

[10]  MakrisDimitrios,et al.  Fall detection system using Kinect's infrared sensor , 2014 .

[11]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Giampaolo Ferraioli,et al.  Type and Location of Wearable Sensors for Monitoring Falls during Static and Dynamic Tasks in Healthy Elderly: A Review , 2018, Sensors.

[14]  Youssef Iraqi,et al.  Fall Detection Systems for Elderly Care: A Survey , 2014, 2014 6th International Conference on New Technologies, Mobility and Security (NTMS).

[15]  Naoyuki Kubota,et al.  Episodic Memory Multimodal Learning for Robot Sensorimotor Map Building and Navigation , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[16]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[17]  Naoyuki Kubota,et al.  A Modular Structured Architecture Using Smart Devices for Socially-Embedded Robot Partners , 2020 .

[18]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[19]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[20]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Toshiyo Tamura,et al.  A Wearable Airbag to Prevent Fall Injuries , 2009, IEEE Transactions on Information Technology in Biomedicine.

[22]  Kotaro Minato,et al.  Quantitative analysis of the fall-risk assessment test with wearable inertia sensors , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Saturnino Maldonado-Bascón,et al.  Fallen People Detection Capabilities Using Assistive Robot , 2019, Electronics.