Development of a methodology to predict and monitor emergency situations of the elderly based on object detection

Because on the increase in the number of the elderly living alone and accidents occurring to them, the demand for a monitoring system capable of supporting fast response in case of an emergency situation by monitoring their everyday life in their residential spaces has been increasing. A framework and a system are presented to monitor the emergency situations of the elderly living alone using a low-cost device and open-source software. First, human pose recognition and emergency situations according to the pose change were defined using object recognition, and a procedure capable of detecting such situations was proposed. In addition, a pose recognition model was created using the TensorFlow Object Detection application programming interface (API) of Google to implement the procedure. Using a data preprocessing process and the created model, a system capable of detecting emergency situations and sounding an alarm was implemented. To verify the proposed system, the pose recognition success rate was examined, and an experiment on emergency situation recognition was performed while the angle and distance of the camera were varied in a setup similar to the residential environment. It is expected that the proposed framework for the emergency notification system for the elderly will be utilized for the analysis of various behavior patterns, such as the sudden abnormal behavior of the elderly, people with disabilities, and children.

[1]  Kwee-Bo Sim,et al.  Ring-type Heart Rate Sensor and Monitoring system for Sensor Network Application , 2007 .

[2]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[3]  J. Poterba,et al.  An aging society: opportunity or challenge? , 1990, Brookings papers on economic activity.

[4]  Namsub Kim.  Development of an Emergency Monitoring Device in a Wrist Watch , 2010 .

[6]  M. Drahansky,et al.  Real-time Terrain Deformations , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[7]  Marcel Mérette,et al.  Population ageing and economic growth in seven OECD countries , 1999 .

[8]  Graham W. Taylor,et al.  Deep Learning Object Detection Methods for Ecological Camera Trap Data , 2018, 2018 15th Conference on Computer and Robot Vision (CRV).

[9]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[10]  Sun Han,et al.  A Practical Method for Moving Target Detection Under Complex Background , 2005 .

[11]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[12]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[14]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[15]  James M. Keller,et al.  Linguistic summarization of video for fall detection using voxel person and fuzzy logic , 2009, Comput. Vis. Image Underst..

[16]  Rita Paradiso,et al.  WEALTHY – a wearable healthcare system: new frontier on e-textile , 2005, Journal of Telecommunications and Information Technology.

[17]  Kuan-Ting Yu,et al.  Multi-view self-supervised deep learning for 6D pose estimation in the Amazon Picking Challenge , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Wan-Young Chung,et al.  A wireless sensor network compatible wearable u-healthcare monitoring system using integrated ECG, accelerometer and SpO2 , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  김윤신,et al.  A Study on the Social Networks Effectiveness to Prevent the Lonely Death of the Elderly who Live Alone , 2011 .

[20]  Aleksandar Milenkovic,et al.  System architecture of a wireless body area sensor network for ubiquitous health monitoring , 2005 .

[21]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[22]  Ruchuan Wang,et al.  TagCare: Using RFIDs to Monitor the Status of the Elderly Living Alone , 2017, IEEE Access.

[23]  Andrew Zisserman,et al.  Flowing ConvNets for Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Cordelia Schmid,et al.  LCR-Net++: Multi-Person 2D and 3D Pose Detection in Natural Images , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jesse S. Jin,et al.  Tracking Using CamShift Algorithm and Multiple Quantized Feature Spaces , 2004, VIP.

[26]  Song Zheng,et al.  An Improved Moving Object Detection Algorithm Based on Frame Difference and Edge Detection , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[27]  Sang-Joong Jung,et al.  A wireless sensor network compatible wearable u-healthcare monitoring system using integrated ECG, accelerometer and SpO2. , 2008, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[28]  Jitendra Malik,et al.  Contextual Action Recognition with R*CNN , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Yi Yang.  Articulated Human Pose Estimation with Flexible Mixtures of Parts , 2013 .

[30]  Martin Kampel,et al.  Robust Fall Detection by Combining 3D Data and Fuzzy Logic , 2012, ACCV Workshops.