Adaptive Deep Learning for a Vision-based Fall Detection

Fall is one of the main causes of severe accidents or even death especially for the elderly. Thus, it is imminent to prevent falls before they occur. In this paper, a vision-based system is adopted for fall detection exploiting novel self-adaptable deep machine learning strategies. The deep network is exploited to distinguished humans (foreground) from the background. Adaptation is necessary to tackle dynamic changes in the visual conditions (shadows, illumination, background changes) which are very often for a real-life environment. For the adaptable we are based on a decision mechanism that enable network retraining whenever the visual conditions are not proper for foreground/background separation. Then, a constraint minimization algorithm is activated to optimally estimate new network weights so that i) data from the current visual environment are trusted as much as possible while ii) a minimal degradation of the already existing network knowledge is accomplished. For the activation of the algorithm a set of new labeled data from the current environment is selected by constraining iterative motion information with a human face/body modeler. Experimental results and comparisons with non-adaptable deep network schemes or shallow non-linear classifier indicate the superior performance of the algorithm than other approaches.

[1]  Abbes Amira,et al.  Multiple comparator classifier framework for accelerometer-based fall detection and diagnostic , 2016, Appl. Soft Comput..

[2]  Neeli R. Prasad,et al.  ISISEMD: Intelligent system for independent living and self-care of seniors with mild cognitive impairment or mild dementia , 2009 .

[3]  M. Tinetti,et al.  Risk factors for falls among elderly persons living in the community. , 1988, The New England journal of medicine.

[4]  John P Hirdes,et al.  Risk factors for falling among community-based seniors using home care services. , 2002, The journals of gerontology. Series A, Biological sciences and medical sciences.

[5]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[7]  Francesco Cesarone,et al.  Linear and Non-linear Programming , 2020 .

[8]  Nikolaos F. Matsatsinis,et al.  3D measures exploitation for a monocular semi-supervised fall detection system , 2016, Multimedia Tools and Applications.

[9]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Rose A Rudd,et al.  Circumstances and Contributing Causes of Fall Deaths among Persons Aged 65 and Older: United States, 2010 , 2014, Journal of the American Geriatrics Society.

[11]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[12]  R. B.,et al.  The United Nations , 1947, Nature.

[13]  Long Chen,et al.  Human fall detection in surveillance video based on PCANet , 2016, Multimedia Tools and Applications.

[14]  Nikolaos Doulamis,et al.  Vision Based Fall Detector Exploiting Deep Learning , 2016, PETRA.

[15]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[16]  Nikolaos D. Doulamis,et al.  Iterative motion estimation constrained by time and shape for detecting persons' falls , 2010, PETRA '10.

[17]  N. Grassly,et al.  United Nations Department of Economic and Social Affairs/population Division , 2022 .

[18]  Nicolas Thome,et al.  A Real-Time, Multiview Fall Detection System: A LHMM-Based Approach , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[20]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[21]  J W Runge,et al.  The cost of injury. , 1993, Emergency medicine clinics of North America.

[22]  Lillemor Lundin-Olsson,et al.  Falls among frail older people in residential care , 2002, Scandinavian journal of public health.

[23]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[24]  Guido M. Cortelazzo,et al.  Automatic 3D modeling of archaeological objects , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[25]  Abdelhamid Bouchachia,et al.  Activity recognition for indoor fall detection using convolutional neural network , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[26]  C. Stentoumis,et al.  A REAL-TIME SINGLE-CAMERA APPROACH FOR AUTOMATIC FALL DETECTION , 2010 .

[27]  S. Cerutti,et al.  Barometric Pressure and Triaxial Accelerometry-Based Falls Event Detection , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Nikolaos Doulamis,et al.  Local Geometrically Enriched Mixtures for Stable and Robust Human Tracking in Detecting Falls , 2013 .

[30]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[31]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[33]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.

[34]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.