Fall Detection of Elderly People Using the Manifold of Positive Semidefinite Matrices

Falls are one of the most critical health care risks for elderly people, being, in some adverse circumstances, an indirect cause of death. Furthermore, demographic forecasts for the future show a growing elderly population worldwide. In this context, models for automatic fall detection and prediction are of paramount relevance, especially AI applications that use ambient, sensors or computer vision. In this paper, we present an approach for fall detection using computer vision techniques. Video sequences of a person in a closed environment are used as inputs to our algorithm. In our approach, we first apply the V2V-PoseNet model to detect 2D body skeleton in every frame. Specifically, our approach involves four steps: (1) the body skeleton is detected by V2V-PoseNet in each frame; (2) joints of skeleton are first mapped into the Riemannian manifold of positive semidefinite matrices of fixed-rank 2 to build time-parameterized trajectories; (3) a temporal warping is performed on the trajectories, providing a (dis-)similarity measure between them; (4) finally, a pairwise proximity function SVM is used to classify them into fall or non-fall, incorporating the (dis-)similarity measure into the kernel function. We evaluated our approach on two publicly available datasets URFD and Charfi. The results of the proposed approach are competitive with respect to state-of-the-art methods, while only involving 2D body skeletons.

[1]  Kyoung Mu Lee,et al.  V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  J. Bongaarts,et al.  United Nations Department of Economic and Social Affairs, Population Division World Family Planning 2020: Highlights, United Nations Publications, 2020. 46 p. , 2020 .

[3]  Bogdan Kwolek,et al.  Improving fall detection by the use of depth sensor and accelerometer , 2015, Neurocomputing.

[4]  Rached Tourki,et al.  Definition and Performance Evaluation of a Robust SVM Based Fall Detection Solution , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[5]  Muhammad Salman Khan,et al.  An unsupervised acoustic fall detection system using source separation for sound interference suppression , 2015, Signal Process..

[6]  Falin Wu,et al.  Development of a Wearable-Sensor-Based Fall Detection System , 2015, International journal of telemedicine and applications.

[7]  Irene Y. H. Gu,et al.  Human fall detection via shape analysis on Riemannian manifolds with applications to elderly care , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  Hsinchun Chen,et al.  Hidden Markov Model-Based Fall Detection With Motion Sensor Orientation Calibration: A Case for Real-Life Home Monitoring , 2018, IEEE Journal of Biomedical and Health Informatics.

[9]  Shehroz S. Khan,et al.  DeepFall: Non-Invasive Fall Detection with Deep Spatio-Temporal Convolutional Autoencoders , 2019, Journal of Healthcare Informatics Research.

[10]  Mohamed Daoudi,et al.  A Novel Space-Time Representation on the Positive Semidefinite Cone for Facial Expression Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Silvere Bonnabel,et al.  Riemannian Metric and Geometric Mean for Positive Semidefinite Matrices of Fixed Rank , 2008, SIAM J. Matrix Anal. Appl..

[12]  S.-C. Huang,et al.  A SKELETON FEATURES-BASED FALL DETECTION USING MICROSOFT KINECT V2 WITH ONE CLASS-CLASSIFIER OUTLIER REMOVAL , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[13]  Silvere Bonnabel,et al.  Regression on Fixed-Rank Positive Semidefinite Matrices: A Riemannian Approach , 2010, J. Mach. Learn. Res..

[14]  Jiaxing Li,et al.  Development of a Fall Detection System with Microsoft Kinect , 2012, RiTA.

[15]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[16]  Bart Vandereycken,et al.  A Riemannian geometry with complete geodesics for the set of positive semidefinite matrices of fixed rank , 2013 .

[17]  Thomas Philip Runarsson,et al.  Support vector machines and dynamic time warping for time series , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[18]  F. Bach,et al.  Low-rank optimization for semidefinite convex problems , 2008, 0807.4423.

[19]  Hamid Tairi,et al.  Human Fall Detection Using Von Mises Distribution and Motion Vectors of Interest Points , 2017, BDCA'17.

[20]  Werapon Chiracharit,et al.  Fall detection using Gaussian mixture model and principle component analysis , 2017, 2017 9th International Conference on Information Technology and Electrical Engineering (ICITEE).

[21]  Sungjoo Kang,et al.  Human-skeleton based Fall-Detection Method using LSTM for Manufacturing Industries , 2019, 2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC).

[22]  Gerhard H Visser,et al.  Automated remote fall detection using impact features from video and audio. , 2019, Journal of biomechanics.

[23]  Mirto Musci,et al.  Embedded Real-Time Fall Detection with Deep Learning on Wearable Devices , 2018, 2018 21st Euromicro Conference on Digital System Design (DSD).

[24]  Rached Tourki,et al.  Optimised spatio-temporal descriptors for real-time fall detection : comparison of SVM and Adaboost based classification , 2013 .

[25]  Wei Huang,et al.  A fall detection method based on a joint motion map using double convolutional neural networks , 2020, Multimedia Tools and Applications.

[26]  Matthias Pätzold,et al.  A Machine Learning Approach for Fall Detection and Daily Living Activity Recognition , 2019, IEEE Access.

[27]  V. K. Bhosale,et al.  Fall Detection for Elderly People in Indoor Environment using Kinect Sensor , 2017 .

[28]  Muhammad Awais Azam,et al.  Activity-Aware Fall Detection and Recognition Based on Wearable Sensors , 2019, IEEE Sensors Journal.

[29]  Yiming Wang,et al.  Human Fall Detection Based on Body Posture Spatio-Temporal Evolution , 2020, Sensors.

[30]  Hamid Tairi,et al.  Video based human fall detection using von Mises distribution of motion vectors , 2017, 2017 Intelligent Systems and Computer Vision (ISCV).

[31]  Mufti Mahmud,et al.  Towards an Accelerometer-Based Elderly Fall Detection System Using Cross-Disciplinary Time Series Features , 2021, IEEE Access.

[32]  Yaser Mowafi,et al.  Fall detection for elderly using anatomical-plane-based representation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Kostas Karpouzis,et al.  Fall detection using history triple features , 2015, PETRA.

[34]  Komal Singh,et al.  Human Fall Detection Using Machine Learning Methods: A Survey , 2019, International Journal of Mathematical, Engineering and Management Sciences.

[35]  Pierre-Antoine Absil,et al.  Quotient Geometry with Simple Geodesics for the Manifold of Fixed-Rank Positive-Semidefinite Matrices , 2020, SIAM J. Matrix Anal. Appl..

[36]  Tao Xu,et al.  New Advances and Challenges of Fall Detection Systems: A Survey , 2018 .

[37]  Abbes Amira,et al.  Fall detection and human activity classification using wearable sensors and compressed sensing , 2019, Journal of Ambient Intelligence and Humanized Computing.

[38]  Irene Y. H. Gu,et al.  Human fall detection in videos via boosting and fusing statistical features of appearance, shape and motion dynamics on Riemannian manifolds with applications to assisted living , 2016, Comput. Vis. Image Underst..

[39]  Md. Shahiduzzaman Fall Detection by Accelerometer and Heart Rate Variability Measurement , 2016 .

[40]  P. Correia,et al.  Using a Skeleton Gait Energy Image for Pathological Gait Classification , 2020, 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020).

[41]  Daniele De Martini,et al.  Online Fall Detection Using Recurrent Neural Networks on Smart Wearable Devices , 2018, IEEE Transactions on Emerging Topics in Computing.

[42]  Giancarlo Fortino,et al.  Recognition of human fall events based on single tri-axial gyroscope , 2018, 2018 IEEE 15th International Conference on Networking, Sensing and Control (ICNSC).

[43]  K. K. Warhade,et al.  Automated unusual event detection in video surveillance , 2016, 2016 International Conference on Inventive Computation Technologies (ICICT).

[44]  Saeid Nahavandi,et al.  A Skeleton-Free Fall Detection System From Depth Images Using Random Decision Forest , 2018, IEEE Systems Journal.

[45]  Stefano Berretti,et al.  A Novel Geometric Framework on Gram Matrix Trajectories for Human Behavior Understanding , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Hailin Guo,et al.  Fall Detection Based on Key Points of Human-Skeleton Using OpenPose , 2020, Symmetry.

[47]  Tanmay T. Verlekar,et al.  Automatic Classification of Gait Impairments Using a Markerless 2D Video-Based System , 2018, Sensors.

[48]  Arif Mahmood,et al.  Using Temporal Covariance of Motion and Geometric Features via Boosting for Human Fall Detection , 2018, Sensors.

[49]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[50]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[51]  Sabu Emmanuel,et al.  Intelligent Video Surveillance for Monitoring Elderly in Home Environments , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[52]  Pierre-Antoine Absil,et al.  Curvature of the Manifold of Fixed-Rank Positive-Semidefinite Matrices Endowed with the Bures-Wasserstein Metric , 2019, GSI.

[53]  Alberto Del Bimbo,et al.  Fitting, Comparison, and Alignment of Trajectories on Positive Semi-Definite Matrices with Application to Action Recognition , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[54]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[55]  Song Wu,et al.  3 D ShapeNets : A Deep Representation for Volumetric Shape Modeling , 2015 .

[56]  Rachid Oulad Haj Thami,et al.  Fall Detection for Elderly People Using the Variation of Key Points of Human Skeleton , 2019, IEEE Access.

[57]  Pierre-Yves Gousenbourger,et al.  Interpolation on the manifold of fixed-rank positive-semidefinite matrices for parametric model order reduction: preliminary results , 2019, ESANN.