Fuzzy inference-based fall detection using kinect and body-worn accelerometer

Graphical abstractDisplay Omitted HighlightsA new approach for reliable fall detection.In case of potential fall a threshold-based algorithm launches the fuzzy system to authenticate the fall event. The fuzzy system consists of two input Mamdani engines and a triggering alert Sugeno engine.The output of the first engine is a fuzzy set, which assigns grades of membership to the possible values of dynamic transitions, whereas the output of the second one is another fuzzy set assigning membership grades to possible body poses.Since the Mamdani engines perform fuzzy reasoning on disjoint subsets of the linguistic variables, the total number of the fuzzy rules needed for input-output mapping is far smaller. In this paper, we present a new approach for reliable fall detection. The fuzzy system consists of two input Mamdani engines and a triggering alert Sugeno engine. The output of the first Mamdani engine is a fuzzy set, which assigns grades of membership to the possible values of dynamic transitions, whereas the output of the second one is another fuzzy set assigning membership grades to possible body poses. Since Mamdani engines perform fuzzy reasoning on disjoint subsets of the linguistic variables, the total number of the fuzzy rules needed for input-output mapping is far smaller. The person pose is determined on the basis of depth maps, whereas the pose transitions are inferred using both depth maps and the accelerations acquired by a body worn inertial sensor. In case of potential fall a threshold-based algorithm launches the fuzzy system to authenticate the fall event. Using the accelerometric data we determine the moment of the impact, which in turn helps us to calculate the pose transitions. To the best of our knowledge, this is a new application of fuzzy logic in a novel approach to modeling and reliable low cost detecting of falls.

[1]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[2]  James M. Keller,et al.  Day or Night Activity Recognition From Video Using Fuzzy Clustering Techniques , 2014, IEEE Transactions on Fuzzy Systems.

[3]  Jin S. Lee,et al.  Universal approximation by hierarchical fuzzy system with constraints on the fuzzy rule , 2002, Fuzzy Sets Syst..

[4]  Bogdan Kwolek,et al.  Detecting human falls with 3-axis accelerometer and depth sensor , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[6]  Andrés Pérez-Uribe,et al.  Indoor Activity Recognition by Combining One-vs.-All Neural Network Classifiers Exploiting Wearable and Depth Sensors , 2013, IWANN.

[7]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[8]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yun Li,et al.  Efficient Source Separation Algorithms for Acoustic Fall Detection Using a Microsoft Kinect , 2014, IEEE Transactions on Biomedical Engineering.

[10]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[11]  Pierpaolo D'Urso,et al.  Fuzzy clustering of human activity patterns , 2013, Fuzzy Sets Syst..

[12]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[13]  Albert Ali Salah,et al.  Coupling Fall Detection and Tracking in Omnidirectional Cameras , 2014, HBU.

[14]  Antonio Fernández-Caballero,et al.  A fuzzy model for human fall detection in infrared video , 2013, J. Intell. Fuzzy Syst..

[15]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[16]  Li-Xin Wang,et al.  Universal approximation by hierarchical fuzzy systems , 1998, Fuzzy Sets Syst..

[17]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[18]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[19]  Jun Zhou,et al.  Hierarchical fuzzy control , 1991 .

[20]  Lotfi A. Zadeh,et al.  A fuzzy-algorithmic approach to the definition of complex or imprecise concepts , 1976 .

[21]  Osama Masoud,et al.  A method for human action recognition , 2003, Image Vis. Comput..

[22]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[23]  Martin Kampel,et al.  Robust Fall Detection by Combining 3D Data and Fuzzy Logic , 2012, ACCV Workshops.

[24]  Bogdan Kwolek,et al.  Fall Detection on Embedded Platform Using Kinect and Wireless Accelerometer , 2012, ICCHP.

[25]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[26]  Andrea Cavallaro,et al.  Video-Based Human Behavior Understanding: A Survey , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  James M. Keller,et al.  Modeling Human Activity From Voxel Person Using Fuzzy Logic , 2009, IEEE Transactions on Fuzzy Systems.

[28]  M N Nyan,et al.  A wearable system for pre-impact fall detection. , 2008, Journal of biomechanics.

[29]  Bogdan Kwolek.  Face tracking system based on color, stereovision and elliptical shape features , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[30]  Yannick Benezeth,et al.  Posture Recognition Based on Fuzzy Logic for Home Monitoring of the Elderly , 2012, IEEE Transactions on Information Technology in Biomedicine.

[31]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[32]  Sabine Van Huffel,et al.  Integrating video and accelerometer signals for nocturnal epileptic seizure detection , 2012, ICMI '12.

[33]  James M. Keller,et al.  Recognizing complex instrumental activities of daily living using scene information and fuzzy logic , 2015, Comput. Vis. Image Underst..

[34]  Inés Couso,et al.  Advocating the Use of Imprecisely Observed Data in Genetic Fuzzy Systems , 2007, IEEE Transactions on Fuzzy Systems.

[35]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[36]  Ajith Abraham,et al.  Rule-Based Expert Systems , 2005 .

[37]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[38]  Maarit Kangas,et al.  Comparison of low-complexity fall detection algorithms for body attached accelerometers. , 2008, Gait & posture.

[39]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[40]  Jean Meunier,et al.  3D head tracking for fall detection using a single calibrated camera , 2013, Image Vis. Comput..

[41]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[42]  Ashutosh Tewari,et al.  Knowledge-based parameter identification of TSK fuzzy models , 2010, Appl. Soft Comput..

[43]  Cordelia Schmid,et al.  Action recognition by dense trajectories , 2011, CVPR 2011.

[44]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[45]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[46]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[47]  Bogdan Kwolek,et al.  Fuzzy Inference-Based Reliable Fall Detection Using Kinect and Accelerometer , 2012, ICAISC.

[48]  Thi-Lan Le,et al.  An analysis on human fall detection using skeleton from Microsoft kinect , 2014, 2014 IEEE Fifth International Conference on Communications and Electronics (ICCE).

[49]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.