A framework for fall detection of elderly people by analyzing environmental sounds through acoustic local ternary patterns

The elderly people living alone or life of a patient face distress situations particularly in case of falling and becoming unable to ask for help. Fall in elderly people may result in head injury, broken hips, and bones that need immediate hospitalization to lower the mortality risk. During the last decade, several technological solutions were presented for early fall detection but most of them have critical limitations and are impeded by several environmental constraints. In this paper, we have analyzed the environmental sounds for early fall detection utilizing the fact that reflection of pain directly occurs through sound. The proposed framework first analyzes the environmental sounds by suppressing the silence zones in signals and distinguishing overlapping sound signals through hidden Markov model based component analysis (HMM-CA). The source separated components are then represented by acoustic local ternary patterns (acoustic-LTPs) by extending the existing ideas of acoustic local binary patterns (acoustic-LBPs). In the proposed work, we have also introduced the concept of rotation invariance through uniform patterns for audio signals that, arguably, is a fundamental requirement for an acoustic descriptor. Once the signal representation is completed, we classify the signals through SVM classifier. The performance of the proposed acoustic-LTP is evaluated against state-of-the-art methods and acoustic-LBP. Results clearly evince that proposed method is more powerful and reliable in terms of fall detection when compared against other methods.

[1]  Michel Vacher,et al.  Complete Sound and Speech Recognition System for Health Smart Homes: Application to the Recognition of Activities of Daily Living , 2010 .

[2]  Muhammad Salman Khan,et al.  An unsupervised acoustic fall detection system using source separation for sound interference suppression , 2015, Signal Process..

[3]  Wang Yi,et al.  AutoDietary: A Wearable Acoustic Sensor System for Food Intake Recognition in Daily Life , 2016, IEEE Sensors Journal.

[4]  Yun Li,et al.  A Microphone Array System for Automatic Fall Detection , 2012, IEEE Transactions on Biomedical Engineering.

[5]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[6]  C. Moran,et al.  Early mortality after hip fracture: is delay before surgery important? , 2005, The Journal of bone and joint surgery. American volume.

[7]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[8]  Ning Liu,et al.  Bathroom Activity Monitoring Based on Sound , 2005, Pervasive.

[9]  G K Wilcock,et al.  Rhabdomyolysis in elderly people after collapse. , 1984, British medical journal.

[10]  Francesco Piazza,et al.  Acoustic cues from the floor: A new approach for fall classification , 2016, Expert Syst. Appl..

[11]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[12]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[13]  Muhammad Ahsan,et al.  Daily sound recognition for elderly people using ensemble methods , 2014, 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[14]  R. J. Gurley,et al.  Persons found in their homes helpless or dead. , 1996, The New England journal of medicine.

[15]  John J. Soraghan,et al.  Local binary patterns for 1-D signal processing , 2010, 2010 18th European Signal Processing Conference.

[16]  E. Finkelstein,et al.  The costs of fatal and non-fatal falls among older adults , 2006, Injury Prevention.

[17]  Satoshi Nakamura,et al.  Design and collection of acoustic sound data for hands-free speech recognition and sound scene understanding , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[18]  S. Cerutti,et al.  Barometric Pressure and Triaxial Accelerometry-Based Falls Event Detection , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Ilias Maglogiannis,et al.  Advanced patient or elder fall detection based on movement and sound data , 2008, 2008 Second International Conference on Pervasive Computing Technologies for Healthcare.

[20]  Meng Wu,et al.  Fall Detection Based on Sequential Modeling of Radar Signal Time-Frequency Features , 2013, 2013 IEEE International Conference on Healthcare Informatics.

[21]  Liang Liu,et al.  Automatic fall detection based on Doppler radar motion signature , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[22]  John F. Roddick,et al.  An Efficient Scheme for Detecting Copy-move Forged Images by Local Binary Patterns , 2013, J. Inf. Hiding Multim. Signal Process..

[23]  Michael W. Spratling A review of predictive coding algorithms , 2017, Brain and Cognition.

[24]  Matti Pietikäinen,et al.  Unsupervised texture segmentation using feature distributions , 1997, Pattern Recognit..

[25]  L. Gonzo,et al.  A hardware-software framework for high-reliability people fall detection , 2008, 2008 IEEE Sensors.

[26]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[27]  Naser Dehghan,et al.  Adverse health effects of occupational exposure to radiofrequency radiation in airport surveillance radar operators , 2013, Indian journal of occupational and environmental medicine.

[28]  Bernadette Dorizzi,et al.  Daily sound recognition using a combination of GMM and SVM for home automation , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[29]  M. Popescu,et al.  Acoustic fall detection using one-class classifiers , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Marjorie Skubic,et al.  Doppler Radar Fall Activity Detection Using the Wavelet Transform , 2015, IEEE Transactions on Biomedical Engineering.

[31]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .