Two-step detection of water sound events for the diagnostic and monitoring of dementia

A significant aging of world population is foreseen for the next decades. Thus, developing technologies to empower the independency and assist the elderly are becoming of great interest. In this framework, the IMMED project investigates tele-monitoring technologies to support doctors in the diagnostic and follow-up of dementia illnesses such as Alzheimer. Specifically, water sounds are very useful to track and identify abnormal behaviors form everyday activities (e.g. hygiene, household, cooking, etc.). In this work, we propose a double-stage system to detect this type of sound events. In the first stage, the audio stream is segmented with a simple but effective algorithm based on the Spectral Cover feature. The second stage improves the system precision by classifying the segmented streams into water/non-water sound events using Gammatone Cepstral Coefficients and Support Vector Machines. Experimental results reveal the potential of the combined system, yielding a F-measure higher than 80%.

[1]  Bin Zhang,et al.  Ball Hit Detection in Table Tennis Games Based on Audio Analysis , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Chloé Clavel,et al.  Events Detection for an Audio-Based Surveillance System , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[3]  James Fogarty,et al.  Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition , 2006, UIST.

[4]  Alex Mihailidis,et al.  Water Flow Detection in a Handwashing Task , 2010, 2010 Canadian Conference on Computer and Robot Vision.

[5]  Julien Pinquier,et al.  Water sound recognition based on physical models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Jenny Benois-Pineau,et al.  The IMMED project: wearable video monitoring of people with age dementia , 2010, ACM Multimedia.

[7]  Brian R Glasberg,et al.  Derivation of auditory filter shapes from notched-noise data , 1990, Hearing Research.

[8]  Julien Pinquier,et al.  Water flow detection from a wearable device with a new feature, the spectral cover , 2012, 2012 10th International Workshop on Content-Based Multimedia Indexing (CBMI).

[9]  Jenny Benois-Pineau,et al.  Strategies for multiple feature fusion with Hierarchical HMM: Application to activity recognition from wearable audiovisual sensors , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Julien Pinquier,et al.  Jingle detection and identification in audio documents , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Juha Röning,et al.  Feature Selection and Activity Recognition to Detect Water Waste from Water Tap Usage , 2011, 2011 IEEE 17th International Conference on Embedded and Real-Time Computing Systems and Applications.

[12]  Shrikanth Narayanan,et al.  Environmental Sound Recognition With Time–Frequency Audio Features , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  Francesc Alías,et al.  Gammatone Cepstral Coefficients: Biologically Inspired Features for Non-Speech Audio Classification , 2012, IEEE Transactions on Multimedia.

[14]  M. Al Masum Shaikh,et al.  Automatic Life-Logging: A novel approach to sense real-world activities by environmental sound cues and common sense , 2008, 2008 11th International Conference on Computer and Information Technology.

[15]  Roy D. Patterson,et al.  A FUNCTIONAL MODEL OF NEURAL ACTIVITY PATTERNS AND AUDITORY IMAGES , 2004 .

[16]  Paul Lukowicz,et al.  Design and Evaluation of a Sound Based Water Flow Measurement System , 2008, EuroSSC.

[17]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[18]  Ning Liu,et al.  Bathroom Activity Monitoring Based on Sound , 2005, Pervasive.