Analyzing Breathing Signals and Swallow Sequence Locality for Solid Food Intake Monitoring

Self-reported questionnaires are widely used by researchers for analyzing the dietary behavior of overweight and obese individuals. It has been established that questionnaire-based data collection often suffers from high errors due to its reporting subjectivity. Automatic swallow detection, as an alternative to questionnaires, is proposed in this paper to avoid such subjectivity. Existing approaches for swallow detection include the use of surface electromyography and sound to detect individual swallowing events. Many of these methods are generally too complicated and cumbersome for daily usage in a free-living setting. This paper presents a wearable solid food intake monitoring system that analyzes human breathing signals and swallow sequence locality. Food intake is identified by detecting swallow events. The system works based on a key observation that the otherwise continuous breathing process is interrupted by a short apnea during swallowing. A support vector machine (SVM) is first used for detecting such apneas in breathing signals collected from a wearable chest belt. The resulting swallow detection is then refined using a hidden Markov model (HMM)-based mechanism that leverages the known temporal locality in the sequence of human swallows. Temporal locality is based on the fact that people usually do not swallow in consecutive breathing cycles. The HMM model is used to model such temporal locality in order to refine the SVM results. Experiments were carried out on six healthy subjects wearing the proposed system. The proposed SVM method achieved up to 61% precision and 91% recall on average. Utilization of HMM in addition to SVM improved the overall performance to up to 75% precision and 86% recall.

[1]  J. Hebebrand,et al.  [Obesity and overweight]. , 2009, Zeitschrift fur Kinder- und Jugendpsychiatrie und Psychotherapie.

[2]  Dinesh K. Bhatia,et al.  Towards automated ingestion detection: Swallow sounds , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Gerhard Tröster,et al.  Recognition of dietary activity events using on-body sensors , 2008, Artif. Intell. Medicine.

[4]  Geoff Holmes,et al.  Benchmarking Attribute Selection Techniques for Discrete Class Data Mining , 2003, IEEE Trans. Knowl. Data Eng..

[5]  Claude Bouchard,et al.  Clinical guidelines on the identification, evaluation, and treatment of overweight and obesity in adults. , 1998, WMJ : official publication of the State Medical Society of Wisconsin.

[6]  David G. Stork,et al.  Pattern Classification , 1973 .

[7]  Chiung-Cheng Chuang,et al.  Noninvasive Swallowing Test for Young Healthy Adults: Finding the Best Location to Monitor Thyroid Cartilage Movements , 2014 .

[8]  V. Drapeau,et al.  The night‐eating syndrome and obesity , 2012, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[9]  Salvatore Sessa,et al.  Development of an ultra-miniaturized inertial measurement unit for jaw movement analysis during free chewing , 2010 .

[10]  Bo Dong,et al.  Wearable diet monitoring through breathing signal analysis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[12]  Gila Benchetrit,et al.  Use of Respiratory Inductance Plethysmography for the Detection of Swallowing in the Elderly , 2005, Dysphagia.

[13]  Bo Dong,et al.  Wearable networked sensing for human mobility and activity analytics: A systems study , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[14]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[15]  A. Musaiger,et al.  Association between food intake frequency and obesity among adolescent girls in Saudi Arabia , 2014, International journal of adolescent medicine and health.

[16]  Wolf-Joachim Fischer,et al.  Food Intake Activity Detection Using a Wearable Microphone System , 2011, 2011 Seventh International Conference on Intelligent Environments.

[17]  I. L. Freeston,et al.  Algorithms for the detection of breaths from respiratory waveform recordings of infants , 1982, Medical and Biological Engineering and Computing.

[18]  Edward Sazonov,et al.  A novel approach for food intake detection using electroglottography , 2014, Physiological measurement.

[19]  J Abbott,et al.  Night eating syndrome: implications for severe obesity , 2012, Nutrition & Diabetes.

[20]  Bo Dong,et al.  Liquid intake monitoring through breathing signal using machine learning , 2013, Defense, Security, and Sensing.

[21]  Gerhard Tröster,et al.  Methods for Detection and Classification of Normal Swallowing from Muscle Activation and Sound , 2006, 2006 Pervasive Health Conference and Workshops.

[22]  V. Vance,et al.  Self-reported dietary energy intake of normal weight, overweight and obese adolescents , 2009, Public Health Nutrition.

[23]  D G Schlundt,et al.  The role of breakfast in the treatment of obesity: a randomized clinical trial. , 1992, The American journal of clinical nutrition.

[24]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[25]  Rob Miller,et al.  Smart Homes that Monitor Breathing and Heart Rate , 2015, CHI.

[26]  G. Wahba Support vector machines, reproducing kernel Hilbert spaces, and randomized GACV , 1999 .

[27]  Bo Dong,et al.  Swallow monitoring through apnea detection in breathing signal , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Salvatore Sessa,et al.  Application of wireless inertial measurement units and EMG sensors for studying deglutition — Preliminary results , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Edward Sazonov,et al.  Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior. , 2008, Physiological measurement.