Automatic food intake detection based on swallowing sounds

This paper presents a novel fully automatic food intake detection methodology, an important step toward objective monitoring of ingestive behavior. The aim of such monitoring is to improve our understanding of eating behaviors associated with obesity and eating disorders. The proposed methodology consists of two stages. First, acoustic detection of swallowing instances based on mel-scale Fourier spectrum features and classification using support vector machines is performed. Principal component analysis and a smoothing algorithm are used to improve swallowing detection accuracy. Second, the frequency of swallowing is used as a predictor for detection of food intake episodes. The proposed methodology was tested on data collected from 12 subjects with various degrees of adiposity. Average accuracies of >80% and >75% were obtained for intra-subject and inter-subject models correspondingly with a temporal resolution of 30s. Results obtained on 44.1 hours of data with a total of 7305 swallows show that detection accuracies are comparable for obese and lean subjects. They also suggest feasibility of food intake detection based on swallowing sounds and potential of the proposed methodology for automatic monitoring of ingestive behavior. Based on a wearable non-invasive acoustic sensor the proposed methodology may potentially be used in free-living conditions.

[1]  O. Makeyev,et al.  Detection of Food Intake from Swallowing Sequences by Supervised and Unsupervised Methods , 2010, Annals of Biomedical Engineering.

[2]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[3]  M. Livingstone,et al.  Markers of the validity of reported energy intake. , 2003, The Journal of nutrition.

[4]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[5]  M. Brock,et al.  The use of “overall accuracy” to evaluate the validity of screening or diagnostic tests , 2004, Journal of General Internal Medicine.

[6]  Michael R Neuman,et al.  Toward Objective Monitoring of Ingestive Behavior in Free‐living Population , 2009, Obesity.

[7]  Oleksandr Makeyev,et al.  Automatic identification of the number of food items in a meal using clustering techniques based on the monitoring of swallowing and chewing , 2012, Biomed. Signal Process. Control..

[8]  Xingyu Wang,et al.  Classification of Direction perception EEG Based on PCA-SVM , 2007, Third International Conference on Natural Computation (ICNC 2007).

[9]  J. Hebebrand,et al.  [Obesity and overweight]. , 2009, Zeitschrift fur Kinder- und Jugendpsychiatrie und Psychotherapie.

[10]  Michael R. Neuman,et al.  Reply to "Comment on 'Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior" , 2009 .

[11]  Michael R. Neuman,et al.  Automatic Detection of Swallowing Events by Acoustical Means for Applications of Monitoring of Ingestive Behavior , 2010, IEEE Transactions on Biomedical Engineering.

[12]  Edward Sazonov,et al.  Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior. , 2008, Physiological measurement.

[13]  Rachel K. Johnson,et al.  The use of a personal digital assistant for dietary self-monitoring does not improve the validity of self-reports of energy intake. , 2006, Journal of the American Dietetic Association.

[14]  E Stellar,et al.  Chews and swallows and the microstructure of eating. , 1985, The American journal of clinical nutrition.

[15]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[16]  Melanie Wall,et al.  Obesity, disordered eating, and eating disorders in a longitudinal study of adolescents: how do dieters fare 5 years later? , 2006, Journal of the American Dietetic Association.

[17]  Tadahiro Kuroda,et al.  Eating habits monitoring using wireless wearable in-ear microphone , 2008, 2008 3rd International Symposium on Wireless Pervasive Computing.

[18]  Edward Taub,et al.  Spontaneous swallowing rate and emotional state , 1995, Digestive Diseases and Sciences.

[19]  Haitao Zhao,et al.  Combined SVM and PCA to Recognize the Brain Function from fMRI Images , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[20]  D. Schoeller Limitations in the assessment of dietary energy intake by self-report. , 1995, Metabolism: clinical and experimental.