Spectrogram-based audio classification of nutrition intake

Acoustic monitoring of food intake in an unobtrusive, wearable form-factor can encourage healthy dietary choices by enabling individuals to monitor their eating patterns, maintain regularity in their meal times, and ensure adequate hydration levels. In this paper, we describe a system capable of monitoring food intake by means of a throat microphone, classifying the data based on the food being consumed among several categories through spectrogram analysis, and providing user feedback in the form of mobile application. We are able to classify sandwich swallows, sandwich chewing, water swallows, and none, with an F-Measure of 0.836.

[1]  E. S. Sazonov,et al.  A Sensor System for Automatic Detection of Food Intake Through Non-Invasive Monitoring of Chewing , 2012, IEEE Sensors Journal.

[2]  Hassan Ghasemzadeh,et al.  Multimodal energy expenditure calculation for pervasive health: A data fusion model using wearable sensors , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[3]  K. Glanz,et al.  Improving Dietary Self-Monitoring and Adherence with Hand-Held Computers: A Pilot Study , 2006, American journal of health promotion : AJHP.

[4]  James R Hebert,et al.  Association between eating patterns and obesity in a free-living US adult population. , 2003, American journal of epidemiology.

[5]  Majid Sarrafzadeh,et al.  A Wearable Nutrition Monitoring System , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[6]  Michael R. Neuman,et al.  Automatic Detection of Swallowing Events by Acoustical Means for Applications of Monitoring of Ingestive Behavior , 2010, IEEE Transactions on Biomedical Engineering.

[7]  Oleksandr Makeyev,et al.  Automatic food intake detection based on swallowing sounds , 2012, Biomed. Signal Process. Control..

[8]  Kenji Suzuki,et al.  A neck mounted interface for sensing the swallowing activity based on swallowing sound , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Sherry L Pagoto,et al.  Number of 24-hour diet recalls needed to estimate energy intake. , 2009, Annals of epidemiology.

[10]  Hideaki Doi,et al.  Non-Restrictive Measurement of Swallowing Frequency Using a Throat Microphone , 2010 .

[11]  O. Makeyev,et al.  Limited receptive area neural classifier for recognition of swallowing sounds using continuous wavelet transform , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  E Stellar,et al.  Chews and swallows and the microstructure of eating. , 1985, The American journal of clinical nutrition.

[13]  Z. Moussavi,et al.  Automated classification of swallowing and breadth sounds , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.