Food watch: detecting and characterizing eating episodes through feeding gestures

Obesity, caused primarily by overeating, is a preventable chronic disease yielding staggering healthcare costs. To detect overeating passively, a machine learning framework was designed to detect and accurately count the number of feeding gestures during an eating episode to characterize each eating episode with a feeding gesture count. With the ubiquitous nature of wrist-worn sensors, existing literature has focused on detecting eating-related gestures and eating episodes that are at least f ve minutes long. In this paper, our objective is to show the potential of commercial smartwatches to be used in detection of eating episodes with short durations confounded by other activities of daily living in order to truly capture all eating episodes in the field The effect of time-series segmentation and sensing configuration on the accuracy of detecting and characterizing feeding gestures is then analyzed. Finally, the effects of personalized and generalized machine learning models in predicting feeding gestures are compared. Results demonstrate the large within-subject variability of eating, where a generalized user-independentmodel yields a 75.7% average F-measure, whereas a personalized user-dependent modelyields a 85.7% average F-measure. This shows the effects of personalized clustering on feeding gesture count, resulting in a root mean square error of 8.4.

[1]  Nils Y. Hammerla,et al.  Body-Worn Sensors in Parkinson's Disease: Evaluating Their Acceptability to Patients. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[2]  Yiran Chen,et al.  eButton: A wearable computer for health monitoring and personal assistance , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).

[3]  Majid Sarrafzadeh,et al.  Robust human intensity-varying activity recognition using Stochastic Approximation in wearable sensors , 2013, 2013 IEEE International Conference on Body Sensor Networks.

[4]  R. McNally,et al.  Emotional arousal and overeating in restrained eaters. , 1992, Journal of abnormal psychology.

[5]  Emre Ertin,et al.  puffMarker: a multi-sensor approach for pinpointing the timing of first lapse in smoking cessation , 2015, UbiComp.

[6]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[7]  Paul Johns,et al.  Predicting "About-to-Eat" Moments for Just-in-Time Eating Intervention , 2016, Digital Health.

[8]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[9]  C. Nederkoorn,et al.  Happy eating. The underestimated role of overeating in a positive mood , 2013, Appetite.

[10]  Nadir Weibel,et al.  ChronoViz: a system for supporting navigation of time-coded data , 2011, CHI Extended Abstracts.

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Thad Starner,et al.  A wearable system for detecting eating activities with proximity sensors in the outer ear , 2015, SEMWEB.

[13]  Yujie Dong,et al.  A Device for Detecting and Counting Bites of Food Taken by a Person during Eating , 2009, IEEE International Conference on Bioinformatics and Biomedicine.

[14]  Evangelos Kalogerakis,et al.  RisQ: recognizing smoking gestures with inertial sensors on a wristband , 2014, MobiSys.

[15]  R. Wing,et al.  Stress-induced eating. , 1994, Psychological bulletin.

[16]  Yujie Dong,et al.  Detecting Periods of Eating During Free-Living by Tracking Wrist Motion , 2014, IEEE Journal of Biomedical and Health Informatics.

[17]  Edward Sazonov,et al.  A wearable sensor system for monitoring cigarette smoking. , 2013, Journal of studies on alcohol and drugs.

[18]  Nabil Alshurafa,et al.  Non-invasive monitoring of eating behavior using spectrogram analysis in a wearable necklace , 2014, 2014 IEEE Healthcare Innovation Conference (HIC).

[19]  J. Polivy,et al.  External cues in the control of food intake in humans: The sensory-normative distinction , 2008, Physiology & Behavior.

[20]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[21]  Paul Lukowicz,et al.  Analysis of Chewing Sounds for Dietary Monitoring , 2005, UbiComp.

[22]  Adam W. Hoover,et al.  A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion Tracking , 2012, Applied Psychophysiology and Biofeedback.