Retrieval and Timing Performance of Chewing-Based Eating Event Detection in Wearable Sensors

We present an eating detection algorithm for wearable sensors based on first detecting chewing cycles and subsequently estimating eating phases. We term the corresponding algorithm class as a bottom-up approach. We evaluated the algorithm using electromyographic (EMG) recordings from diet-monitoring eyeglasses in free-living and compared the bottom-up approach against two top-down algorithms. We show that the F1 score was no longer the primary relevant evaluation metric when retrieval rates exceeded approx. 90%. Instead, detection timing errors provided more important insight into detection performance. In 122 hours of free-living EMG data from 10 participants, a total of 44 eating occasions were detected, with a maximum F1 score of 99.2%. Average detection timing errors of the bottom-up algorithm were 2.4 ± 0.4 s and 4.3 ± 0.4 s for the start and end of eating occasions, respectively. Our bottom-up algorithm has the potential to work with different wearable sensors that provide chewing cycle data. We suggest that the research community report timing errors (e.g., using the metrics described in this work).

[1]  Christos Diou,et al.  A Novel Chewing Detection System Based on PPG, Audio, and Accelerometry , 2017, IEEE Journal of Biomedical and Health Informatics.

[2]  Oliver Amft,et al.  WISEglass: multi-purpose context-aware smart eyeglasses , 2015, SEMWEB.

[3]  Thad Starner,et al.  A wearable system for detecting eating activities with proximity sensors in the outer ear , 2015, SEMWEB.

[4]  Min Zheng,et al.  Multimodality sensing for eating recognition , 2016, PervasiveHealth.

[5]  Oliver Amft,et al.  Free-living eating event spotting using EMG-monitoring eyeglasses , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[6]  Oliver Amft,et al.  Monitoring Chewing and Eating in Free-Living Using Smart Eyeglasses , 2018, IEEE Journal of Biomedical and Health Informatics.

[7]  Jungmin Chung,et al.  A glasses-type wearable device for monitoring the patterns of food intake and facial activity , 2017, Scientific Reports.

[8]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[9]  Edward Sazonov,et al.  Accelerometer-Based Detection of Food Intake in Free-Living Individuals , 2018, IEEE Sensors Journal.

[10]  Gerhard Tröster,et al.  Detection of eating and drinking arm gestures using inertial body-worn sensors , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[11]  Yujie Dong,et al.  Detecting Periods of Eating During Free-Living by Tracking Wrist Motion , 2014, IEEE Journal of Biomedical and Health Informatics.

[12]  L M Gallo,et al.  Time-Frequency Analysis of Chewing Activity in the Natural Environment , 2011, Journal of dental research.

[13]  Oliver Amft,et al.  Diet eyeglasses: Recognising food chewing using EMG and smart eyeglasses , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[14]  Paul Lukowicz,et al.  Analysis of Chewing Sounds for Dietary Monitoring , 2005, UbiComp.

[15]  J. Higgins,et al.  Meal Microstructure Characterization from Sensor-Based Food Intake Detection , 2017, Front. Nutr..

[16]  Tao Wang,et al.  Toward a Wearable Sensor for Eating Detection , 2017, WearSys@MobiSys.

[17]  H W van der Glas,et al.  Detection of onset and termination of muscle activity in surface electromyograms. , 1998, Journal of oral rehabilitation.

[18]  Oliver Amft,et al.  A wearable earpad sensor for chewing monitoring , 2010, 2010 IEEE Sensors.

[19]  Oliver Amft,et al.  Personalizing 3D-Printed Smart Eyeglasses to Augment Daily Life , 2017, Computer.

[20]  Edward Sazonov,et al.  A Novel Wearable Device for Food Intake and Physical Activity Recognition , 2016, Sensors.

[21]  Oliver Amft,et al.  Automatic Dietary Monitoring Using Wearable Accessories , 2018 .

[22]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..