Detecting Eating Episodes by Tracking Jawbone Movements with a Non-Contact Wearable Sensor

Eating is one of the most fundamental human activities, and because of the important role it plays in our lives, it has been extensively studied. However, an objective and usable method for dietary intake tracking remains unrealized despite numerous efforts by researchers over the last decade. In this work, we present a new wearable computing approach for detecting eating episodes. Using a novel multimodal sensing strategy combining accelerometer and range sensing, the approach centers on a discreet and lightweight instrumented necklace that captures head and jawbone movements without direct contact with the skin. An evaluation of the system with 32 participants comprised of three phases resulted in eating episodes detected with 95.2% precision and 81.9% recall in controlled studies and 78.2% precision and 72.5% recall in the free-living study. This research add technical contributions to the fields of wearable computing, human activity recognition, and mobile health.

[1]  Mingui Sun,et al.  3D localization of circular feature in 2D image and application to food volume estimation , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[3]  Wai-Nang Paul Lee,et al.  Nutrient-gene interaction: metabolic genotype-phenotype relationship. , 2005, The Journal of nutrition.

[4]  Zhi-Hong Mao,et al.  Automatic eating detection using a proximity sensor , 2014, 2014 40th Annual Northeast Bioengineering Conference (NEBEC).

[5]  Yujie Dong,et al.  Detecting Periods of Eating During Free-Living by Tracking Wrist Motion , 2014, IEEE Journal of Biomedical and Health Informatics.

[6]  S. Bingham,et al.  The dietary assessment of individual: methods, accuracy, new techniques and recommendations , 1987 .

[7]  Gerhard Tröster,et al.  Recognition of dietary activity events using on-body sensors , 2008, Artif. Intell. Medicine.

[8]  K. Michels,et al.  A renaissance for measurement error. , 2001, International journal of epidemiology.

[9]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[10]  Mingui Sun,et al.  Model-based measurement of food portion size for image-based dietary assessment using 3D/2D registration , 2013, Measurement science & technology.

[11]  S B Heymsfield,et al.  Energy balance measurement: when something is not better than nothing , 2014, International Journal of Obesity.

[12]  Wolf-Joachim Fischer,et al.  Food intake monitoring: an acoustical approach to automated food intake activity detection and classification of consumed food , 2012, Physiological measurement.

[13]  Edward Sazonov,et al.  Comparative testing of piezoelectric and printed strain sensors in characterization of chewing , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  D. Wiehl,et al.  Development of new or improved dietary methods for epidemiological investigations. , 1960, American journal of public health and the nation's health.

[15]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[16]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[17]  David R. Jacobs,et al.  Challenges in Research in Nutritional Epidemiology , 2012 .

[18]  E. Widdowson,et al.  A Study Of English Diets By The Individual Method: Part I. Men , 1936, Journal of Hygiene.

[19]  Majid Sarrafzadeh,et al.  A Wearable Nutrition Monitoring System , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[20]  E Stellar,et al.  Chews and swallows and the microstructure of eating. , 1985, The American journal of clinical nutrition.

[21]  Wendy Nilsen,et al.  Dynamic Models of Behavior for Just-in-Time Adaptive Interventions , 2014, IEEE Pervasive Computing.

[22]  Yujie Dong,et al.  Tracking wrist motion to detect and measure the eating intake of free-living humans , 2012 .

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Norbert Wehn,et al.  Activity recognition and nutrition monitoring in every day situations with a textile capacitive neckband , 2013, UbiComp.

[25]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[26]  Gregory D. Abowd,et al.  Inferring Meal Eating Activities in Real World Settings from Ambient Sounds: A Feasibility Study , 2015, IUI.

[27]  Peter Widhalm,et al.  Transport mode detection with realistic Smartphone sensor data , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[28]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[29]  Thad Starner,et al.  A wearable system for detecting eating activities with proximity sensors in the outer ear , 2015, SEMWEB.

[30]  Edward Sazonov,et al.  Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior. , 2008, Physiological measurement.

[31]  Edward Sazonov,et al.  A novel approach for food intake detection using electroglottography , 2014, Physiological measurement.

[32]  D. Wiehl Diets of a group of aircraft workers in Southern California. , 1942 .

[33]  A. Safari,et al.  Piezoelectric and Acoustic Materials for Transducer Applications , 2008 .

[34]  Paul Lukowicz,et al.  Active Capacitive Sensing: Exploring a New Wearable Sensing Modality for Activity Recognition , 2010, Pervasive.

[35]  Paul Johns,et al.  Predicting "About-to-Eat" Moments for Just-in-Time Eating Intervention , 2016, Digital Health.

[36]  G. Siegmund [Sleep and wakefulness]. , 1972, Krankenpflege.

[37]  Min Zheng,et al.  Multimodality sensing for eating recognition , 2016, PervasiveHealth.

[38]  D. Turner The Estimation of the Patient’s Home Dietary Intake1 , 1940, Journal of the American Dietetic Association.

[39]  N. Lifson,et al.  Theory of use of the turnover rates of body water for measuring energy and material balance. , 1966, Journal of theoretical biology.

[40]  Sasu Tarkoma,et al.  Accelerometer-based transportation mode detection on smartphones , 2013, SenSys '13.

[41]  D. Schoeller Limitations in the assessment of dietary energy intake by self-report. , 1995, Metabolism: clinical and experimental.

[42]  M. Gail,et al.  Efficacy and Tolerability of Long-Acting Injectable Naltrexone for Alcohol Dependence: A Randomized Controlled Trial , 2005, Gynecologic oncology.

[43]  Maysam Ghovanloo,et al.  Real-time swallowing detection based on tracheal acoustics , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  L M Gallo,et al.  Time-Frequency Analysis of Chewing Activity in the Natural Environment , 2011, Journal of dental research.

[45]  Jindong Liu,et al.  An Intelligent Food-Intake Monitoring System Using Wearable Sensors , 2012, 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks.

[46]  Edward Sazonov,et al.  Detection of chewing from piezoelectric film sensor signals using ensemble classifiers , 2016, EMBC.

[47]  Yiran Chen,et al.  eButton: A wearable computer for health monitoring and personal assistance , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).

[48]  S. Blair,et al.  Validity of U.S. Nutritional Surveillance: National Health and Nutrition Examination Survey Caloric Energy Intake Data, 1971–2010 , 2013, PloS one.

[49]  Edward Sazonov,et al.  A Novel Wearable Device for Food Intake and Physical Activity Recognition , 2016, Sensors.