Towards a generalizable method for detecting fluid intake with wrist-mounted sensors and adaptive segmentation

Over the last decade, advances in mobile technologies have enabled the development of intelligent systems that attempt to recognize and model a variety of health-related human behaviors. While automated dietary monitoring based on passive sensors has been an area of increasing research activity for many years, much less attention has been given to tracking fluid intake. In this work, we apply an adaptive segmentation technique on a continuous stream of inertial data captured with a practical, off-the-shelf wrist-mounted device to detect fluid intake gestures passively. We evaluated our approach in a study with 30 participants where 561 drinking instances were recorded. Using a leave-one-participant-out (LOPO), we were able to detect drinking episodes with 90.3% precision and 91.0% recall, demonstrating the generalizability of our approach. In addition to our proposed method, we also contribute an anonymized and labeled dataset of drinking and non-drinking gestures to encourage further work in the field.

[1]  Zyad Shaaban,et al.  Data Mining: A Preprocessing Engine , 2006 .

[2]  J. C. Chidester,et al.  Fluid intake in the institutionalized elderly. , 1997, Journal of the American Dietetic Association.

[3]  Majid Sarrafzadeh,et al.  A Wearable Nutrition Monitoring System , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[4]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[5]  A. Kendon Gesture: Visible Action as Utterance , 2004 .

[6]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[7]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[8]  J. Lieske,et al.  Treatment effect, adherence, and safety of high fluid intake for the prevention of incident and recurrent kidney stones: a systematic review and meta-analysis , 2016, Journal of Nephrology.

[9]  Yoong Choon Chang,et al.  Vision-based hand grasping posture recognition in drinking activity , 2014, 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[10]  Paul Lukowicz,et al.  Towards wearable sensing-based assessment of fluid intake , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[11]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[12]  H. Hashim,et al.  Management of fluid intake in patients with overactive bladder , 2009, Current urology reports.

[13]  L. Appel Dietary Reference Intakes for Water , Potassium , Sodium , Chloride , and Sulfate 1 RESEARCH RECOMMENDATIONS AND OTHER ISSUES , 2008 .

[14]  G. Luscombe,et al.  Fluid Intake in patients with eating disorders. , 2005, The International journal of eating disorders.

[15]  D. Marcelli,et al.  The mortality risk of overhydration in haemodialysis patients , 2009, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[16]  Christos Mousas,et al.  Analyzing and Segmenting Finger Gestures in Meaningful Phases , 2014, 2014 11th International Conference on Computer Graphics, Imaging and Visualization.

[17]  Daniel Borrajo,et al.  A dynamic sliding window approach for activity recognition , 2011, UMAP'11.

[18]  M N Sawka,et al.  Dietary Reference Intakes for Water, Potassium, Sodium, Chloride, and Sulfate. Chapter 4 - Water , 2005 .

[19]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[20]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[21]  Bernt Schiele,et al.  Scalable Recognition of Daily Activities with Wearable Sensors , 2007, LoCA.

[22]  Denzil Ferreira,et al.  Detecting Drinking Episodes in Young Adults Using Smartphone-based Sensors , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[23]  Edison Thomaz,et al.  Detecting Eating Episodes by Tracking Jawbone Movements with a Non-Contact Wearable Sensor , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[24]  A. Azzouz 2011 , 2020, City.

[25]  A. Strömberg,et al.  Description of self-reported fluid intake and its effects on body weight, symptoms, quality of life and physical capacity in patients with stable chronic heart failure. , 2008, Journal of clinical nursing.

[26]  Christos Mousas,et al.  Full-Body Locomotion Reconstruction of Virtual Characters Using a Single Inertial Measurement Unit , 2017, Sensors.

[27]  Wang Yi,et al.  AutoDietary: A Wearable Acoustic Sensor System for Food Intake Recognition in Daily Life , 2016, IEEE Sensors Journal.