A smartphone application for semi-controlled collection of objective eating behavior data from multiple subjects

BACKGROUND & OBJECTIVE The study of eating behavior has made significant progress towards understanding the association of specific eating behavioral patterns with medical problems, such as obesity and eating disorders. Smartphones have shown promise in monitoring and modifying unhealthy eating behavior patterns, often with the help of sensors for behavior data recording. However, when it comes to semi-controlled deployment settings, smartphone apps that facilitate eating behavior data collection are missing. To fill this gap, the present work introduces ASApp, one of the first smartphone apps to support researchers in the collection of heterogeneous objective (sensor-acquired) and subjective (self-reported) eating behavior data in an integrated manner from large-scale, naturalistic human subject research (HSR) studies. METHODS This work presents the overarching and deployment-specific requirements that have driven the design of ASApp, followed by the heterogeneous eating behavior dataset that is collected and the employed data collection protocol. The collected dataset combines objective and subjective behavior information, namely (a) dietary self-assessment information, (b) the food weight timeseries throughout an entire meal (using a portable weight scale connected wirelessly), (c) a photograph of the meal, and (d) a series of quantitative eating behavior indicators, mainly calculated from the food weight timeseries. The designed data collection protocol is quick, straightforward, robust and capable of satisfying the requirement of semi-controlled HSR deployment. RESULTS The implemented functionalities of ASApp for research assistants and study participants are presented in detail along with the corresponding user interfaces. ASApp has been successfully deployed for data collection in an in-house testing study and the SPLENDID study, i.e., a real-life semi-controlled HSR study conducted in the cafeteria of a Swedish high-school in the context of an EC-funded research project. The two deployment studies are described and the promising results from the evaluation of the app with respect to attractiveness, usability, and technical soundness are discussed. Access details for ASApp are also provided. CONCLUSIONS This work presents the requirement elucidation, design, implementation and evaluation of a novel smartphone application that supports researchers in the integrated collection of a concise yet rich set of heterogeneous eating behavior data for semi-controlled HSR.

[1]  D. Schoeller,et al.  Inaccuracies in self-reported intake identified by comparison with the doubly labelled water method. , 1990, Canadian journal of physiology and pharmacology.

[2]  Ioannis Ioakimidis,et al.  Description of chewing and food intake over the course of a meal , 2011, Physiology & Behavior.

[3]  Jacki Liddle,et al.  Mobile Phones in Research and Treatment: Ethical Guidelines and Future Directions , 2015, JMIR mHealth and uHealth.

[4]  Anouk Middelweerd,et al.  Physical Activity, Sedentary Behavior, and Diet-Related eHealth and mHealth Research: Bibliometric Analysis , 2018, Journal of medical Internet research.

[5]  H. Moergeli,et al.  How much should I eat? Estimation of meal portions in anorexia nervosa , 2013, Appetite.

[6]  Per Södersten,et al.  Treatment of childhood obesity by retraining eating behaviour: randomised controlled trial , 2009, BMJ : British Medical Journal.

[7]  A Pietrobelli,et al.  What is the best measure of adiposity change in growing children: BMI, BMI %, BMI z-score or BMI centile? , 2005, European Journal of Clinical Nutrition.

[8]  Yan Li,et al.  Models of Individual Dietary Behavior Based on Smartphone Data: The Influence of Routine, Physical Activity, Emotion, and Food Environment , 2016, PloS one.

[9]  Corby K. Martin,et al.  Measuring food intake with digital photography. , 2014, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[10]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[11]  John Torous,et al.  New Tools for New Research in Psychiatry: A Scalable and Customizable Platform to Empower Data Driven Smartphone Research , 2016, JMIR mental health.

[12]  Ioannis Ioakimidis,et al.  The Effect of Food Unit Sizes and Meal Serving Occasions on Eating Behaviour Characteristics: Within Person Randomised Crossover Studies on Healthy Women , 2018, Nutrients.

[13]  P. Södersten,et al.  How eating affects mood , 2011, Physiology & Behavior.

[14]  Christos Diou,et al.  Control of Eating Behavior Using a Novel Feedback System , 2018, Journal of visualized experiments : JoVE.

[15]  M. Carter,et al.  Adherence to a Smartphone Application for Weight Loss Compared to Website and Paper Diary: Pilot Randomized Controlled Trial , 2013, Journal of medical Internet research.

[16]  K. Chapman-Novakofski,et al.  Results of the Clinician Apps Survey, How Clinicians Working With Patients With Diabetes and Obesity Use Mobile Health Apps , 2018, Journal of nutrition education and behavior.

[17]  David S. Ebert,et al.  The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[18]  E Stellar,et al.  Chews and swallows and the microstructure of eating. , 1985, The American journal of clinical nutrition.

[19]  H. Eyles,et al.  “Smart” RCTs: Development of a Smartphone App for Fully Automated Nutrition-Labeling Intervention Trials , 2016, JMIR mHealth and uHealth.

[20]  Christos Diou,et al.  Automatic Analysis of Food Intake and Meal Microstructure Based on Continuous Weight Measurements , 2019, IEEE Journal of Biomedical and Health Informatics.

[21]  Paul Oosterveld,et al.  The children's DEBQ for assessment of restrained, emotional, and external eating in 7- to 12-year-old children. , 2008, The International journal of eating disorders.

[22]  Behnoosh Hariri,et al.  A personal assistive system for nutrient intake monitoring , 2011, Ubi-MUI '11.

[23]  Atta Abbas,et al.  DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS, FIFTH EDITION , 2013 .

[24]  B. Timothy Walsh,et al.  The importance of eating behavior in eating disorders , 2011, Physiology & Behavior.

[25]  P. Kopelman Obesity as a medical problem , 2000, Nature.

[26]  J. Rodin,et al.  Human Eating Behavior: a Critical Review of Studies in Normal Weight and Overweight Individuals , 1981, Appetite.

[27]  Daniel Gatica-Perez,et al.  Bites‘n’Bits , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[28]  G. Borg Psychophysical bases of perceived exertion. , 1982, Medicine and science in sports and exercise.

[29]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[30]  A. Giboreau,et al.  Studying natural meals: What are the benefits of the living lab approach? , 2019, Context.

[31]  Christos Diou,et al.  Objective measures of eating behaviour in a Swedish high school , 2017, Behav. Inf. Technol..

[32]  Reinhold G. Laessle,et al.  Laboratory eating behavior in obesity , 2007, Appetite.

[33]  Jesse Dallery,et al.  A New Frontier: Integrating Behavioral and Digital Technology to Promote Health Behavior , 2014, The Behavior Analyst.

[34]  C. Fairburn,et al.  Apps and eating disorders: A systematic clinical appraisal , 2015, The International journal of eating disorders.

[35]  Per Södersten,et al.  A new treatment of anorexia nervosa , 1996, The Lancet.

[36]  Fanglin Chen,et al.  My smartphone knows i am hungry , 2014, WPA@MobiSys.

[37]  Adam W. Hoover,et al.  Examining the utility of a bite-count-based measure of eating activity in free-living human beings. , 2014, Journal of the Academy of Nutrition and Dietetics.

[38]  K. Flegal,et al.  Prevalence of childhood and adult obesity in the United States, 2011-2012. , 2014, JAMA.

[39]  Nicos Maglaveras,et al.  Preventing obesity and eating disorders through behavioural modifications: the SPLENDID vision , 2014, Appetite.

[40]  Tom Baranowski,et al.  Need for technological innovation in dietary assessment. , 2010, Journal of the American Dietetic Association.

[41]  P. Södersten,et al.  Children eat their school lunch too quickly: an exploratory study of the effect on food intake , 2012, BMC Public Health.

[42]  J. Thompson Body image, eating disorders, and obesity : an integrative guide for assessment and treatment , 2001 .

[43]  A. Geelen,et al.  Self-reported eating rate is associated with weight status in a Dutch population: a validation study and a cross-sectional study , 2017, International Journal of Behavioral Nutrition and Physical Activity.

[44]  Ioannis Ioakimidis,et al.  Food Intake during School Lunch Is Better Explained by Objectively Measured Eating Behaviors than by Subjectively Rated Food Taste and Fullness: A Cross-Sectional Study , 2019, Nutrients.

[45]  Stephanie P Goldstein,et al.  Review of smartphone applications for the treatment of eating disorders. , 2015, European eating disorders review : the journal of the Eating Disorders Association.

[46]  Vigneshwaran Subbaraju,et al.  Annapurna: Building a Real-World Smartwatch-Based Automated Food Journal , 2018, 2018 IEEE 19th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[47]  Elina Helander,et al.  The use of crowdsourcing for dietary self-monitoring: crowdsourced ratings of food pictures are comparable to ratings by trained observers , 2015, J. Am. Medical Informatics Assoc..

[48]  P. Södersten,et al.  Obesity and the brain. , 2011, Medical hypotheses.

[49]  Geraldine Naughton,et al.  Smartphone Interventions for Weight Treatment and Behavioral Change in Pediatric Obesity: A Systematic Review. , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[50]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[51]  S. Panda,et al.  A Smartphone App Reveals Erratic Diurnal Eating Patterns in Humans that Can Be Modulated for Health Benefits. , 2015, Cell metabolism.

[52]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[53]  Gregory D. Abowd,et al.  Feasibility of identifying eating moments from first-person images leveraging human computation , 2013, SenseCam '13.

[54]  N. Steinle,et al.  Genetics of eating behavior: established and emerging concepts. , 2011, Nutrition reviews.

[55]  K. Brownell,et al.  Obesity and body image. , 2004, Body image.

[56]  Edward Sazonov,et al.  Automatic Ingestion Monitor: A Novel Wearable Device for Monitoring of Ingestive Behavior , 2014, IEEE Transactions on Biomedical Engineering.

[57]  M. Reid,et al.  Understanding the experience of ambivalence in anorexia nervosa: the maintainer's perspective , 2010, Psychology & health.

[58]  Nicos Maglaveras,et al.  Memorandum: A Mobile App for Efficient Note Keeping in Concurrent Multi-participant Human Subject Studies , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[59]  Ioanna Chouvarda,et al.  Introducing a framework for reporting Behavioral Informatics interventions , 2017, 2017 14th International Conference on Telecommunications (ConTEL).

[60]  D Colella,et al.  Physical self‐perception and motor performance in normal‐weight, overweight and obese children , 2011, Scandinavian journal of medicine & science in sports.

[61]  C. Maramis,et al.  Predicting Real-Life Eating Behaviours Using Single School Lunches in Adolescents , 2019, Nutrients.

[62]  C. Graaf 7 – Sensory responses, food intake and obesity , 2005 .

[63]  P. Södersten,et al.  Homeostasis in anorexia nervosa , 2014, Front. Neurosci..

[64]  Wang Yi,et al.  AutoDietary: A Wearable Acoustic Sensor System for Food Intake Recognition in Daily Life , 2016, IEEE Sensors Journal.

[65]  Per Södersten,et al.  Effective treatment of eating disorders: Results at multiple sites. , 2013, Behavioral neuroscience.

[66]  Ioannis Ioakimidis,et al.  A method for the control of eating rate: A potential intervention in eating disorders , 2009, Behavior research methods.

[67]  A. Mitchell,et al.  Mortality rates in patients with anorexia nervosa and other eating disorders. A meta-analysis of 36 studies. , 2011, Archives of general psychiatry.