Alone or With Others? Understanding Eating Episodes of College Students with Mobile Sensing

Understanding food consumption patterns and contexts using mobile sensing is fundamental to build mobile health applications that require minimal user interaction to generate mobile food diaries. Many available mobile food diaries, both commercial and in research, heavily rely on self-reports, and this dependency limits the long term adoption of these apps by people. The social context of eating (alone, with friends, with family, with a partner, etc.) is an important self-reported feature that influences aspects such as food type, psychological state while eating, and the amount of food, according to prior research in nutrition and behavioral sciences. In this work, we use two datasets regarding the everyday eating behavior of college students in two countries, namely Switzerland (Nch=122) and Mexico (Nmx=84), to examine the relation between the social context of eating and passive sensing data from wearables and smartphones. Moreover, we design a classification task, namely inferring eating-alone vs. eating-with-others episodes using passive sensing data and time of eating, obtaining accuracies between 77% and 81%. We believe that this is a first step towards understanding more complex social contexts related to food consumption using mobile sensing.

[1]  Max Welling,et al.  The Variational Fair Autoencoder , 2015, ICLR.

[2]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[3]  Xuelong Li,et al.  Gait Components and Their Application to Gender Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  D. Chapelot,et al.  The role of snacking in energy balance: a biobehavioral approach. , 2011, The Journal of nutrition.

[5]  Carl A. Gunter,et al.  Privacy and Security in Mobile Health: A Research Agenda , 2016, Computer.

[6]  G. Loewenstein,et al.  Time and Decision: Economic and Psychological Perspectives of Intertemporal Choice , 2003 .

[7]  C. Nederkoorn,et al.  Happy eating. The underestimated role of overeating in a positive mood , 2013, Appetite.

[8]  Mobile Health and Fitness Apps: What Are the Privacy Risks? , 2017 .

[9]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[10]  Carolina Ruiz,et al.  SlipBuddy: A Mobile Health Intervention to Prevent Overeating , 2017, HICSS.

[11]  Sandra Rizk,et al.  Eating habits and obesity among Lebanese university students , 2008, Nutrition Journal.

[12]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[13]  Annie S. Anderson,et al.  Situational effects on meal intake: A comparison of eating alone and eating with others , 2006, Physiology & Behavior.

[14]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[15]  M. Bélanger,et al.  Relationship between eating behaviors and physical activity of preschoolers and their peers: a systematic review , 2016, International Journal of Behavioral Nutrition and Physical Activity.

[16]  Grant T. Harris,et al.  Comparing Effect Sizes in Follow-Up Studies: ROC Area, Cohen's d, and r , 2005, Law and human behavior.

[17]  Mirco Musolesi,et al.  Are you getting sick? Predicting influenza-like symptoms using human mobility behaviors , 2017, EPJ Data Science.

[18]  Vivek Kanhangad,et al.  Investigating gender recognition in smartphones using accelerometer and gyroscope sensor readings , 2016, 2016 International Conference on Computational Techniques in Information and Communication Technologies (ICCTICT).

[19]  R. van der Meer,et al.  Meat and cancer: haemoglobin and haemin in a low-calcium diet promote colorectal carcinogenesis at the aberrant crypt stage in rats. , 2003, Carcinogenesis.

[20]  Anna Timperio,et al.  Understanding meal patterns: definitions, methodology and impact on nutrient intake and diet quality , 2015, Nutrition Research Reviews.

[21]  Tae Kyun Kim,et al.  T test as a parametric statistic , 2015, Korean journal of anesthesiology.

[22]  Eugene Volokh,et al.  Personalization and privacy , 2000, CACM.

[23]  S. Goodman,et al.  Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations , 2016, European Journal of Epidemiology.

[24]  Dong Kyu Lee Alternatives to P value: confidence interval and effect size , 2016, Korean journal of anesthesiology.

[25]  Cecilia Mascolo,et al.  Passive mobile sensing and psychological traits for large scale mood prediction , 2019, PervasiveHealth.

[26]  W. Malorni,et al.  Gender-related differences in dietary habits , 2017 .

[27]  The psychology of overeating. , 2005 .

[28]  Samantha Kleinberg,et al.  Automated estimation of food type and amount consumed from body-worn audio and motion sensors , 2016, UbiComp.

[29]  Balachander Krishnamurthy,et al.  For sale : your data: by : you , 2011, HotNets-X.

[30]  D. Culibrk,et al.  Demographic Attributes Prediction on the Real-World Mobile Data , 2012 .

[31]  R. Heaney,et al.  Amount and type of protein influences bone health. , 2008, The American journal of clinical nutrition.

[32]  Vigneshwaran Subbaraju,et al.  Annapurna: An automated smartwatch-based eating detection and food journaling system , 2020, Pervasive Mob. Comput..

[33]  Mi Zhang,et al.  MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones , 2015, UbiComp.

[34]  R. Wurtman,et al.  Brain serotonin, carbohydrate-craving, obesity and depression. , 1995, Obesity research.

[35]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[36]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[37]  C. Minson,et al.  Sex and gender: what is the difference? , 2005, Journal of applied physiology.

[38]  Joseph Bonneau,et al.  The Privacy Jungle: On the Market for Data Protection in Social Networks , 2009, WEIS.

[39]  Rachel C. Shelton,et al.  The association between social factors and physical activity among low-income adults living in public housing. , 2011, American journal of public health.

[40]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[41]  Henner Gimpel,et al.  myStress: Unobtrusive Smartphone-Based Stress Detection , 2015, ECIS.

[42]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[43]  Yoav Goldberg,et al.  Adversarial Removal of Demographic Attributes from Text Data , 2018, EMNLP.

[44]  Claude Castelluccia,et al.  Selling Off Privacy at Auction , 2014, NDSS 2014.

[45]  Andrea Cavallaro,et al.  Mobile Sensor Data Anonymization , 2019 .

[46]  Mirco Musolesi,et al.  Interpretable Machine Learning for Privacy-Preserving Pervasive Systems , 2020, IEEE Pervasive Computing.

[47]  R. McNally,et al.  Film-induced sadness as a trigger for disinhibited eating. , 2000, The International journal of eating disorders.

[48]  R R Wing,et al.  Successful weight loss maintainers use health‐tracking smartphone applications more than a nationally representative sample: comparison of the National Weight Control Registry to Pew Tracking for Health , 2017, Obesity science & practice.

[49]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[50]  Larry L. Lesher,et al.  Food acceptability in field studies with US army men and women: relationship with food intake and food choice after repeated exposures , 2005, Appetite.

[51]  Andrea Cavallaro,et al.  Protecting Sensory Data against Sensitive Inferences , 2018, P2DS@EuroSys.

[52]  D. Schlundt,et al.  Impact of moods and social context on eating behavior , 2001, Appetite.

[53]  Jennifer Utter,et al.  The use of a wearable camera to capture and categorise the environmental and social context of self-identified eating episodes , 2015, Appetite.

[54]  T. Cruwys,et al.  Social modeling of eating: A review of when and why social influence affects food intake and choice , 2015, Appetite.

[55]  Tian Lan,et al.  Zooming into individuals to understand the collective: A review of trajectory-based travel behaviour studies , 2014 .

[56]  Ramnath K. Chellappa,et al.  Personalization versus Privacy: An Empirical Examination of the Online Consumer’s Dilemma , 2005, Inf. Technol. Manag..

[57]  Kadan Aljoumaa,et al.  Predicting customer’s gender and age depending on mobile phone data , 2019, Journal of Big Data.

[58]  Daniel Gatica-Perez,et al.  Protecting Mobile Food Diaries from Getting too Personal , 2020, MUM.

[59]  Ana Rodríguez Santamaría,et al.  Eating habits and attitudes and their relationship with Body Mass Index (BMI) , 2009 .

[60]  L. Ferguson,et al.  Meat and cancer. , 2010, Meat science.

[61]  Richard Kahn,et al.  Dietary Sugar and Body Weight: Have We Reached a Crisis in the Epidemic of Obesity and Diabetes? , 2014, Diabetes Care.

[62]  Archan Misra,et al.  BuScope: Fusing Individual & Aggregated Mobility Behavior for "Live" Smart City Services , 2019, MobiSys.

[63]  Robin I. M. Dunbar Breaking Bread: the Functions of Social Eating , 2017, Adaptive Human Behavior and Physiology.

[64]  Denzil Ferreira,et al.  Detecting Drinking Episodes in Young Adults Using Smartphone-based Sensors , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[65]  Archan Misra,et al.  PokeME: Applying Context-Driven Notifications to Increase Worker Engagement in Mobile Crowd-sourcing , 2020, CHIIR.

[66]  Zhe Zhao,et al.  Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations , 2017, ArXiv.

[67]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[68]  F. Bellisle,et al.  Meals and snacking, diet quality and energy balance , 2014, Physiology & Behavior.

[69]  Yun Fu,et al.  Gender recognition from body , 2008, ACM Multimedia.

[70]  L. Zepeda,et al.  Think before you eat: photographic food diaries as intervention tools to change dietary decision making and attitudes , 2008 .

[71]  永山 貞則,et al.  文化芸術と Gender Statistics , 1998 .

[72]  Helen Bromley,et al.  Sugar-sweetened beverages coverage in the British media: an analysis of public health advocacy versus pro-industry messaging , 2016, BMJ Open.

[73]  Nasir D. Memon,et al.  Kid on The Phone! Toward Automatic Detection of Children on Mobile Devices , 2018, Comput. Secur..

[74]  Luca Foschini,et al.  Adherent Use of Digital Health Trackers Is Associated with Weight Loss , 2016, PloS one.

[75]  J. Bernhardt,et al.  Behavioral Functionality of Mobile Apps in Health Interventions: A Systematic Review of the Literature , 2015, JMIR mHealth and uHealth.

[76]  Vaclav Smil,et al.  Eating meat: Constants and changes ☆ , 2014 .

[77]  Steven C. H. Hoi,et al.  FoodAI: Food Image Recognition via Deep Learning for Smart Food Logging , 2019, KDD.

[78]  Daniel Gatica-Perez,et al.  DrinkSense: Characterizing Youth Drinking Behavior Using Smartphones , 2018, IEEE Transactions on Mobile Computing.

[79]  Ramesh C. Jain,et al.  A Survey on Food Computing , 2018, ACM Comput. Surv..

[80]  Dirk Heylen,et al.  Sensory Interactive Table (SIT)—Development of a Measurement Instrument to Support Healthy Eating in a Social Dining Setting , 2020, Sensors.

[81]  Yang Wang,et al.  Personalization and privacy: a survey of privacy risks and remedies in personalization-based systems , 2012, User Modeling and User-Adapted Interaction.

[82]  Courtney C Simpson,et al.  Calorie counting and fitness tracking technology: Associations with eating disorder symptomatology. , 2017, Eating behaviors.

[83]  Paul Johns,et al.  Food and Mood: Just-in-Time Support for Emotional Eating , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[84]  Yan Li,et al.  Models of Individual Dietary Behavior Based on Smartphone Data: The Influence of Routine, Physical Activity, Emotion, and Food Environment , 2016, PloS one.

[85]  Wouter Joosen,et al.  A Systematic Comparison of Age and Gender Prediction on IMU Sensor-Based Gait Traces , 2019, Sensors.

[86]  C. Devine,et al.  Dimensions of everyday eating and drinking episodes , 2007, Appetite.

[87]  Koji Yatani,et al.  Effect Sizes and Power Analysis in HCI , 2016 .

[88]  H. Bruch PSYCHOLOGICAL ASPECTS OF OVEREATING AND OBESITY. , 1964, Psychosomatics.

[89]  Gregory D. Abowd,et al.  Feasibility of identifying eating moments from first-person images leveraging human computation , 2013, SenseCam '13.

[90]  Joanne L Slavin,et al.  What Is a Snack, Why Do We Snack, and How Can We Choose Better Snacks? A Review of the Definitions of Snacking, Motivations to Snack, Contributions to Dietary Intake, and Recommendations for Improvement. , 2016, Advances in nutrition.

[91]  Qiang Yang,et al.  User demographics prediction based on mobile data , 2013, Pervasive Mob. Comput..

[92]  K. Sahoo,et al.  Childhood obesity: causes and consequences , 2015, Journal of family medicine and primary care.

[93]  Daniël Lakens,et al.  Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs , 2013, Front. Psychol..

[94]  Mohammad Malekzadeh,et al.  Replacement AutoEncoder: A Privacy-Preserving Algorithm for Sensory Data Analysis , 2017, 2018 IEEE/ACM Third International Conference on Internet-of-Things Design and Implementation (IoTDI).

[95]  Kathryn M. Ross,et al.  Impact of newer self‐monitoring technology and brief phone‐based intervention on weight loss: A randomized pilot study , 2016, Obesity.

[96]  Andrew T. Campbell,et al.  Bewell: A smartphone application to monitor, model and promote wellbeing , 2011, PervasiveHealth 2011.

[97]  Archan Misra,et al.  Inferring Accurate Bus Trajectories from Noisy Estimated Arrival Time Records , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[98]  A. Hill,et al.  Negative mood-induced overeating in obese binge eaters: an experimental study , 2004, International Journal of Obesity.

[99]  Andrew T. Campbell,et al.  BeWell+: multi-dimensional wellbeing monitoring with community-guided user feedback and energy optimization , 2012, Wireless Health.

[100]  Daniel Gatica-Perez,et al.  Discovering eating routines in context with a smartphone app , 2019, UbiComp/ISWC Adjunct.

[101]  Matthew Kay,et al.  Cognitive rhythms: unobtrusive and continuous sensing of alertness using a mobile phone , 2016, UbiComp.

[102]  A. Warde,et al.  Eating together and eating alone: meal arrangements in British households. , 2017, The British journal of sociology.

[103]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[104]  J. Pennebaker,et al.  Are Mexicans more or less sociable than Americans? Insights from a naturalistic observation study , 2009 .

[105]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.

[106]  J. Polivy,et al.  Social Influences on Eating , 2019 .