Smartphone Sensing for the Well-Being of Young Adults: A Review

Over the years, mobile phones have become versatile devices with a multitude of capabilities due to the plethora of embedded sensors that enable them to capture rich data unobtrusively. In a world where people are more conscious regarding their health and well-being, the pervasiveness of smartphones has enabled researchers to build apps that assist people to live healthier lifestyles, and to diagnose and monitor various health conditions. Motivated by the high smartphone coverage among young adults and the unique issues they face, in this review paper, we focus on studies that have used smartphone sensing for the well-being of young adults. We analyze existing work in the domain from two perspectives, namely Data Perspective and System Perspective. For both these perspectives, we propose taxonomies motivated from human science literature, which enable to identify important study areas. Furthermore, we emphasize the importance of diversity-awareness in smartphone sensing, and provide insights and future directions for researchers in ubiquitous and mobile computing, and especially to new researchers who want to understand the basics of smartphone sensing research targeting the well-being of young adults.

[1]  Shayan Mirjafari,et al.  Predicting Brain Functional Connectivity Using Mobile Sensing , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  Piet Kommers,et al.  Modeling habitual and addictive smartphone behavior: The role of smartphone usage types, emotional intelligence, social stress, self-regulation, age, and gender , 2015, Comput. Hum. Behav..

[3]  S. Michie,et al.  A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy , 2011, Psychology & health.

[4]  José Luís Oliveira,et al.  Passive Sensing of Health Outcomes Through Smartphones: Systematic Review of Current Solutions and Possible Limitations , 2019, JMIR mHealth and uHealth.

[5]  tim boone,et al.  SOCIAL LEARNING THEORY Albert Bandura Englewood Cliffs, N.J.: Prentice-Hall, 1977. 247 pp., paperbound , 1977 .

[6]  Laura Ferrari,et al.  Urban Sensing Using Mobile Phone Network Data: A Survey of Research , 2014, ACM Comput. Surv..

[7]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.

[8]  Daniel Gatica-Perez,et al.  Smartphone usage in the wild: a large-scale analysis of applications and context , 2011, ICMI '11.

[9]  Andrew T. Campbell,et al.  BeWell+: multi-dimensional wellbeing monitoring with community-guided user feedback and energy optimization , 2012, Wireless Health.

[10]  Cecilia Mascolo,et al.  Mobile Sensing at the Service of Mental Well-being: a Large-scale Longitudinal Study , 2017, WWW.

[11]  Indika Perera,et al.  Cognitive Analysis of 360 degree Surround Photos , 2019, ArXiv.

[12]  Netzahualcóyotl Hernández,et al.  Literature Review on Transfer Learning for Human Activity Recognition Using Mobile and Wearable Devices with Environmental Technology , 2020, SN Computer Science.

[13]  Hassan Ghasemzadeh,et al.  Transfer Learning for Activity Recognition in Mobile Health , 2020, ArXiv.

[14]  Cecilia Mascolo,et al.  Putting mood in context: Using smartphones to examine how people feel in different locations , 2017 .

[15]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[16]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[17]  A. Miura,et al.  Generativity and Interaction Between the Old and Young: The Role of Perceived Respect and Perceived Rejection. , 2015, The Gerontologist.

[18]  Alex Pentland,et al.  Using Social Sensing to Understand the Links between Sleep, Mood, and Sociability , 2011, 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing.

[19]  Raja Ariffin Raja Ghazilla,et al.  Reviews on Various Inertial Measurement Unit (IMU) Sensor Applications , 2013, SiPS 2013.

[20]  Daniel Gatica-Perez,et al.  #Drink Or #Drunk: Multimodal Signals and Drinking Practices on Instagram , 2019, PervasiveHealth.

[21]  A. Jemal,et al.  Emerging cancer trends among young adults in the USA: analysis of a population-based cancer registry. , 2019, The Lancet. Public health.

[22]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[23]  K D'MelloSidney,et al.  Prediction of Mood Instability with Passive Sensing , 2019 .

[24]  Guanling Chen,et al.  A Survey of Context-Aware Mobile Computing Research , 2000 .

[25]  Salil S. Kanhere,et al.  A survey on privacy in mobile participatory sensing applications , 2011, J. Syst. Softw..

[26]  Indika Perera,et al.  Enhanced in-store shopping experience through smart phone based mixed reality application , 2017, 2017 Seventeenth International Conference on Advances in ICT for Emerging Regions (ICTer).

[27]  R. Whittaker,et al.  Mobile phone-based interventions for smoking cessation , 2010, The Cochrane database of systematic reviews.

[28]  Tanzeem Choudhury,et al.  Towards circadian computing: "early to bed and early to rise" makes some of us unhealthy and sleep deprived , 2014, UbiComp.

[29]  Yunbin Deng,et al.  Deep learning on mobile devices: a review , 2019, Defense + Commercial Sensing.

[30]  Archan Misra,et al.  BuScope: Fusing Individual & Aggregated Mobility Behavior for "Live" Smart City Services , 2019, MobiSys.

[31]  Andreas Pitsillides,et al.  Mobile Phone Computing and the Internet of Things: A Survey , 2016, IEEE Internet of Things Journal.

[32]  K. Lewin Action Research and Minority Problems , 1946 .

[33]  M. Weissman Cross-National Epidemiology of Obsessive-Compulsive Disorder , 1998, CNS Spectrums.

[34]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[35]  N. Lane,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys '13.

[36]  Jon D. Elhai,et al.  Non-social features of smartphone use are most related to depression, anxiety and problematic smartphone use , 2017, Comput. Hum. Behav..

[37]  Gregory D. Abowd,et al.  Prediction of Mood Instability with Passive Sensing , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[38]  Daniel Gatica-Perez,et al.  DrinkSense: Characterizing Youth Drinking Behavior Using Smartphones , 2018, IEEE Transactions on Mobile Computing.

[39]  Yu Huang,et al.  Assessing social anxiety using gps trajectories and point-of-interest data , 2016, UbiComp.

[40]  Matthew Kay,et al.  Cognitive rhythms: unobtrusive and continuous sensing of alertness using a mobile phone , 2016, UbiComp.

[41]  Yunhao Liu,et al.  Incentives for Mobile Crowd Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[42]  L. Otto-Salaj,et al.  Participant recruitment in intervention research: scientific integrity and cost‐effective strategies , 2009 .

[43]  P. Bentler,et al.  Impact of adolescent drug use and social support on problems of young adults: a longitudinal study. , 1988, Journal of abnormal psychology.

[44]  Daniel Gatica-Perez,et al.  Protecting Mobile Food Diaries from Getting too Personal , 2020, MUM.

[45]  Helen R. Beiser,et al.  Meeting at the Crossroads: Women's Psychology and Girls' Development , 1993 .

[46]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[47]  Paul Johns,et al.  Predicting "About-to-Eat" Moments for Just-in-Time Eating Intervention , 2016, Digital Health.

[48]  Cecilia Mascolo,et al.  Mobile-Based Experience Sampling for Behaviour Research , 2015, Emotions and Personality in Personalized Services.

[49]  Daniel Gatica-Perez,et al.  GroupUs: Smartphone Proximity Data and Human Interaction Type Mining , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[50]  Yan Li,et al.  Models of Individual Dietary Behavior Based on Smartphone Data: The Influence of Routine, Physical Activity, Emotion, and Food Environment , 2016, PloS one.

[51]  Mi Zhang,et al.  MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones , 2015, UbiComp.

[52]  Daniel Gatica-Perez,et al.  By their apps you shall understand them: mining large-scale patterns of mobile phone usage , 2010, MUM.

[53]  J. Wenny Rahayu,et al.  Mobile cloud computing: A survey , 2013, Future Gener. Comput. Syst..

[54]  Hyunjoo Lee,et al.  Social Implications of Smartphone Use: Korean College Students' Smartphone Use and Psychological Well-Being , 2012, Cyberpsychology Behav. Soc. Netw..

[55]  Jacob E. Barkley,et al.  The relationship between cell phone use, physical and sedentary activity, and cardiorespiratory fitness in a sample of U.S. college students , 2013, International Journal of Behavioral Nutrition and Physical Activity.

[56]  E. Yahia Postharvest Biology and Technology of Tropical and Subtropical Fruits: Fundamental IssuesVolume 2 of Woodhead Publishing Series in Food Science, Technology and Nutrition , 2011 .

[57]  Inioluwa Deborah Raji,et al.  Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products , 2019, AIES.

[58]  Sean A. Munson,et al.  Examining Menstrual Tracking to Inform the Design of Personal Informatics Tools , 2017, CHI.

[59]  Hui-Xin Wang,et al.  Lifestyle, social factors, and survival after age 75: population based study , 2012, BMJ : British Medical Journal.

[60]  A. Bandura Social cognitive theory of self-regulation☆ , 1991 .

[61]  P. Lazarsfeld Principles of Topological Psychology , 1938 .

[62]  Vigneshwaran Subbaraju,et al.  Can multimodal sensing detect and localize transient events? , 2018, Defense + Security.

[63]  Johannes Schöning,et al.  Falling asleep with Angry Birds, Facebook and Kindle: a large scale study on mobile application usage , 2011, Mobile HCI.

[64]  D. Mohr,et al.  Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning. , 2017, Annual review of clinical psychology.

[65]  Gabriella M. Harari,et al.  Smartphone sensing methods for studying behavior in everyday life , 2017, Current Opinion in Behavioral Sciences.

[66]  H. P. van der Ploeg,et al.  Effectiveness of interventions using self-monitoring to reduce sedentary behavior in adults: a systematic review and meta-analysis , 2019, International Journal of Behavioral Nutrition and Physical Activity.

[67]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[68]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.

[69]  Jeong-Yeol Yoon,et al.  Recent approaches for optical smartphone sensing in resource-limited settings: a brief review , 2016 .

[70]  Mika Raento,et al.  Smartphones , 2009 .

[71]  Gregory D. Abowd,et al.  A practical approach for recognizing eating moments with wrist-mounted inertial sensing , 2015, UbiComp.

[72]  Yilu Liu,et al.  Impact of GPS Signal Loss and Its Mitigation in Power System Synchronized Measurement Devices , 2017, IEEE Transactions on Smart Grid.

[73]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[74]  Weidong Hu,et al.  Diversity in Machine Learning , 2018, IEEE Access.

[75]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[76]  Vikram Patel,et al.  Mental health of young people: a global public-health challenge , 2007, The Lancet.

[77]  Serkan Balli,et al.  Stress Detection via Keyboard Typing Behaviors by Using Smartphone Sensors and Machine Learning Techniques , 2020, Journal of Medical Systems.

[78]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[79]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[80]  Vassilis Koutkias,et al.  A Survey of Mobile Phone Sensing, Self-Reporting, and Social Sharing for Pervasive Healthcare , 2017, IEEE Journal of Biomedical and Health Informatics.

[81]  Martin Pielot,et al.  Productive, anxious, lonely: 24 hours without push notifications , 2016, MobileHCI.

[82]  Richard J. Holden,et al.  Systematic review of smartphone-based passive sensing for health and wellbeing , 2018, J. Biomed. Informatics.

[83]  Daniel Gatica-Perez,et al.  Alone or With Others? Understanding Eating Episodes of College Students with Mobile Sensing , 2020, MUM.

[84]  Charlie Hargood,et al.  The Effect of Timing and Frequency of Push Notifications on Usage of a Smartphone-Based Stress Management Intervention: An Exploratory Trial , 2017, PloS one.

[85]  Fabio Pianesi,et al.  Happiness Recognition from Mobile Phone Data , 2013, 2013 International Conference on Social Computing.

[86]  Guodong Sun,et al.  Daily Mood Assessment Based on Mobile Phone Sensing , 2012, 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks.

[87]  Nigel H. Lovell,et al.  Tracking the Evolution of Smartphone Sensing for Monitoring Human Movement , 2015, Sensors.

[88]  M. Snyder Self-monitoring of expressive behavior. , 1974 .

[89]  Annie S. Anderson,et al.  Situational effects on meal intake: A comparison of eating alone and eating with others , 2006, Physiology & Behavior.

[90]  Jeongeun Kim,et al.  Why do young people use fitness apps? Cognitive characteristics and app quality , 2018, Electron. Commer. Res..

[91]  Alex Pentland,et al.  Looking at People: Sensing for Ubiquitous and Wearable Computing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[92]  K. Hawton,et al.  Suicide in young people aged 15-24: a psychological autopsy study. , 2001, Journal of affective disorders.

[93]  Dan Cosley,et al.  Mobile manifestations of alertness: connecting biological rhythms with patterns of smartphone app use , 2016, MobileHCI.

[94]  Archan Misra,et al.  Prior Activation Distribution (PAD): A Versatile Representation to Utilize DNN Hidden Units , 2019, ArXiv.

[95]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[96]  Jinwoo Shin,et al.  MetaSense: few-shot adaptation to untrained conditions in deep mobile sensing , 2019, SenSys.

[97]  S Park,et al.  The Wearable Motherboard: a flexible information infrastructure or sensate liner for medical applications. , 1999, Studies in health technology and informatics.

[98]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[99]  K. Smolders,et al.  Bright light and mental fatigue: effects on alertness, vitality, performance and physiological arousal , 2014 .

[100]  Daniel Gatica-Perez,et al.  Bites‘n’Bits , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[101]  Katarzyna Wac,et al.  Getting closer: an empirical investigation of the proximity of user to their smart phones , 2011, UbiComp '11.

[102]  Lizzie Coles-Kemp,et al.  In a New Land: Mobile Phones, Amplified Pressures and Reduced Capabilities , 2018, CHI.

[103]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[104]  Yu Huang,et al.  Understanding behavioral dynamics of social anxiety among college students through smartphone sensors , 2019, Inf. Fusion.

[105]  Cem Ersoy,et al.  Stress detection in daily life scenarios using smart phones and wearable sensors: A survey , 2019, J. Biomed. Informatics.

[106]  Laura E. Barnes,et al.  DemonicSalmon: Monitoring mental health and social interactions of college students using smartphones , 2018, Smart Health.

[107]  G. Loewenstein,et al.  Time and Decision: Economic and Psychological Perspectives of Intertemporal Choice , 2003 .

[108]  G. Curhan,et al.  Influence of age on the association between lifestyle factors and risk of hypertension. , 2012, Journal of the American Society of Hypertension : JASH.

[109]  Denzil Ferreira,et al.  Detecting Drinking Episodes in Young Adults Using Smartphone-based Sensors , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[110]  Rui Wang,et al.  Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[111]  Archan Misra,et al.  Jointly Optimizing Sensing Pipelines for Multimodal Mixed Reality Interaction , 2020, 2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[112]  P. Toussaint,et al.  Mobile Sensing in Substance Use Research: A Scoping Review. , 2020, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[113]  E. Guney,et al.  Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare , 2020, npj Digital Medicine.

[114]  L. Tennakoon,et al.  Challenges in recruitment of research participants , 2003 .

[115]  Beth T. Bell,et al.  Shaping the Design of Smartphone-Based Interventions for Self-Harm , 2020, CHI.

[116]  Mirco Musolesi,et al.  Intelligent Notification Systems: A Survey of the State of the Art and Research Challenges , 2017, ArXiv.

[117]  Bruno Lepri,et al.  Strategies and limitations in app usage and human mobility , 2019, Scientific Reports.

[118]  Jennifer E. Pelletier,et al.  Social norms and dietary behaviors among young adults. , 2014, American journal of health behavior.

[119]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[120]  H. Brosin The psychology of overeating. , 1953, The New England journal of medicine.

[121]  Christian Montag,et al.  How age and gender affect smartphone usage , 2016, UbiComp Adjunct.

[122]  Tanzeem Choudhury,et al.  Sensing behavioral symptoms of mental health and delivering personalized interventions using mobile technologies , 2017, Depression and anxiety.

[123]  Zarnie Khadjesari,et al.  User Preferences for Content, Features, and Style for an App to Reduce Harmful Drinking in Young Adults: Analysis of User Feedback in App Stores and Focus Group Interviews , 2016, JMIR mHealth and uHealth.

[124]  N. Petry,et al.  A comparison of young, middle-aged, and older adult treatment-seeking pathological gamblers. , 2002, The Gerontologist.

[125]  Alexander Russell,et al.  Behavior vs. introspection: refining prediction of clinical depression via smartphone sensing data , 2016, 2016 IEEE Wireless Health (WH).

[126]  Haslenda Hashim,et al.  An Overview of the Influence of Physical Office Environments Towards Employee , 2011 .