User Perspectives of Mood-Monitoring Apps Available to Young People: Qualitative Content Analysis

Background Mobile health apps are increasingly available and used in a clinical context to monitor young people’s mood and mental health. Despite the benefits of accessibility and cost-effectiveness, consumer engagement remains a hurdle for uptake and continued use. Hundreds of mood-monitoring apps are publicly available to young people on app stores; however, few studies have examined consumer perspectives. App store reviews held on Google and Apple platforms provide a large, rich source of naturally generated, publicly available user reviews. Although commercial developers use these data to modify and improve their apps, to date, there has been very little in-depth evaluation of app store user reviews within scientific research, and our current understanding of what makes apps engaging and valuable to young people is limited. Objective This study aims to gain a better understanding of what app users consider useful to encourage frequent and prolonged use of mood-monitoring apps appropriate for young people. Methods A systematic approach was applied to the selection of apps and reviews. We identified mood-monitoring apps (n=53) by a combination of automated application programming interface (API) methods. We only included apps appropriate for young people based on app store age categories (apps available to those younger than 18 years). We subsequently downloaded all available user reviews via API data scraping methods and selected a representative subsample of reviews (n=1803) for manual qualitative content analysis. Results The qualitative content analysis revealed 8 main themes: accessibility (34%), flexibility (21%), recording and representation of mood (18%), user requests (17%), reflecting on mood (16%), technical features (16%), design (13%), and health promotion (11%). A total of 6 minor themes were also identified: notification and reminders; recommendation; privacy, security, and transparency; developer; adverts; and social/community. Conclusions Users value mood-monitoring apps that can be personalized to their needs, have a simple and intuitive design, and allow accurate representation and review of complex and fluctuating moods. App store reviews are a valuable repository of user engagement feedback and provide a wealth of information about what users value in an app and what user needs are not being met. Users perceive mood-monitoring apps positively, but over 20% of reviews identified the need for improvement.

[1]  Karen Spärck Jones IDF term weighting and IR research lessons , 2004, J. Documentation.

[2]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[3]  Christy K. Scott,et al.  A Pilot Study to Examine the Feasibility and Potential Effectiveness of Using Smartphones to Provide Recovery Support for Adolescents , 2015, Substance abuse.

[4]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[5]  Yuanyuan Zhang,et al.  The App Sampling Problem for App Store Mining , 2015, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories.

[6]  J Noyes,et al.  Are there health risks for teenagers using mobile phones? A study of phone use amongst 14–18 year olds , 2017 .

[7]  Helen Christensen,et al.  The Reviews Are in: A Qualitative Content Analysis of Consumer Perspectives on Apps for Bipolar Disorder , 2017, Journal of medical Internet research.

[8]  VanAnh Vo,et al.  Patients’ Perceptions of mHealth Apps: Meta-Ethnographic Review of Qualitative Studies , 2019, JMIR mHealth and uHealth.

[9]  Mariesa Nicholas,et al.  Development and evaluation of an Internet-based program to improve the mental health and wellbeing of young men , 2015, Interact. Technol. Smart Educ..

[10]  Dhiya Al-Jumeily,et al.  Technology Acceptance Model for the Use of M-Health Services among Health Related Users in UAE , 2015, 2015 International Conference on Developments of E-Systems Engineering (DeSE).

[11]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[12]  Robert A. Schoevers,et al.  Self-monitoring and personalized feedback based on the experiencing sampling method as a tool to boost depression treatment: a protocol of a pragmatic randomized controlled trial (ZELF-i) , 2018, BMC Psychiatry.

[13]  Rachel Kenny,et al.  Ecological Momentary Assessment of Adolescent Problems, Coping Efficacy, and Mood States Using a Mobile Phone App: An Exploratory Study , 2016, JMIR mental health.

[14]  Fred D. Davis A technology acceptance model for empirically testing new end-user information systems : theory and results , 1985 .

[15]  Jamie Yea Eun Park,et al.  Mobile Phone Apps Targeting Medication Adherence: Quality Assessment and Content Analysis of User Reviews , 2019, JMIR mHealth and uHealth.

[16]  C. Meyer,et al.  A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people , 2017, Psychological Medicine.

[17]  Dietmar Pfahl,et al.  Feature-based evaluation of competing apps , 2016, WAMA@SIGSOFT FSE.

[18]  Garret R Sacco,et al.  Developing a smartphone application for depression: tracking risk and wellness factors , 2015 .

[19]  Mark Matthews,et al.  Mobile phone mood charting for adolescents , 2008 .

[20]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[21]  J. Onnela,et al.  Understanding the quality, effectiveness and attributes of top-rated smartphone health apps , 2019, Evidence-Based Mental Health.

[22]  Lisa A. Marsch,et al.  Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature , 2015, Journal of mental health.

[23]  John Torous,et al.  Current research and trends in the use of smartphone applications for mood disorders , 2015 .

[24]  Katarzyna Stawarz,et al.  User Experience of Cognitive Behavioral Therapy Apps for Depression: An Analysis of App Functionality and User Reviews , 2018, Journal of medical Internet research.

[25]  Alain Abran,et al.  A systematic literature review: Opinion mining studies from mobile app store user reviews , 2017, J. Syst. Softw..

[26]  Mariesa Nicholas,et al.  Encouraging young men\\\\\\\'s participation in mental health research and treatment: perspectives in our technological age , 2014 .

[27]  Johnny Downs,et al.  Informing the development of an E-platform for monitoring wellbeing in schools: involving young people in a co-design process , 2020, Research Involvement and Engagement.

[28]  Tiziana Volpe,et al.  A qualitative study of young people's perspectives on receiving psychiatric services via televideo. , 2010, Journal of the Canadian Academy of Child and Adolescent Psychiatry = Journal de l'Academie canadienne de psychiatrie de l'enfant et de l'adolescent.

[29]  J. L. Bender,et al.  Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace , 2015, JMIR mHealth and uHealth.

[30]  Geri Gay,et al.  Pilot Study of Aurora, a Social, Mobile-Phone-Based Emotion Sharing and Recording System , 2011, Journal of diabetes science and technology.

[31]  Patrick Ajibade,et al.  Technology Acceptance Model Limitations and Criticisms: Exploring the Practical Applications and Use in Technology-related Studies, Mixed-method, and Qualitative Researches , 2018 .

[32]  Rachel Kenny,et al.  Developing mental health mobile apps: Exploring adolescents’ perspectives , 2016, Health Informatics J..

[33]  Kai Zheng,et al.  Mobile apps for mood tracking: an analysis of features and user reviews , 2017, AMIA.

[34]  R. Tesch Qualitative Research: Analysis Types and Software , 1990 .

[35]  Rachel Harrison,et al.  What are you complaining about?: a study of online reviews of mobile applications , 2013, BCS HCI.

[36]  Erik Frøkjær,et al.  Designing daybuilder: an experimental app to support people with depression , 2012, PDC '12.

[37]  Nuria Oliver,et al.  A study of mobile mood awareness and communication through MobiMood , 2010, NordiCHI.

[38]  Donna Spruijt-Metz,et al.  Momentary negative moods and being with friends precede cigarette use among Korean American emerging adults. , 2014, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[39]  Stephen M Schueller,et al.  Discovery of and Interest in Health Apps Among Those With Mental Health Needs: Survey and Focus Group Study , 2018, Journal of medical Internet research.

[40]  M. Linehan,et al.  A biosocial developmental model of borderline personality: Elaborating and extending Linehan's theory. , 2009, Psychological bulletin.

[41]  Ahmed E. Hassan,et al.  User reviews of top mobile apps in Apple and Google app stores , 2017, CACM.

[42]  Alison M Darcy,et al.  Development of a smartphone application for eating disorder self-monitoring. , 2015, The International journal of eating disorders.

[43]  Rudy Bowen,et al.  Mood instability as a precursor to depressive illness: A prospective and mediational analysis , 2015, The Australian and New Zealand journal of psychiatry.

[44]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[45]  John Torous,et al.  User Engagement in Mental Health Apps: A Review of Measurement, Reporting, and Validity. , 2019, Psychiatric services.

[46]  Joel Paris,et al.  Borderline or Bipolar? Distinguishing Borderline Personality Disorder from Bipolar Spectrum Disorders , 2004, Harvard review of psychiatry.

[47]  H. Christensen,et al.  Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review , 2013, Journal of medical Internet research.

[48]  Helvi Kyngäs,et al.  The qualitative content analysis process. , 2008, Journal of advanced nursing.

[49]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[50]  George C. Patton,et al.  A mobile phone program to track young people’s experiences of mood, stress and coping , 2009, Social Psychiatry and Psychiatric Epidemiology.

[51]  John Torous,et al.  Mental Health Apps: What to Tell Patients: An Evaluation Model Created Specifically for Such Apps Can Help Guide Your Discussions , 2018 .

[52]  Mario Linares Vásquez,et al.  On automatically detecting similar Android apps , 2016, 2016 IEEE 24th International Conference on Program Comprehension (ICPC).