Individual-level Anxiety Detection and Prediction from Longitudinal YouTube and Google Search Engagement Logs

Anxiety disorder is one of the world's most prevalent mental health conditions, arising from complex interactions of biological and environmental factors and severely interfering one's ability to lead normal life activities. Current methods for detecting anxiety heavily rely on in-person interviews, which can be expensive, time-consuming, and blocked by social stigmas. In this work, we propose an alternative method to identify individuals with anxiety and further estimate their levels of anxiety using personal online activity histories from YouTube and the Google Search engine, platforms that are used by millions of people daily. We ran a longitudinal study and collected multiple rounds of anonymized YouTube and Google Search logs from volunteering participants, along with their clinically validated ground-truth anxiety assessment scores. We then developed explainable features that capture both the temporal and contextual aspects of online behaviors. Using those, we were able to train models that (i) identify individuals having anxiety disorder with an average F1 score of 0.83 and (ii) assess the level of anxiety by predicting the gold standard Generalized Anxiety Disorder 7-item scores (ranges from 0 to 21) with a mean square error of 1.87 based on the ubiquitous individual-level online engagement data. Our proposed anxiety assessment framework is cost-effective, time-saving, scalable, and opens the door for it to be deployed in real-world clinical settings, empowering care providers and therapists to learn about anxiety disorders of patients non-invasively at any moment in time.

[1]  H. Sueki Does the volume of Internet searches using suicide‐related search terms influence the suicide death rate: Data from 2004 to 2009 in Japan , 2011, Psychiatry and clinical neurosciences.

[2]  B. Löwe,et al.  A brief measure for assessing generalized anxiety disorder: the GAD-7. , 2006, Archives of internal medicine.

[3]  Eric Horvitz,et al.  Social media as a measurement tool of depression in populations , 2013, WebSci.

[4]  Christopher M. Danforth,et al.  Forecasting the onset and course of mental illness with Twitter data , 2016, Scientific Reports.

[5]  Sue Jamison-Powell,et al.  "I can't get no sleep": discussing #insomnia on twitter , 2012, CHI.

[6]  Eric Horvitz,et al.  Predicting Depression via Social Media , 2013, ICWSM.

[7]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[8]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[9]  Mark Dredze,et al.  Shared Task : Depression and PTSD on Twitter , 2015 .

[10]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys '13.

[11]  M. Santed-Germán,et al.  Google Searches and Suicide Rates in Spain, 2004-2013: Correlation Study , 2020, JMIR public health and surveillance.

[12]  J. Ayers,et al.  Seasonality in seeking mental health information on Google. , 2013, American journal of preventive medicine.

[13]  Jane E. Klobas,et al.  Compulsive YouTube usage: A comparison of use motivation and personality effects , 2018, Comput. Hum. Behav..

[14]  M. Antony,et al.  Social anxiety in college students. , 2001, Journal of anxiety disorders.

[15]  Matthew Chan,et al.  CalmMeNow: exploratory research and design of stress mitigating mobile interventions , 2011, CHI Extended Abstracts.

[16]  D. Lester,et al.  Using google searches on the internet to monitor suicidal behavior. , 2013, Journal of affective disorders.

[17]  S. Nuti,et al.  The Use of Google Trends in Health Care Research: A Systematic Review , 2014, PloS one.

[18]  Ryen W. White,et al.  Screening for Pancreatic Adenocarcinoma Using Signals From Web Search Logs: Feasibility Study and Results. , 2016, Journal of oncology practice.

[19]  Ryen W. White,et al.  Detecting Devastating Diseases in Search Logs , 2016, KDD.

[20]  Mike Thelwall,et al.  Detection of Stress and Relaxation Magnitudes for Tweets , 2018, WWW.

[21]  A. Kaplan,et al.  Users of the world, unite! The challenges and opportunities of Social Media , 2010 .

[22]  Abdullah M. Baabdullah,et al.  Facebook usage and mental health: An empirical study of role of non-directional social comparisons in the UK , 2019, Int. J. Inf. Manag..

[23]  T. Vos,et al.  Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010 , 2013, The Lancet.

[24]  Margaret L. Kern,et al.  Social Networking Sites, Depression, and Anxiety: A Systematic Review , 2016, JMIR mental health.

[25]  N. Williams The GAD-7 questionnaire , 2014 .

[26]  Hiroyuki Ohsaki,et al.  Recognizing Depression from Twitter Activity , 2015, CHI.

[27]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[28]  C. Conley,et al.  Navigating the College Years: Developmental Trajectories and Gender Differences in Psychological Functioning, Cognitive-Affective Strategies, and Social Well-Being , 2020 .

[29]  Rui Wang,et al.  Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[30]  R. Swinson The GAD-7 scale was accurate for diagnosing generalised anxiety disorder , 2006, Evidence-based medicine.

[31]  Zaheer Hussain,et al.  Problematic smartphone use, nature connectedness, and anxiety , 2018, Journal of behavioral addictions.

[32]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[33]  Munmun De Choudhury,et al.  A Social Media Based Index of Mental Well-Being in College Campuses , 2017, CHI.

[34]  Eric Horvitz,et al.  Characterizing and predicting postpartum depression from shared facebook data , 2014, CSCW.

[35]  Mary Czerwinski,et al.  MoodWings: a wearable biofeedback device for real-time stress intervention , 2013, PETRA '13.

[36]  C. Peng,et al.  Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. , 2011, Journal of affective disorders.

[37]  Konrad Paul Kording,et al.  Distributed under Creative Commons Cc-by 4.0 the Relationship between Mobile Phone Location Sensor Data and Depressive Symptom Severity , 2022 .

[38]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[39]  Stevie Chancellor,et al.  Methods in predictive techniques for mental health status on social media: a critical review , 2020, npj Digital Medicine.

[40]  J. Sundquist,et al.  Longitudinal trends in self-reported anxiety. Effects of age and birth cohort during 25 years , 2017, BMC Psychiatry.

[41]  J. Elhai,et al.  The relationship between anxiety symptom severity and problematic smartphone use: A review of the literature and conceptual frameworks. , 2019, Journal of anxiety disorders.

[42]  M. McCarthy,et al.  Internet monitoring of suicide risk in the population. , 2010, Journal of affective disorders.

[43]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[44]  Henry A. Kautz,et al.  Detecting Low Self-Esteem in Youths from Web Search Data , 2019, WWW.

[45]  Ofir Turel,et al.  The “Facebook-self”: characteristics and psychological predictors of false self-presentation on Facebook , 2015, Front. Psychol..

[46]  Leonardo Max Batista Claudino,et al.  Beyond LDA: Exploring Supervised Topic Modeling for Depression-Related Language in Twitter , 2015, CLPsych@HLT-NAACL.

[47]  J. Parsons,et al.  Internet Addiction: College Student Case Study Using Best Practices in Cognitive Behavior Therapy. , 2001 .

[48]  D. Mohr,et al.  Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning. , 2017, Annual review of clinical psychology.

[49]  Daniela Paolotti,et al.  How Search Engine Data Enhance the Understanding of Determinants of Suicide in India and Inform Prevention: Observational Study , 2019, Journal of medical Internet research.

[50]  Skyler Place,et al.  Behavioral Indicators on a Mobile Sensing Platform Predict Clinically Validated Psychiatric Symptoms of Mood and Anxiety Disorders , 2017, Journal of medical Internet research.

[51]  J. Margraf,et al.  Relationships between addictive Facebook use, depressiveness, insomnia, and positive mental health in an inpatient sample: A German longitudinal study , 2019, Journal of behavioral addictions.

[52]  Guodong Sun,et al.  Daily Mood Assessment Based on Mobile Phone Sensing , 2012, 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks.

[53]  E. Costello,et al.  The Developmental Epidemiology of Anxiety Disorders: Phenomenology, Prevalence, and Comorbidity , 2005 .

[54]  Mark Dredze,et al.  Quantifying Mental Health Signals in Twitter , 2014, CLPsych@ACL.

[55]  Marian-Andrei Rizoiu,et al.  Hawkes processes for events in social media , 2017, Frontiers of Multimedia Research.

[56]  Judith Amores,et al.  PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces , 2016, CHI Extended Abstracts.

[57]  Mark Dredze,et al.  Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media , 2016, CHI.

[58]  Bethany K. B. Fleck,et al.  YouTube in the Classroom: Helpful Tips and Student Perceptions , 2014 .

[59]  Melvyn W B Zhang,et al.  Smartphone apps in mental healthcare: the state of the art and potential developments , 2015, BJPsych Advances.