Causal Factors of Effective Psychosocial Outcomes in Online Mental Health Communities

Online mental health communities enable people to seek and provide support, and growing evidence shows the efficacy of community participation to cope with mental health distress. However, what factors of peer support lead to favorable psychosocial outcomes for individuals is less clear. Using a dataset of over 300K posts by [~]39K individuals on an online community TalkLife, we present a study to investigate the effect of several factors, such as adaptability, diversity, immediacy, and the nature of support. Unlike typical causal studies that focus on the effect of each treatment, we focus on the outcome and address the reverse causal question of identifying treatments that may have led to the outcome, drawing on case-control studies in epidemiology. Specifically, we define the outcome as an aggregate of affective, behavioral, and cognitive psychosocial change and identify Case (most improved) and Control (least improved) cohorts of individuals. Considering responses from peers as treatments, we evaluate the differences in the responses received by Case and Control, per matched clusters of similar individuals. We find that effective support includes complex language factors such as diversity, adaptability, and style, but simple indicators such as quantity and immediacy are not causally relevant. Our work bears methodological and design implications for online mental health platforms, and has the potential to guide suggestive interventions for peer supporters on these platforms.

[1]  Gregory D. Abowd,et al.  Inferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  A. Kazdin Evidence-based treatment research: Advances, limitations, and next steps. , 2011, The American psychologist.

[3]  Svetlana Yarosh,et al.  Write for Life , 2017, Proc. ACM Hum. Comput. Interact..

[4]  Munmun De Choudhury,et al.  Modeling Stress with Social Media Around Incidents of Gun Violence on College Campuses , 2017, Proc. ACM Hum. Comput. Interact..

[5]  X Zhang,et al.  Multivariate Matching and Bias Reduction in the Surgical Outcomes Study , 2001, Medical care.

[6]  Robert Gee,et al.  The Experience of Online Counseling , 2007 .

[7]  Taisa Kushner,et al.  Bursts of Activity: Temporal Patterns of Help-Seeking and Support in Online Mental Health Forums , 2020, WWW.

[8]  Munmun De Choudhury,et al.  Linguistic Markers Indicating Therapeutic Outcomes of Social Media Disclosures of Schizophrenia , 2017, Proc. ACM Hum. Comput. Interact..

[9]  T. Glass,et al.  The quality and quantity of social support: stroke recovery as psycho-social transition. , 1992, Social science & medicine.

[10]  J. Pennebaker,et al.  Psychological aspects of natural language. use: our words, our selves. , 2003, Annual review of psychology.

[11]  Scott Counts,et al.  Using Longitudinal Social Media Analysis to Understand the Effects of Early College Alcohol Use , 2018, ICWSM.

[12]  Loren Terveen,et al.  Bridging Qualitative and Quantitative Methods for User Modeling: Tracing Cancer Patient Behavior in an Online Health Community , 2020, ICWSM.

[13]  J. Norcross,et al.  Psychotherapy Relationships That Work III , 2018, Psychotherapy.

[14]  David E. Irwin,et al.  Finding a "Kneedle" in a Haystack: Detecting Knee Points in System Behavior , 2011, 2011 31st International Conference on Distributed Computing Systems Workshops.

[15]  Munmun De Choudhury,et al.  The Language of Social Support in Social Media and Its Effect on Suicidal Ideation Risk , 2017, ICWSM.

[16]  S. Breckler Empirical validation of affect, behavior, and cognition as distinct components of attitude. , 1984, Journal of personality and social psychology.

[17]  Emre Kiciman,et al.  Distilling the Outcomes of Personal Experiences: A Propensity-scored Analysis of Social Media , 2017, CSCW.

[18]  Munmun De Choudhury,et al.  Designing Dashboard for Campus Stakeholders to Support College Student Mental Health , 2019, PervasiveHealth.

[19]  Aron Culotta,et al.  Using matched samples to estimate the effects of exercise on mental health from twitter , 2015, AAAI 2015.

[20]  Bradley C. Love,et al.  Exploring Psychosocial Support Online: A Content Analysis of Messages in an Adolescent and Young Adult Cancer Community , 2012, Cyberpsychology Behav. Soc. Netw..

[21]  Lyle H. Ungar,et al.  Understanding and Measuring Psychological Stress using Social Media , 2018, ICWSM.

[22]  J. K. Johnsen,et al.  Social support in a wired world: Use of online mental health forums in Norway , 2002, Nordic journal of psychiatry.

[23]  Gregory D. Abowd,et al.  Prediction of Mood Instability with Passive Sensing , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[24]  Hyun Jung Oh,et al.  Facebooking for health: An examination into the solicitation and effects of health-related social support on social networking sites , 2013, Comput. Hum. Behav..

[25]  D. Rubin Causal Inference Using Potential Outcomes , 2005 .

[26]  Nitesh V. Chawla,et al.  Social Media as a Passive Sensor in Longitudinal Studies of Human Behavior and Wellbeing , 2019, CHI Extended Abstracts.

[27]  Michael B. Spring,et al.  Effectiveness of Online Collaborative Care for Treating Mood and Anxiety Disorders in Primary Care , 2017, JAMA psychiatry.

[28]  Kaleab Z. Abebe,et al.  My care manager, my computer therapy and me: The relationship triangle in computerized cognitive behavioural therapy , 2017, Internet interventions.

[29]  N. Ellison,et al.  Social capital, self-esteem, and use of online social network sites: A longitudinal analysis , 2008 .

[30]  Jina Huh,et al.  Clinical Questions in Online Health Communities: The Case of "See your doctor" Threads , 2015, CSCW.

[31]  D. Mohr,et al.  Behavioral intervention technologies: evidence review and recommendations for future research in mental health. , 2013, General hospital psychiatry.

[32]  Anja Thieme,et al.  Understanding Client Support Strategies to Improve Clinical Outcomes in an Online Mental Health Intervention , 2020, CHI.

[33]  Kathleen Ferrara Contexts of Accommodation: Accommodation in therapy , 1991 .

[34]  Munmun De Choudhury,et al.  Understanding Moderation in Online Mental Health Communities , 2020, HCI.

[35]  SahaKoustuv,et al.  The Language of LGBTQ+ Minority Stress Experiences on Social Media , 2019 .

[36]  Hww Potts,et al.  Online support groups: an overlooked resource for patients , 2005 .

[37]  G. Imbens,et al.  Why Ask Why? Forward Causal Inference and Reverse Causal Questions , 2013 .

[38]  F. Mair,et al.  Cumulative complexity: a functional, patient-centered model of patient complexity can improve research and practice. , 2012, Journal of clinical epidemiology.

[39]  J. Pearl Causal inference in statistics: An overview , 2009 .

[40]  Mark Dredze,et al.  Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media , 2016, CHI.

[41]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[42]  Herbert S. Gross,et al.  Therapeutic Discourse: Psychotherapy as Conversation , 1978 .

[43]  Cameron Marlow,et al.  Social network activity and social well-being , 2010, CHI.

[44]  Jure Leskovec,et al.  Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health , 2016, TACL.

[45]  K. Schulz,et al.  Case-control studies: research in reverse , 2002, The Lancet.

[46]  Amit Baumel,et al.  Digital Peer-Support Platform (7Cups) as an Adjunct Treatment for Women With Postpartum Depression: Feasibility, Acceptability, and Preliminary Efficacy Study , 2018, JMIR mHealth and uHealth.

[47]  M. Klein,et al.  Congruence or genuineness. , 2001 .

[48]  Munmun De Choudhury,et al.  A Social Media Study on the Effects of Psychiatric Medication Use , 2019, ICWSM.

[49]  G. Everly,et al.  Crisis intervention: a review. , 2000, International journal of emergency mental health.

[50]  A. Bandura Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[51]  Henry Lieberman,et al.  Mixed-Initiative Real-Time Topic Modeling & Visualization for Crisis Counseling , 2015, IUI.

[52]  Priya Nambisan,et al.  Information seeking and social support in online health communities: impact on patients' perceived empathy , 2011, J. Am. Medical Informatics Assoc..

[53]  Amit Sharma,et al.  Moments of Change: Analyzing Peer-Based Cognitive Support in Online Mental Health Forums , 2019, CHI.

[54]  J. Torous,et al.  Empowering the digital therapeutic relationship: virtual clinics for digital health interventions , 2018, npj Digital Medicine.

[55]  Cristian Danescu-Niculescu-Mizil,et al.  Conversations Gone Awry: Detecting Early Signs of Conversational Failure , 2018, ACL.

[56]  Munmun De Choudhury,et al.  Who is the "Human" in Human-Centered Machine Learning , 2019, Proc. ACM Hum. Comput. Interact..

[57]  Michael J. Lambert,et al.  Research summary on the therapeutic relationship and psychotherapy outcome. , 2001 .

[58]  Jeremy N. V. Miles,et al.  Tolerance and Variance Inflation Factor , 2005 .

[59]  Cristian Danescu-Niculescu-Mizil,et al.  Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussions , 2016, WWW.

[60]  James Lindsey DROPOUTS IN LONGITUDINAL STUDIES: DEFINITIONS AND MODELS , 2000, Journal of biopharmaceutical statistics.

[61]  Michael J Lambert,et al.  Psychotherapy relationships that work II. , 2011, Psychotherapy.

[62]  C. B. Taylor,et al.  Evaluation of an internet support group for women with primary breast cancer , 2003, Cancer.

[63]  Munmun De Choudhury,et al.  Characterizing Audience Engagement and Assessing Its Impact on Social Media Disclosures of Mental Illnesses , 2018, ICWSM.

[64]  R. Perkins What constitutes success? , 2001, British Journal of Psychiatry.

[65]  Munmun De Choudhury,et al.  Mental Health Support and its Relationship to Linguistic Accommodation in Online Communities , 2018, CHI.

[66]  Diyi Yang,et al.  Commitment of Newcomers and Old-timers to Online Health Support Communities , 2017, CHI.

[67]  Sachin R. Pendse,et al.  Cross-Cultural Differences in the Use of Online Mental Health Support Forums , 2019, Proc. ACM Hum. Comput. Interact..

[68]  S. Sherman : Toward Effective Counseling and Psychotherapy: Training and Practice , 1968 .

[69]  Munmun De Choudhury,et al.  A Social Media Based Examination of the Effects of Counseling Recommendations after Student Deaths on College Campuses , 2018, ICWSM.

[70]  Ashton Anderson,et al.  Causal Effects of Brevity on Style and Success in Social Media , 2019, Proc. ACM Hum. Comput. Interact..

[71]  H. Giles,et al.  Contexts of Accommodation: Developments in Applied Sociolinguistics , 2010 .

[72]  Robert R. Carkhuff,et al.  Toward effective counseling and psychotherapy : training and practice , 2017 .

[73]  D. Watts Common Sense and Sociological Explanations1 , 2014, American Journal of Sociology.

[74]  VEDANT DAS SWAIN,et al.  A Multisensor Person-Centered Approach to Understand the Role of Daily Activities in Job Performance with Organizational Personas , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[75]  Fernando Martín-Sánchez,et al.  Health outcomes and related effects of using social media in chronic disease management: A literature review and analysis of affordances , 2013, J. Biomed. Informatics.

[76]  Munmun De Choudhury,et al.  Understanding Social Media Disclosures of Sexual Abuse Through the Lenses of Support Seeking and Anonymity , 2016, CHI.

[77]  Munmun De Choudhury,et al.  Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity , 2014, ICWSM.

[78]  Jacob Eisenstein,et al.  A Multidimensional Lexicon for Interpersonal Stancetaking , 2017, ACL.

[79]  Gregory D. Abowd,et al.  Modeling Organizational Culture with Workplace Experiences Shared on Glassdoor , 2020, CHI.

[80]  J. Larson The World Health Organization's definition of health: Social versus spiritual health , 1996 .

[81]  Cindy K. Chung,et al.  When Small Words Foretell Academic Success: The Case of College Admissions Essays , 2014, PloS one.

[82]  Xiao Ma,et al.  When Do People Trust Their Social Groups? , 2019, CHI.

[83]  E. Hannan Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. , 2008, JACC. Cardiovascular interventions.