Harnessing Reddit to Understand the Written-Communication Challenges Experienced by Individuals With Mental Health Disorders: Analysis of Texts From Mental Health Communities

Background Mental disorders such as depression, bipolar disorder, and schizophrenia are common, incapacitating, and have the potential to be fatal. Despite the prevalence and gravity of mental disorders, our knowledge concerning everyday challenges associated with them is relatively limited. One of the most studied deficits related to everyday challenges is language impairment, yet we do not know how mental disorders can impact common forms of written communication, for example, social media. Objective The aims of this study were to investigate written communication challenges manifest in online mental health communities focusing on depression, bipolar disorder, and schizophrenia, as well as the impact of participating in these online mental health communities on written communication. As the control, we selected three online health communities focusing on positive emotion, exercising, and weight management. Methods We examined lexical diversity and readability, both important features for measuring the quality of writing. We used four well-established readability metrics that consider word frequencies and syntactic complexity to measure writers’ written communication ability. We then measured the lexical diversity by calculating the percentage of unique words in posts. To compare lexical diversity and readability among communities, we first applied pairwise independent sample t tests, followed by P value adjustments using the prespecified Hommel procedure to adjust for multiple comparison. To measure the changes, we applied linear least squares regression to the readability and lexical diversity scores against the interaction sequence for each member, followed by pairwise independent sample t tests and P value adjustments. Given the large sample of members, we also report effect sizes and 95% CIs for the pairwise comparisons. Results On average, members of depression, bipolar disorder, and schizophrenia communities showed indications of difficulty expressing their ideas compared with three other online health communities. Our results also suggest that participating in these platforms has the potential to improve members’ written communication. For example, members of all three mental health communities showed statistically significant improvement in both lexical diversity and readability compared with members of the OHC focusing on positive emotion. Conclusions We provide new insights into the written communication challenges faced by individuals suffering from depression, bipolar disorder, and schizophrenia. A comparison with three other online health communities suggests that written communication in mental health communities is significantly more difficult to read, while also consisting of a significantly less diverse lexicon. We contribute practical suggestions for utilizing our findings in Web-based communication settings to enhance members’ communicative experience. We consider these findings to be an important step toward understanding and addressing everyday written communication challenges among individuals suffering from mental disorders.

[1]  Mike Conway,et al.  Towards Tracking Opium Related Discussions in Social Media , 2017, Online Journal of Public Health Informatics.

[2]  W. Furman,et al.  “Stay or Leave” , 2017, Emerging Adulthood.

[3]  Mike Conway,et al.  Longitudinal Changes in Psychological States in Online Health Community Members: Understanding the Long-Term Effects of Participating in an Online Depression Community , 2017, Journal of medical Internet research.

[4]  Mike Conway,et al.  The Readability of Electronic Cigarette Health Information and Advice: A Quantitative Analysis of Web-Based Information , 2017, JMIR public health and surveillance.

[5]  Wagner Meira,et al.  Factors Associated With Weight Change in Online Weight Management Communities: A Case Study in the LoseIt Reddit Community , 2017, Journal of medical Internet research.

[6]  Jina Huh,et al.  “How Did We Get Here?”: Topic Drift in Online Health Discussions , 2016, Journal of medical Internet research.

[7]  Maria Liakata,et al.  The language of mental health problems in social media , 2016, CLPsych@HLT-NAACL.

[8]  Mike Conway,et al.  Social Media, Big Data, and Mental Health: Current Advances and Ethical Implications. , 2016, Current opinion in psychology.

[9]  Mike Conway,et al.  Ethical issues in using Twitter for population-level depression monitoring: a qualitative study , 2016, BMC Medical Ethics.

[10]  Gisele L. Pappa,et al.  The Effect of Social Feedback in a Reddit Weight Loss Community , 2016, Digital Health.

[11]  Adam E M Eltorai,et al.  Readability of Invasive Procedure Consent Forms , 2015, Clinical and translational science.

[12]  David W. McDonald,et al.  Homophily of Vocabulary Usage: Beneficial Effects of Vocabulary Similarity on Online Health Communities Participation , 2015, AMIA.

[13]  Jina Huh,et al.  Automatically Detecting Failures in Natural Language Processing Tools for Online Community Text , 2015, Journal of medical Internet research.

[14]  Marcel Salathé,et al.  Ethical Challenges of Big Data in Public Health , 2015, PLoS Comput. Biol..

[15]  Mike Conway Ethical Issues in Using Twitter for Public Health Surveillance and Research: Developing a Taxonomy of Ethical Concepts From the Research Literature , 2014, Journal of medical Internet research.

[16]  Michael Mackert,et al.  Readability, suitability, and health content assessment of web-based patient education materials on colorectal cancer screening. , 2014, Gastrointestinal endoscopy.

[17]  Munmun De Choudhury,et al.  Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity , 2014, ICWSM.

[18]  Toine Bogers,et al.  How 'Social' are Social News Sites? Exploring the Motivations for Using Reddit.com , 2014 .

[19]  Galit Shmueli,et al.  Research Commentary - Too Big to Fail: Large Samples and the p-Value Problem , 2013, Inf. Syst. Res..

[20]  T. Vos,et al.  Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010 , 2013, The Lancet.

[21]  Delphine Bernhard,et al.  Coherence and Cohesion for the Assessment of Text Readability , 2013, NLPCS 2013.

[22]  Ethan Kross,et al.  An everyday activity as a treatment for depression: the benefits of expressive writing for people diagnosed with major depressive disorder. , 2013, Journal of affective disorders.

[23]  David R. Hansberry,et al.  A comparative analysis of the quality of patient education materials from medical specialties. , 2013, JAMA internal medicine.

[24]  Aaron Smith,et al.  6% of online adults are reddit users , 2013 .

[25]  Benard P Dreyer,et al.  Readability, Suitability, and Characteristics of Asthma Action Plans: Examination of Factors That May Impair Understanding , 2013, Pediatrics.

[26]  Philip J. Gregory,et al.  Readability of Consumer Health Information on the Internet: A Comparison of U.S. Government–Funded and Commercially Funded Websites , 2012, Journal of health communication.

[27]  Norito Kawakami,et al.  Mental disorders and suicide in Japan: a nation-wide psychological autopsy case-control study. , 2012, Journal of affective disorders.

[28]  John M. Levine,et al.  To stay or leave?: the relationship of emotional and informational support to commitment in online health support groups , 2012, CSCW.

[29]  Alla Keselman,et al.  Beyond Readability: Investigating Coherence of Clinical Text for Consumers , 2011, Journal of medical Internet research.

[30]  Kathleen M Griffiths,et al.  Explicit and implicit information needs of people with depression: a qualitative investigation of problems reported on an online depression support forum , 2011, BMC psychiatry.

[31]  Debra Lauterbach,et al.  It's not that i don't have problems, i'm just not putting them on facebook: challenges and opportunities in using online social networks for health , 2011, CSCW.

[32]  Marli Terblanche,et al.  Examining the readability of patient-informed consent forms , 2010 .

[33]  Heide Klumpp,et al.  Review of brain functioning in depression for semantic processing and verbal fluency. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  Philip M. McCarthy,et al.  Linguistic Features of Writing Quality , 2010 .

[35]  S. Sawilowsky New Effect Size Rules of Thumb , 2009 .

[36]  Julie E. Dockrell,et al.  The Impact of Specific Language Impairment on Adolescents' Written Text , 2009 .

[37]  Ronald C Kessler,et al.  The global burden of mental disorders: An update from the WHO World Mental Health (WMH) Surveys* , 2009, Epidemiologia e Psichiatria Sociale.

[38]  T. Suslow Estimating verbal intelligence in unipolar depression: Comparison of word definition and word recognition , 2009, Nordic journal of psychiatry.

[39]  Peter Thomas,et al.  Being online, living offline: the influence of social ties over the appropriation of social network sites , 2008, CSCW.

[40]  Ani Nenkova,et al.  Revisiting Readability: A Unified Framework for Predicting Text Quality , 2008, EMNLP.

[41]  Gilad Mishne,et al.  Finding high-quality content in social media , 2008, WSDM '08.

[42]  Justin C. Hulbert,et al.  Understanding words in context: The role of Broca's area in word comprehension , 2007, Brain Research.

[43]  I. Melle,et al.  Early detection of the first episode of schizophrenia and suicidal behavior. , 2006, The American journal of psychiatry.

[44]  Xiaoping Hu,et al.  Differential activity in left inferior frontal gyrus for pseudowords and real words: An event‐related fMRI study on auditory lexical decision , 2005, Human brain mapping.

[45]  C. Classen,et al.  The Effects of Expressive Writing on Pain, Depression and Posttraumatic Stress Disorder Symptoms in Survivors of Intimate Partner Violence , 2005, Journal of health psychology.

[46]  Asaid Khateb,et al.  Variability of fMRI activation during a phonological and semantic language task in healthy subjects , 2004, Human brain mapping.

[47]  P. Corrigan How stigma interferes with mental health care. , 2004, The American psychologist.

[48]  John F Connolly,et al.  Separating phonological and semantic processing in auditory sentence processing: A high‐resolution event‐related brain potential study , 2004, Human brain mapping.

[49]  P. Fossati,et al.  Verbal memory performance of patients with a first depressive episode and patients with unipolar and bipolar recurrent depression. , 2004, Journal of psychiatric research.

[50]  E. T. Possing,et al.  Neural Correlates of Lexical Access during Visual Word Recognition , 2003, Journal of Cognitive Neuroscience.

[51]  P. Fossati,et al.  Qualitative analysis of verbal fluency in depression , 2003, Psychiatry Research.

[52]  S. Moritz,et al.  Executive functioning in obsessive-compulsive disorder, unipolar depression, and schizophrenia , 2002 .

[53]  D M D'Alessandro,et al.  The readability of pediatric patient education materials on the World Wide Web. , 2001, Archives of pediatrics & adolescent medicine.

[54]  C. Waternaux,et al.  Suicidal behavior in bipolar mood disorder: clinical characteristics of attempters and nonattempters. , 2000, Journal of affective disorders.

[55]  Jennifer Preece,et al.  Lurker demographics: counting the silent , 2000, CHI.

[56]  N. Raoux,et al.  Executive functioning and verbal memory in young patients with unipolar depression and schizophrenia , 1999, Psychiatry Research.

[57]  Anna Basso,et al.  Semantic category and initial letter word fluency in left‐brain‐damaged patients , 1997 .

[58]  R. Watkins,et al.  Measuring children's lexical diversity: differentiating typical and impaired language learners. , 1995, Journal of speech and hearing research.

[59]  Karl J. Friston,et al.  Regional Brain Activity in Chronic Schizophrenic Patients during the Performance of a Verbal Fluency Task , 1995, British Journal of Psychiatry.

[60]  C. Vázquez,et al.  Automatic and effortful processing in depression. , 1993, Psychological bulletin.

[61]  S. P. Wright,et al.  Adjusted P-values for simultaneous inference , 1992 .

[62]  N. Schutte,et al.  Readability of health warnings on alcohol and tobacco products. , 1992, American journal of public health.

[63]  Karl J. Friston,et al.  A PET study of word finding , 1991, Neuropsychologia.

[64]  Cathy D. Meade,et al.  Readability Formulas: Cautions and Criteria , 1991 .

[65]  C. Meade,et al.  Patient literacy and the readability of smoking education literature. , 1989, American journal of public health.

[66]  R. Post,et al.  Effortful and automatic cognitive processes in depression. , 1986, Archives of general psychiatry.

[67]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[68]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[69]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[70]  R. Gunning The Fog Index After Twenty Years , 1969 .

[71]  R. Gunning The Technique of Clear Writing. , 1968 .

[72]  Arthur L. Benton,et al.  Word fluency and brain damage , 1967 .

[73]  Mike Conway,et al.  Examining thematic similarity, difference, and membership in three online mental health communities from reddit: A text mining and visualization approach , 2018, Comput. Hum. Behav..

[74]  Mike Conway,et al.  Tracking Health Related Discussions on Reddit for Public Health Applications , 2017, AMIA.

[75]  Rafael A. Calvo,et al.  Augmenting Online Mental Health Support Services , 2017 .

[76]  Elmer V. Bernstam,et al.  Social support in an Internet weight loss community , 2010, Int. J. Medical Informatics.

[77]  Siobhan Devlin,et al.  Simplifying Text for Language-Impaired Readers , 1999, EACL.

[78]  R. Heinrichs,et al.  Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. , 1998, Neuropsychology.

[79]  W. Maier,et al.  Assessment of frontal lobe functioning in schizophrenia and unipolar major depression. , 1993, Psychopathology.

[80]  Yoshitomo Takahashi Depression and Suicide. , 1975, Postgraduate medicine.

[81]  G. Harry McLaughlin,et al.  SMOG Grading - A New Readability Formula. , 1969 .