The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods

We are in the midst of a technological revolution whereby, for the first time, researchers can link daily word use to a broad array of real-world behaviors. This article reviews several computerized text analysis methods and describes how Linguistic Inquiry and Word Count (LIWC) was created and validated. LIWC is a transparent text analysis program that counts words in psychologically meaningful categories. Empirical results using LIWC demonstrate its ability to detect meaning in a wide variety of experimental settings, including to show attentional focus, emotionality, social relationships, thinking styles, and individual differences.

[1]  S. Freud.  The Psychopathology of Everyday Life , 1915 .

[2]  W. Holtzman.  Validation studies of the Rorschach test: shyness and gregariousness in the normal superior adult. , 1950, Journal of clinical psychology.

[3]  G. Gleser,et al.  THE SPEECH PATTERNS OF SCHIZOPHRENIC PATIENTS: A METHOD OF ASSESSING RELATIVE DEGREE OF PERSONAL DISORGANIZATION AND SOCIAL ALIENATION , 1958, Psychiatric research reports.

[4]  Philip J. Stone,et al.  Extracting Information. (Book Reviews: The General Inquirer. A Computer Approach to Content Analysis) , 1967 .

[5]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[6]  R. Cartwright,et al.  The Measurement of Psychological States Through the Content Analysis of Verbal Behavior , 1971 .

[7]  References , 1971 .

[8]  Deborah Davis,et al.  Use of first person pronouns as a function of increased objective self-awareness and performance feedback , 1975 .

[9]  D C McClelland,et al.  Inhibited power motivation and high blood pressure in men. , 1979, Journal of abnormal psychology.

[10]  S. Rosenberg,et al.  Verbal behavior and schizophrenia. The semantic dimension. , 1979, Archives of general psychiatry.

[11]  Philip E. Tetlock,et al.  Pre- to postelection shifts in presidential rhetoric: Impression management or cognitive adjustment. , 1981 .

[12]  Steven R. Brown,et al.  Verbal Behavior: Adaptation and Psychopathology , 1982 .

[13]  Theodore Shapiro,et al.  Verbal Behavior: Adaptation and Psychopathology , 1982 .

[14]  James W. Pennebaker,et al.  The psychology of physical symptoms , 1982 .

[15]  Philip E. Tetlock,et al.  Verbal Style and the Presidency: A Computer-Based Analysis , 1985 .

[16]  J. Pennebaker,et al.  Confronting a traumatic event: toward an understanding of inhibition and disease. , 1986, Journal of abnormal psychology.

[17]  James J. Bradac,et al.  Threats to generalization in the use of elicited, purloined, and contrived messages in human communication research , 1986 .

[18]  P. Stone,et al.  Verbal Style and the Presidency: A Computer-Based Analysis. , 1986 .

[19]  K. Fiedler,et al.  The cognitive functions of linguistic categories in describing persons: Social cognition and language. , 1988 .

[20]  W. Weintraub.  Verbal behavior in everyday life , 1989 .

[21]  Louis A. Gottschalk,et al.  Computerized content analysis of natural language , 1989, Artif. Intell. Medicine.

[22]  James W. Pennebaker,et al.  Opening up : the healing power of expressing emotions , 1990 .

[23]  George A. Miller,et al.  The science of words , 1991 .

[24]  S. Fienberg,et al.  The Clockwork Muse: The Predictability of Artistic Change. , 1991 .

[25]  E. Mergenthaler,et al.  Emotion-abstraction patterns in verbatim protocols: a new way of describing psychotherapeutic processes. , 1996, Journal of consulting and clinical psychology.

[26]  G. Stephenson,et al.  Diaries of significant events: socio-linguistic correlates of therapeutic outcomes in patients with addiction problems† , 1997 .

[27]  Martha E. Francis,et al.  Journal of Personality and Social Psychology Linguistic Predictors of Adaptive Bereavement , 2022 .

[28]  S. Lepore,et al.  Journal of Personality and Social Psychology Expressive Writing Moderates the Relation between Intrusive Thoughts and Depressive Symptoms , 2022 .

[29]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[30]  D. Winter.  A motivational analysis of the Clinton first term and the 1996 presidential campaign , 1998 .

[31]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[32]  Language1. . . n and Social Interaction1. . . n: Nature Abhors Uniformity , 1999 .

[33]  Robin M. Kowalski,et al.  “I was Only Kidding!”: Victims’ and Perpetrators’ Perceptions of Teasing , 2000 .

[34]  S. Brownlow,et al.  Differential Forms Linguistic Content of Various of Political Advertising , 2000 .

[35]  Sexton Jb,et al.  Analyzing cockpit communications: the links between language, performance, error, and workload. , 2000 .

[36]  J. Pennebaker,et al.  Word Use in the Poetry of Suicidal and Nonsuicidal Poets , 2001, Psychosomatic medicine.

[37]  K. Klein,et al.  Expressive writing can increase working memory capacity. , 2001, Journal of experimental psychology. General.

[38]  C. Beevers,et al.  Ignorance May Be Bliss, But Thought Suppression Promotes Superficial Cognitive Processing , 2001 .

[39]  E. Foa,et al.  Linguistic predictors of trauma pathology and physical health , 2001 .

[40]  Expressing health experience through embodied language. , 2002, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[41]  V. Follette,et al.  Physical and Psychological Effects of Written Disclosure Among Sexual Abuse Survivors , 2002 .

[42]  S. Manne.  Language Use and Post-Traumatic Stress Symptomatology in Parents of Pediatric Cancer Survivors1 , 2002 .

[43]  J. Pennebaker,et al.  Trauma in Real Time: Talking and Avoiding Online Conversations About the Death of Princess Diana , 2002 .

[44]  James W. Pennebaker,et al.  Language Use and Personality during Crises: Analyses of Mayor Rudolph Giuliani's Press Conferences , 2002 .

[45]  J. Pennebaker,et al.  Praying About Difficult Experiences as Self-Disclosure to God , 2002 .

[46]  J. Pennebaker,et al.  The sounds of social life: a psychometric analysis of students' daily social environments and natural conversations. , 2003, Journal of personality and social psychology.

[47]  Intentional avoidance and social understanding in repressors and nonrepressors: Two functions for emotion experience? , 2003 .

[48]  L. Rapport,et al.  Aspects of social and emotional competence in adult attention-deficit/hyperactivity disorder. , 2003, Neuropsychology.

[49]  Lauren A. Schmidt,et al.  Sex, syntax and semantics. , 2003 .

[50]  James Hartley,et al.  Improving the Clarity of Journal Abstracts in Psychology , 2003 .

[51]  J. Pennebaker,et al.  Lying Words: Predicting Deception from Linguistic Styles , 2003, Personality & social psychology bulletin.

[52]  J. Pennebaker,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Words of Wisdom: Language Use Over the Life Span , 2003 .

[53]  R. Adolphs,et al.  Effects of Damage to Right-Hemisphere Brain Structures on Spontaneous Emotional and Social Judgments , 2003 .

[54]  D. Gentner,et al.  Language in Mind: Advances in the Study of Language and Thought , 2003 .

[55]  S. Hemenover,et al.  The Good, the Bad, and the Healthy: Impacts of Emotional Disclosure of Trauma on Resilient Self-Concept and Psychological Distress , 2003, Personality & social psychology bulletin.

[56]  Jason E. Owen,et al.  Investigation of the effects of gender and preparation on quality of communication in Internet support groups , 2003, Comput. Hum. Behav..

[57]  James W. Pennebaker,et al.  THE ARCHIVAL ANATOMY OF A DISASTER: MEDIA COVERAGE AND COMMUNITY-WIDE HEALTH EFFECTS OF THE TEXAS A&M BONFIRE TRAGEDY , 2003 .

[58]  Alastair J. Gill,et al.  Language With Character: A Stratified Corpus Comparison of Individual Differences in E-Mail Communication , 2006 .

[59]  E. Watkins,et al.  Adaptive and maladaptive ruminative self-focus during emotional processing. , 2004, Behaviour research and therapy.

[60]  J. Pennebaker,et al.  Language use of depressed and depression-vulnerable college students , 2004 .

[61]  J. Tsai,et al.  Somatic and Social: Chinese Americans Talk about Emotion , 2004, Personality & social psychology bulletin.

[62]  D. Drotar,et al.  Linguistic Analysis of Written Narratives of Caregivers of Children and Adolescents with Chronic Illness: Cognitive and Emotional Processes and Physical and Psychological Health Outcomes , 2004, Journal of Clinical Psychology in Medical Settings.

[63]  J. Pennebaker,et al.  Linguistic Markers of Psychological Change Surrounding September 11, 2001 , 2004, Psychological science.

[64]  Jennifer C. Plumb,et al.  An Experimental Study of Emotional Responding in Women With Posttraumatic Stress Disorder Related to Interpersonal Violence , 2004, Journal of traumatic stress.

[65]  William G. Sharp,et al.  Emotional expression and modality: an analysis of affective arousal and linguistic output in a computer vs. paper paradigm , 2004, Comput. Hum. Behav..

[66]  James Hartley,et al.  Abstracts, introductions and discussions: How far do they differ in style? , 2003, Scientometrics.

[67]  D. Lester.  Katie's Diary : Unlocking the Mystery of a Suicide , 2004 .

[68]  J. Nunamaker,et al.  Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated Communications , 2004 .

[69]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[70]  Expressive Writing Intervention for Adolescents' Somatic Symptoms and Mood , 2004, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[71]  Jason E. Owen,et al.  Use of the Internet for Information and Support: Disclosure Among Persons with Breast and Prostate Cancer , 2004, Journal of Behavioral Medicine.

[72]  Carla J. Groom,et al.  Testosterone as a social inhibitor: two case studies of the effect of testosterone treatment on language. , 2004, Journal of abnormal psychology.

[73]  Richard B. Slatcher,et al.  Linguistic markers of psychological state through media interviews: John Kerry and John Edwards in 2004, Al Gore in 2000 , 2005 .

[74]  Adrienne Y. Lee,et al.  Language of lies in prison: linguistic classification of prisoners' truthful and deceptive natural language , 2005 .

[75]  D. Sloan,et al.  Getting to the Heart of the Matter: Written Disclosure, Gender, and Heart Rate , 2005, Psychosomatic medicine.

[76]  M. Tull,et al.  An investigation of the construct validity of the 20-Item Toronto Alexithymia Scale through the use of a verbalization task. , 2005, Journal of psychosomatic research.

[77]  J. Eid,et al.  Trauma narratives and emotional processing. , 2005, Scandinavian journal of psychology.

[78]  Jane A. Luterek,et al.  An experimental examination of emotional experience, expression, and disclosure in women reporting a history of childhood sexual abuse. , 2005, Journal of traumatic stress.

[79]  M. F. Schober,et al.  Chair and Couch Discourse: A Study of Visual Copresence in Psychoanalysis , 2005 .

[80]  M. Hebl,et al.  Affirmative Reaction: The Influence of Type of Justification on Nonbeneficiary Attitudes Toward Affirmative Action Plans in Higher Education , 2005 .

[81]  Doerte U. Junghaenel,et al.  Written Emotional Expression Produces Health Benefits in Fibromyalgia Patients , 2005, Psychosomatic medicine.

[82]  L. Cohen,et al.  Linguistic Analysis of College Aged Smokers and Never Smokers , 2005 .

[83]  C. Barr Taylor,et al.  Evaluation of computerized text analysis in an Internet breast cancer support group , 2005, Comput. Hum. Behav..

[84]  Peter C. Gordon,et al.  Pronouns in Marital Interaction , 2005, Psychological science.

[85]  D. Sloan,et al.  It’s All About Me: Self-Focused Attention and Depressed Mood , 2005, Cognitive Therapy and Research.

[86]  James W. Pennebaker,et al.  The Language of Love: Sex, Sexual Orientation, and Language Use in Online Personal Advertisements , 2005 .

[87]  Paul J. Taylor,et al.  Linguistic Style Matching and Negotiation Outcome , 2005 .

[88]  K. Heilman,et al.  Affective facial and lexical expression in aprosodic versus aphasic stroke patients , 2005, Journal of the International Neuropsychological Society.

[89]  K. Klein,et al.  Word Use in Emotional Narratives about Failed Romantic Relationships and Subsequent Mental Health , 2005 .

[90]  D. Roth,et al.  Randomized pilot of a self-guided internet coping group for women with early-stage breast cancer , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[91]  S. Dollinger,et al.  “A Picture’s Worth a Thousand Words”: Language Use in the Autophotographic Essay , 2005, Personality & social psychology bulletin.

[92]  J. Owen,et al.  Self-Report and Linguistic Indicators of Emotional Expression in Narratives as Predictors of Adjustment to Cancer , 2006, Journal of Behavioral Medicine.

[93]  Susan R. Fussell,et al.  Using linguistic features to measure presence in computer-mediated communication , 2006, CHI.

[94]  M. Lumley,et al.  Health effects of written emotional disclosure in adolescents with asthma: a randomized, controlled trial. , 2006, Journal of pediatric psychology.

[95]  Susanne M. Jones,et al.  How Does the Comforting Process Work? An Empirical Test of an Appraisal-Based Model of Comforting , 2006 .

[96]  Carolyn Penstein Rosé,et al.  Talk to me: foundations for successful individual-group interactions in online communities , 2006, CHI.

[97]  M. McCullough,et al.  Writing about the benefits of an interpersonal transgression facilitates forgiveness. , 2006, Journal of consulting and clinical psychology.

[98]  Jordan B. Peterson,et al.  The Bitter-Sweet Labor of Emoting: The Linguistic Comparison of Writers and Physicists , 2006 .

[99]  M. Strube,et al.  A Comparison of Narratives Told by Younger and Older Adults , 2005, Experimental aging research.

[100]  J. Pennebaker,et al.  How Do I Love Thee? Let Me Count the Words , 2006, Psychological science.

[101]  E. King,et al.  The stigma of obesity in customer service: a mechanism for remediation and bottom-line consequences of interpersonal discrimination. , 2006, The Journal of applied psychology.

[102]  M. Lumley,et al.  The health effects of at-home written emotional disclosure in fibromyalgia: A randomized trial , 2006, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[103]  J. Bono,et al.  Charisma, positive emotions and mood contagion , 2006 .

[104]  J. Pennebaker,et al.  Pro-anorexics and recovering anorexics differ in their linguistic Internet self-presentation. , 2006, Journal of psychosomatic research.

[105]  Sara Kiesler,et al.  Relationship effects in psychological explanations of nonhuman behavior , 2006 .

[106]  A. Guastella,et al.  Cognitive-Behavioral Models of Emotional Writing: A Validation Study , 2006, Cognitive Therapy and Research.

[107]  S. Gosling,et al.  Personality in its natural habitat: manifestations and implicit folk theories of personality in daily life. , 2006, Journal of personality and social psychology.

[108]  G. Huon,et al.  Expressive writing for high-risk drug dependent patients in a primary care clinic: A pilot study , 2006, Harm reduction journal.

[109]  A. Maass,et al.  Do verbs and adjectives play different roles in different cultures? A cross-linguistic analysis of person representation. , 2006, Journal of personality and social psychology.

[110]  Robert E. Kraut,et al.  Predicting Continued Participation in Newsgroups , 2006, J. Comput. Mediat. Commun..

[111]  M. Mehl,et al.  The lay assessment of subclinical depression in daily life. , 2006, Psychological assessment.

[112]  Danielle S. McNamara,et al.  Using Computational Text Analysis Tools to Compare the Lyrics of Suicidal and Non-Suicidal Songwriters , 2007 .

[113]  Jennifer C. Plumb,et al.  The case for mindfulness-based approaches in the cultivation of empathy: does nonjudgmental, present-moment awareness increase capacity for perspective-taking and empathic concern? , 2007, Journal of marital and family therapy.

[114]  K. Wilson,et al.  REVISITING WRITTEN DISCLOSURE: THE EFFECTS OF WARM VERSUS COLD EXPERIMENTERS , 2007 .

[115]  Jeffrey T. Hancock,et al.  On Lying and Being Lied To: A Linguistic Analysis of Deception in Computer-Mediated Communication , 2007 .

[116]  Dan Cosley,et al.  Feedback for guiding reflection on teamwork practices , 2007, GROUP.

[117]  Lori D. Handelman,et al.  The content of suicide notes from attempters and completers. , 2007, Crisis.

[118]  Cindy M Meston,et al.  Sexual Desire and Linguistic Analysis: A Comparison of Sexually-Abused and Non-Abused Women , 2007, Archives of sexual behavior.

[119]  Jeffrey T. Hancock,et al.  Expressing emotion in text-based communication , 2007, CHI.

[120]  Jeanne M. Brett,et al.  Sticks and Stones: Language, Face, and Online Dispute Resolution , 2007 .

[121]  L. Quine,et al.  Effects of written emotional disclosure on health outcomes in patients with ankylosing spondylitis , 2007 .

[122]  S. Rude,et al.  Self-compassion and adaptive psychological functioning. , 2007 .

[123]  A. Vrij,et al.  Cues to Deception and Ability to Detect Lies as a Function of Police Interview Styles , 2007, Law and human behavior.

[124]  M. Pasupathi.  Telling and the remembered self: Linguistic differences in memories for previously disclosed and previously undisclosed events , 2007, Memory.

[125]  R. Booth,et al.  Changes in mood predict disease activity and quality of life in patients with psoriasis following emotional disclosure. , 2007, Journal of psychosomatic research.

[126]  Hans Kordy,et al.  Linguistic analyses of natural written language: unobtrusive assessment of cognitive style in eating disorders. , 2007, The International journal of eating disorders.

[127]  Cindy K. Chung,et al.  The Relations Between Personality and Language Use , 2007, The Journal of general psychology.

[128]  Cindy K. Chung,et al.  The development and psychometric properties of LIWC2007 , 2007 .

[129]  R. Geenen,et al.  Feasibility and induced cognitive-emotional change of an emotional disclosure intervention adapted for home application. , 2007, Patient education and counseling.

[130]  L. Hasher,et al.  Does expressive writing reduce stress and improve health for family caregivers of older adults? , 2007, The Gerontologist.

[131]  D. Lester,et al.  Letters from a Suicide , 2007, Death studies.

[132]  Sheldon Cohen,et al.  Use of Social Words in Autobiographies and Longevity , 2007, Psychosomatic medicine.

[133]  R. M. Tobin,et al.  Measuring emotional expression with the Linguistic Inquiry and Word Count. , 2007, The American journal of psychology.

[134]  L. Rew,et al.  A Linguistic Investigation of Mediators Between Religious Commitment and Health Behaviors in Older Adolescents , 2007, Issues in comprehensive pediatric nursing.

[135]  Annette L. Stanton,et al.  Does Self-Affirmation, Cognitive Processing, or Discovery of Meaning Explain Cancer-Related Health Benefits of Expressive Writing? , 2007, Personality & social psychology bulletin.

[136]  Lili Ma,et al.  Signs of Pretense Across Age and Scenario. , 2007, Infancy : the official journal of the International Society on Infant Studies.

[137]  Georg W. Alpers,et al.  Cognitive and Emotional Processing in Narratives of Women Abused by Intimate Partners , 2007, Violence against women.

[138]  Cindy K. Chung,et al.  Variations in the spacing of expressive writing sessions. , 2008, British journal of health psychology.

[139]  Joshua M. Smyth,et al.  LINGUISTIC DIMENSIONS OF PSYCHOPATHOLOGY: A QUANTITATIVE ANALYSIS , 2008 .

[140]  Monisha Pasupathi,et al.  Blogging About Trauma: Linguistic Measures of Apparent Recovery , 2008 .

[141]  G. Clore,et al.  Affective incoherence: when affective concepts and embodied reactions clash. , 2008, Journal of personality and social psychology.

[142]  Ethan Kross,et al.  Facilitating Adaptive Emotional Analysis: Distinguishing Distanced-Analysis of Depressive Experiences From Immersed-Analysis and Distraction , 2008, Personality & social psychology bulletin.

[143]  B. Cheson,et al.  Implementing an expressive writing study in a cancer clinic. , 2008, The oncologist.

[144]  Morton A. Lieberman,et al.  Effects of disease and leader type on moderators in online support groups , 2008, Comput. Hum. Behav..

[145]  M. Rohrbaugh,et al.  Prognostic significance of spouse we talk in couples coping with heart failure. , 2008, Journal of consulting and clinical psychology.

[146]  Poor cognitive-emotional processing may impede the outcome of emotional disclosure interventions. , 2008, British journal of health psychology.

[147]  J. A. Dooley,et al.  Relaxation Training and Written Emotional Disclosure for Tension or Migraine Headaches: A Randomized, Controlled Trial , 2008, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[148]  D. Markland,et al.  The effects of autonomy-supportive versus controlling environments on self-talk , 2008 .

[149]  P. Taylor,et al.  Linguistic Style Matching and Negotiation Outcome , 2005 .

[150]  Carla J. Groom,et al.  Gender Differences in Language Use: An Analysis of 14,000 Text Samples , 2008 .

[151]  P. Costa,et al.  Age differences in descriptions of emotional experiences in oneself and others. , 2008, The journals of gerontology. Series B, Psychological sciences and social sciences.

[152]  A. Cohen,et al.  Clarifying the Linguistic Signature: Measuring Personality From Natural Speech , 2008, Journal of personality assessment.

[153]  Expressive writing in context: the effects of a confessional setting and delivery of instructions on participant experience and language in writing. , 2008, British journal of health psychology.

[154]  J. Pennebaker,et al.  Am “I” more important than “we”? Couples’ word use in instant messages , 2008 .

[155]  Mitch Golant,et al.  Detecting emotional expression in face-to-face and online breast cancer support groups. , 2008, Journal of consulting and clinical psychology.

[156]  J. Singer,et al.  Telling losses: Personality correlates and functions of bereavement narratives , 2008 .

[157]  Darren Gergle,et al.  The language of emotion in short blog texts , 2008, CSCW.

[158]  Peter C Gordon,et al.  How do hostile and emotionally overinvolved relatives view relationships? What relatives' pronoun use tells us. , 2008, Family process.

[159]  E. Bantum,et al.  Evaluating the validity of computerized content analysis programs for identification of emotional expression in cancer narratives. , 2009, Psychological assessment.

[160]  Stephen Reysen,et al.  Online Interactions Between Group Members Who Differ in Status , 2009 .