Cognitive Impairments in Schizophrenia: A Study in a Large Clinical Sample Using Natural Language Processing

Background: Cognitive impairments are a neglected aspect of schizophrenia despite being a major factor of poor functional outcome. They are usually measured using various rating scales, however, these necessitate trained practitioners and are rarely routinely applied in clinical settings. Recent advances in natural language processing techniques allow us to extract such information from unstructured portions of text at a large scale and in a cost effective manner. We aimed to identify cognitive problems in the clinical records of a large sample of patients with schizophrenia, and assess their association with clinical outcomes. Methods: We developed a natural language processing based application identifying cognitive dysfunctions from the free text of medical records, and assessed its performance against a rating scale widely used in the United Kingdom, the cognitive component of the Health of the Nation Outcome Scales (HoNOS). Furthermore, we analyzed cognitive trajectories over the course of patient treatment, and evaluated their relationship with various socio-demographic factors and clinical outcomes. Results: We found a high prevalence of cognitive impairments in patients with schizophrenia, and a strong correlation with several socio-demographic factors (gender, education, ethnicity, marital status, and employment) as well as adverse clinical outcomes. Results obtained from the free text were broadly in line with those obtained using the HoNOS subscale, and shed light on additional associations, notably related to attention and social impairments for patients with higher education. Conclusions: Our findings demonstrate that cognitive problems are common in patients with schizophrenia, can be reliably extracted from clinical records using natural language processing, and are associated with adverse clinical outcomes. Harvesting the free text from medical records provides a larger coverage in contrast to neurocognitive batteries or rating scales, and access to additional socio-demographic and clinical variables. Text mining tools can therefore facilitate large scale patient screening and early symptoms detection, and ultimately help inform clinical decisions.

[1]  R. Dobson,et al.  Cognitive Trajectories in Comorbid Dementia With Schizophrenia or Bipolar Disorder: The South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLaM BRC) Case Register , 2020, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[2]  Thorsten Gerber,et al.  Applied Longitudinal Data Analysis Modeling Change And Event Occurrence , 2016 .

[3]  Olivier Bodenreider,et al.  The Unified Medical Language System (UMLS): integrating biomedical terminology , 2004, Nucleic Acids Res..

[4]  R. Jacobs,et al.  Impact of crisis resolution and home treatment teams on psychiatric admissions in England. , 2011, The British journal of psychiatry : the journal of mental science.

[5]  Mark Taylor,et al.  Suicide and schizophrenia: a systematic review of rates and risk factors , 2010, Journal of psychopharmacology.

[6]  E. Bleuler.  [Dementia praecox or the group of schizophrenias]. , 1968, Vertex.

[7]  Jaewoo Kang,et al.  BioBERT: a pre-trained biomedical language representation model for biomedical text mining , 2019, Bioinform..

[8]  R'emi Louf,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[9]  James M. Gold,et al.  The MATRICS Consensus Cognitive Battery (MCCB): Clinical and cognitive correlates , 2012, Schizophrenia Research.

[10]  Zina M. Ibrahim,et al.  Identification of Adverse Drug Events from Free Text Electronic Patient Records and Information in a Large Mental Health Case Register , 2015, PloS one.

[11]  E. Stip,et al.  Exploring cognitive complaints in schizophrenia: the subjective scale to investigate cognition in schizophrenia. , 2003, Comprehensive psychiatry.

[12]  R. Stewart,et al.  Recorded poor insight as a predictor of service use outcomes: cohort study of patients with first-episode psychosis in a large mental healthcare database , 2019, BMJ Open.

[13]  Mogens Vestergaard,et al.  Life expectancy and cardiovascular mortality in persons with schizophrenia , 2012, Current opinion in psychiatry.

[14]  A M Owen,et al.  Computerized assessment in neuropsychiatry using CANTAB: discussion paper. , 1992, Journal of the Royal Society of Medicine.

[15]  Kent A. Spackman,et al.  SNOMED clinical terms: overview of the development process and project status , 2001, AMIA.

[16]  Jessica D. Tenenbaum,et al.  Symptom-based patient stratification in mental illness using clinical notes , 2019, J. Biomed. Informatics.

[17]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[18]  R. Mayes.  The ADHD Explosion: Myths, Medication, Money, and Today's Push for Performance , 2015 .

[19]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[20]  Mike J. Crawford,et al.  Improving the quality of mental health services using patient outcome data: making the most of HoNOS , 2017, BJPsych bulletin.

[21]  M. Olfson,et al.  Predicting psychiatric hospital admission among adults with schizophrenia. , 2011, Psychiatric services.

[22]  S. Hofer,et al.  Decline in Memory, Visuospatial Ability, and Crystalized Cognitive Abilities in Older Adults: Normative Aging or Terminal Decline? , 2017, Journal of aging research.

[23]  Richard Dobson,et al.  Comparative Analysis of Text Classification Approaches in Electronic Health Records , 2020, BIONLP.

[24]  A. Need,et al.  A comparison of the Cambridge Automated Neuropsychological Test Battery (CANTAB) with “traditional” neuropsychological testing instruments , 2013, Journal of clinical and experimental neuropsychology.

[25]  Rashmi Patel,et al.  Mood instability is a common feature of mental health disorders and is associated with poor clinical outcomes , 2015, BMJ Open.

[26]  R. Heinrichs,et al.  Neurocognitive deficit in schizophrenia: a quantitative review of the evidence. , 1998, Neuropsychology.

[27]  Sumithra Velupillai,et al.  Generating Positive Psychosis Symptom Keywords from Electronic Health Records , 2019, AIME.

[28]  Xuanjing Huang,et al.  How to Fine-Tune BERT for Text Classification? , 2019, CCL.

[29]  G. Harper.  The ADHD Explosion: Myths, Medication, Money, and Today's Push for Performanceby Stephen P. Hinshaw and Richard M. Scheffler; New York, Oxford University Press, 2014, 254 pages. , 2016, Psychiatric services.

[30]  Lysandre Debut,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[31]  Philip D. Harvey,et al.  The Schizophrenia Cognition Rating Scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. , 2006, The American journal of psychiatry.

[32]  Nishita Mehta,et al.  Concurrence of big data analytics and healthcare: A systematic review , 2018, Int. J. Medical Informatics.

[33]  R. Stewart,et al.  Recorded atypical hallucinations in psychotic and affective disorders and associations with non-benzodiazepine hypnotic use: the South London and Maudsley Case Register , 2018, BMJ Open.

[34]  Graham Thornicroft,et al.  The South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLAM BRC) case register: development and descriptive data , 2009, BMC psychiatry.

[35]  J K Wing,et al.  Health of the Nation Outcome Scales (HoNOS) , 1998, British Journal of Psychiatry.

[36]  Angus Roberts,et al.  Negative symptoms in schizophrenia: a study in a large clinical sample of patients using a novel automated method , 2015, BMJ Open.

[37]  Sujita Kumar Kar,et al.  Cognitive Deficits in Schizophrenia: Understanding the Biological Correlates and Remediation Strategies , 2018, Clinical psychopharmacology and neuroscience : the official scientific journal of the Korean College of Neuropsychopharmacology.

[38]  Philip E. Bourne,et al.  Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review , 2019, J. Am. Medical Informatics Assoc..

[39]  Philip D. Harvey,et al.  The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery , 2004, Schizophrenia Research.

[40]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[41]  James G. Scott,et al.  Global Epidemiology and Burden of Schizophrenia: Findings From the Global Burden of Disease Study 2016 , 2018, Schizophrenia bulletin.

[42]  E. Stip,et al.  Computerized assessment of cognition in schizophrenia: Promises and pitfalls of CANTAB , 2007, European Psychiatry.

[43]  Christos Pantelis,et al.  Cognitive functioning in schizophrenia, schizoaffective disorder and affective psychoses: meta-analytic study , 2009, British Journal of Psychiatry.

[44]  Andrea C. Fernandes,et al.  Cohort profile of the South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLaM BRC) Case Register: current status and recent enhancement of an Electronic Mental Health Record-derived data resource , 2016, BMJ Open.