Toward the Automation of Diagnostic Conversation Analysis in Patients with Memory Complaints.

BACKGROUND The early diagnosis of dementia is of great clinical and social importance. A recent study using the qualitative methodology of conversation analysis (CA) demonstrated that language and communication problems are evident during interactions between patients and neurologists, and that interactional observations can be used to differentiate between cognitive difficulties due to neurodegenerative disorders (ND) or functional memory disorders (FMD). OBJECTIVE This study explores whether the differential diagnostic analysis of doctor-patient interactions in a memory clinic can be automated. METHODS Verbatim transcripts of conversations between neurologists and patients initially presenting with memory problems to a specialist clinic were produced manually (15 with FMD, and 15 with ND). A range of automatically detectable features focusing on acoustic, lexical, semantic, and visual information contained in the transcripts were defined aiming to replicate the diagnostic qualitative observations. The features were used to train a set of five machine learning classifiers to distinguish between ND and FMD. RESULTS The mean rate of correct classification between ND and FMD was 93% ranging from 97% by the Perceptron classifier to 90% by the Random Forest classifier.Using only the ten best features, the mean correct classification score increased to 95%. CONCLUSION This pilot study provides proof-of-principle that a machine learning approach to analyzing transcripts of interactions between neurologists and patients describing memory problems can distinguish people with neurodegenerative dementia from people with FMD.

[1]  J. Raven Coloured progressive matrices : sets A, Ab, B , 1956 .

[2]  P. Rubé,et al.  L’examen Clinique en Psychologie , 1959 .

[3]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[4]  E. Renzi,et al.  Normative Data and Screening Power of a Shortened Version of the Token Test , 1978, Cortex.

[5]  C. Wells Communication and Cognition in Normal Aging and Dementia , 1990 .

[6]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[7]  H. Hamilton Conversations with an Alzheimer's Patient: An Interactional Sociolinguistic Study , 1994 .

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  D. Wechsler Wechsler Adult Intelligence Scale , 2021, Encyclopedia of Evolutionary Psychological Science.

[10]  A. Whitworth,et al.  Conversing in dementia: A conversation analytic approach , 1998, Journal of Neurolinguistics.

[11]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[12]  N. Cercone,et al.  Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[13]  Christopher M. Callahan,et al.  Implementing a screening and diagnosis program for dementia in primary care , 2005, Journal of General Internal Medicine.

[14]  Elizabeth Shriberg,et al.  Spontaneous speech: how people really talk and why engineers should care , 2005, INTERSPEECH.

[15]  B. Metternich,et al.  The syndrome of functional memory disorder: definition, etiology, and natural course. , 2008, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[16]  M. Reuber,et al.  Listening to people with seizures: how can linguistic analysis help in the differential diagnosis of seizure disorders? , 2008, Communication & medicine.

[17]  B. Metternich,et al.  How are memory complaints in functional memory disorder related to measures of affect, metamemory and cognition? , 2009, Journal of psychosomatic research.

[18]  Ewan Klein,et al.  Natural Language Processing with Python , 2009 .

[19]  C. Warlow,et al.  Symptoms 'unexplained by organic disease' in 1144 new neurology out-patients: how often does the diagnosis change at follow-up? , 2009, Brain : a journal of neurology.

[20]  Chiara M. Monzoni,et al.  Using interactional and linguistic analysis to distinguish between epileptic and psychogenic nonepileptic seizures: A prospective, blinded multirater study , 2009, Epilepsy & Behavior.

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[23]  I. Hickie,et al.  Subjective memory complaints, vascular risk factors and psychological distress in the middle-aged: a cross-sectional study , 2011, BMC psychiatry.

[24]  Nick C Fox,et al.  Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. , 2011, Brain : a journal of neurology.

[25]  A. Larner,et al.  Use of cognitive screening instruments in primary care: the impact of national dementia directives (NICE/SCIE, National Dementia Strategy). , 2011, Family practice.

[26]  A. David,et al.  Functional (conversion) neurological symptoms: research since the millennium , 2012, Journal of Neurology, Neurosurgery & Psychiatry.

[27]  Yiannis Kompatsiaris,et al.  Evaluation of speech-based protocol for detection of early-stage dementia , 2013, INTERSPEECH.

[28]  Marcos Faúndez-Zanuy,et al.  On the Selection of Non-Invasive Methods Based on Speech Analysis Oriented to Automatic Alzheimer Disease Diagnosis , 2013, Sensors.

[29]  F. Jessen,et al.  AD dementia risk in late MCI, in early MCI, and in subjective memory impairment , 2014, Alzheimer's & Dementia.

[30]  A. Larner Impact of the National Dementia Strategy in a neurology-led memory clinic: 5-year data. , 2014, Clinical medicine.

[31]  Colleen Richey,et al.  Aided diagnosis of dementia type through computer-based analysis of spontaneous speech , 2014, CLPsych@ACL.

[32]  L. Fratiglioni,et al.  Mild cognitive impairment: a concept in evolution , 2014, Journal of internal medicine.

[33]  Hans Förstl,et al.  Suitability of the 6CIT as a screening test for dementia in primary care patients , 2013, Aging & mental health.

[34]  M. Reuber,et al.  Memory difficulties are not always a sign of incipient dementia: a review of the possible causes of loss of memory efficiency. , 2014, British medical bulletin.

[35]  Andrew J. Saykin,et al.  A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer's disease , 2014, Alzheimer's & Dementia.

[36]  D. Blackburn,et al.  A diagnosis for £55: what is the cost of government initiatives in dementia case finding. , 2014, Age and ageing.

[37]  P. Drew,et al.  Towards diagnostic conversational profiles of patients presenting with dementia or functional memory disorders to memory clinics. , 2015, Patient education and counseling.

[38]  Robert J. Moore,et al.  Automated Transcription and Conversation Analysis , 2015 .

[39]  Jesús B. Alonso,et al.  Feature selection for spontaneous speech analysis to aid in Alzheimer's disease diagnosis: A fractal dimension approach , 2015, Comput. Speech Lang..

[40]  Gábor Gosztolya,et al.  Automatic detection of mild cognitive impairment from spontaneous speech using ASR , 2015, INTERSPEECH.

[41]  Frank Rudzicz,et al.  Using linguistic features longitudinally to predict clinical scores for Alzheimer’s disease and related dementias , 2015, SLPAT@Interspeech.

[42]  P. Drew,et al.  Conversational assessment in memory clinic encounters: interactional profiling for differentiating dementia from functional memory disorders , 2016, Aging & mental health.

[43]  Kathleen C. Fraser,et al.  Linguistic Features Identify Alzheimer's Disease in Narrative Speech. , 2015, Journal of Alzheimer's disease : JAD.

[44]  Gábor Gosztolya,et al.  Detecting Mild Cognitive Impairment from Spontaneous Speech by Correlation-Based Phonetic Feature Selection , 2016, INTERSPEECH.