Spoken language biomarkers for detecting cognitive impairment

In this study we developed an automated system that evaluates speech and language features from audio recordings of neuropsychological examinations of 92 subjects in the Framingham Heart Study. A total of 265 features were used in an elastic-net regularized binomial logistic regression model to classify the presence of cognitive impairment, and to select the most predictive features. We compared performance with a demographic model from 6,258 subjects in the greater study cohort (0.79 AUC), and found that a system that incorporated both audio and text features performed the best (0.92 AUC), with a True Positive Rate of 29% (at 0% False Positive Rate) and a good model fit (Hosmer-Lemeshow test > 0.05). We also found that decreasing pitch and jitter, shorter segments of speech, and responses phrased as questions were positively associated with cognitive impairment.

[1]  D. Hosmer,et al.  Goodness of fit tests for the multiple logistic regression model , 1980 .

[2]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[3]  Janice E. Knoefel,et al.  Apolipoprotein E element 4 association with dementia in a population-based study , 1996, Neurology.

[4]  C. Dufouil,et al.  Incidence of Dementia over Three Decades in the Framingham Heart Study. , 2016, The New England journal of medicine.

[5]  A. Saykin,et al.  Older adults with cognitive complaints show brain atrophy similar to that of amnestic MCI , 2006, Neurology.

[6]  Marcos Faúndez-Zanuy,et al.  On Automatic Diagnosis of Alzheimer’s Disease Based on Spontaneous Speech Analysis and Emotional Temperature , 2013, Cognitive Computation.

[7]  Daniel Levy,et al.  The Framingham Heart Study and the epidemiology of cardiovascular disease: a historical perspective , 2014, The Lancet.

[8]  Kathleen C. Fraser,et al.  Linguistic Features Identify Alzheimer's Disease in Narrative Speech. , 2015, Journal of Alzheimer's disease : JAD.

[9]  Vanessa Taler,et al.  Language performance in Alzheimer's disease and mild cognitive impairment: A comparative review , 2008, Journal of clinical and experimental neuropsychology.

[10]  N. Meinshausen,et al.  High-Dimensional Inference: Confidence Intervals, $p$-Values and R-Software hdi , 2014, 1408.4026.

[11]  J. Haines,et al.  Effects of Age, Sex, and Ethnicity on the Association Between Apolipoprotein E Genotype and Alzheimer Disease: A Meta-analysis , 1997 .

[12]  Bennett P Leifer Early Diagnosis of Alzheimer's Disease: Clinical and Economic Benefits , 2003, Journal of the American Geriatrics Society.

[13]  E. Reiman,et al.  Multicenter Standardized 18F-FDG PET Diagnosis of Mild Cognitive Impairment, Alzheimer's Disease, and Other Dementias , 2008, Journal of Nuclear Medicine.

[14]  Sudha Seshadri,et al.  Serum brain-derived neurotrophic factor and the risk for dementia: the Framingham Heart Study. , 2014, JAMA neurology.

[15]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[16]  F. Jessen,et al.  Prediction of dementia by subjective memory impairment: effects of severity and temporal association with cognitive impairment. , 2010, Archives of general psychiatry.

[17]  N. Cercone,et al.  Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[18]  R B D'Agostino,et al.  The effect of education on the incidence of dementia and Alzheimer's disease in the Framingham Study , 1995, Neurology.

[19]  Sudha Seshadri,et al.  Biomarkers for insulin resistance and inflammation and the risk for all-cause dementia and alzheimer disease: results from the Framingham Heart Study. , 2012, Archives of neurology.

[20]  K. Horley,et al.  Emotional prosody perception and production in dementia of the Alzheimer's type. , 2010, Journal of speech, language, and hearing research : JSLHR.

[21]  D. N. Ripich,et al.  Turn-taking and speech act patterns in the discourse of senile dementia of the Alzheimer's type patients , 1991, Brain and Language.

[22]  J. Illes Neurolinguistic features of spontaneous language production dissociate three forms of neurodegenerative disease: Alzheimer's, Huntington's, and Parkinson's , 1989, Brain and Language.

[23]  Gianluigi Forloni,et al.  Homocysteine, folate, and vitamin B-12 in mild cognitive impairment, Alzheimer disease, and vascular dementia. , 2004, The American journal of clinical nutrition.

[24]  Wei Zhu,et al.  Outcome over seven years of healthy adults with and without subjective cognitive impairment , 2010, Alzheimer's & Dementia.

[25]  R. Petersen,et al.  Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects , 2009, Annals of neurology.

[26]  P. Wolf,et al.  The lifetime risk of stroke: estimates from the Framingham Study. , 2006, Stroke.

[27]  Björn Schuller,et al.  Opensmile: the munich versatile and fast open-source audio feature extractor , 2010, ACM Multimedia.

[28]  R. Nussbaum,et al.  Alzheimer's disease and Parkinson's disease. , 2003, The New England journal of medicine.

[29]  C. Ferri,et al.  World Alzheimer Report 2011 : The benefits of early diagnosis and intervention , 2018 .

[30]  Diederick E Grobbee,et al.  Prevalence of Alzheimer's disease and vascular dementia: association with education. The Rotterdam study , 1995, BMJ.

[31]  Janet Wiles,et al.  An Automated Approach to Examining Conversational Dynamics between People with Dementia and Their Carers , 2015, PloS one.

[32]  Constantine Lyketsos,et al.  Dementia and Alzheimer's Disease Incidence in Relationship to Cardiovascular Disease in the Cardiovascular Health Study Cohort , 2005, Journal of the American Geriatrics Society.

[33]  R. D'Agostino,et al.  Association of white matter hyperintensity volume with decreased cognitive functioning: the Framingham Heart Study. , 2006, Archives of neurology.

[34]  Alzheimer’s Association 2015 Alzheimer's disease facts and figures , 2015, Alzheimer's & Dementia.

[35]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[36]  G. C. Román,et al.  Vascular dementia , 1993, Neurology.

[37]  Florian Eyben,et al.  Real-time Speech and Music Classification by Large Audio Feature Space Extraction , 2015 .

[38]  V. Manera,et al.  Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease , 2015, Alzheimer's & dementia.

[39]  James R. Glass,et al.  Analysis and Processing of Lecture Audio Data: Preliminary Investigations , 2004, Proceedings of the Workshop on Interdisciplinary Approaches to Speech Indexing and Retrieval at HLT-NAACL 2004 - SpeechIR '04.

[40]  Dolores E. López,et al.  Speech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia? , 2014, Dementia and Geriatric Cognitive Disorders.

[41]  D. Holtzman,et al.  The Role of Apolipoprotein E in Alzheimer's Disease , 2009, Neuron.

[42]  C. Jack,et al.  Serial PIB and MRI in normal, mild cognitive impairment and Alzheimer's disease: implications for sequence of pathological events in Alzheimer's disease , 2009, Brain : a journal of neurology.

[43]  A. Hofman,et al.  Atherosclerosis, apolipoprotein E, and prevalence of dementia and Alzheimer's disease in the Rotterdam Study , 1997, The Lancet.

[44]  Andreas Stolcke,et al.  SRILM - an extensible language modeling toolkit , 2002, INTERSPEECH.

[45]        Global prevalence of dementia: a Delphi consensus study , 2006 .