A systematic literature review of automatic Alzheimer’s disease detection from speech and language

Abstract Objective In recent years numerous studies have achieved promising results in Alzheimer’s Disease (AD) detection using automatic language processing. We systematically review these articles to understand the effectiveness of this approach, identify any issues and report the main findings that can guide further research. Materials and Methods We searched PubMed, Ovid, and Web of Science for articles published in English between 2013 and 2019. We performed a systematic literature review to answer 5 key questions: (1) What were the characteristics of participant groups? (2) What language data were collected? (3) What features of speech and language were the most informative? (4) What methods were used to classify between groups? (5) What classification performance was achieved? Results and Discussion We identified 33 eligible studies and 5 main findings: participants’ demographic variables (especially age ) were often unbalanced between AD and control group; spontaneous speech data were collected most often; informative language features were related to word retrieval and semantic, syntactic, and acoustic impairment; neural nets, support vector machines, and decision trees performed well in AD detection, and support vector machines and decision trees performed well in decline detection; and average classification accuracy was 89% in AD and 82% in mild cognitive impairment detection versus healthy control groups. Conclusion The systematic literature review supported the argument that language and speech could successfully be used to detect dementia automatically. Future studies should aim for larger and more balanced datasets, combine data collection methods and the type of information analyzed, focus on the early stages of the disease, and report performance using standardized metrics.

[1]  Natalia Grabar,et al.  Contrastive conversational analysis of language production by Alzheimer's and control people , 2014, MIE.

[2]  Andrés Montoyo,et al.  Advances on natural language processing , 2007, Data Knowl. Eng..

[3]  Gábor Gosztolya,et al.  Automatic detection of mild cognitive impairment from spontaneous speech using ASR , 2015, INTERSPEECH.

[4]  Daly Louise,et al.  Systematic Approaches to a Successful Literature Review , 2013 .

[5]  J. David Schaffer,et al.  Speech Processing Approach for Diagnosing Dementia in an Early Stage , 2017, INTERSPEECH.

[6]  Saturnino Luz,et al.  A Method for Analysis of Patient Speech in Dialogue for Dementia Detection , 2018, ArXiv.

[7]  Francisco Martínez-Sánchez,et al.  Acoustic Markers Associated with Impairment in Language Processing in Alzheimer's Disease , 2012, The Spanish journal of psychology.

[8]  J. Pariente,et al.  Pauses During Autobiographical Discourse Reflect Episodic Memory Processes in Early Alzheimer’s Disease , 2015, Journal of Alzheimer's disease : JAD.

[9]  D. Friedman,et al.  Event-Related Potential and Behavioral Correlates of Semantic Processing in Alzheimer′s Patients and Normal Controls , 1995, Brain and Language.

[10]  Gábor Gosztolya,et al.  Detecting Mild Cognitive Impairment from Spontaneous Speech by Correlation-Based Phonetic Feature Selection , 2016, INTERSPEECH.

[11]  Alexandra Konig,et al.  Use of Speech Analyses within a Mobile Application for the Assessment of Cognitive Impairment in Elderly People. , 2018, Current Alzheimer research.

[12]  Ali Khodabakhsh,et al.  Evaluation of linguistic and prosodic features for detection of Alzheimer’s disease in Turkish conversational speech , 2015, EURASIP J. Audio Speech Music. Process..

[13]  Juliana Onofre DE Lira,et al.  Analysis of word number and content in discourse of patients with mild to moderate Alzheimer's disease , 2014, Dementia & neuropsychologia.

[14]  J. Hodges,et al.  The effects of very early Alzheimer's disease on the characteristics of writing by a renowned author. , 2004, Brain : a journal of neurology.

[15]  R. Knight,et al.  Memory processing in Alzheimer's disease , 2002, Neuropsychologia.

[16]  M N Rossor,et al.  Presymptomatic cognitive deficits in individuals at risk of familial Alzheimer's disease. A longitudinal prospective study. , 1998, Brain : a journal of neurology.

[17]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[18]  F. Martínez-Sánchez,et al.  Speech rhythm alterations in Spanish-speaking individuals with Alzheimer’s disease , 2017, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[19]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[20]  Marcos Faúndez-Zanuy,et al.  On the Selection of Non-Invasive Methods Based on Speech Analysis Oriented to Automatic Alzheimer Disease Diagnosis , 2013, Sensors.

[21]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[22]  M. Prince,et al.  World Alzheimer report 2016: improving healthcare for people living with dementia: coverage, quality and costs now and in the future , 2016 .

[23]  Vitor C. Zimmerer,et al.  Formulaic Language in People with Probable Alzheimer's Disease: A Frequency-Based Approach. , 2016, Journal of Alzheimer's disease : JAD.

[24]  Pedro Gómez Vilda,et al.  ALZUMERIC : A decision support system for diagnosis and monitoring of cognitive impairment , 2017 .

[25]  Hélène Kerhervé,et al.  Two-Stage Feature Selection of Voice Parameters for Early Alzheimer's Disease Prediction , 2018, IRBM.

[26]  G. Guyatt,et al.  GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. , 2011, Journal of clinical epidemiology.

[27]  Yiannis Kompatsiaris,et al.  Evaluation of speech-based protocol for detection of early-stage dementia , 2013, INTERSPEECH.

[28]  Ben Singer,et al.  A comparison of syntax, semantics, and pragmatics in spoken language among residents with Alzheimer's disease in managed-care facilities , 2014, 2014 IEEE Symposium on Computational Intelligence in Healthcare and e-health (CICARE).

[29]  Li-Chen Fu,et al.  An Assessment System for Alzheimer's Disease Based on Speech Using a Novel Feature Sequence Design and Recurrent Neural Network , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[30]  Ali Khodabakhsh,et al.  Detection of Alzheimer's disease using prosodic cues in conversational speech , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[31]  A. Venneri,et al.  Distinct Patterns of Spontaneous Speech Deterioration: An Early Predictor of Alzheimer's Disease , 2002, Brain and Cognition.

[32]  D. G. Clark,et al.  Lexical factors and cerebral regions influencing verbal fluency performance in MCI , 2014, Neuropsychologia.

[33]  Armando Barreto,et al.  Computerized neuropsychological assessment in mild cognitive impairment based on natural language processing-oriented feature extraction , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[34]  Marcos Faúndez-Zanuy,et al.  On Automatic Diagnosis of Alzheimer’s Disease Based on Spontaneous Speech Analysis and Emotional Temperature , 2013, Cognitive Computation.

[35]  D. G. Clark,et al.  Novel verbal fluency scores and structural brain imaging for prediction of cognitive outcome in mild cognitive impairment , 2016, Alzheimer's & dementia.

[36]  P. Garrard,et al.  Lost in semantic space: a multi-modal, non-verbal assessment of feature knowledge in semantic dementia. , 2006, Brain : a journal of neurology.

[37]  H. Christensen,et al.  Toward the Automation of Diagnostic Conversation Analysis in Patients with Memory Complaints. , 2017, Journal of Alzheimer's disease : JAD.

[38]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[39]  Karin Zazo Ortiz,et al.  Naming ability in patients with mild to moderate Alzheimer's disease: what changes occur with the evolution of the disease? , 2015, Clinics.

[40]  Gordon H Guyatt,et al.  GRADE guidelines: 5. Rating the quality of evidence--publication bias. , 2011, Journal of clinical epidemiology.

[41]  Jackie MacDonald,et al.  Systematic Approaches to a Successful Literature Review , 2014 .

[42]  Annalena Venneri,et al.  Diagnostic and prognostic role of semantic processing in preclinical Alzheimer's disease. , 2018, Biomarkers in medicine.

[43]  Fabio Tamburini,et al.  Speech Analysis by Natural Language Processing Techniques: A Possible Tool for Very Early Detection of Cognitive Decline? , 2018, Front. Aging Neurosci..

[44]  Amal Mudallali Statement , 1988, Definitions.

[45]  Koichi Shinoda,et al.  Detecting Alzheimer's Disease Using Gated Convolutional Neural Network from Audio Data , 2018, INTERSPEECH.

[46]  Knut Waterloo,et al.  Neuroanatomical correlates of verbal fluency in early Alzheimer’s disease and normal aging , 2016, Brain and Language.

[47]  K. Forbes-McKay,et al.  Detecting subtle spontaneous language decline in early Alzheimer’s disease with a picture description task , 2005, Neurological Sciences.

[48]  Sylvie Ratté,et al.  Computer-based evaluation of Alzheimer’s disease and mild cognitive impairment patients during a picture description task , 2018, Alzheimer's & dementia.

[49]  V. Manera,et al.  Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease , 2015, Alzheimer's & dementia.

[50]  Jesús B. Alonso,et al.  Feature selection for spontaneous speech analysis to aid in Alzheimer's disease diagnosis: A fractal dimension approach , 2015, Comput. Speech Lang..

[51]  Karin Zazo Ortiz,et al.  Evaluation of macrolinguistic aspects of the oral discourse in patients with Alzheimer’s disease , 2018, International Psychogeriatrics.

[52]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[53]  Jiri Mekyska,et al.  Advances on Automatic Speech Analysis for Early Detection of Alzheimer Disease: A Non-linear Multi-task Approach. , 2018, Current Alzheimer research.

[54]  Paavo Alku,et al.  Vocal effort compensation for MFCC feature extraction in a shouted versus normal speaker recognition task , 2019, Comput. Speech Lang..

[55]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[56]  P. Garrard,et al.  Connected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease , 2013, Brain : a journal of neurology.

[57]  Gábor Gosztolya,et al.  Identifying Mild Cognitive Impairment and mild Alzheimer's disease based on spontaneous speech using ASR and linguistic features , 2019, Comput. Speech Lang..

[58]  Gábor Gosztolya,et al.  A Speech Recognition-based Solution for the Automatic Detection of Mild Cognitive Impairment from Spontaneous Speech , 2018, Current Alzheimer research.

[59]  Dragana Nikolic,et al.  Motif discovery in speech: application to monitoring Alzheimer's disease , 2014, IWBBIO.

[60]  Kathleen C. Fraser,et al.  Linguistic Features Identify Alzheimer's Disease in Narrative Speech. , 2015, Journal of Alzheimer's disease : JAD.

[61]  Vassiliki Rentoumi,et al.  Automatic detection of linguistic indicators as a means of early detection of Alzheimer's disease and of related dementias: A computational linguistics analysis , 2017, 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom).

[62]  M. E. Maron,et al.  Automatic Indexing: An Experimental Inquiry , 1961, JACM.

[63]  Ali Khodabakhsh,et al.  Natural language features for detection of Alzheimer's disease in conversational speech , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[64]  Yassine Ben Ayed,et al.  Speech Processing for Early Alzheimer Disease Diagnosis: Machine Learning Based Approach , 2018, 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA).

[65]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation , 2015, BMJ : British Medical Journal.