RaPID-2 : Resources and ProcessIng of Linguistic , Para-Linguistic and Extra-Linguistic Data from People with Various Forms of Cognitive / Psychiatric Impairments

In the past decade the preclinical stage of Alzheimer’s Disease (AD) has become a major research focus. Subjective cognitive decline (SCD) is gaining attention as an important risk factor of AD-pathology in early stages of mild-cognitive impairment (MCI), preclinical AD and depression. In this context, neuropsychological assessments aim at detecting sorts of subtle cognitive decline. Automatic classification may help increasing the expressiveness of such assessments by selecting high-risk subjects in research settings. In this paper, we explore the use of neuropsychological data and interview based data designed to detect AD-related SCD in different clinical samples to classify patients through the implementation of machine learning algorithms. The aim is to explore the classificatory expressiveness of features derived from this data. To this end, we experiment with a sample of 23 memory-clinic patients, 21 depressive patients and 21 healthy-older controls. We use several classifiers, including SVMs and neural networks, to classify these patients using the above mentioned data. We reach a successful classification based on neuropsychological data as well as on cognitive complaint categories. Our analysis indicates that a combination of these data should be preferred for classification, as we achieve an F-score above 90% in this case. We show that automatic classification using machine learning is a powerful approach that can be used to improve neuropsychological assessment.

[1]  Yasunori Yamada,et al.  Topic Repetition in Conversations on Different Days as a Sign of Dementia , 2018, MIE.

[2]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[3]  Heidi Christensen,et al.  Diagnosing People with Dementia Using Automatic Conversation Analysis , 2016, INTERSPEECH.

[4]  F. Cuetos,et al.  Linguistic changes in verbal expression: A preclinical marker of Alzheimer's disease , 2007, Journal of the International Neuropsychological Society.

[5]  G. Winocur,et al.  Clustering and switching as two components of verbal fluency: evidence from younger and older healthy adults. , 1997, Neuropsychology.

[6]  Saturnino Luz,et al.  The relevance of timing, pauses and overlaps in dialogues: detecting topic changes in scenario based meetings , 2010, INTERSPEECH.

[7]  G. Winocur,et al.  Clustering and switching on verbal fluency: the effects of focal frontal- and temporal-lobe lesions , 1998, Neuropsychologia.

[8]  Frank Rudzicz,et al.  Identifying and Avoiding Confusion in Dialogue with People with Alzheimer’s Disease , 2017, CL.

[9]  D. G. Clark,et al.  Novel verbal fluency scores and structural brain imaging for prediction of cognitive outcome in mild cognitive impairment , 2016, Alzheimer's & dementia.

[10]  Saturnino Luz,et al.  Longitudinal Monitoring and Detection of Alzheimer's Type Dementia from Spontaneous Speech Data , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[11]  Saturnino Luz,et al.  Automatic identification of experts and performance prediction in the multimodal math data corpus through analysis of speech interaction , 2013, ICMI '13.

[12]  A. Lang,et al.  A comparison of the mini mental state exam to the montreal cognitive assessment in identifying cognitive deficits in Parkinson's disease , 2008, Movement disorders : official journal of the Movement Disorder Society.

[13]  Peter Garrard,et al.  Semantic processing in connected speech at a uniformly early stage of autopsy-confirmed Alzheimer's disease. , 2013, Neuropsychology.

[14]  Jan Alexandersson,et al.  Using Neural Word Embeddings in the Analysis of the Clinical Semantic Verbal Fluency Task , 2017, IWCS.

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Graeme Hirst,et al.  Longitudinal detection of dementia through lexical and syntactic changes in writing: a case study of three British novelists , 2011, Lit. Linguistic Comput..

[17]  John T. O'Brien,et al.  The midlife cognitive profiles of adults at high risk of late-onset Alzheimer's disease: The PREVENT study , 2017, Alzheimer's & Dementia.

[18]  Shwetak N. Patel,et al.  DoppleSleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar , 2015, UbiComp.

[19]  J. Hodges,et al.  The effects of very early Alzheimer's disease on the characteristics of writing by a renowned author. , 2004, Brain : a journal of neurology.

[20]  E. Tangalos,et al.  Mild Cognitive Impairment Clinical Characterization and Outcome , 1999 .

[21]  Meysam Asgari,et al.  Predicting mild cognitive impairment from spontaneous spoken utterances , 2017, Alzheimer's & dementia.

[22]  J. Bardram,et al.  Voice analysis as an objective state marker in bipolar disorder , 2016, Translational psychiatry.

[23]  E. Yund,et al.  Computerized Analysis of Verbal Fluency: Normative Data and the Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury , 2016, PloS one.

[24]  Peter Garrard,et al.  Features and machine learning classification of connected speech samples from patients with autopsy proven Alzheimer's disease with and without additional vascular pathology. , 2014, Journal of Alzheimer's disease : JAD.

[25]  Markus Forsberg,et al.  Sparv : Språkbanken ’ s corpus annotation pipeline infrastructure , 2016 .

[26]  Y. Levy,et al.  Morphology in picture descriptions provided by persons with Alzheimer's disease. , 2003, Journal of speech, language, and hearing research : JSLHR.

[27]  A. Ciapponi,et al.  Mini-Mental State Examination (MMSE) for the detection of Alzheimer's disease and other dementias in people with mild cognitive impairment (MCI). , 2015, The Cochrane database of systematic reviews.

[28]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[29]  J. Henry,et al.  Verbal fluency deficits in Parkinson's disease: A meta-analysis , 2004, Journal of the International Neuropsychological Society.

[30]  Jan Alexandersson,et al.  Automated speech-based screening for alzheimer's disease in a care service scenario , 2017, PervasiveHealth.

[31]  J. Touchon,et al.  Mild cognitive impairment: conceptual basis and current nosological status , 2000, The Lancet.

[32]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  H. Goodglass Boston diagnostic aphasia examination , 2013 .

[35]  Geoffrey Zweig,et al.  Achieving Human Parity in Conversational Speech Recognition , 2016, ArXiv.

[36]  Serguei V. S. Pakhomov,et al.  Characterizing cognitive performance in a large longitudinal study of aging with computerized semantic indices of verbal fluency , 2016, Neuropsychologia.

[37]  G. Lockhead,et al.  The free recall of category examples. , 1980 .

[38]  D. White,et al.  Using verbal fluency to detect very mild dementia of the Alzheimer type. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[39]  Soo Borson,et al.  Should older adults be screened for dementia? , 2006, Alzheimer's & Dementia.

[40]  P. Robert,et al.  Clustering and switching strategies in verbal fluency tasks: Comparison between schizophrenics and healthy adults , 1998, Journal of the International Neuropsychological Society.

[41]  Lori Lamel,et al.  Challenges in real-life emotion annotation and machine learning based detection , 2005, Neural Networks.

[42]  Andrew Kertesz,et al.  Category and letter fluency in semantic dementia, primary progressive aphasia, and Alzheimer’s disease , 2006, Brain and Language.

[43]  N. Cercone,et al.  Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[44]  Ling Zheng,et al.  Longitudinal Verbal Fluency in Normal Aging, Preclinical, and Prevalent Alzheimer’s Disease , 2009, American journal of Alzheimer's disease and other dementias.

[45]  Sofie Johansson Kokkinakis,et al.  A Cascaded Finite-State Parser for Syntactic Analysis of Swedish , 1999, EACL.

[46]  M. Prince,et al.  World Alzheimer Report 2015 - The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends , 2015 .

[47]  Ani Nenkova,et al.  Predicting the Fluency of Text with Shallow Structural Features: Case Studies of Machine Translation and Human-Written Text , 2009, EACL.

[48]  Frederick A. Schmitt,et al.  Should older adults be screened for dementia? It is important to screen for evidence of dementia! , 2007, Alzheimer's & Dementia.

[49]  Frida Blomberg,et al.  Swedish and English word ratings of imageability, familiarity and age of acquisition are highly correlated , 2015, Nordic Journal of Linguistics.

[50]  Eduardo Gonzalez-Moreira,et al.  Automatic Prosodic Analysis to Identify Mild Dementia , 2015, BioMed research international.

[51]  Yiannis Kompatsiaris,et al.  Evaluation of speech-based protocol for detection of early-stage dementia , 2013, INTERSPEECH.

[52]  J. Henry,et al.  A meta-analytic review of verbal fluency deficits in Huntington's disease. , 2005, Neuropsychology.

[53]  Yiannis Kompatsiaris,et al.  The Dem@Care Experiments and Datasets: a Technical Report , 2016, ArXiv.

[54]  D R Wekstein,et al.  Linguistic ability in early life and cognitive function and Alzheimer's disease in late life. Findings from the Nun Study. , 1996, JAMA.

[55]  P. Robert,et al.  Language Modelling for the Clinical Semantic Verbal Fluency Task , 2018 .

[56]  M. Trosset,et al.  Cross-Sectional Analysis of Alzheimer Disease Effects on Oral Discourse in a Picture Description Task , 1996, Alzheimer disease and associated disorders.

[57]  Curry I. Guinn,et al.  Language Analysis of Speakers with Dementia of the Alzheimer's Type , 2012, AAAI Fall Symposium: Artificial Intelligence for Gerontechnology.

[58]  Peter Garrard,et al.  Abnormal discourse in semantic dementia: A data-driven approach , 2010, Neurocase.

[59]  Frank Rudzicz,et al.  Automatically identifying trouble-indicating speech behaviors in alzheimer's disease , 2014, ASSETS.

[60]  Keita Watanabe,et al.  Early detection of cognitive impairment in the elderly based on Bayesian mining using speech prosody and cerebral blood flow activation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[61]  Max A. Little,et al.  Accurate Telemonitoring of Parkinson's Disease Progression by Noninvasive Speech Tests , 2009, IEEE Transactions on Biomedical Engineering.

[62]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[63]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer's disease: Recommendations from the National Institute on Aging and the Alzheimer's Association workgroup , 2011 .

[64]  Remigiusz Sokołowski,et al.  Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis. , 2016, Psychiatria polska.

[65]  Eva Björkner,et al.  Data Collection from Persons with Mild Forms of Cognitive Impairment and Healthy Controls - Infrastructure for Classification and Prediction of Dementia , 2017, NODALIDA.

[66]  S. Cappa,et al.  Nouns and verbs in the brain: A review of behavioural, electrophysiological, neuropsychological and imaging studies , 2011, Neuroscience & Biobehavioral Reviews.

[67]  C. Watson An analysis of trouble and repair in the natural conversations of people with dementia of the Alzheimer's type , 1999 .

[68]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[69]  Yasunori Yamada,et al.  Word Repetition in Separate Conversations for Detecting Dementia:A Preliminary Evaluation on Data of Regular Monitoring Service , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[70]  Brian Roark,et al.  Spoken Language Derived Measures for Detecting Mild Cognitive Impairment , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[71]  D. G. MacKay,et al.  Amnesic H.M.'s performance on the language competence test: Parallel deficits in memory and sentence production , 2008, Journal of clinical and experimental neuropsychology.

[72]  Markus Forsberg,et al.  Korp — the corpus infrastructure of Språkbanken , 2012, LREC.

[73]  Brian Roark,et al.  Graph-Based Word Alignment for Clinical Language Evaluation , 2015, CL.

[74]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[75]  Marcos Faúndez-Zanuy,et al.  Alzheimer Disease Diagnosis based on Automatic Spontaneous Speech Analysis , 2012, IJCCI.

[76]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[77]  Kathleen C. Fraser,et al.  Automated Syntactic Analysis of Language Abilities in Persons with Mild and Subjective Cognitive Impairment , 2018, MIE.

[78]  A. Smith,et al.  Predicting the time of conversion to MCI in the elderly , 2009, Neurology.

[79]  Tanja Schultz,et al.  Manual and Automatic Transcriptions in Dementia Detection from Speech , 2017, INTERSPEECH.

[80]  M. Prince,et al.  The Global Impact of Dementia 2013-2050 , 2013 .

[81]  R. Petersen MILD COGNITIVE IMPAIRMENT , 2004, Lancet.

[82]  P. Garrard,et al.  Connected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease , 2013, Brain : a journal of neurology.

[83]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[84]  Kristine Yaffe,et al.  Promising strategies for the prevention of dementia. , 2009, Archives of neurology.

[85]  Giuseppe Carenini,et al.  Detecting Dementia through Retrospective Analysis of Routine Blog Posts by Bloggers with Dementia , 2017, BioNLP.

[86]  Quincy M. Samus,et al.  Dementia prevention, intervention, and care , 2017, The Lancet.

[87]  Yoav Freund,et al.  Boosting: Foundations and Algorithms , 2012 .

[88]  Lars-Göran Nilsson,et al.  Age Effects on Semantic Coherence: Latent Semantic Analysis Applied to Letter Fluency Data , 2009, 2009 Third International Conference on Advances in Semantic Processing.

[89]  Peter Garrard,et al.  From hindsight to insight – retrospective analysis of language written by a renowned Alzheimer's patient , 2008 .

[90]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[91]  Atta Abbas,et al.  DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS, FIFTH EDITION , 2013 .

[92]  Serguei V. S. Pakhomov,et al.  A computerized technique to assess language use patterns in patients with frontotemporal dementia , 2010, Journal of Neurolinguistics.

[93]  Kathleen C. Fraser,et al.  Linguistic Features Identify Alzheimer's Disease in Narrative Speech. , 2015, Journal of Alzheimer's disease : JAD.

[94]  D. Ader,et al.  Formal Thought Disorder, the Type-Token Ratio, and Disturbed Voluntary Motor Movement in Schizophrenia , 1981, British Journal of Psychiatry.

[95]  Kenneth Rockwood,et al.  Verbal Repetition in People With Mild-to-Moderate Alzheimer Disease: A Descriptive Analysis From the VISTA Clinical Trial , 2009, Alzheimer disease and associated disorders.

[96]  Paul R. Solomon,et al.  Should we screen for Alzheimer's disease? , 2005 .

[97]  B. Croisile,et al.  Comparative Study of Oral and Written Picture Description in Patients with Alzheimer's Disease , 1996, Brain and Language.

[98]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[99]  J. Morris,et al.  Clinical Dementia Rating: A Reliable and Valid Diagnostic and Staging Measure for Dementia of the Alzheimer Type , 1997, International Psychogeriatrics.

[100]  Taku Kudo,et al.  MeCab : Yet Another Part-of-Speech and Morphological Analyzer , 2005 .

[101]  Nivja H. Jong,et al.  Praat script to detect syllable nuclei and measure speech rate automatically , 2009, Behavior research methods.

[102]  Jean-François Dartigues,et al.  A Longitudinal Study of Quantitative and Qualitative Features of Category Verbal Fluency in Incident Alzheimer’s Disease Subjects: Results from the PAQUID Study , 2006, Dementia and Geriatric Cognitive Disorders.

[103]  Jan Alexandersson,et al.  Predicting Dementia Screening and Staging Scores from Semantic Verbal Fluency Performance , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[104]  Jean-François Dartigues,et al.  Clustering and switching processes in semantic verbal fluency in the course of Alzheimer's disease subjects: Results from the PAQUID longitudinal study , 2008, Cortex.

[105]  T. Shibata,et al.  Robot therapy for elders affected by dementia , 2008, IEEE Engineering in Medicine and Biology Magazine.

[106]  Masatomo Kobayashi,et al.  Detecting Mental Fatigue from Eye-Tracking Data Gathered While Watching Video , 2017, AIME.

[107]  G. Kavé,et al.  Word retrieval in picture descriptions produced by individuals with Alzheimer’s disease , 2016, Journal of clinical and experimental neuropsychology.

[108]  R. Albin,et al.  Factors associated with cognitive evaluations in the United States , 2015, Neurology.

[109]  Carl Vogel,et al.  Speech Rate Comparison When Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task , 2017, Interspeech.

[110]  B. Reisberg,et al.  Current evidence for subjective cognitive impairment (SCI) as the pre-mild cognitive impairment (MCI) stage of subsequently manifest Alzheimer's disease , 2008, International Psychogeriatrics.

[111]  Colleen Richey,et al.  Aided diagnosis of dementia type through computer-based analysis of spontaneous speech , 2014, CLPsych@ACL.

[112]  Romola S. Bucks,et al.  Analysis of spontaneous, conversational speech in dementia of Alzheimer type: Evaluation of an objective technique for analysing lexical performance , 2000 .

[113]  Marwan N. Sabbagh,et al.  The Montreal Cognitive Assessment and the Mini-Mental State Examination as Screening Instruments for Cognitive Impairment: Item Analyses and Threshold Scores , 2011, Dementia and Geriatric Cognitive Disorders.

[114]  S. Pendlebury,et al.  MoCA, ACE-R, and MMSE Versus the National Institute of Neurological Disorders and Stroke–Canadian Stroke Network Vascular Cognitive Impairment Harmonization Standards Neuropsychological Battery After TIA and Stroke , 2012, Stroke.

[115]  Masaru Mimura,et al.  [The Social Costs of Dementia in Japan: Focusing on the Informal Care Cost]. , 2016, Brain and nerve = Shinkei kenkyu no shinpo.

[116]  H. Kirshner,et al.  Primary Progressive Aphasia and Alzheimer’s Disease: Brief History, Recent Evidence , 2012, Current Neurology and Neuroscience Reports.

[117]  J. Henry,et al.  Verbal fluency performance in dementia of the Alzheimer’s type: a meta-analysis , 2004, Neuropsychologia.

[118]  Alex Mihailidis,et al.  Speech recognition in Alzheimer’s disease with personal assistive robots , 2014, SLPAT@ACL.

[119]  Sterling C. Johnson,et al.  Declines in Connected Language Are Associated with Very Early Mild Cognitive Impairment: Results from the Wisconsin Registry for Alzheimer’s Prevention , 2018, Front. Aging Neurosci..

[120]  S. Feldstein,et al.  Rhythms of dialogue , 1970 .

[121]  Masatomo Kobayashi,et al.  Fatigue Detection Model for Older Adults Using Eye-Tracking Data Gathered While Watching Video: Evaluation Against Diverse Fatiguing Tasks , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[122]  Elmar Nöth,et al.  An N-Gram Based Approach to the Automatic Diagnosis of Alzheimer's Disease from Spoken Language , 2017, INTERSPEECH.

[123]  Mike Conway,et al.  Social Media, Big Data, and Mental Health: Current Advances and Ethical Implications. , 2016, Current opinion in psychology.

[124]  Cristina D. Dye,et al.  Temporal parameters of spontaneous speech in Alzheimer's disease , 2010, International journal of speech-language pathology.

[125]  Yogesan Kanagasingam,et al.  Innovative diagnostic tools for early detection of Alzheimer's disease , 2015, Alzheimer's & Dementia.

[126]  V. Manera,et al.  Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease , 2015, Alzheimer's & dementia.

[127]  Marc Schröder,et al.  The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching , 2003, Int. J. Speech Technol..

[128]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[129]  Francisco Martínez-Sánchez,et al.  Acoustic Markers Associated with Impairment in Language Processing in Alzheimer's Disease , 2012, The Spanish journal of psychology.

[130]  J. Kaye,et al.  Detecting cognitive changes in preclinical Alzheimer's disease: A review of its feasibility , 2017, Alzheimer's & Dementia.

[131]  Gábor Gosztolya,et al.  Detecting Mild Cognitive Impairment by Exploiting Linguistic Information from Transcripts , 2016, ACL.

[132]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[133]  Michael F. Bonner,et al.  The New Classification of Primary Progressive Aphasia into Semantic, Logopenic, or Nonfluent/Agrammatic Variants , 2010, Current neurology and neuroscience reports.

[134]  Mira Goral,et al.  Word retrieval in connected speech in Alzheimer’s disease: a review with meta-analyses , 2018 .

[135]  Boyd H. Davis,et al.  Finding a balance: The Carolinas Conversation Collection , 2011 .

[136]  H. Vankova Mini Mental State , 2010 .

[137]  E. Dolgin How to defeat dementia , 2016, Nature.

[138]  M. Prince,et al.  World Alzheimer report 2016: improving healthcare for people living with dementia: coverage, quality and costs now and in the future , 2016 .