Detection of Dementia from Responses to Atypical Questions Asked by Embodied Conversational Agents

Detection of dementia requires examinations, such as blood tests and functional magnetic resonance imaging (fMRI), that can be very stressful for the patient. Previous studies proposed screenings for easy detection of dementia that utilized acoustic and language information derived from conversations between patients and medical staff. Although these studies demonstrated effectiveness in automatically detecting dementia, the tasks used were created based on neuropsychological tests. The effect of habituation on this limited variety of tasks might have a negative impact on routine dementia screening. We propose a method to detect dementia using responses to more atypical questions asked by embodied conversational agents. Through consultations with neuropsychologists, we created a total of 13 questions. The embodied conversational agent obtained answers to these questions from 24 participants (12 dementia and 12 non-dementia). We recorded their responses and extracted speech and language features. We classified the two groups (dementia/non-dementia) by a machine learning algorithm (support vector machines and logistic regression) using the extracted features. The results showed a 0.95 detection performance in the area under the curve of the receiver operating characteristic (AUROC). This result demonstrates that our system using atypical questions can detect dementia.

[1]  Satoshi Nakamura,et al.  Initial response time measurement in eye movement for dementia screening test , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[2]  Joel H Kramer,et al.  Patterns of autobiographical memory loss in dementia , 2005, International journal of geriatric psychiatry.

[3]  Eiji Aramaki,et al.  Vocabulary Size in Speech May Be an Early Indicator of Cognitive Impairment , 2016, PLoS ONE.

[4]  Heidi Christensen,et al.  An Avatar-Based System for Identifying Individuals Likely to Develop Dementia , 2017, INTERSPEECH.

[5]  L. Squire,et al.  Memory: brain systems and behavior , 1988, Trends in Neurosciences.

[6]  Satoshi Nakamura,et al.  Detecting Dementia Through Interactive Computer Avatars , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[7]  Yogesan Kanagasingam,et al.  Innovative diagnostic tools for early detection of Alzheimer's disease , 2015, Alzheimer's & Dementia.

[8]  Vanessa Taler,et al.  Language performance in Alzheimer's disease and mild cognitive impairment: A comparative review , 2008, Journal of clinical and experimental neuropsychology.

[9]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[10]  R Nakamura,et al.  Psychometric Equivalence of the Hasegawa Dementia Scale—Revised with the Mini-Mental State Examination in Stroke Patients , 1994, Perceptual and motor skills.

[11]  L. Squire,et al.  The learning of categories: parallel brain systems for item memory and category knowledge. , 1993, Science.

[12]  Brian Roark,et al.  Spoken Language Derived Measures for Detecting Mild Cognitive Impairment , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  K. Santacruz,et al.  Early diagnosis of dementia. , 2001, American family physician.

[14]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[15]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.