Elderly Conversational Speech Corpus with Cognitive Impairment Test and Pilot Dementia Detection Experiment Using Acoustic Characteristics of Speech in Japanese Dialects

There is a need for a simple method of detecting early signs of dementia which is not burdensome to patients, since early diagnosis and treatment can often slow the advance of the disease. Several studies have explored using only the acoustic and linguistic information of conversational speech as diagnostic material, with some success. To accelerate this research, we recorded natural conversations between 128 elderly people living in four different regions of Japan and interviewers, who also administered the Hasegawa’s Dementia Scale-Revised (HDS-R), a cognitive impairment test. Using our elderly speech corpus and dementia test results, we propose an SVM-based screening method which can detect dementia using the acoustic features of conversational speech even when regional dialects are present. We accomplish this by omitting some acoustic features, to limit the negative effect of differences between dialects. When using our proposed method, a dementia detection accuracy rate of about 91% was achieved for speakers from two regions. When speech from four regions was used in a second experiment, the discrimination rate fell to 76.6%, but this may have been due to using only sentence-level acoustic features in the second experiment, instead of sentence and phoneme-level features as in the previous experiment. This is an on-going research project, and additional investigation is needed to understand differences in the acoustic characteristics of phoneme units in the conversational speech collected from these four regions, to determine whether the removal of formants and other features can improve the dementia detection rate.

[1]  Ryota Nishimura,et al.  Improving Speech Recognition for the Elderly: A New Corpus of Elderly Japanese Speech and Investigation of Acoustic Modeling for Speech Recognition , 2020, LREC.

[2]  Shweta,et al.  2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA) , 2019 .

[3]  Satoshi Nakamura,et al.  Detection of Dementia from Responses to Atypical Questions Asked by Embodied Conversational Agents , 2018, INTERSPEECH.

[4]  Saturnino Luz,et al.  A Method for Analysis of Patient Speech in Dialogue for Dementia Detection , 2018, ArXiv.

[5]  Eiji Aramaki,et al.  Vocabulary Size in Speech May Be an Early Indicator of Cognitive Impairment , 2016, PLoS ONE.

[6]  Sylvester Olubolu Orimaye,et al.  Learning Predictive Linguistic Features for Alzheimer’s Disease and related Dementias using Verbal Utterances , 2014, CLPsych@ACL.

[7]  Tatsuya Kawahara,et al.  Recent Development of Open-Source Speech Recognition Engine Julius , 2009 .

[8]  Ki Woong Kim,et al.  Diagnostic Accuracy of Mini-Mental Status Examination and Revised Hasegawa Dementia Scale for Alzheimer’s Disease , 2005, Dementia and Geriatric Cognitive Disorders.

[9]  Kiyohiro Shikano,et al.  Elderly acoustic model for large vocabulary continuous speech recognition , 2001, INTERSPEECH.

[10]  L. Kurlowicz,et al.  The Mini Mental State Examination (MMSE). , 1999, Director.

[11]  Tomoko Watanabe,et al.  Data collection of Japanese dialects and its influence into speech recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[12]  Y. Imai,et al.  The Revised Hasegawa's Dementia Scale (HDS-R)-Evaluation of Its Usefulness as a Screening Test for Dementia , 1994 .

[13]  Osamu Fujimura,et al.  Nasalization of Vowels in Relation to Nasals , 1958 .

[14]  Satoshi Nakamura,et al.  Detecting Dementia Through Interactive Computer Avatars , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[15]  Alexandra König,et al.  Speech-based automatic and robust detection of very early dementia , 2014, INTERSPEECH.

[16]  S. Kato,et al.  Development of the revised version of Hasegawa's Dementia Scale (HDS-R) , 1991 .