Extraction of Narrative Recall Patterns for Neuropsychological Assessment

Poor narrative memory is associated with a variety of neurodegenerative and developmental disorders, such as autism and Alzheimer’s related dementia. Hence, narrative recall tasks are included in most standard neurological examinations. In this paper, we explore methods for automatically assessing the quality of retellings via alignment to the original narrative. Word alignments serve both to automate manual scoring and to derive other features related to narrative coherence that can be used for diagnostic classification. Despite relatively high word alignment error rates, the automatic alignments provide sufficient information to achieve nearly as accurate diagnostic classification as manual scores. Furthermore, additional features that become available with alignment provide utility in classifying subject groups. While the additional features we explore here did not provide additive gains in accuracy, they point the way to the development of many potentially useful features in this domain.

[1]  Ben Taskar,et al.  Alignment by Agreement , 2006, NAACL.

[2]  Susan Kemper,et al.  Oral language and alzheimer's disease: A reduction in syntactic complexity , 1994 .

[3]  Yang Liu,et al.  Using Language Models to Identify Language Impairment in Spanish-English Bilingual Children , 2008, BioNLP.

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  Edith L Bavin,et al.  Children with specific language impairment: an investigation of their narratives and memory. , 2008, International journal of language & communication disorders.

[6]  C. Lord Autism diagnostic observation schedule : ADOS manual , 2003 .

[7]  Brian Roark,et al.  Syntactic complexity measures for detecting Mild Cognitive Impairment , 2007, BioNLP@ACL.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Deborah P. Waber,et al.  Developmental Neuropsychological Assessment , 2020, Definitions.

[10]  J. J. Diehl,et al.  Story Recall and Narrative Coherence of High-Functioning Children with Autism Spectrum Disorders , 2006, Journal of abnormal child psychology.

[11]  John O. Willis,et al.  NEPSY: A Developmental Neuropsychological Assessment , 2008 .

[12]  Sameer Singh,et al.  Evaluation of an objective technique for analysing temporal variables in DAT spontaneous speech , 2001 .

[13]  D. White,et al.  Using verbal fluency to detect very mild dementia of the Alzheimer type. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[14]  Yang Liu,et al.  A Corpus-Based Approach for the Prediction of Language Impairment in Monolingual English and Spanish-English Bilingual Children , 2009, HLT-NAACL.

[15]  Tapio Salakoski,et al.  EXACT AND EFFICIENT LEAVE-PAIR-OUT CROSS-VALIDATION FOR RANKING RLS , 2008 .

[16]  J. Touchon,et al.  Mild cognitive impairment: conceptual basis and current nosological status , 2000, The Lancet.

[17]  Alon Lavie,et al.  Automatic Measurement of Syntactic Development in Child Language , 2005, ACL.

[18]  Nicola Botting,et al.  Narrative as a tool for the assessment of linguistic and pragmatic impairments , 2002 .

[19]  Linda Boise,et al.  Dementia assessment in primary care: results from a study in three managed care systems. , 2004, The journals of gerontology. Series A, Biological sciences and medical sciences.

[20]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[21]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[22]  William R. Shankle,et al.  Methods to improve the detection of mild cognitive impairment. , 2005 .

[23]  Mehryar Mohri,et al.  An Alternative Ranking Problem for Search Engines , 2007, WEA.

[24]  F R Ferraro,et al.  On the preservation of syntax in Alzheimer's disease. Evidence from written sentences. , 1993, Archives of neurology.

[25]  Helen Tager-Flusberg,et al.  ‘Once upon a ribbit’: Stories narrated by autistic children , 1995 .