Alignment of spoken narratives for automated neuropsychological assessment

Narrative recall tasks are commonly included in neurological examinations, as deficits in narrative memory are associated with disorders such as Alzheimer's dementia. We explore methods for automatically scoring narrative retellings via alignment to a source narrative. Standard alignment methods, designed for large bilingual corpora for machine translation, yield high alignment error rates (AER) on our small monolingual corpora. We present modifications to these methods that obtain a decrease in AER, an increase in scoring accuracy, and diagnostic classification performance comparable to that of manual methods, thus demonstrating the utility of these techniques for this task and other tasks relying on monolingual alignments.

[1]  C. Lord Autism diagnostic observation schedule : ADOS manual , 2003 .

[2]  J. Morris The Clinical Dementia Rating (CDR) , 1993, Neurology.

[3]  Yang Liu,et al.  A Corpus-Based Approach for the Prediction of Language Impairment in Monolingual English and Spanish-English Bilingual Children , 2009, HLT-NAACL.

[4]  D. White,et al.  Using verbal fluency to detect very mild dementia of the Alzheimer type. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[5]  Hermann Ney,et al.  A Systematic Comparison of Various Statistical Alignment Models , 2003, CL.

[6]  Brian Roark,et al.  Extraction of Narrative Recall Patterns for Neuropsychological Assessment , 2011, INTERSPEECH.

[7]  Alon Lavie,et al.  Automatic Measurement of Syntactic Development in Child Language , 2005, ACL.

[8]  Brian Roark,et al.  Classification of Atypical Language in Autism , 2011, CMCL@ACL.

[9]  J. Touchon,et al.  Mild cognitive impairment: conceptual basis and current nosological status , 2000, The Lancet.

[10]  Ben Taskar,et al.  Alignment by Agreement , 2006, NAACL.

[11]  Magnus Sahlgren,et al.  Automatic bilingual lexicon acquisition using random indexing of parallel corpora , 2005, Nat. Lang. Eng..

[12]  Brian Roark,et al.  Syntactic complexity measures for detecting Mild Cognitive Impairment , 2007, BioNLP@ACL.

[13]  John O. Willis,et al.  NEPSY: A Developmental Neuropsychological Assessment , 2008 .

[14]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[15]  Alexander S. Yeh,et al.  More accurate tests for the statistical significance of result differences , 2000, COLING.

[16]  Regina Barzilay,et al.  Extracting Paraphrases from a Parallel Corpus , 2001, ACL.

[17]  William R. Shankle,et al.  Methods to improve the detection of mild cognitive impairment. , 2005 .

[18]  Mehryar Mohri,et al.  An Alternative Ranking Problem for Search Engines , 2007, WEA.

[19]  Yang Liu,et al.  Using Language Models to Identify Language Impairment in Spanish-English Bilingual Children , 2008, BioNLP.

[20]  Edith L Bavin,et al.  Children with specific language impairment: an investigation of their narratives and memory. , 2008, International journal of language & communication disorders.

[21]  Philip Resnik,et al.  An Unsupervised Method for Word Sense Tagging using Parallel Corpora , 2002, ACL.

[22]  Helen Tager-Flusberg,et al.  ‘Once upon a ribbit’: Stories narrated by autistic children , 1995 .

[23]  Nicola Botting,et al.  Narrative as a tool for the assessment of linguistic and pragmatic impairments , 2002 .

[24]  Sameer Singh,et al.  Evaluation of an objective technique for analysing temporal variables in DAT spontaneous speech , 2001 .

[25]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[26]  Tapio Salakoski,et al.  EXACT AND EFFICIENT LEAVE-PAIR-OUT CROSS-VALIDATION FOR RANKING RLS , 2008 .

[27]  Susan Kemper,et al.  Oral language and alzheimer's disease: A reduction in syntactic complexity , 1994 .

[28]  Chris Callison-Burch,et al.  Syntactic Constraints on Paraphrases Extracted from Parallel Corpora , 2008, EMNLP.

[29]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.