Prevalence of below-criterion Reliable Digit Span scores in a clinical sample of older adults.

OBJECTIVE The Reliable Digit Span (RDS) is a well-validated embedded indicator of performance validity. An RDS score of ≤7 is commonly referenced as indicative of invalid performance; however, few studies have examined the classification accuracy of the RDS among individuals suspected for dementia. The current study evaluated performance of the RDS in a clinical sample of 934 non-litigating individuals presenting to an outpatient memory disorders clinic for assessment of dementia. METHOD The RDS was calculated for each participant in the context of a comprehensive neuropsychological assessment completed as part of routine clinical care. Score distributions were examined to establish the base rate of below criterion performance for RDS cutoffs of ≤7, ≤6, and ≤5. One-way ANOVA was used to compare performance on a cognitive screening measure and informant reports of functional independence of those falling below and above cutoffs. RESULTS A cutoff score of ≤7 resulted in a high prevalence of below-criterion performance (29.7%), though an RDS of ≤6 was associated with fewer below-criterion scores (12.8%) and prevalence of an RDS of ≤5 was infrequent (4.3%). Those scoring below cutoffs performed worse on cognitive measures compared with those falling above cutoffs. CONCLUSIONS Using the RDS as a measure of performance validity among individuals presenting with a possibility of dementia increases the risk of misinterpreting genuine cognitive impairment as invalid performance when higher cutoffs are used; lower cutoffs may be useful when interpreted in conjunction with other measures of performance validity.

[1]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[3]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[4]  Kathleen Veizel,et al.  Wechsler Memory Scale–Fourth Edition , 2014 .

[5]  M. Wagner,et al.  The Test of Memory Malingering (TOMM): normative data from cognitively intact, cognitively impaired, and elderly patients with dementia. , 2004, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[6]  L. Baade,et al.  Reliable Digit Span , 2012, Assessment.

[7]  D. Loring,et al.  Characterization of the Medical Symptom Validity Test in evaluation of clinically referred memory disorders clinic patients. , 2007, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[8]  J. Hodges,et al.  Perception, attention, and working memory are disproportionately impaired in dementia with Lewy bodies compared with Alzheimer's disease , 2001, Journal of neurology, neurosurgery, and psychiatry.

[9]  J. Cummings,et al.  Concordance of the Montreal cognitive assessment with standard neuropsychological measures , 2015, Alzheimer's & dementia.

[10]  S. Millis,et al.  American Academy of Clinical Neuropsychology Consensus Conference Statement on the Neuropsychological Assessment of Effort, Response Bias, and Malingering , 2009, The Clinical neuropsychologist.

[11]  Stuart C. Yudofsky,et al.  The American Psychiatric Publishing Textbook of Psychiatry , 2014 .

[12]  E. Kaplan,et al.  Delis-Kaplan Executive Function System , 2012 .

[13]  S. Belleville,et al.  Working memory in mild cognitive impairment and Alzheimer's disease: contribution of forgetting and predictive value of complex span tasks. , 2011, Neuropsychology.

[14]  L. Rabin,et al.  Assessment practices of clinical neuropsychologists in the United States and Canada: a survey of INS, NAN, and APA Division 40 members. , 2005, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[15]  S. Joordens,et al.  Conducting research with non-clinical healthy undergraduates: does effort play a role in neuropsychological test performance? , 2012, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[16]  N. Pliskin,et al.  Effects of Severity of Dementia on a Symptom Validity Measure , 2014, The Clinical neuropsychologist.

[17]  D. Salmon,et al.  The neuropsychological profile of Alzheimer disease. , 2012, Cold Spring Harbor perspectives in medicine.

[18]  S. Weintraub,et al.  The Activities of Daily Living Questionnaire: A Validation Study in Patients with Dementia , 2004, Alzheimer disease and associated disorders.

[19]  B. Axelrod,et al.  Embedded symptom validity tests and overall neuropsychological test performance. , 2011, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[20]  M. Greiffenstein,et al.  Validation of malingered amnesia measures with a large clinical sample , 1994 .

[21]  M. Horner,et al.  Performance on Standard Indexes of Effort Among Patients with Dementia , 2013, Applied neuropsychology. Adult.

[22]  David R. Cox,et al.  Official Position of the Military TBI Task Force on the Role of Neuropsychology and Rehabilitation Psychology in the Evaluation, Management, and Research of Military Veterans with Traumatic Brain Injury , 2008, The Clinical neuropsychologist.

[23]  R. Kessels,et al.  Assessment of working-memory deficits in patients with mild cognitive impairment and Alzheimer’s dementia using Wechsler’s Working Memory Index , 2011, Aging clinical and experimental research.

[24]  E. Kaplan,et al.  The Boston naming test , 2001 .

[25]  K. Boone.  Assessment of feigned cognitive impairment: A neuropsychological perspective. , 2007 .

[26]  G. Larrabee.  Performance Validity and Symptom Validity in Neuropsychological Assessment , 2012, Journal of the International Neuropsychological Society.

[27]  K. Greve,et al.  WAIS Digit Span-Based Indicators of Malingered Neurocognitive Dysfunction , 2005, Assessment.

[28]  B. Baughman,et al.  Expansion and Re-examination of Digit Span Effort Indices on the WAIS-IV , 2012, The Clinical neuropsychologist.

[29]  R. S. Jorgensen,et al.  I Just Want My Research Credit: Frequency of Suboptimal Effort in a Non-Clinical Healthy Undergraduate Sample , 2015, The Clinical neuropsychologist.

[30]  B. Schmand,et al.  On the limits of effort testing: Symptom validity tests and severity of neurocognitive symptoms in nonlitigant patients , 2007, Journal of clinical and experimental neuropsychology.

[31]  B. Gavett,et al.  Base rate of performance invalidity among non-clinical undergraduate research participants. , 2014, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[32]  D. D. Fox.  Symptom Validity Test Failure Indicates Invalidity of Neuropsychological Tests , 2011, The Clinical neuropsychologist.

[33]  K. Boone,et al.  Dementia and effort test performance , 2009, The Clinical neuropsychologist.

[34]  P. Green,et al.  Effort has a greater effect on test scores than severe brain injury in compensation claimants , 2001, Brain injury.

[35]  A. Tröster,et al.  Symptom validity assessment: practice issues and medical necessity NAN policy & planning committee. , 2005, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[36]  Nicholas J. Pastorek,et al.  A Retrospective Review of Digit Span-Related Effort Indicators in Probable Alzheimer's Disease Patients , 2012, The Clinical neuropsychologist.