Improving the ecological validity of executive functioning assessment.

The current study investigated ways to improve the ecological validity of the neuropsychological assessment of executive functioning through the formal assessment of compensatory strategies and environmental cognitive demands. Results indicated that the group of executive functioning tests (i.e., Trail Making Test, Wisconsin Card Sorting Test, Stroop, and Controlled Oral Word Association Test) accounted for 18-20% of the variance in everyday executive ability as measured by the Dysexecutive Questionnaire and Brock Adaptive Functioning Questionnaire. The addition of extra-test variables significantly increased the variance in everyday executive ability accounted for. The current study adds to the literature on the ecological validity of executive functioning assessment by highlighting the importance of extra-test variables when trying to understand the complex relationship between cognitive testing and real world performance.

[1]  K. Kortte,et al.  The Trail Making Test, Part B: Cognitive Flexibility or Ability to Maintain Set? , 2002, Applied neuropsychology.

[2]  C. Silver.  Ecological validity of neuropsychological assessment in childhood traumatic brain injury. , 2000, The Journal of head trauma rehabilitation.

[3]  R. Chan,et al.  Dysexecutive symptoms among a non-clinical sample: a study with the use of the Dysexecutive Questionnaire. , 2001, British journal of psychology.

[4]  B. Wilson.  Ecological validity of neuropsychological assessment: Do neuropsychological indexes predict performance in everyday activities? , 1993 .

[5]  P. Burgess,et al.  The ecological validity of tests of executive function , 1998, Journal of the International Neuropsychological Society.

[6]  S. Koskinen,et al.  Neuropsychological problems in everyday life: a 5-year follow-up study of young severely closed-head-injured patients. , 1995, Brain injury.

[7]  Christie Golden,et al.  Stroop Color and Word Test: Manual for Clinical and Experimental Uses. , 1978 .

[8]  S. MacDonald,et al.  Self-awareness after traumatic brain injury: a comparison of measures and their relationship to executive functions. , 2003, Journal of the International Neuropsychological Society : JINS.

[9]  G. Goldstein,et al.  Differences between patient and informant functional outcome ratings in head-injured individuals , 1995 .

[10]  Jordan Grafman,et al.  The Effects of Frontal Lobe Damage on Everyday Problem Solving , 1996, Cortex.

[11]  B. Ober,et al.  Independent frontal-system deficits in schizophrenia: cognitive, clinical, and adaptive implications , 1999, Psychiatry Research.

[12]  E. Kaplan,et al.  The Boston naming test , 2001 .

[13]  R. Slovenko.  Forensic Neuropsychology: Fundamentals and Practice , 2001 .

[14]  R. Mccaffrey,et al.  The Practice of Forensic Neuropsychology: Meeting Challenges in the Courtroom , 2004 .

[15]  Sergio Della Sala,et al.  Behavioral dysexecutive symptoms in normal aging , 2003, Brain and Cognition.

[16]  亀井 聡,et al.  パーキンソン病における遂行機能障害の「遂行機能障害症候群の行動評価 (Behavioural Assessment of the Dysexecutive Syndrome : BADS)」を用いた分析 , 2008 .

[17]  Gordon D. Logan,et al.  The Ecological Validity of Delay Aversion and Response Inhibition as Measures of Impulsivity in AD/HD: A Supplement to the NIMH Multimodal Treatment Study of AD/HD , 2001, Journal of abnormal child psychology.

[18]  R. Tate,et al.  The Behavioural Assessment of the Dysexecutive Syndrome (BADS): Ecological, Concurrent and Construct Validity , 2000 .

[19]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[20]  R. Heinrichs,et al.  Current and emergent applications of neuropsychological assessment: Problems of validity and utility. , 1990 .

[21]  T. Guilmette,et al.  Ecological validity: Prediction of everyday and vocational functioning from neuropsychological test data. , 1999 .

[22]  E. Roth,et al.  Closed head injury in spinal cord injured patients: retrospective study of loss of consciousness and post-traumatic amnesia. , 1985, Archives of Physical Medicine and Rehabilitation.

[23]  P. McKenna,et al.  Assessment of the dysexecutive syndrome in schizophrenia , 1997, Psychological Medicine.

[24]  Robert J. Sbordone,et al.  Ecological Validity of Neuropsychological Testing , 1996 .

[25]  G. Chelune.  Toward a Neuropsychological Model of Everyday Functioning , 1985 .

[26]  P J Nichols,et al.  Functional Assessment , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.

[27]  Jane S. Paulsen,et al.  Ecological Validity of Neuropsychological and Personality Measures of Executive Functions , 2001, The Clinical neuropsychologist.

[28]  M. Schmitter-Edgecombe,et al.  The Ecological Validity of Neuropsychological Tests: A Review of the Literature on Everyday Cognitive Skills , 2003, Neuropsychology Review.

[29]  S. Segalowitz,et al.  Self- and Family Ratings of Adaptive Behavior after Traumatic Brain Injury: Psychometric Scores and Frontally Generated ERPs , 1996 .

[30]  Robert K. Heaton,et al.  Wisconsin Card Sorting Test Manual – Revised and Expanded , 1993 .

[31]  M. Prior,et al.  Do Executive Function Deficits Differentiate Between Adolescents with ADHD and Oppositional Defiant/Conduct Disorder? A Neuropsychological Study Using the Six Elements Test and Hayling Sentence Completion Test , 2000, Journal of abnormal child psychology.

[32]  J. Nici,et al.  A Compendium of Neuropsychological Tests, 2nd ed , 2000 .

[33]  Alan Sunderland,et al.  Do Laboratory Tests Predict Everyday Memory? A Neuropsychological Study. , 1983 .

[34]  M. Schmitter-Edgecombe,et al.  Prediction of employment status following traumatic brain injury using a behavioural measure of frontal lobe functioning , 2002, Brain injury.

[35]  M. Lezak.  Neuropsychological assessment, 3rd ed. , 1995 .