The ability of CNS vital signs to detect coached sandbagging performance during concussion baseline testing: a randomized control trial

ABSTRACT Objective: Despite widespread use of baseline neurocognitive testing in concussion management, suboptimal performance due to sandbagging still readily occurs without detection. The purpose of this study is to determine CNS Vital Signs validity indicator accuracy in detecting coached sandbagging compared to controls. Method: We compared rates of invalidity and domain composite scores for neurocognitive test performance between two groups of twenty-five college-aged students (age = 20.8 ± 1.1 years, range 18–25, 48% female) completing CNS Vital Signs instructed to either 1) give their best effort (control) or, 2) give suboptimal performance (sandbag). The sandbagging group was given standardized instructions on how to sandbag without detection. All participants rated their effort after completing on a Visual Analog Scale (0–100 mm). Results: Built in invalidity indicators successfully identified 68.0% of sandbaggers, while only 12% in the control group presented with invalid scores. Participants in the sandbagging group on average reported significantly lower effort (sandbag: 51.0 ± 21.0, control: 86.0 ± 12.0, p < .001) Conclusions: Built-in CNS Vital Signs validity indicators have an overall high accuracy in identifying those attempting to purposefully sandbag and are comparable to other computerized neurocognitive tests. Given that 32% of intentional sandbaggers went undetected, clinicians should consider additional safeguards to detect these individuals at baseline.

[1]  Julianne D. Schmidt,et al.  Athletic Trainers' Concussion-Assessment and -Management Practices: An Update. , 2019, Journal of athletic training.

[2]  L. Erdodi,et al.  Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator , 2018, JAMA neurology.

[3]  Steven P. Broglio,et al.  Test-Retest Reliability and Interpretation of Common Concussion Assessment Tools: Findings from the NCAA-DoD CARE Consortium , 2017, Sports Medicine.

[4]  K. Sarmiento,et al.  A Scoping Review to Address the Culture of Concussion in Youth and High School Sports. , 2017, The Journal of school health.

[5]  T. Covassin,et al.  Exploring Sandbagging Behaviors, Effort, and Perceived Utility of the ImPACT Baseline Assessment in College Athletes , 2017 .

[6]  Allen K. Sills,et al.  Consensus statement on concussion in sport—the 5th international conference on concussion in sport held in Berlin, October 2016 , 2017, British Journal of Sports Medicine.

[7]  L. Weyandt,et al.  Immediate Post-Concussion and Cognitive Testing (ImPACT): a systematic review of the prevalence and assessment of invalid performance , 2017, The Clinical neuropsychologist.

[8]  A. Maerlender,et al.  Sandbagging on the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) in a high school athlete population , 2016, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[9]  Amanda R. Rabinowitz,et al.  A pilot investigation of the Motivation Behaviors Checklist (MBC): An observational rating scale of effort towards testing for baseline sports-concussion assessment , 2016, Journal of clinical and experimental neuropsychology.

[10]  T. Covassin,et al.  Epidemiology of Sports-Related Concussion in NCAA Athletes From 2009-2010 to 2013-2014 , 2015, The American journal of sports medicine.

[11]  T. Buckley,et al.  Concussion-Management Practice Patterns of National Collegiate Athletic Association Division II and III Athletic Trainers: How the Other Half Lives. , 2015, Journal of athletic training.

[12]  M. McCrea,et al.  Rates and Predictors of Invalid Baseline Test Performance in High School and Collegiate Athletes for 3 Computerized Neurocognitive Tests , 2015, The American journal of sports medicine.

[13]  B. Hill,et al.  Logistic Regression Function for Detection of Suspicious Performance During Baseline Evaluations Using Concussion Vital Signs , 2015, Applied neuropsychology. Adult.

[14]  K. Guskiewicz,et al.  Clinical Management of Sport-Related Concussion: Developing a Roadmap to a Successful Outcome , 2015 .

[15]  A. Murray,et al.  Sports Concussion: Time for a Culture Change , 2015, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[16]  D. Hovda,et al.  The New Neurometabolic Cascade of Concussion. , 2014, Neurosurgery.

[17]  G. Iverson,et al.  Embedded validity indicators on CNS vital signs in youth with neurological diagnoses. , 2014, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[18]  Steven P Broglio,et al.  National Athletic Trainers' Association position statement: management of sport concussion. , 2014, Journal of athletic training.

[19]  Ashley J Szabo,et al.  Invalid performance and the ImPACT in national collegiate athletic association division I football players. , 2013, Journal of athletic training.

[20]  K. Guskiewicz,et al.  Current concepts in sport concussion management: A multifaceted approach , 2013 .

[21]  P. Schatz,et al.  "Sandbagging" baseline test performance on ImPACT, without detection, is more difficult than it appears. , 2013, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[22]  K. Guskiewicz,et al.  Identifying Impairments after concussion: normative data versus individualized baselines. , 2012, Medicine and science in sports and exercise.

[23]  K. Erdal Neuropsychological testing for sports-related concussion: how athletes can sandbag their baseline testing without detection. , 2012, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[24]  Philip Schatz,et al.  Group Versus Individual Administration Affects Baseline Neurocognitive Test Performance , 2011, The American journal of sports medicine.

[25]  S. Millis,et al.  American Academy of Clinical Neuropsychology Consensus Conference Statement on the Neuropsychological Assessment of Effort, Response Bias, and Malingering , 2009, The Clinical neuropsychologist.

[26]  Michael S Ferrara,et al.  Age-related differences in neuropsychological testing among high school athletes. , 2009, Journal of athletic training.

[27]  Michael S Ferrara,et al.  Test-retest reliability of computerized concussion assessment programs. , 2007, Journal of athletic training.

[28]  C. Gualtieri,et al.  Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[29]  R. Echemendia,et al.  The impact of motivation on neuropsychological performance in sports-related mild traumatic brain injury , 2006, Journal of the International Neuropsychological Society.

[30]  P. Green,et al.  Effort has a greater effect on test scores than severe brain injury in compensation claimants , 2001, Brain injury.

[31]  D B McKeag,et al.  Relationship between concussion and neuropsychological performance in college football players. , 1999, JAMA.