Optimizing Components of the Sport Concussion Assessment Tool for Acute Concussion Assessment.

BACKGROUND The Sport Concussion Assessment Tool (SCAT) could be improved by identifying critical subsets that maximize diagnostic accuracy and eliminate low information elements. OBJECTIVE To identify optimal SCAT subsets for acute concussion assessment. METHODS Using Concussion Assessment, Research, and Education (CARE) Consortium data, we compared student-athletes' and cadets' preinjury baselines (n = 2178) with postinjury assessments within 6 h (n = 1456) and 24 to 48 h (n = 2394) by considering demographics, symptoms, Standard Assessment of Concussion (SAC), and Balance Error Scoring System (BESS) scores. We divided data into training/testing (60%/40%) sets. Using training data, we integrated logistic regression with an engineering methodology-mixed integer programming-to optimize models with ≤4, 8, 12, and 16 variables (Opt-k). We also created models including only raw scores (Opt-RS-k) and symptom, SAC, and BESS composite scores (summary scores). We evaluated models using testing data. RESULTS At <6 h and 24 to 48 h, most Opt-k and Opt-RS-k models included the following symptoms: do not feel right, headache, dizziness, sensitivity to noise, and whether physical or mental activity worsens symptoms. Opt-k models included SAC concentration and delayed recall change scores. Opt-k models had lower Brier scores (BS) and greater area under the curve (AUC) (<6 h: BS = 0.072-0.089, AUC = 0.95-0.96; 24-48 h: BS = 0.085-0.093, AUC = 0.94-0.95) than Opt-RS-k (<6 h: BS = 0.082-0.087, AUC = 0.93-0.95; 24-48 h: BS = 0.095-0.099, AUC = 0.92-0.93) and summary score models (<6 h: BS = 0.14, AUC = 0.89; 24-48 h: BS = 0.15, AUC = 0.87). CONCLUSION We identified SCAT subsets that accurately assess acute concussion and improve administration time over the complete battery, highlighting the importance of eliminating "noisy" elements. These findings can direct clinicians to the SCAT components that are most sensitive to acute concussion.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[3]  J. Kelly,et al.  Standardized Assessment of Concussion (SAC): On-Site Mental Status Evaluation of the Athlete , 1998, The Journal of head trauma rehabilitation.

[4]  Kevin M. Guskiewicz,et al.  Relationship between clinical and forceplate measures of postural stability , 1999 .

[5]  Eva K. Lee,et al.  Integer Programming Applied to Intensity-Modulated Radiation Therapy Treatment Planning , 2003, Ann. Oper. Res..

[6]  S. Marshall,et al.  Acute effects and recovery time following concussion in collegiate football players: the NCAA Concussion Study. , 2003, JAMA.

[7]  T. Covassin,et al.  Sex Differences and the Incidence of Concussions Among Collegiate Athletes. , 2003, Journal of athletic training.

[8]  P. Royston Multiple Imputation of Missing Values , 2004 .

[9]  Jason R. Freeman,et al.  Sex differences in outcome following sports-related concussion. , 2005, Journal of neurosurgery.

[10]  S. Marshall,et al.  Standard regression-based methods for measuring recovery after sport-related concussion , 2005, Journal of the International Neuropsychological Society.

[11]  I. Williamson,et al.  Converging evidence for the under-reporting of concussions in youth ice hockey , 2006, British Journal of Sports Medicine.

[12]  M. Lovell,et al.  Measurement of Symptoms Following Sports-Related Concussion: Reliability and Normative Data for the Post-Concussion Scale , 2006, Applied neuropsychology.

[13]  Robert F. Dell,et al.  Formulating Integer Linear Programs: A Rogues' Gallery , 2007, INFORMS Trans. Educ..

[14]  Luke M Gessel,et al.  Concussions among United States high school and collegiate athletes. , 2007, Journal of athletic training.

[15]  T. Covassin,et al.  SEX DIFFERENCES IN NEUROPSYCHOLOGICAL FUNCTION AND POST‐CONCUSSION SYMPTOMS OF CONCUSSED COLLEGIATE ATHLETES , 2007, Neurosurgery.

[16]  T. Hammeke,et al.  Concussion symptom inventory: an empirically derived scale for monitoring resolution of symptoms following sport-related concussion. , 2009, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[17]  J. Kutcher,et al.  At-Risk Populations in Sports-Related Concussion , 2010, Current sports medicine reports.

[18]  M. Putukian The acute symptoms of sport-related concussion: diagnosis and on-field management. , 2011, Clinics in sports medicine.

[19]  T. Hammeke,et al.  Incidence, Clinical Course, and Predictors of Prolonged Recovery Time Following Sport-Related Concussion in High School and College Athletes , 2012, Journal of the International Neuropsychological Society.

[20]  Jared M. Bruce,et al.  The Utility of Post-Concussion Neuropsychological Data in Identifying Cognitive Change Following Sports-Related MTBI in the Absence of Baseline Data , 2012, The Clinical neuropsychologist.

[21]  M. Mrazik,et al.  Sport concussion knowledge base, clinical practises and needs for continuing medical education: a survey of family physicians and cross-border comparison , 2012, British Journal of Sports Medicine.

[22]  T. Covassin,et al.  The Role of Age and Sex in Symptoms, Neurocognitive Performance, and Postural Stability in Athletes After Concussion , 2012, The American journal of sports medicine.

[23]  Oguzhan Alagöz,et al.  The Effect of Budgetary Restrictions on Breast Cancer Diagnostic Decisions , 2012, Manuf. Serv. Oper. Manag..

[24]  K. Guskiewicz,et al.  Identifying Impairments after concussion: normative data versus individualized baselines. , 2012, Medicine and science in sports and exercise.

[25]  K. Guskiewicz,et al.  Onfield assessment of concussion in the adult athlete , 2013, British Journal of Sports Medicine.

[26]  K. Guskiewicz,et al.  Evidence-based approach to revising the SCAT2: introducing the SCAT3 , 2013, British Journal of Sports Medicine.

[27]  Alexandra M. Newman,et al.  A Survey of Linear and Mixed-Integer Optimization Tutorials , 2013, INFORMS Trans. Educ..

[28]  J. Ghajar,et al.  Concussion guidelines step 1: systematic review of prevalent indicators. , 2014, Neurosurgery.

[29]  Matthew A. Eisenberg,et al.  Duration and Course of Post-Concussive Symptoms , 2014, Pediatrics.

[30]  J. Kutcher,et al.  Sports Concussion Diagnosis and Management , 2014, Continuum.

[31]  S. Marshall,et al.  Disclosure and non-disclosure of concussion and concussion symptoms in athletes: Review and application of the socio-ecological framework , 2014, Brain injury.

[32]  Jared M. Bruce,et al.  Prospective Clinical Assessment Using Sideline Concussion Assessment Tool-2 Testing in the Evaluation of Sport-Related Concussion in College Athletes , 2015, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[33]  D. Bertsimas,et al.  Best Subset Selection via a Modern Optimization Lens , 2015, 1507.03133.

[34]  P. McCrory,et al.  Clinical challenges in the diagnosis and assessment of sports-related concussion. , 2015, Neurology. Clinical practice.

[35]  Kumar Rajaram,et al.  Planning for HIV Screening, Testing, and Care at the Veterans Health Administration , 2015, Oper. Res..

[36]  S. Austin,et al.  Norms, Athletic Identity, and Concussion Symptom Under-Reporting Among Male Collegiate Ice Hockey Players: A Prospective Cohort Study , 2015, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[37]  W. Barr,et al.  Reliability and Validity of the Sport Concussion Assessment Tool–3 (SCAT3) in High School and Collegiate Athletes , 2016, The American journal of sports medicine.

[38]  C. Cullum,et al.  The sensitivity and specificity of clinical measures of sport concussion: three tests are better than one , 2016, BMJ Open Sport & Exercise Medicine.

[39]  Toshiki Sato,et al.  Feature subset selection for logistic regression via mixed integer optimization , 2016, Computational Optimization and Applications.

[40]  Dimitris Bertsimas,et al.  OR Forum - An Algorithmic Approach to Linear Regression , 2016, Oper. Res..

[41]  Allen K. Sills,et al.  The Sport Concussion Assessment Tool: a systematic review. , 2016, Neurosurgical focus.

[42]  J. Ortega,et al.  A National Study on the Effects of Concussion in Collegiate Athletes and US Military Service Academy Members: The NCAA–DoD Concussion Assessment, Research and Education (CARE) Consortium Structure and Methods , 2017, Sports Medicine.

[43]  R. Ellenbogen,et al.  What are the critical elements of sideline screening that can be used to establish the diagnosis of concussion? A systematic review , 2017, British Journal of Sports Medicine.

[44]  Allen K. Sills,et al.  The Sport Concussion Assessment Tool 5th Edition (SCAT5): Background and rationale , 2017, British Journal of Sports Medicine.

[45]  Allen K. Sills,et al.  Consensus statement on concussion in sport—the 5th international conference on concussion in sport held in Berlin, October 2016 , 2017, British Journal of Sports Medicine.

[46]  Turgay Ayer,et al.  Optimal M-Switch Surveillance Policies for Liver Cancer in a Hepatitis C-Infected Population , 2018, Oper. Res..

[47]  T. Kaminski,et al.  Efficacy of Tandem Gait to Identify Impaired Postural Control after Concussion , 2018, Medicine and science in sports and exercise.

[48]  J. Ortega,et al.  Immediate Removal From Activity After Sport-Related Concussion Is Associated With Shorter Clinical Recovery and Less Severe Symptoms in Collegiate Student-Athletes , 2018, The American journal of sports medicine.

[49]  Gian-Gabriel P. Garcia,et al.  Quantifying the Value of Multidimensional Assessment Models for Acute Concussion: An Analysis of Data from the NCAA-DoD Care Consortium , 2018, Sports Medicine.

[50]  P. Comper,et al.  Determining sensitivity and specificity of the Sport Concussion Assessment Tool 3 (SCAT3) components in university athletes , 2018, Brain injury.

[51]  Oguzhan Alagoz,et al.  Analysis of Mammography Screening Policies under Resource Constraints , 2018 .

[52]  P. GarciaGian-Gabriel,et al.  A Data-Driven Approach to Unlikely, Possible, Probable, and Definite Acute Concussion Assessment , 2019 .