Phybrata Sensors and Machine Learning for Enhanced Neurophysiological Diagnosis and Treatment

Concussion injuries remain a significant public health challenge. A significant unmet clinical need remains for tools that allow related physiological impairments and longer-term health risks to be identified earlier, better quantified, and more easily monitored over time. We address this challenge by combining a head-mounted wearable inertial motion unit (IMU)-based physiological vibration acceleration (“phybrata”) sensor and several candidate machine learning (ML) models. The performance of this solution is assessed for both binary classification of concussion patients and multiclass predictions of specific concussion-related neurophysiological impairments. Results are compared with previously reported approaches to ML-based concussion diagnostics. Using phybrata data from a previously reported concussion study population, four different machine learning models (Support Vector Machine, Random Forest Classifier, Extreme Gradient Boost, and Convolutional Neural Network) are first investigated for binary classification of the test population as healthy vs. concussion (Use Case 1). Results are compared for two different data preprocessing pipelines, Time-Series Averaging (TSA) and Non-Time-Series Feature Extraction (NTS). Next, the three best-performing NTS models are compared in terms of their multiclass prediction performance for specific concussion-related impairments: vestibular, neurological, both (Use Case 2). For Use Case 1, the NTS model approach outperformed the TSA approach, with the two best algorithms achieving an F1 score of 0.94. For Use Case 2, the NTS Random Forest model achieved the best performance in the testing set, with an F1 score of 0.90, and identified a wider range of relevant phybrata signal features that contributed to impairment classification compared with manual feature inspection and statistical data analysis. The overall classification performance achieved in the present work exceeds previously reported approaches to ML-based concussion diagnostics using other data sources and ML models. This study also demonstrates the first combination of a wearable IMU-based sensor and ML model that enables both binary classification of concussion patients and multiclass predictions of specific concussion-related neurophysiological impairments.

[1]  Tara A. Whitten,et al.  Robotic Assessment of Motor, Sensory, and Cognitive Function in Acute Sport-Related Concussion and Recovery. , 2019, Journal of neurotrauma.

[2]  David C. Zhu,et al.  A potential biomarker in sports-related concussion: brain functional connectivity alteration of the default-mode network measured with longitudinal resting-state fMRI over thirty days. , 2015, Journal of neurotrauma.

[3]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[4]  S. Marshall,et al.  Detecting altered postural control after cerebral concussion in athletes with normal postural stability , 2005, British Journal of Sports Medicine.

[5]  A. Murray,et al.  A Review of Frailty Syndrome and Its Physical, Cognitive and Emotional Domains in the Elderly , 2017, Geriatrics.

[6]  R. Peterka,et al.  Sensory reweighting dynamics in human postural control. , 2014, Journal of neurophysiology.

[7]  L. Hazrati,et al.  DNA repair deficiency and senescence in concussed professional athletes involved in contact sports , 2019, Acta Neuropathologica Communications.

[8]  D. Voaklander,et al.  Concussion diagnoses among adults presenting to three Canadian emergency departments: Missed opportunities☆ , 2018, The American journal of emergency medicine.

[9]  Hossein Rouhani,et al.  Detection of daily postures and walking modalities using a single chest-mounted tri-axial accelerometer. , 2018, Medical engineering & physics.

[10]  J. Hebert,et al.  Reliability and Validity of the Computerized Dynamic Posturography Sensory Organization Test in People with Multiple Sclerosis. , 2017, International journal of MS care.

[11]  Joshua M. Roper,et al.  Physiological Vibration Acceleration (Phybrata) Sensor Assessment of Multi-System Physiological Impairments and Sensory Reweighting Following Concussion , 2020, Medical devices.

[12]  Debbie Rand,et al.  How Active Are People With Stroke?: Use of Accelerometers to Assess Physical Activity , 2009, Stroke.

[13]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[14]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[15]  E. Golanov,et al.  Review of wearable technologies and machine learning methodologies for systematic detection of mild traumatic brain injuries , 2021, Journal of neural engineering.

[16]  Li-Shan Chou,et al.  Monitoring recovery of gait balance control following concussion using an accelerometer. , 2015, Journal of biomechanics.

[17]  P. Burman A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods , 1989 .

[18]  G. Iverson,et al.  Using concurrent gait and cognitive assessments to identify impairments after concussion: a narrative review , 2018, Concussion.

[19]  Donald C. Wunsch,et al.  Predictive Modeling of Sports-Related Concussions using Clinical Assessment Metrics , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[20]  D. Lai,et al.  Reweighting of the sensory inputs for postural control in patients with cervical spondylotic myelopathy after surgery , 2019, Journal of NeuroEngineering and Rehabilitation.

[21]  W. Kuan,et al.  Parkinson’s Disease: Etiology, Neuropathology, and Pathogenesis , 2018, Parkinson’s Disease: Pathogenesis and Clinical Aspects.

[22]  Kyle I. Ruiter,et al.  From Group-Level Statistics to Single-Subject Prediction: Machine Learning Detection of Concussion in Retired Athletes , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  C. Balaban,et al.  Oculomotor, Vestibular, and Reaction Time Tests in Mild Traumatic Brain Injury , 2016, PloS one.

[24]  S. O'Leary,et al.  Sensorimotor and Physiological Indicators of Impairment in Mild Traumatic Brain Injury: A Meta-Analysis , 2018, Neurorehabilitation and neural repair.

[25]  Alireza Sadeghian,et al.  Using artificial neural networks to identify patients with concussion and postconcussion syndrome based on antisaccades. , 2019, Journal of neurosurgery.

[26]  Songbai Ji,et al.  Concussion classification via deep learning using whole-brain white matter fiber strains , 2017, PloS one.

[27]  Harald Schrader,et al.  Magnetic resonance imaging after most common form of concussion , 2009, BMC Medical Imaging.

[28]  Zelma H. T. Kiss,et al.  Smart watch accelerometry for analysis and diagnosis of tremor , 2014, Journal of Neuroscience Methods.

[29]  Peter C. Fino,et al.  Sensor-Based Balance Measures Outperform Modified Balance Error Scoring System in Identifying Acute Concussion , 2017, Annals of Biomedical Engineering.

[30]  D. Cifu,et al.  Utility of a multimodal neurophysiological assessment tool in distinguishing between individuals with and without a history of mild traumatic brain injury , 2002 .

[31]  B. Parmenter,et al.  The association between cognitive impairment and physical disability in multiple sclerosis , 2005, Multiple sclerosis.

[32]  M. Poca,et al.  The Sport Concussion Assessment Tool (SCAT2) for evaluating civilian mild traumatic brain injury. A pilot normative study , 2019, PloS one.

[33]  T. Alvarez,et al.  Epidemiology and Incidence of Pediatric Concussions in General Aspects of Life , 2019, Brain sciences.

[34]  C. Cullum,et al.  The sensitivity and specificity of clinical measures of sport concussion: three tests are better than one , 2016, BMJ Open Sport & Exercise Medicine.

[35]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[36]  Douglas N. Martini,et al.  The chronic effects of concussion on gait , 2011, British Journal of Sports Medicine.

[37]  A K Bourke,et al.  Activity classification using a single chest mounted tri-axial accelerometer. , 2011, Medical engineering & physics.

[38]  Yoonsuh Jung Multiple predicting K-fold cross-validation for model selection , 2018 .

[39]  A. McKee,et al.  The Neuropathology of Chronic Traumatic Encephalopathy: The Status of the Literature , 2020, Seminars in Neurology.

[40]  W. Wright,et al.  Visual-vestibular processing deficits in mild traumatic brain injury. , 2017, Journal of vestibular research : equilibrium & orientation.

[41]  J. Keith,et al.  A Clinician’s Guide to Machine Learning in Neuropsychological Research and Practice , 2019, Journal of Pediatric Neuropsychology.

[42]  M. W. McNerney,et al.  Objective Classification of mTBI Using Machine Learning on a Combination of Frontopolar Electroencephalography Measurements and Self-reported Symptoms , 2019, Sports Medicine - Open.

[43]  D. Straumann,et al.  Artificial intelligence for understanding concussion: Retrospective cluster analysis on the balance and vestibular diagnostic data of concussion patients , 2019, PloS one.

[44]  Tarek N. Dief,et al.  Investigating the validity of a single tri-axial accelerometer mounted on the head for monitoring the activities of daily living and the timed-up and go test. , 2021, Gait & posture.

[45]  D. Wiebe,et al.  Vestibular Deficits following Youth Concussion. , 2015, The Journal of pediatrics.

[46]  H. Diener,et al.  Quantification of postural sway in normals and patients with cerebellar diseases. , 1984, Electroencephalography and clinical neurophysiology.

[47]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[48]  A. Saykin,et al.  Resting-state fMRI metrics in acute sport-related concussion and their association with clinical recovery: A study from the NCAA-DOD CARE Consortium. , 2020, Journal of neurotrauma.

[49]  H. Sair,et al.  Derivation of a Three Biomarker Panel to Improve Diagnosis in Patients with Mild Traumatic Brain Injury , 2017, Front. Neurol..

[50]  Dianne Langford,et al.  Blood biomarkers for brain injury: What are we measuring? , 2016, Neuroscience & Biobehavioral Reviews.

[51]  Steven P. Broglio,et al.  Test-Retest Reliability and Interpretation of Common Concussion Assessment Tools: Findings from the NCAA-DoD CARE Consortium , 2017, Sports Medicine.

[52]  K Aminian,et al.  Ambulatory system for the quantitative and qualitative analysis of gait and posture in chronic pain patients treated with spinal cord stimulation. , 2004, Gait & posture.

[53]  K. Schneider,et al.  Altered Vestibular Balance Function in Combat Sport Athletes. , 2021, Journal of neurotrauma.

[54]  Eswar Damaraju,et al.  Detection of Mild Traumatic Brain Injury by Machine Learning Classification Using Resting State Functional Network Connectivity and Fractional Anisotropy. , 2017, Journal of neurotrauma.

[55]  Thad W. Buster,et al.  Computerized dynamic posturography detects balance deficits in individuals with a history of chronic severe traumatic brain injury , 2016, Brain injury.

[56]  Chad Cook,et al.  Differences in change scores and the predictive validity of three commonly used measures following concussion in the middle school and high school aged population. , 2011, International journal of sports physical therapy.

[57]  Gabriel Pardo,et al.  Decreased postural balance in multiple sclerosis patients with low disability , 2011, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[58]  P. Vidal,et al.  Wearable inertial sensors provide reliable biomarkers of disease severity in multiple sclerosis: a systematic review and meta-analysis. , 2020, Annals of physical and rehabilitation medicine.

[59]  J. Barth,et al.  Mild Traumatic Brain Injury: Lessons Learned from Clinical, Sports, and Combat Concussions , 2012, Rehabilitation research and practice.

[60]  C. Busettini,et al.  Peripheral Vestibular and Balance Function in Athletes With and Without Concussion , 2019, Journal of neurologic physical therapy : JNPT.

[61]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[62]  C. Gerloff,et al.  Stroke subtype classification by geometrical descriptors of lesion shape , 2017, PloS one.

[63]  Jonathan Miller,et al.  Classification algorithms for the identification of structural injury in TBI using brain electrical activity , 2014, Comput. Biol. Medicine.

[64]  Monitoring of postural sway with a head-mounted wearable device: effects of gender, participant state, and concussion , 2019, Medical devices.

[65]  M. Sutliff Contribution of impaired mobility to patient burden in multiple sclerosis , 2010, Current medical research and opinion.

[66]  P. Azouvi,et al.  Age-Related Changes in the Association Between Traumatic Brain Injury and Dementia in Older Men and Women. , 2020, The Journal of head trauma rehabilitation.

[67]  Kimitaka Nakazawa,et al.  Difference in Postural Control during Quiet Standing between Young Children and Adults: Assessment with Center of Mass Acceleration , 2015, PloS one.

[68]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[69]  J. Carson,et al.  Concussion diagnosis and management: Knowledge and attitudes of family medicine residents. , 2017, Canadian family physician Medecin de famille canadien.

[70]  J. Lifshitz,et al.  Traumatic brain injury and vestibulo-ocular function: current challenges and future prospects , 2016, Eye and brain.

[71]  Nicholas Stergiou,et al.  A Nonlinear Dynamic Approach for Evaluating Postural Control , 2005, Sports medicine.

[72]  Gian-Gabriel P. Garcia,et al.  Optimizing Components of the Sport Concussion Assessment Tool for Acute Concussion Assessment. , 2020, Neurosurgery.

[73]  R. Moe-Nilssen,et al.  A new method for evaluating motor control in gait under real-life environmental conditions. Part 1: The instrument. , 1998, Clinical biomechanics.

[74]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[75]  Samantha Holdsworth,et al.  Rapid Prediction of Brain Injury Pattern in mTBI by Combining FE Analysis With a Machine-Learning Based Approach , 2020, IEEE Access.

[76]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[77]  L. Becerra,et al.  The young brain and concussion: Imaging as a biomarker for diagnosis and prognosis , 2012, Neuroscience & Biobehavioral Reviews.

[78]  L. Goldstein,et al.  Pathophysiology of Concussion. , 2019, Seminars in pediatric neurology.

[79]  Alexander S. Aruin,et al.  Frequency analysis approach to study balance control in individuals with multiple sclerosis , 2014, Journal of Neuroscience Methods.

[80]  Tanya Z. Filardi,et al.  Developing a Comprehensive, Interdisciplinary Concussion Program , 2020, Health services insights.

[81]  F. Barkhof,et al.  Clinical correlations of brain lesion distribution in multiple sclerosis , 2009, Journal of magnetic resonance imaging : JMRI.

[82]  Cheng Perng Phoo,et al.  Predicting Risk of Sport-Related Concussion in Collegiate Athletes and Military Cadets: A Machine Learning Approach Using Baseline Data from the CARE Consortium Study , 2020, Sports Medicine.

[83]  Tyler F. Rooks,et al.  Machine Learning Classification of Head Impact Sensor Data , 2019 .

[84]  B. Zörner,et al.  Profiling walking dysfunction in multiple sclerosis: characterisation, classification and progression over time , 2018, Scientific Reports.

[85]  T. Chmielewski,et al.  Lower Extremity Stiffness Changes after Concussion in Collegiate Football Players , 2017, Medicine and science in sports and exercise.

[86]  Leslie S. Prichep,et al.  A multimodal biomarker for concussion identification, prognosis and management , 2018, Comput. Biol. Medicine.

[87]  O. Kolev,et al.  Vestibular disorders following different types of head and neck trauma. , 2016, Functional neurology.

[88]  Charles Tator,et al.  In search of evidence-based treatment for concussion: characteristics of current clinical trials , 2014, Brain injury.

[89]  S. Margulies,et al.  Head Rotational Kinematics, Tissue Deformations, and Their Relationships to the Acute Traumatic Axonal Injury , 2020, Journal of biomechanical engineering.

[90]  Paolo Bonato,et al.  Detection of Subclinical Mild Traumatic Brain Injury (mTBI) Through Speech and Gait , 2020, INTERSPEECH.