PrimSeq: A deep learning-based pipeline to quantitate rehabilitation training

Stroke rehabilitation seeks to increase neuroplasticity through the repeated practice of functional motions, but may have minimal impact on recovery because of insufficient repetitions. The optimal training content and quantity are currently unknown because no practical tools exist to measure them. Here, we present PrimSeq, a pipeline to classify and count functional motions trained in stroke rehabilitation. Our approach integrates wearable sensors to capture upper-body motion, a deep learning model to predict motion sequences, and an algorithm to tally motions. The trained model accurately decomposes rehabilitation activities into component functional motions, outperforming competitive machine learning methods. PrimSeq furthermore quantifies these motions at a fraction of the time and labor costs of human experts. We demonstrate the capabilities of PrimSeq in previously unseen stroke patients with a range of upper extremity motor impairment. We expect that these advances will support the rigorous measurement required for quantitative dosing trials in stroke rehabilitation.

[1]  Dale Corbett,et al.  Does Stroke Rehabilitation Really Matter? Part B: An Algorithm for Prescribing an Effective Intensity of Rehabilitation , 2018, Neurorehabilitation and neural repair.

[2]  W. J. Powers,et al.  Very Early Constraint-Induced Movement during Stroke Rehabilitation (VECTORS) , 2009, Neurology.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Carlos Fernandez-Granda,et al.  Sequence-to-Sequence Modeling for Action Identification at High Temporal Resolution , 2021, ArXiv.

[5]  A. Krassioukov,et al.  Higher Doses Improve Walking Recovery During Stroke Inpatient Rehabilitation , 2020, Stroke.

[6]  Sunil Agrawal,et al.  Capture, learning, and classification of upper extremity movement primitives in healthy controls and stroke patients , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[7]  Alexander W Dromerick,et al.  Measuring Functional Arm Movement after Stroke Using a Single Wrist-Worn Sensor and Machine Learning. , 2017, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[8]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics-2021 Update: A Report From the American Heart Association. , 2021, Circulation.

[9]  Lin-Ching Chang,et al.  Improving Accelerometry-Based Measurement of Functional Use of the Upper Extremity After Stroke: Machine Learning Versus Counts Threshold Method , 2020, Neurorehabilitation and neural repair.

[10]  R. Schafer,et al.  On the use of the I 0 -sinh window for spectrum analysis , 1980 .

[11]  S. Yamane,et al.  Effects of motor training on the recovery of manual dexterity after primary motor cortex lesion in macaque monkeys. , 2008, Journal of neurophysiology.

[12]  Catherine E. Lang,et al.  Translating Animal Doses of Task-Specific Training to People With Chronic Stroke in 1-Hour Therapy Sessions: A Proof-of-Concept Study , 2010, Neurorehabilitation and neural repair.

[13]  Catherine E Lang,et al.  Comparison of amounts and types of practice during rehabilitation for traumatic brain injury and stroke. , 2010, Journal of rehabilitation research and development.

[14]  Marina Bosch,et al.  Stroke Rehabilitation A Function Based Approach , 2016 .

[15]  Avinash Parnandi,et al.  A Taxonomy of Functional Upper Extremity Motion , 2019, Front. Neurol..

[16]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[17]  Angelo M. Sabatini,et al.  Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing , 2006, IEEE Transactions on Biomedical Engineering.

[18]  S. Kautz,et al.  Vagus nerve stimulation paired with rehabilitation for upper limb motor function after ischaemic stroke (VNS-REHAB): a randomised, blinded, pivotal, device trial , 2021, The Lancet.

[19]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[20]  Kendra M. Cherry-Allen,et al.  Dose response of task‐specific upper limb training in people at least 6 months poststroke: A phase II, single‐blind, randomized, controlled trial , 2016, Annals of neurology.

[21]  Fran Brander,et al.  Intensive upper limb neurorehabilitation in chronic stroke: outcomes from the Queen Square programme , 2019, Journal of Neurology, Neurosurgery, and Psychiatry.

[22]  D. Reisman,et al.  Observation of amounts of movement practice provided during stroke rehabilitation. , 2009, Archives of physical medicine and rehabilitation.

[23]  Hirokatsu Kataoka,et al.  Alleviating Over-segmentation Errors by Detecting Action Boundaries , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[24]  Lara A. Boyd,et al.  Is More Better? Using Metadata to Explore Dose–Response Relationships in Stroke Rehabilitation , 2014, Stroke.

[25]  D. Corbett,et al.  Advancing Stroke Recovery Through Improved Articulation of Nonpharmacological Intervention Dose. , 2021, Stroke.

[26]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[27]  E. Newport,et al.  Critical Period After Stroke Study (CPASS): A phase II clinical trial testing an optimal time for motor recovery after stroke in humans , 2021, Proceedings of the National Academy of Sciences.

[28]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[29]  C. Lang,et al.  Feasibility of high-repetition, task-specific training for individuals with upper-extremity paresis. , 2014, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[30]  Stanley P. Azen,et al.  Effect of a Task-Oriented Rehabilitation Program on Upper Extremity Recovery Following Motor Stroke: The ICARE Randomized Clinical Trial. , 2016, JAMA.

[31]  J. Kleim,et al.  Experience with the “Good” Limb Induces Aberrant Synaptic Plasticity in the Perilesion Cortex after Stroke , 2015, The Journal of Neuroscience.

[32]  Catherine E Lang,et al.  Counting Repetitions: An Observational Study of Outpatient Therapy for People with Hemiparesis Post-Stroke , 2007, Journal of neurologic physical therapy : JNPT.

[33]  M. Biddle,et al.  A report from the American Heart Association Council on Cardiovascular and Stroke Nursing. , 2015, The Journal of cardiovascular nursing.

[34]  Heidi M. Schambra,et al.  Recovery and Rehabilitation after Intracerebral Hemorrhage , 2016, Seminars in Neurology.

[35]  Catherine E Lang,et al.  On the Reporting of Experimental and Control Therapies in Stroke Rehabilitation Trials: A Systematic Review. , 2018, Archives of physical medicine and rehabilitation.

[36]  A. Eagger Rehabilitation , 1960 .