Training with Agency-Inspired Feedback from an Instrumented Glove to Improve Functional Grasp Performance

Sensory feedback from wearables can be effective to learn better movement through enhanced information and engagement. Facilitating greater user cognition during movement practice is critical to accelerate gains in motor function during rehabilitation following brain or spinal cord trauma. This preliminary study presents an approach using an instrumented glove to leverage sense of agency, or perception of control, to provide training feedback for functional grasp. Seventeen able-bodied subjects underwent training and testing with a custom-built sensor glove prototype from our laboratory. The glove utilizes onboard force and flex sensors to provide inputs to an artificial neural network that predicts achievement of “secure” grasp. Onboard visual and audio feedback was provided during training with progressively shorter time delay to induce greater agency by intentional binding, or perceived compression in time between an action (grasp) and sensory consequence (feedback). After training, subjects demonstrated a significant reduction (p < 0.05) in movement pathlength and completion time for a functional task involving grasp-move-place of a small object. Future work will include a model-based algorithm to compute secure grasp, virtual reality immersion, and testing with clinical populations.

[1]  B. Dobkin Behavioral self-management strategies for practice and exercise should be included in neurologic rehabilitation trials and care. , 2016, Current opinion in neurology.

[2]  Frank Schumann,et al.  Mindful movement and skilled attention , 2015, Front. Hum. Neurosci..

[3]  M. Dijkers,et al.  Physical therapy after spinal cord injury: A systematic review of treatments focused on participation , 2014, The journal of spinal cord medicine.

[4]  Zong-Ming Li,et al.  Integration of marker and force data to compute three-dimensional joint moments of the thumb and index finger digits during pinch , 2015, Computer methods in biomechanics and biomedical engineering.

[5]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[6]  G. Knoblich,et al.  Do Implicit and Explicit Measures of the Sense of Agency Measure the Same Thing? , 2014, PloS one.

[7]  Kevin C. Galloway,et al.  Assisting hand function after spinal cord injury with a fabric-based soft robotic glove , 2018, Journal of NeuroEngineering and Rehabilitation.

[8]  Aaron M. Dollar,et al.  Classifying Human Hand Use and the Activities of Daily Living , 2014, The Human Hand as an Inspiration for Robot Hand Development.

[9]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[10]  Graham Morgan,et al.  Deep learning-based artificial vision for grasp classification in myoelectric hands , 2017, Journal of neural engineering.

[11]  Raviraj Nataraj,et al.  Agency and Performance of Reach-to-Grasp With Modified Control of a Virtual Hand: Implications for Rehabilitation , 2020, Frontiers in Human Neuroscience.

[12]  Jan Peters,et al.  A low-cost sensor glove with vibrotactile feedback and multiple finger joint and hand motion sensing for human-robot interaction , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[13]  S. Adamovich,et al.  Sensorimotor Training in a Virtual Reality Environment: Does It Improve Functional Recovery Poststroke? , 2006, Neurorehabilitation and neural repair.

[14]  John Nassour,et al.  A Robust Data-Driven Soft Sensory Glove for Human Hand Motions Identification and Replication , 2020, IEEE Sensors Journal.

[15]  C. Shea,et al.  Motor skill learning and performance: a review of influential factors , 2010, Medical education.

[16]  K. McCulloch Attention and Dual-Task Conditions: Physical Therapy Implications for Individuals With Acquired Brain Injury , 2007, Journal of neurologic physical therapy : JNPT.

[17]  Máximo A. Roa,et al.  Grasp quality measures: review and performance , 2014, Autonomous Robots.

[18]  Soo-Jin Lee,et al.  Current hand exoskeleton technologies for rehabilitation and assistive engineering , 2012 .

[19]  Ching-yi Wu,et al.  The Effects of Bilateral Arm Training on Motor Control and Functional Performance in Chronic Stroke: A Randomized Controlled Study , 2010, Neurorehabilitation and neural repair.

[20]  Leah R. Enders,et al.  Remote vibrotactile noise improves light touch sensation in stroke survivors’ fingertips via stochastic resonance , 2013, Journal of NeuroEngineering and Rehabilitation.

[21]  G. Alon,et al.  Functional Electrical Stimulation Enhancement of Upper Extremity Functional Recovery During Stroke Rehabilitation: A Pilot Study , 2007, Neurorehabilitation and neural repair.

[22]  James R. Dixon,et al.  The International Conference on Harmonization Good Clinical Practice guideline. , 1999, Quality assurance.

[23]  James W. Moore,et al.  What Is the Sense of Agency and Why Does it Matter? , 2016, Front. Psychol..

[24]  L. Moja,et al.  Constraint-Induced Movement Therapy for Upper Extremities in People With Stroke , 2015, The Cochrane database of systematic reviews.

[25]  Carol A Giuliani,et al.  A Pilot Study: Coordination of Precision Grip in Children and Adolescents with High Functioning Autism , 2009, Pediatric physical therapy : the official publication of the Section on Pediatrics of the American Physical Therapy Association.