Attention Enhancement for Exoskeleton-Assisted Hand Rehabilitation Using Fingertip Haptic Stimulation

Active enrollment in rehabilitation training yields better treatment outcomes. This paper introduces an exoskeleton-assisted hand rehabilitation system. It is the first attempt to combine fingertip cutaneous haptic stimulation with exoskeleton-assisted hand rehabilitation for training participation enhancement. For the first time, soft material 3D printing techniques are adopted to make soft pneumatic fingertip haptic feedback actuators to achieve cheaper and faster iterations of prototype designs with consistent quality. The fingertip haptic stimulation is synchronized with the motion of our hand exoskeleton. The contact force of the fingertips resulted from a virtual interaction with a glass of water was based on data collected from normal hand motions to grasp a glass of water. System characterization experiments were conducted and exoskeleton-assisted hand motion with and without the fingertip cutaneous haptic stimulation were compared in an experiment involving healthy human subjects. Users’ attention levels were monitored in the motion control process using a Brainlink EEG-recording device and software. The results of characterization experiments show that our created haptic actuators are lightweight (6.8 ± 0.23 g each with a PLA fixture and Velcro) and their performance is consistent and stable with small hysteresis. The user study experimental results show that participants had significantly higher attention levels with additional haptic stimulations compared to when only the exoskeleton was deployed; heavier stimulated grasping weight (a 300 g glass) was associated with significantly higher attention levels of the participants compared to when lighter stimulated grasping weight (a 150 g glass) was applied. We conclude that haptic stimulations increase the involvement level of human subjects during exoskeleton-assisted hand exercises. Potentially, the proposed exoskeleton-assisted hand rehabilitation with fingertip stimulation may better attract user’s attention during treatment.

[1]  Cosima Prahm,et al.  Application of AR and VR in hand rehabilitation: A systematic review , 2020, J. Biomed. Informatics.

[2]  D. Werring,et al.  Stroke: causes and clinical features , 2020, Medicine.

[3]  Maud Marchal,et al.  HapTip: Displaying Haptic Shear Forces at the Fingertips for Multi-Finger Interaction in Virtual Environments , 2016, Front. ICT.

[4]  Domenico Prattichizzo,et al.  Simplified design of haptic display by extending one-point kinesthetic feedback to multipoint tactile feedback , 2010, 2010 IEEE Haptics Symposium.

[5]  Effects of gait training with rhythmic auditory stimulation on gait ability in stroke patients , 2016, Journal of physical therapy science.

[6]  Antonio Frisoli,et al.  The Combined Impact of Virtual Reality Neurorehabilitation and Its Interfaces on Upper Extremity Functional Recovery in Patients With Chronic Stroke , 2012, Stroke.

[7]  Nikolaos G. Tsagarakis,et al.  A High Performance Tactile Feedback Display and Its Integration in Teleoperation , 2012, IEEE Transactions on Haptics.

[8]  Soo-Chul Lim,et al.  Role of combined tactile and kinesthetic feedback in minimally invasive surgery , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[9]  Mounia Ziat,et al.  Haptic Neurorehabilitation and Virtual Reality for Upper Limb Paralysis: A Review. , 2016, Critical reviews in biomedical engineering.

[10]  J. Shuster,et al.  Adding electrical stimulation during standard rehabilitation after stroke to improve motor function. A systematic review and meta-analysis. , 2018, Annals of physical and rehabilitation medicine.

[11]  D. Reinkensmeyer,et al.  Effect of visual distraction and auditory feedback on patient effort during robot-assisted movement training after stroke , 2011, Journal of NeuroEngineering and Rehabilitation.

[12]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[13]  Mahdi Haghshenas-Jaryani,et al.  Soft Robotic Rehabilitation Exoskeleton (REHAB Glove) for Hand Therapy , 2017 .

[14]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[15]  S. Leonhardt,et al.  A survey on robotic devices for upper limb rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[16]  S. Cai,et al.  Printing Multi‐Material Organic Haptic Actuators , 2020, Advanced materials.

[17]  Kaspar Althoefer,et al.  Multi-fingered haptic palpation utilizing granular jamming stiffness feedback actuators , 2014 .

[18]  Hong Kai Yap,et al.  Design and Preliminary Feasibility Study of a Soft Robotic Glove for Hand Function Assistance in Stroke Survivors , 2017, Front. Neurosci..

[19]  Weiliang Xu,et al.  A Three-Fingered Force Feedback Glove Using Fiber-Reinforced Soft Bending Actuators , 2020, IEEE Transactions on Industrial Electronics.

[20]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Systematic Review of its Effectiveness for Upper Limb Motor Recovery , 2007, Topics in stroke rehabilitation.

[21]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[22]  Aman Arora,et al.  A Pneumatic Haptic Display for Collaborative Robotics applications , 2020, 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT.

[23]  Emanuele Lindo Secco,et al.  A Wearable Exoskeleton for Hand Kinesthetic Feedback in Virtual Reality , 2019, MobiHealth.

[24]  Soo-Jin Lee,et al.  Current hand exoskeleton technologies for rehabilitation and assistive engineering , 2012 .

[25]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[26]  Kaspar Althoefer,et al.  Multi-fingered haptic palpation using pneumatic feedback actuators , 2014 .

[27]  Jing Wang,et al.  Hand Rehabilitation Robotics on Poststroke Motor Recovery , 2017, Behavioural neurology.

[28]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[29]  Haruhisa Kawasaki,et al.  Development of a Hand-Assist Robot With Multi-Degrees-of-Freedom for Rehabilitation Therapy , 2012, IEEE/ASME Transactions on Mechatronics.

[30]  Cuntai Guan,et al.  Brain-Computer Interface in Stroke Rehabilitation , 2013, J. Comput. Sci. Eng..

[31]  Rajni V. Patel,et al.  A Multi-Functional Lower- and Upper-Limb Stroke Rehabilitation Robot , 2020, IEEE Transactions on Medical Robotics and Bionics.

[32]  Kyung Hyun Choi,et al.  3D printing for soft robotics – a review , 2018, Science and technology of advanced materials.

[33]  Kaspar Althoefer,et al.  An Attention-Controlled Hand Exoskeleton for the Rehabilitation of Finger Extension and Flexion Using a Rigid-Soft Combined Mechanism , 2019, Front. Neurorobot..

[34]  Changho Song,et al.  Gait Training with Bilateral Rhythmic Auditory Stimulation in Stroke Patients: A Randomized Controlled Trial , 2018, Brain sciences.

[35]  YapHong Kai,et al.  High-Force Soft Printable Pneumatics for Soft Robotic Applications , 2016 .

[36]  Guanghua Xu,et al.  A review: Motor rehabilitation after stroke with control based on human intent , 2018, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[37]  Effie Chew,et al.  Is Motor‐Imagery Brain‐Computer Interface Feasible in Stroke Rehabilitation? , 2014, PM & R : the journal of injury, function, and rehabilitation.

[38]  N. Takeuchi,et al.  Rehabilitation with Poststroke Motor Recovery: A Review with a Focus on Neural Plasticity , 2013, Stroke research and treatment.

[39]  Allison M. Okamura,et al.  Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments , 2017, IEEE Transactions on Haptics.

[40]  Mojtaba Ahmadi,et al.  A task oriented haptic gait rehabilitation robot , 2014 .

[41]  Dong Pyo Jang,et al.  Development of virtual reality proprioceptive rehabilitation system for stroke patients , 2014, Comput. Methods Programs Biomed..

[42]  Atulya K. Nagar,et al.  Wearable Vibrotactile Haptic Device for Stiffness Discrimination during Virtual Interactions , 2017, Front. Robot. AI.

[43]  Adrie Kooijman,et al.  Implementation and Validation of Engagement Monitoring in an Engagement Enhancing Rehabilitation System , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Chen-Hua Yeow,et al.  Print-it-Yourself (PIY) glove: A fully 3D printed soft robotic hand rehabilitative and assistive exoskeleton for stroke patients , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[45]  Catherine Disselhorst-Klug,et al.  Comparison of Muscular Activity and Movement Performance in Robot-Assisted and Freely Performed Exercises , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.