HapPro: A Wearable Haptic Device for Proprioceptive Feedback

Objective: Myoelectric hand prostheses have reached a considerable technological level and gained an increasing attention in assistive robotics. However, their abandonment rate remains high, with unintuitive control and lack of sensory feedback being major causes. Among the different types of sensory information, proprioception, e.g., information on hand aperture, is crucial to successfully perform everyday actions. Despite the many attempts in literature to restore and convey this type of feedback, much remains to be done to close the action-perception loop in prosthetic devices. Methods: With this as motivation, in this paper we introduce HapPro, a wearable, noninvasive haptic device that can convey proprioceptive information for a prosthetic hand. The device was used with an under-actuated, simple to control anthropomorphic robotic hand, providing information about hand aperture by mapping it to the position of a wheel that can run on the user's forearm. Tests with 43 able bodied subjects and one amputee subject were conducted in order to quantify the effectiveness of HapPro as a feedback device. Results: HapPro provided a good level of accuracy for item discrimination. Participants also reported the device to be intuitive and effective in conveying proprioceptive cues. Similar results were obtained in the proof-of-concept experiment with an amputee subject. Conclusions: Results show that HapPro is able to convey information on the opening of a prosthetic hand in a noninvasive way. Significance: Using this device for proprioceptive feedback could improve usability of myoelectric prostheses, potentially reducing abandonment and increasing quality of life for their users.

[1]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[2]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[3]  Mark R. Cutkosky,et al.  Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[4]  Manuel G. Catalano,et al.  The SoftHand Pro: Translation from Robotic Hand to Prosthetic Prototype , 2017 .

[5]  Mark R. Cutkosky,et al.  Rotational Skin Stretch Feedback: A Wearable Haptic Display for Motion , 2010, IEEE Transactions on Haptics.

[6]  Alessandro Moscatelli,et al.  Modeling psychophysical data at the population-level: the generalized linear mixed model. , 2012, Journal of vision.

[7]  Matteo Bianchi,et al.  Design and Characterization of a Fabric-Based Softness Display , 2015, IEEE Transactions on Haptics.

[8]  D. Datta,et al.  Functional outcome of patients with proximal upper limb deficiency–acquired and congenital , 2004, Clinical rehabilitation.

[9]  Allison M. Okamura,et al.  Conveying the configuration of a virtual human hand using vibrotactile feedback , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[10]  J. Wheeler,et al.  Investigation of Rotational Skin Stretch for Proprioceptive Feedback With Application to Myoelectric Systems , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Allison M. Okamura,et al.  Identifying the role of proprioception in upper-limb prosthesis control: Studies on targeted motion , 2010, TAP.

[12]  A. Bicchi,et al.  The Change in Fingertip Contact Area as a Novel Proprioceptive Cue , 2016, Current Biology.

[13]  D. McCloskey Kinesthetic sensibility. , 1978, Physiological reviews.

[14]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  C. Pylatiuk,et al.  Results of an Internet survey of myoelectric prosthetic hand users , 2007, Prosthetics and orthotics international.

[16]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[17]  Elaine Biddiss,et al.  Consumer design priorities for upper limb prosthetics , 2007, Disability and rehabilitation. Assistive technology.

[18]  Giorgio Grioli,et al.  The Quest for Natural Machine Motion: An Open Platform to Fast-Prototyping Articulated Soft Robots , 2017, IEEE Robotics & Automation Magazine.

[19]  Simona Casini,et al.  Design and realization of the CUFF - clenching upper-limb force feedback wearable device for distributed mechano-tactile stimulation of normal and tangential skin forces , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  S. Gandevia,et al.  Cutaneous receptors contribute to kinesthesia at the index finger, elbow, and knee. , 2005, Journal of neurophysiology.

[22]  Marcia Kilchenman O'Malley,et al.  Vibrotactile feedback of pose error enhances myoelectric control of a prosthetic hand , 2013, 2013 World Haptics Conference (WHC).

[23]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[25]  Keehoon Kim,et al.  Haptic Feedback Enhances Grip Force Control of sEMG-Controlled Prosthetic Hands in Targeted Reinnervation Amputees , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Hans Dietl,et al.  User demands for sensory feedback in upper extremity prostheses , 2012, 2012 IEEE International Symposium on Medical Measurements and Applications Proceedings.

[27]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[28]  Christopher J Hasson,et al.  Effects of kinematic vibrotactile feedback on learning to control a virtual prosthetic arm , 2015, Journal of NeuroEngineering and Rehabilitation.

[29]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[30]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[31]  Mark R. Cutkosky,et al.  Contact Location Display for Haptic Perception of Curvature and Object Motion , 2005, Int. J. Robotics Res..

[32]  Dario Farina,et al.  Closed-Loop Control of Grasping With a Myoelectric Hand Prosthesis: Which Are the Relevant Feedback Variables for Force Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[34]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[35]  Timothy Bretl,et al.  Passive Mechanical Skin Stretch for Multiple Degree-of-Freedom Proprioception in a Hand Prosthesis , 2014, EuroHaptics.

[36]  Sibylle B. Thies,et al.  The reality of myoelectric prostheses : understanding what makes , 2018 .

[37]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .