Skin Stretch Haptic Feedback to Convey Closure Information in Anthropomorphic, Under-Actuated Upper Limb Soft Prostheses

Restoring hand function in individuals with upper limb loss is a challenging task, made difficult by the complexity of human hands from both a functional and sensory point of view. Users of commercial prostheses, even sophisticated devices, must visually attend to the hand to know its state, since in most cases they are not provided with any direct sensory information. Among the different types of haptic feedback that can be delivered, particularly information on hand opening is likely to reduce the requirement of constant visual attention. In recent years, there has been a trend of using underactuated, compliant multi-fingered hands as upper limb prostheses, in part due to their simplicity and ease of use attributed to low degree-of-freedom (d.o.f.) actuation. The trend toward underactuation encourages the design of one d.o.f. haptic devices to provide intuitive sensory feedback from the prosthesis. However, mapping the closure of a multi-d.o.f. prosthetic hand to a simple and intuitive haptic cue is not a trivial task. In this paper, we explore the use of a one d.o.f. skin stretch haptic device, the rice haptic rocker, to provide intuitive proprioceptive feedback indicating overall hand closure of an underactuated prosthesis. The benefits and challenges of the system are assessed in multi-tasking and reduced vision scenarios for an object-size discrimination task, in an effort to simulate challenges in daily life, and are compared against the haptic resolution of the device using the just noticeable difference. Finally, an evaluation done with a prosthesis user, in the form of a truncated version of the Activities Measure for Upper Limb Amputees (AM-ULA), shows possible benefits of the addition of haptic feedback in tasks with reduced visual attention.

[1]  Dario Farina,et al.  GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses , 2017, Journal of neural engineering.

[2]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[3]  H. Ehrsson,et al.  Upper limb amputees can be induced to experience a rubber hand as their own , 2008, Brain : a journal of neurology.

[4]  K. Vogeley,et al.  The “sense of agency” and its underlying cognitive and neural mechanisms , 2008, Consciousness and Cognition.

[5]  J. Wheeler,et al.  Investigation of Rotational Skin Stretch for Proprioceptive Feedback With Application to Myoelectric Systems , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Allison M. Okamura,et al.  Identifying the role of proprioception in upper-limb prosthesis control: Studies on targeted motion , 2010, TAP.

[7]  A. Bicchi,et al.  The Change in Fingertip Contact Area as a Novel Proprioceptive Cue , 2016, Current Biology.

[8]  Marcia Kilchenman O'Malley,et al.  The role of auxiliary and referred haptic feedback in myoelectric control , 2015, 2015 IEEE World Haptics Conference (WHC).

[9]  Mark R. Cutkosky,et al.  Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  Sibylle B. Thies,et al.  The reality of myoelectric prostheses : understanding what makes , 2018 .

[11]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[12]  Dario Farina,et al.  Closed-Loop Control of Grasping With a Myoelectric Hand Prosthesis: Which Are the Relevant Feedback Variables for Force Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  S. D. Reimers,et al.  Kinesthetic Sensing for the EMG Controlled "Boston Arm" , 1970 .

[14]  Peter H. Veltink,et al.  Vibro- and Electrotactile User Feedback on Hand Opening for Myoelectric Forearm Prostheses , 2012, IEEE Transactions on Biomedical Engineering.

[15]  Jacqueline S. Hebert,et al.  Applications of sensory feedback in motorized upper extremity prosthesis: a review , 2014, Expert review of medical devices.

[16]  S. Millstein,et al.  Prosthetic Use in Adult Upper Limb Amputees: A Comparison of the Body Powered and Electrically Powered Prostheses , 1986, Prosthetics and orthotics international.

[17]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  C. Pylatiuk,et al.  Results of an Internet survey of myoelectric prosthetic hand users , 2007, Prosthetics and orthotics international.

[19]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[20]  Karlin Young Ju Bark Rotational skin stretch feedback: A new approach to wearable haptic display , 2009 .

[21]  Edoardo Battaglia,et al.  The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand , 2017, 2017 IEEE World Haptics Conference (WHC).

[22]  Manuel G. Catalano,et al.  A Century of Robotic Hands , 2019, Annu. Rev. Control. Robotics Auton. Syst..

[23]  Keehoon Kim,et al.  Haptic Feedback Enhances Grip Force Control of sEMG-Controlled Prosthetic Hands in Targeted Reinnervation Amputees , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Peter H Veltink,et al.  Hand-opening feedback for myoelectric forearm prostheses: performance in virtual grasping tasks influenced by different levels of distraction. , 2012, Journal of rehabilitation research and development.

[25]  C. Murray Embodiment and Prosthetics , 2008 .

[26]  Hans Dietl,et al.  User demands for sensory feedback in upper extremity prostheses , 2012, 2012 IEEE International Symposium on Medical Measurements and Applications Proceedings.

[27]  M. J. Highsmith,et al.  Differences in myoelectric and body-powered upper-limb prostheses: Systematic literature review. , 2015, Journal of rehabilitation research and development.

[28]  Dario Farina,et al.  Multichannel electrotactile feedback for simultaneous and proportional myoelectric control , 2016, Journal of neural engineering.

[29]  L. Resnik,et al.  Development and evaluation of the activities measure for upper limb amputees. , 2013, Archives of Physical Medicine and Rehabilitation.

[30]  Elaine Biddiss,et al.  Consumer design priorities for upper limb prosthetics , 2007, Disability and rehabilitation. Assistive technology.

[31]  Giorgio Grioli,et al.  The Quest for Natural Machine Motion: An Open Platform to Fast-Prototyping Articulated Soft Robots , 2017, IEEE Robotics & Automation Magazine.

[32]  S. Gandevia,et al.  Cutaneous receptors contribute to kinesthesia at the index finger, elbow, and knee. , 2005, Journal of neurophysiology.

[33]  Marcia Kilchenman O'Malley,et al.  Vibrotactile feedback of pose error enhances myoelectric control of a prosthetic hand , 2013, 2013 World Haptics Conference (WHC).

[34]  Christopher J Hasson,et al.  Effects of kinematic vibrotactile feedback on learning to control a virtual prosthetic arm , 2015, Journal of NeuroEngineering and Rehabilitation.

[35]  Christian Cipriani,et al.  HyVE—Hybrid Vibro-Electrotactile Stimulation—Is an Efficient Approach to Multi-Channel Sensory Feedback , 2014, IEEE Transactions on Haptics.

[36]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[37]  S. Gandevia,et al.  The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. , 2012, Physiological reviews.

[38]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[39]  Manuel G. Catalano,et al.  A synergy-driven approach to a myoelectric hand , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[40]  Stefania Fatone,et al.  Outcome instruments for prosthetics: clinical applications. , 2014, Physical medicine and rehabilitation clinics of North America.

[41]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[42]  Alessandro Moscatelli,et al.  Modeling psychophysical data at the population-level: the generalized linear mixed model. , 2012, Journal of vision.

[43]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[44]  S. Gandevia,et al.  The kinaesthetic senses , 2009, The Journal of physiology.

[45]  Nikolaos G. Tsagarakis,et al.  Design of a wearable skin stretch cutaneous device for the upper limb , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[46]  Matteo Bianchi,et al.  The SoftHand Pro: Functional evaluation of a novel, flexible, and robust myoelectric prosthesis , 2018, PloS one.

[47]  Marco Santello,et al.  Improving Fine Control of Grasping Force during Hand–Object Interactions for a Soft Synergy-Inspired Myoelectric Prosthetic Hand , 2018, Front. Neurorobot..

[48]  Timothy Bretl,et al.  Passive Mechanical Skin Stretch for Multiple Degree-of-Freedom Proprioception in a Hand Prosthesis , 2014, EuroHaptics.

[49]  Mark R. Cutkosky,et al.  Rotational Skin Stretch Feedback: A Wearable Haptic Display for Motion , 2010, IEEE Transactions on Haptics.

[50]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.