Humans Can Integrate Force Feedback to Toes in Their Sensorimotor Control of a Robotic Hand

Tactile sensory feedback is essential for dexterous object manipulation. Users of hand myoelectric prostheses without tactile feedback must depend essentially on vision to control their device. Indeed, improved tactile feedback is one of their main priorities. Previous research has provided evidence that conveying tactile feedback can improve prostheses control, although additional effort is required to solve problems related to pattern recognition learning, unpleasant sensations, sensory adaptation, and low spatiotemporal resolution. Still, these studies have mainly focused on providing stimulation to hairy skin regions close to the amputation site, i.e., usually to the upper arm. Here, we explored the possibility to provide tactile feedback to the glabrous skin of toes, which have mechanical and neurophysiological properties similar to the fingertips. We explored this paradigm in a grasp-and-lift task, in which healthy participants controlled two opposing digits of a robotic hand by changing the spacing of their index finger and thumb. The normal forces applied by the robotic fingertips to a test object were fed back to the right big and second toe. We show that within a few lifting trials, all the participants incorporated the force feedback received by the foot in their sensorimotor control of the robotic hand.

[1]  A. Kargov,et al.  Design and Evaluation of a Low-Cost Force Feedback System for Myoelectric Prosthetic Hands , 2006 .

[2]  B. Edin,et al.  Task requirements influence sensory integration during grasping in humans. , 2004, Learning & memory.

[3]  J. J. Denier van der Gon,et al.  Integration of proprioceptive and visual position-information , 1999 .

[4]  Roland S. Johansson,et al.  Sensory Control of Dexterous Manipulation in Humans , 1996 .

[5]  R. Johansson,et al.  Signals in tactile afferents from the fingers eliciting adaptive motor responses during precision grip , 2004, Experimental Brain Research.

[6]  Silvestro Micera,et al.  Design of a cybernetic hand for perception and action , 2006, Biological Cybernetics.

[7]  J. Downar,et al.  The Effect of Task Relevance on the Cortical Response to Changes in Visual and Auditory Stimuli: An Event-Related fMRI Study , 2001, NeuroImage.

[8]  R. Johansson,et al.  Encoding of Direction of Fingertip Forces by Human Tactile Afferents , 2001, The Journal of Neuroscience.

[9]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[10]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[11]  J. T. Inglis,et al.  Distribution and behaviour of glabrous cutaneous receptors in the human foot sole , 2002, The Journal of physiology.

[12]  Benoni B. Edin,et al.  Acquiring and adapting a novel audiomotor map in human grasping , 2006, Experimental Brain Research.

[13]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[14]  G. Lundborg,et al.  Sensory substitution in prosthetics. , 2001, Hand clinics.

[15]  G.S. Dhillon,et al.  Direct neural sensory feedback and control of a prosthetic arm , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[17]  A. Kargov,et al.  Progress in the development of a multifunctional hand prosthesis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  G. Lundborg Nerve injury and repair – a challenge to the plastic brain , 2003 .

[19]  Daniel M Wolpert,et al.  Role of uncertainty in sensorimotor control. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  P. Kyberd,et al.  Survey of Upper-Extremity Prosthesis Users in Sweden and the United Kingdom , 2007 .

[21]  R. Johansson,et al.  Tactile Sensory Control of Object Manipulation in Humans , 2020, The Senses: A Comprehensive Reference.

[22]  Mats Trulsson,et al.  Mechanoreceptive afferents in the human sural nerve , 2001, Experimental Brain Research.

[23]  S C Jacobsen,et al.  Extended physiologic taction: design and evaluation of a proportional force feedback system. , 1989, Journal of rehabilitation research and development.

[24]  Paul Fiolkowski,et al.  Plantar feedback contributes to the regulation of leg stiffness. , 2005, Clinical biomechanics.

[25]  N. Thakor,et al.  Journal of Neuroengineering and Rehabilitation Open Access a Brain-computer Interface with Vibrotactile Biofeedback for Haptic Information , 2007 .

[26]  Erin Piateski,et al.  Vibrotactile pattern recognition on the arm and torso , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[27]  Alejandro Hernández Arieta,et al.  An f-MRI study of an EMG Prosthetic Hand Biofeedback System , 2006, IAS.

[28]  Mikael Wiberg,et al.  Precision grip function after free toe transfer in children with hypoplastic digits. , 2007, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[29]  D. Atkins,et al.  Epidemiologic Overview of Individuals with Upper-Limb Loss and Their Reported Research Priorities , 1996 .

[30]  L. M. Ward,et al.  Regional variation and changes with ageing in vibrotactile sensitivity in the human footsole. , 2003, The journals of gerontology. Series A, Biological sciences and medical sciences.

[31]  Felice L. Bedford,et al.  Perceptual and cognitive spatial learning. , 1993, Journal of experimental psychology. Human perception and performance.

[32]  P E Patterson,et al.  Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. , 1992, Journal of rehabilitation research and development.

[33]  K. Horch,et al.  Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs. , 2004, The Journal of hand surgery.

[34]  B. Rosén,et al.  Artificial Sensibility Based on the Use of Piezoresistive Sensors , 1998, Journal of hand surgery.