Armband with Soft Robotic Actuators and Vibrotactile Stimulators for Bimodal Haptic Feedback from a Dexterous Artificial Hand

The haptic sense relies upon a plurality of receptors and pathways to produce a complex perceptual experience of contact, pressure, taps, vibrations and flutters. This complexity is yet to be reproduced in haptic feedback interfaces that are used by people controlling a dexterous robotic hand, be it for limb-absence or teleoperation. The goal of the present bimodal haptic armband is to convey both low-frequency pressure changes and high-frequency vibrations from a dexterous robotic hand to a human's upper arm, so as to guide his/her control of the artificial limb. To that end, we design and manufacture four novel soft robotic armbands combining inflatable air chambers and vibrotactile stimulators. We develop control systems for both pathways. We conduct a series of benchtop tests to determine the pneumatic and vibrotactile performance and select from competing designs and materials. We test two of the resulting bimodal haptic armband on human subjects and confirm their ability to use both aspects of this haptic information. Arguing that dexterous artificial hands are presently not used to their fullest capability by the dearth of haptic information in users, this work aims to achieve a more realistic tactile experience for a fluent, more natural usage of robotic artificial hands.

[1]  Nitish V. Thakor,et al.  Hybrid Tele-Manipulation System Using a Sensorized 3-D-Printed Soft Robotic Gripper and a Soft Fabric-Based Haptic Glove , 2017, IEEE Robotics and Automation Letters.

[2]  A. Vallbo,et al.  Intraneural microstimulation in man. Its relation to specificity of tactile sensations. , 1987, Brain : a journal of neurology.

[3]  Roland Werthschützky,et al.  Perception-Inspired Haptic Force Sensor - A Concept Study , 2012 .

[4]  C Spence,et al.  Touch and the body: The role of the somatosensory cortex in tactile awareness , 2010 .

[5]  Christian Cipriani,et al.  HyVE—Hybrid Vibro-Electrotactile Stimulation—Is an Efficient Approach to Multi-Channel Sensory Feedback , 2014, IEEE Transactions on Haptics.

[6]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[7]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[8]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[9]  Erik D. Engeberg,et al.  Anthropomorphic Control of a Dexterous Artificial Hand via Task Dependent Temporally Synchronized Synergies , 2014 .

[10]  Gian Domenico Iannetti,et al.  Whole-Body Mapping of Spatial Acuity for Pain and Touch , 2014, Annals of neurology.

[11]  H. Ehrsson,et al.  Referral of sensation to an advanced humanoid robotic hand prosthesis , 2009, Scandinavian journal of plastic and reconstructive surgery and hand surgery.

[12]  M. L. Nicolelis,et al.  Assimilation of virtual legs and perception of floor texture by complete paraplegic patients receiving artificial tactile feedback , 2016, Scientific Reports.

[13]  A. G. Fel'dman,et al.  Interaction of afferent and efferent signals underlying joint position sense: empirical and theoretical approaches. , 1982, Journal of motor behavior.

[14]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[15]  Erik D. Engeberg,et al.  Direction of Slip Detection for Adaptive Grasp Force Control with a Dexterous Robotic Hand , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[16]  Roberta L. Klatzky,et al.  Measuring just noticeable differences for haptic force feedback: implications for rehabilitation , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[17]  Max Ortiz-Catalan,et al.  An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs , 2014, Science Translational Medicine.

[18]  Peter B. Shull,et al.  Haptic wearables as sensory replacement, sensory augmentation and trainer – a review , 2015, Journal of NeuroEngineering and Rehabilitation.

[19]  Maria Chiara Carrozza,et al.  Towards Humanlike Social Touch for Sociable Robotics and Prosthetics: Comparisons on the Compliance, Conformance and Hysteresis of Synthetic and Human Fingertip Skins , 2009, Int. J. Soc. Robotics.

[20]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[21]  Hannes P. Saal,et al.  Biomimetic approaches to bionic touch through a peripheral nerve interface , 2015, Neuropsychologia.

[22]  Claire Dormann,et al.  Once More With Feeling , 2013, Games Cult..

[23]  Alan M Jette The Promise of Assistive Technology to Enhance Work Participation. , 2017, Physical therapy.

[24]  R. Ackerley,et al.  The role of tactile afference in shaping motor behaviour and implications for prosthetic innovation , 2015, Neuropsychologia.

[25]  Helena Reckitt Once More With Feeling, Nuit Blanche , 2012 .

[26]  Panagiotis K. Artemiadis,et al.  Telemanipulation with the DLR/HIT II robot hand using a dataglove and a low cost force feedback device , 2013, 21st Mediterranean Conference on Control and Automation.

[27]  Nareen Karnati,et al.  Electromyogram synergy control of a dexterous artificial hand to unscrew and screw objects , 2013, Journal of NeuroEngineering and Rehabilitation.