A Novel Tactile Feedback System with On-Line Texture Decoding and Direct-Texture-Feedback

Tactile perception on our fingers is a key sensory feedback that enables us to perceive and explore our world using our hands as probes, and is essential for efficient gripping and manipulation of objects. A tactile feedback system can therefore greatly improve the quality of life of individuals with partial or complete sensory loss like during stroke, or with artificial limbs after an amputation. However, most existing tactile texture feedback technologies suffer from two constraints. First, texture decoding and texture feedback have been traditionally examined separately and not as parts of the same problem, and second, texture information has been popularly fed back using sensory modality other than tactile itself. In this study, we propose a prototype on-line direct-texture decoding and feedback system in which the texture touched by a user is decoded using an accelerometer attached to the finger. The feedback is realized by rubbing the user’s skin with the actual material and the speed of the user swipes. The efficacy of the proposed system was tested in two user experiments with five test materials. The results and the corresponding hints for future improvements are discussed.

[1]  Mark R. Cutkosky,et al.  Using Haptic Feedback to Improve Grasp Force Control in Multiple Sclerosis Patients , 2009, IEEE Transactions on Robotics.

[2]  Gregory J. Gerling,et al.  An engineered tactile afferent modulation platform to elicit compound sensory nerve action potentials in response to force magnitude , 2013, 2013 World Haptics Conference (WHC).

[3]  L. Carey,et al.  Sensory loss in stroke patients: effective training of tactile and proprioceptive discrimination. , 1993, Archives of physical medicine and rehabilitation.

[4]  S. Lederman,et al.  Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. , 1981, Journal of experimental psychology. Human perception and performance.

[5]  Wenwei Yu,et al.  Accurate Decoding of Material Textures Using a finger Mounted Accelerometer , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[6]  R. Osu,et al.  A pilot study of sensory feedback by transcutaneous electrical nerve stimulation to improve manipulation deficit caused by severe sensory loss after stroke , 2013, Journal of NeuroEngineering and Rehabilitation.

[7]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[8]  Jeremy A. Fishel,et al.  Evaluation of force, vibration and thermal tactile feedback in prosthetic limbs , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[9]  Peter Galambos,et al.  Vibrotactile force feedback for telemanipulation: Concept and applications , 2011, 2011 2nd International Conference on Cognitive Infocommunications (CogInfoCom).

[10]  S. Kitazawa,et al.  Referral of tactile sensation to the tips of L-shaped sticks. , 2005, Journal of neurophysiology.

[11]  Michio Tanaka,et al.  Postcentral neurons in hand region of area 2: their possible role in the form discrimination of tactile objects , 1978, Brain Research.

[12]  Vincent Duchaine,et al.  The Use of Vibrotactile Feedback to Restore Texture Recognition Capabilities, and the Effect of Subject Training , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  A. Sano,et al.  Skin-propagated vibration for roughness and textures , 2016, 2016 World Automation Congress (WAC).

[14]  J. Wessberg,et al.  Coding of pleasant touch by unmyelinated afferents in humans , 2009, Nature Neuroscience.

[15]  Shana Smith,et al.  A Natural User Interface for Realistic Tactile Perception of Object Surface Texture , 2017, 2017 9th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[16]  Mitsuo Kawato,et al.  Physically interacting individuals estimate the partner’s goal to enhance their movements , 2017, Nature Human Behaviour.

[17]  Rahman Davoodi,et al.  Development of a Physics-Based Target Shooting Game to Train Amputee Users of Multijoint Upper Limb Prostheses , 2012, PRESENCE: Teleoperators and Virtual Environments.

[18]  M. Kawato,et al.  Two is better than one: Physical interactions improve motor performance in humans , 2014, Scientific Reports.

[19]  Keehoon Kim,et al.  Haptic Feedback Enhances Grip Force Control of sEMG-Controlled Prosthetic Hands in Targeted Reinnervation Amputees , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Axay K. Rana,et al.  An Improved Soft Dielectric for a Highly Sensitive Capacitive Tactile Sensor , 2016, IEEE Sensors Journal.

[21]  M. Hollins,et al.  The vibrations of texture , 2003, Somatosensory & motor research.

[22]  J. Lexell,et al.  Test-retest reliability of the Shape/Texture Identification testTM in people with chronic stroke , 2016, Clinical rehabilitation.

[23]  Yuichi Ohta,et al.  Sensory Properties in Fusion of Visual/Haptic Stimuli Using Mixed Reality , 2010 .

[24]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[25]  Eric Chatelet,et al.  Tactile perception by friction induced vibrations , 2011 .

[26]  Xuezeng Zhao,et al.  Tactile Perception of Roughness and Hardness to Discriminate Materials by Friction-Induced Vibration , 2017, Sensors.