Accurate Decoding of Material Textures Using a finger Mounted Accelerometer

Tactile feedback plays a crucial role in our experience and control of physical interaction with objects in our environment. However, the technology for low-cost and efficient tactile feedback remains a big challenge during stroke rehabilitation, and for prosthetic designs. Here we show that a low-cost accelerometer mounted on the finger can provide accurate decoding of many daily life materials during touch. We first designed a customized touch analysis system that allowed us to present different materials for touch by human participants, while controlling for the contact force and touch speed. Then, we collected data from six participants, who touched seven daily life materials-plastic, cork, wool, aluminum, paper, denim, cotton. We use linear sparse logistic regression and show that the materials can be classified from accelerometer recordings with an accuracy of 88℅ across materials and participants within 7 seconds of touch.

[1]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[2]  Benoit P. Delhaye,et al.  Texture-induced vibrations in the forearm during tactile exploration , 2012, Front. Behav. Neurosci..

[3]  André Crosnier,et al.  Haptic Zero-Shot Learning: Recognition of objects never touched before , 2018, Robotics Auton. Syst..

[4]  Yoshihiro Tanaka,et al.  Skin vibration and contact force in active perception for roughness ratings , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[5]  Yasuharu Koike,et al.  Utilizing sensory prediction errors for movement intention decoding: A new methodology , 2018, Science Advances.

[6]  Ruth Dickstein,et al.  EMG activity of finger flexor muscles and grip force following low-dose transcutaneous electrical nerve stimulation in healthy adult subjects , 2015, Somatosensory & motor research.

[7]  G.S. Dhillon,et al.  Direct neural sensory feedback and control of a prosthetic arm , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Alejandro Hernández Arieta,et al.  Slip Speed Feedback for Grip Force Control , 2012, IEEE Transactions on Biomedical Engineering.

[10]  R. Osu,et al.  Feeling the force: Returning haptic signals influence effort inference during motor coordination , 2013, Scientific Reports.

[11]  Allison M. Okamura,et al.  Wearable haptic device for cutaneous force and slip speed display , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Yoshihiro Tanaka,et al.  Wearable skin vibration sensor using a PVDF film , 2015, 2015 IEEE World Haptics Conference (WHC).

[13]  Eric Chatelet,et al.  Tactile perception by friction induced vibrations , 2011 .

[14]  Kaustubh Supekar,et al.  Sparse logistic regression for whole-brain classification of fMRI data , 2010, NeuroImage.

[15]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[16]  Sally Bennett,et al.  Interventions for sensory impairment in the upper limb after stroke. , 2010, The Cochrane database of systematic reviews.

[17]  R. Osu,et al.  A pilot study of sensory feedback by transcutaneous electrical nerve stimulation to improve manipulation deficit caused by severe sensory loss after stroke , 2013, Journal of NeuroEngineering and Rehabilitation.

[18]  Fumihiro Kato,et al.  Classification method of tactile feeling using stacked autoencoder based on haptic primary colors , 2017, 2017 IEEE Virtual Reality (VR).

[19]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[20]  Jan Andrysek,et al.  Toward an artificial sensory feedback system for prosthetic mobility rehabilitation: examination of sensorimotor responses. , 2014, Journal of rehabilitation research and development.