Tactile Perception Based on Injected Vibration in Soft Sensor

Tactile perception using vibration sensation helps robots recognize their environment's physical properties and perform complex tasks. A sliding motion is applied to target objects to generate tactile vibration data. However, situations exist where such a sliding motion is infeasible due to geometrical constraints in the environment or an object's fragility which cannot resist friction forces. This letter explores a novel approach to achieve vibration-based tactile perception without a sliding motion. To this end, our key idea is injecting a mechanical vibration into a soft tactile sensor system and measuring the propagated vibration inside it by a sensor. Soft tactile sensors are deformed by the contact state, and the touched objects’ shape or texture should change the characteristics of the vibration propagation. Therefore, the propagated-vibration data are expected to contain useful information for recognizing touched environments. We developed a prototype system for a proof-of-concept: a mechanical vibration is applied to a biomimetic (soft and vibration-based) tactile sensor from a small, mounted piezoelectric actuator. As a verification experiment, we performed two classification tasks for sandpaper's grit size and a slit's gap widths using our approach and compared their accuracies with that of using sliding motions. Our approach resulted in 70$\mathrm{\%}$ accuracy for the grit size classification and 99$\mathrm{\%}$ accuracy for the gap width classification. These results are comparable to or better than the comparison methods with a sliding motion.

[1]  Kazuhiro Shimonomura,et al.  Tactile Image Sensors Employing Camera: A Review , 2019, Sensors.

[2]  Takamitsu Matsubara,et al.  Kernel dynamic policy programming: Applicable reinforcement learning to robot systems with high dimensional states , 2017, Neural Networks.

[3]  S. Ando,et al.  Ultrasonic six-axis deformation sensing , 2001, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[4]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[5]  Michael C. Yip,et al.  Vibration-Based Multi-Axis Force Sensing: Design, Characterization, and Modeling , 2020, IEEE Robotics and Automation Letters.

[6]  L. M. Ward,et al.  Stochastic resonance and sensory information processing: a tutorial and review of application , 2004, Clinical Neurophysiology.

[7]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[8]  Shih-Fu Ling,et al.  Bioinspired active whisker sensor for robotic vibrissal tactile sensing , 2014 .

[9]  Katsuhiko Nakamura,et al.  Instantaneous evaluation of friction based on ARTC tactile sensor , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Hendrik Kolvenbach,et al.  Towards autonomous inspection of concrete deterioration in sewers with legged robots , 2020, J. Field Robotics.

[11]  Kuniyuki Takahashi,et al.  Deep Visuo-Tactile Learning: Estimation of Tactile Properties from Images , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[12]  Jun Ueda,et al.  Wearable Sensorimotor Enhancer for Fingertip Based on Stochastic Resonance Effect , 2013, IEEE Transactions on Human-Machine Systems.

[13]  Nathan F. Lepora,et al.  Tactile Quality Control With Biomimetic Active Touch , 2016, IEEE Robotics and Automation Letters.

[14]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[15]  Z. Jane Wang,et al.  Novel Tactile Sensor Technology and Smart Tactile Sensing Systems: A Review , 2017, Sensors.

[16]  Hiroyuki Shinoda,et al.  Acoustic resonant tensor cell for tactile sensing , 1997, Proceedings of International Conference on Robotics and Automation.

[17]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[18]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[19]  Masahiro Ohka,et al.  Stochastic resonance aided tactile sensing , 2009, Robotica.

[20]  Takamitsu Matsubara,et al.  Object manifold learning with action features for active tactile object recognition , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Vladimir J. Lumelsky,et al.  Real-time collision avoidance in teleoperated whole-sensitive robot arm manipulators , 1993, IEEE Trans. Syst. Man Cybern..

[22]  Keiji Sasaki,et al.  Development of remote microsurgery robot and new surgical procedure for deep and narrow space , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[23]  Jeremy A. Fishel,et al.  Signal processing and fabrication of a biomimetic tactile sensor array with thermal, force and microvibration modalities , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[24]  J. A. Fishel,et al.  Sensing tactile microvibrations with the BioTac — Comparison with human sensitivity , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[25]  Fulvio Mastrogiovanni,et al.  Active Haptic Perception in Robots: A Review , 2019, Front. Neurorobot..

[26]  Takamitsu Matsubara,et al.  An optimal control approach for exploratory actions in active tactile object recognition , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[27]  G.E. Loeb,et al.  A robust micro-vibration sensor for biomimetic fingertips , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[28]  Benoit P. Delhaye,et al.  Robo-Psychophysics: Extracting Behaviorally Relevant Features from the Output of Sensors on a Prosthetic Finger , 2016, IEEE Transactions on Haptics.