Contact Feature Recognition Based on MFCC of Force Signals

Contact-based tasks such as assembly and grinding often require the information on contact states. This letter therefore proposes a recognition method based on the Mel Frequency Cepstrum Coefficient (MFCC) of force signals. It demonstrates that the combination of MFCCs and time delayed neural networks is effective for learning features of contact events. This method is able to recognize instantaneous responses that do not generate repetitive waveforms. As a result, the recognition rate of the click response during a pen cap closing task increased from 75% to 96% following the proposed method. It is confirmed that this method is applicable not only to the data obtained by the robot's highly reproducible motions but also to the data whose parameters are scattered due to human interference.

[1]  Weihao Yuan,et al.  Towards Learning to Detect and Predict Contact Events on Vision-based Tactile Sensors , 2019, CoRL.

[2]  Mirko Wächter,et al.  Hierarchical segmentation of manipulation actions based on object relations and motion characteristics , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[3]  Oliver Chiu-sing Choy,et al.  An efficient MFCC extraction method in speech recognition , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[4]  Masahide Kaneko,et al.  Segmenting Continuous Motions with Hidden Semi-markov Models and Gaussian Processes , 2017, Front. Neurorobot..

[5]  V. Tiwari.  MFCC and its applications in speaker recognition , 2010 .

[6]  Toshiaki Tsuji,et al.  Success/Failure Identification of Skill Movement by Neural Network Using Force Information , 2019, IECON 2019 - 45th Annual Conference of the IEEE Industrial Electronics Society.

[7]  Toshiaki Tsuji,et al.  Motion Planning With Success Judgement Model Based on Learning From Demonstration , 2020, IEEE Access.

[8]  Bohan Wu,et al.  MAT: Multi-Fingered Adaptive Tactile Grasping via Deep Reinforcement Learning , 2019, CoRL.

[9]  Rüdiger Dillmann,et al.  Contact Skill Imitation Learning for Robot-Independent Assembly Programming , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  I. Elamvazuthi,et al.  Voice Recognition Algorithms using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques , 2010, ArXiv.

[11]  Jianhua Li,et al.  Slip Detection with Combined Tactile and Visual Information , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Toshiaki Tsuji,et al.  Reinforcement Learning for Robotic Assembly Using Non-Diagonal Stiffness Matrix , 2021, IEEE Robotics and Automation Letters.

[13]  Lu Fang,et al.  Deep Learning for Surface Material Classification Using Haptic and Visual Information , 2015, IEEE Transactions on Multimedia.

[14]  Toshiaki Tsuji,et al.  Recognition of Contact Event Based on MFCC of Force Signals , 2021 .

[15]  Jitendra Malik,et al.  More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch , 2018, IEEE Robotics and Automation Letters.

[16]  Kouhei Ohnishi,et al.  Motion control for advanced mechatronics , 1996 .

[17]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[18]  Tetsuya Ogata,et al.  Learning Multiple Sensorimotor Units to Complete Compound Tasks using an RNN with Multiple Attractors , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Richard A. Volz,et al.  Acquiring robust, force-based assembly skills from human demonstration , 2000, IEEE Trans. Robotics Autom..

[20]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[21]  Seiichiro Katsura,et al.  Analysis and Modeling Based on Cepstrum for Haptic Presentation Considering Frequency Features of Vibration in Rubbing Motion , 2015 .

[22]  Hyung-Kew Lee,et al.  A Flexible Polymer Tactile Sensor: Fabrication and Modular Expandability for Large Area Deployment , 2006, Journal of Microelectromechanical Systems.

[23]  J. C. Kappatou,et al.  A Novel Approach for Broken Bar Fault Diagnosis in Induction Motors Through Torque Monitoring , 2013, IEEE Transactions on Energy Conversion.