Discrimination of Dual-Arm Motions Using a Joint Posterior Probability Neural Network for Human-Robot Interfaces

This chapter describes a novel dual-arm motion discrimination method that combines posterior probabilities estimated independently for left and right arm movements, and its application to control a robotic manipulator. The proposed method estimates the posterior probability of each single-arm motion through learning using recurrent probabilistic neural networks. The posterior probabilities output from the networks are then combined based on motion dependency between arms, making it possible to calculate a joint posterior probability of dual-arm motions. With this method, all the dual-arm motions consisting of each single-arm motion can be discriminated through leaning of single-arm motions only. In the experiments performed, the proposed method was applied to the discrimination of up to 50 dualarm motions. The results showed that the method enables relatively high discrimination performance. In addition, the possibility of applying the proposed method for a human-robot interface was confirmed through operation experiments for the robotic manipulator using dual-arm motions.

[1]  Maki K. Habib Biomimetics: innovations and robotics , 2011 .

[2]  Toshio Tsuji,et al.  同時事後確率推定ニューラルネットを用いた双腕動作識別法;同時事後確率推定ニューラルネットを用いた双腕動作識別法;Discrimination of Dual-arm Motions Using a Joint Posterior Probability Neural Network , 2013 .

[3]  Toshio Tsuji,et al.  A novel dual-arm motion discrimination method using recurrent probability neural networks for automatic gesture recognition , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[4]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[5]  Gerhard Tröster,et al.  Real time gesture recognition using continuous time recurrent neural networks , 2007, BODYNETS.

[6]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[7]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[8]  Toshio Tsuji,et al.  EMG-Based Motion Discrimination Using a Novel Recurrent Neural Network , 2003, Journal of Intelligent Information Systems.

[9]  Shankar M. Krishnan,et al.  Neural Networks in Healthcare: Potential and Challenges , 2006 .

[10]  Toshio Tsuji,et al.  Pattern discrimination method with a boosting approach using hierarchical neural trees , 2008 .

[11]  Mansoor Sarhadi,et al.  A non-linear model of shape and motion for tracking finger spelt American sign language , 2002, Image Vis. Comput..

[12]  Scott Devine,et al.  Real time robotic arm control using hand gestures with multiple end effectors , 2016, 2016 UKACC 11th International Conference on Control (CONTROL).

[13]  Toshio Tsuji,et al.  EMG-based control of a multi-joint robot for operating a glovebox , 2014 .

[14]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[16]  Toshio Tsuji,et al.  A recurrent log-linearized Gaussian mixture network , 2003, IEEE Trans. Neural Networks.

[17]  Clément Gosselin,et al.  Wireless sEMG-Based Body–Machine Interface for Assistive Technology Devices , 2017, IEEE Journal of Biomedical and Health Informatics.

[18]  Xilin Chen,et al.  Isolated Sign Language Recognition with Grassmann Covariance Matrices , 2016, TACC.

[19]  Francisco J. Solis,et al.  Automatic Mexican Sign Language Recognition Using Normalized Moments and Artificial Neural Networks , 2016 .

[20]  Paulo Menezes,et al.  Face tracking and hand gesture recognition for human-robot interaction , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[21]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[22]  Jagdish Lal Raheja,et al.  Real-Time Robotic Hand Control Using Hand Gestures , 2010, 2010 Second International Conference on Machine Learning and Computing.

[23]  Houqiang Li,et al.  Sign Language Recognition using 3D convolutional neural networks , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[24]  Terry Caelli,et al.  Model-based neural networks , 1993, Neural Networks.