A comparative evaluation of time-delay, deep learning and echo state neural networks when used as simulated transhumeral prosthesis controllers

Transhumeral amputation has a considerable detrimental effect on the amputee’s quality of life and independence. Previous work has already established the potential for exploiting proximal humerus myoelectric and kinematic signals for the effective control of a myoelectric prosthesis. That previous work used a Time-Delay Neural Network (TDNN) to perform the mapping of six electromyographic (EMG) and six kinematic proximal humerus signals to predict elbow flexion/extension. Since that earlier work alternative deep learning and recurrent neural network architectures, well-suited to the processing of high-dimensional time-series data, have come to the fore. The work reported here is a comparative evaluation using the metric of RMS error for the predicted elbow flexion/extension angles output by TDNN, Long Short Term Memory (LSTM) and Echo State Network (ESN) architectures. For the most effective comparison we successfully reproduced TDNN results that were comparable to previous work (with average RMSE of 11.8 degrees on unseen test data). Then using the same training and testing datasets, and networks of broadly similar complexity, we evaluated the effectiveness of the LSTM and ESN approaches. The LSTMs trained here delivered an average RMSE of 10.4 degrees on unseen test data. The ESNs delivered an average RMSE of 16.3 degrees on unseen test data. The current work was not intended to find the best possible LSTM or ESN solution for this problem. Instead the intention was to see if any particular aspects of the network architectures worked better with the particular challenges of transhumeral biomedical engineering data of this sort.

[1]  Benjamin Schrauwen,et al.  Extending reservoir computing with random static projections: a hybrid between extreme learning and RC , 2010, ESANN.

[2]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[3]  H. Jin Kim,et al.  Online Learning Control of Hydraulic Excavators Based on Echo-State Networks , 2017, IEEE Transactions on Automation Science and Engineering.

[4]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[5]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[6]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[7]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[8]  Joris M. Lambrecht,et al.  Electromyogram-based neural network control of transhumeral prostheses. , 2011, Journal of rehabilitation research and development.

[9]  Theocharis Kyriacou,et al.  Feasibility of using combined EMG and kinematic signals for prosthesis control: A simulation study using a virtual reality environment , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  M. Tiwana,et al.  Classification of EEG signals for wrist and grip movements using echo state network , 2017 .

[12]  Bjarne Foss,et al.  Echo State Networks for data-driven downhole pressure estimation in gas-lift oil wells , 2017, Neural Networks.

[13]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[14]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[15]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[16]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Hendrik Van Brussel,et al.  Pruning and regularization in reservoir computing , 2009, Neurocomputing.

[18]  Herbert F. Voigt,et al.  IEEE Engineering in Medicine and Biology Society , 2019, IEEE Transactions on Biomedical Engineering.

[19]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[20]  B. Schrauwen,et al.  Reservoir computing and extreme learning machines for non-linear time-series data analysis , 2013, Neural Networks.