Revisiting Echo State Networks for Continuous Gesture Recognition

Smartphones are equipped with Inertial Measurement Units (IMUs) that can capture user gesture data. Continuous gesture recognition is essential as it can be utilized and enhance human-computer interaction. Echo State Networks (ESNs) and Long Short-Term Memory (LSTM) models are well suited to performing this task. They have been successfully applied to the task in previous research, with LSTMs outperforming ESNs while having a considerably longer training time. However, the application of ESNs to continuous gesture recognition has not been fully explored as only the leaky integrator ESN has been used without hyperparameter optimization. In this study, we attempt to improve the ESN performance on the continuous gesture recognition task by experimenting with different model architectures and hyperparameter tuning. The performance of ESN models is significantly enhanced in terms of $F_{1}$ -score to 0.88, which is higher than the previously best performance of 0.87 using an LSTM model on continuous gesture recognition. The significant improvement is in training time, which is approximately 13 seconds for the ESN model compared to 89 seconds for the LSTM model in past research.

[1]  Hassan Ali,et al.  Echo State Networks and Long Short-Term Memory for Continuous Gesture Recognition: a Comparative Study , 2020 .

[2]  Thanh Trung Dinh,et al.  ReservoirPy: An Efficient and User-Friendly Library to Design Echo State Networks , 2020, ICANN.

[3]  Stefan Wermter,et al.  A Reservoir Computing Framework for Continuous Gesture Recognition , 2019, ICANN.

[4]  Ulrich Parlitz,et al.  Gradient based hyperparameter optimization in Echo State Networks , 2019, Neural Networks.

[5]  Hsi-Pin Ma,et al.  Real-Time Continuous Gesture Recognition with Wireless Wearable IMU Sensors , 2018, 2018 IEEE 20th International Conference on e-Health Networking, Applications and Services (Healthcom).

[6]  Junfei Qiao,et al.  Growing Echo-State Network With Multiple Subreservoirs , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[7]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[8]  Jochen J. Steil,et al.  Improving reservoirs using intrinsic plasticity , 2008, Neurocomputing.

[9]  Garrison W. Cottrell,et al.  2007 Special Issue: Learning grammatical structure with Echo State Networks , 2007 .

[10]  D. Popovici,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[11]  Jochen Triesch,et al.  A Gradient Rule for the Plasticity of a Neuron's Intrinsic Excitability , 2005, ICANN.

[12]  Amir F. Atiya,et al.  New results on recurrent network training: unifying the algorithms and accelerating convergence , 2000, IEEE Trans. Neural Networks Learn. Syst..