Recurrent Neural Networks for fast and robust vibration-based ground classification on mobile robots

This paper investigates Recurrent Neural Networks (RNNs), particularly Dynamic Cortex Memories (DCMs), an extension of Long Short Term Memories (LSTMs) for classification of 14 different ground types based on vibration data. Also a simple regularization technique called Sequence Boundary Dropout (SBD) is introduced, which effectively enlarges the training set and improves generalization. The neural networks perform in the time domain without any explicit feature computation, while previous state-of-the-art methods extract features mainly in the frequency domain. The presented approach does not require a time window, is causal, and works just-in-time, such that a classification can be done online at each new time step. Furthermore, we show that the neural networks outperform previous methods significantly in terms of classification accuracy. Finally, we demonstrate that the networks retrained with Random Activation Preservation (RAP) can classify very early - within a fraction of a second - but robustly at the same time in a continuous recognition scenario with varying classes.

[1]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[2]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[3]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[4]  Karl Iagnemma,et al.  Vibration-based terrain classification for planetary exploration rovers , 2005, IEEE Transactions on Robotics.

[5]  Andreas Zell,et al.  Vibration-based Terrain Classification Using Support Vector Machines , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  K. Iagnemma,et al.  Self-Supervised Terrain Classification for Planetary Rovers , 2022 .

[7]  C.A. Brooks,et al.  Self-Supervised Classification for Planetary Rover Terrain Sensing , 2007, 2007 IEEE Aerospace Conference.

[8]  Sebastian Otte,et al.  JANNLab Neural Network Framework for Java , 2013, MLDM Posters.

[9]  Andreas Zell,et al.  Comparison of Different Approaches to Vibration-based Terrain Classification , 2007, EMCR.

[10]  Andreas Zell,et al.  An analysis of Dynamic Cortex Memory networks , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[11]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[12]  Andreas Zell,et al.  Dynamic Cortex Memory: Enhancing Recurrent Neural Networks for Gradient-Based Sequence Learning , 2014, ICANN.

[13]  Andreas Zell,et al.  A combination of vision- and vibration-based terrain classification , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Steven Dubowsky,et al.  Terrain estimation for high-speed rough-terrain autonomous vehicle navigation , 2002, SPIE Defense + Commercial Sensing.