Recurrent Clifford Support Machines

This paper introduces the recurrent Clifford support vector machines (RCSVM). First we explain the generalization of the real- and complex-valued support vector machines using the Clifford geometric algebra. In this framework we handle the design of kernels involving the Clifford or geometric product and one redefines the optimization variables as multivectors. This allows us to have a multivector as output therefore we can represent multiple classes according to the dimension of the geometric algebra in which we work. We show that one can apply CSVM to build a recurrent CSVM.We study the performance of the recurrent CSVM with experiments using time series and tasks of visually guided robotics.

[1]  Alan F. Murray,et al.  International Joint Conference on Neural Networks , 1993 .

[2]  Risto Miikkulainen,et al.  Active Guidance for a Finless Rocket Using Neuroevolution , 2003, GECCO.

[3]  Faustino J. Gomez,et al.  Recurrent Support Vector Machines , 2005 .

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[6]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[7]  Jürgen Schmidhuber,et al.  Evolino: Hybrid Neuroevolution / Optimal Linear Search for Sequence Prediction , 2005, IJCAI 2005.

[8]  Michael C. Mozer,et al.  A Discrete Probabilistic Memory Model for Discovering Dependencies in Time , 2001, ICANN.

[9]  Jürgen Schmidhuber,et al.  Applying LSTM to Time Series Predictable through Time-Window Approaches , 2000, ICANN.

[10]  Eduardo Bayro-Corrochano,et al.  Geometric neural computing , 2001, IEEE Trans. Neural Networks.

[11]  J. Suykens,et al.  Recurrent least squares support vector machines , 2000 .

[12]  E. Bayro-Corrochano,et al.  Design of kernels for support multivector machines involving the Clifford geometric product and the conformal geometric neuron , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[13]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.