An approach to prediction of spatio-temporal patterns based on binary neural networks and cellular automata

This paper studies application of binary neural networks (BNN) to prediction for spatio-temporal patterns. In the approach, we assume that the objective spatio-temporal patterns can be approximated by a cellular automaton (CA). Teacher signals are extracted from a part of objective pattern and are used for learning of the BNN. The BNN is used to govern dynamics of CA that outputs prediction patterns. Performing basic numerical experiments, we have investigated relation among the number of teacher signals, the number of hidden neurons and prediction performance. The results provide basic information for development of robust prediction method for digital spatio-temporal patterns.

[1]  James A. Reggia,et al.  Automatic discovery of self-replicating structures in cellular automata , 1997, IEEE Trans. Evol. Comput..

[2]  T. Saito,et al.  A GA-Based Learning Algorithm for Binary Neural Networks , 2002 .

[3]  Stephen Wolfram,et al.  Universality and complexity in cellular automata , 1983 .

[4]  Mansur R. Kabuka,et al.  Design of Supervised Classifiers Using Boolean Neural Networks , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Zbigniew Michalewicz,et al.  Time Series Forecasting for Dynamic Environments: The DyFor Genetic Program Model , 2007, IEEE Transactions on Evolutionary Computation.

[6]  Shigetoshi Nara,et al.  Completely reproducible description of digital sound data with cellular automata , 2002 .

[7]  Youshen Xia,et al.  A prediction fusion method for reconstructing spatial temporal dynamics using support vector machines , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[8]  Toshimichi Saito,et al.  Genetic Learning of Digital Three-Layer Perceptrons for Implementation of Binary Cellular Automata. , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Stephen B. Wicker,et al.  Path Output Register Selection Register 4 t Maximum Path Metric Selection , 2004 .

[10]  Larry Bull,et al.  Towards predicting spatial complexity: a learning classifier system approach to the identification of cellular automata , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  Shigetoshi Nara,et al.  Errorless reproduction of given pattern dynamics by means of cellular automata. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Min Han,et al.  Support Vector Echo-State Machine for Chaotic Time-Series Prediction , 2007, IEEE Transactions on Neural Networks.

[13]  Marcin Seredynski,et al.  Block cipher based on reversible cellular automata , 2004, IEEE Congress on Evolutionary Computation.

[14]  Leon O. Chua,et al.  A Nonlinear Dynamics Perspective of Wolfram's New Kind of Science Part I: Threshold of Complexity , 2002, Int. J. Bifurc. Chaos.

[15]  John Hallam,et al.  IEEE International Joint Conference on Neural Networks , 2005 .

[16]  Sung-Kwon Park,et al.  The geometrical learning of binary neural networks , 1995, IEEE Trans. Neural Networks.