An Artificial Neural Network for Spatio-Temporal Bipolar Patterns: Application to Phoneme Classification

An artificial neural network is developed to recognize spatio-temporal bipolar patterns associatively. The function of a formal neuron is generalized by replacing multiplication with convolution, weights with transfer functions, and thresholding with nonlinear transform following adaptation. The Hebbian learn­ ing rule and the delta learning rule are generalized accordingly, resulting in the learning of weights and delays. The neural network which was first developed for spatial patterns was thus generalized for spatio-temporal patterns. It was tested using a set of bipolar input patterns derived from speech signals, showing robust classification of 30 model phonemes.

[1]  THE INSTITUTE OF RADIO ENGINEERS , 1943, Science.

[2]  C Koch,et al.  Analog "neuronal" networks in early vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[3]  G. O. Stone,et al.  An analysis of the delta rule and the learning of statistical associations , 1986 .

[4]  A. Holden.  Competition and cooperation in neural nets , 1983 .

[5]  Dan E. Dudgeon,et al.  Multidimensional Digital Signal Processing , 1983 .

[6]  Oster,et al.  Competition and Cooperation in Neural Nets , 2022 .

[7]  C. Johnson,et al.  Theory and design of adaptive filters , 1987 .

[8]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[9]  S. Grossberg.  Associative and Competitive Principles of Learning and Development: The Temporal Unfolding and Stability of Stm and Ltm Patterns , 1987 .

[10]  Dennis H. Klatt,et al.  Software for a cascade/parallel formant synthesizer , 1980 .

[11]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[12]  J. Varah.  A Practical Examination of Some Numerical Methods for Linear Discrete Ill-Posed Problems , 1979 .

[13]  R. de Figueiredo.  The Volterra and Wiener theories of nonlinear systems , 1982, Proceedings of the IEEE.

[14]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  R J Marks Ii,et al.  Performance analysis of associative memories with nonlinearities in the correlation domain. , 1988, Applied optics.

[17]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[18]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[19]  John J. Hopfield,et al.  CONCENTRATION INFORMATION IN TIME: ANALOG NEURAL NETWORKS WITH APPLICATIONS TO SPEECH RECOGNITION PROBLEMS. , 1987 .

[20]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.