Temporal semantics: An Adaptive Resonance Theory approach

Encoding sensor observations across time is a critical component in the ability to model cognitive processes. All biological cognitive systems receive sensory stimuli as continuous streams of observed data over time. Therefore, the perceptual grounding of all biological cognitive processing is in temporal semantic encodings, where the particular grounding semantics are sensor modalities. We introduce a technique that encodes temporal semantic data as temporally integrated patterns stored in Adaptive Resonance Theory (ART) modules.

[1]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[2]  Sandiway Fong,et al.  Can recurrent neural networks learn natural language grammars? , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[3]  Lokendra Shastri,et al.  Recognizing Handwritten Digit Strings Using Modular Spatio-temporal Connectionist Networks , 1995, Connect. Sci..

[4]  Ah Chung Tsoi,et al.  Discrete time recurrent neural network architectures: A unifying review , 1997, Neurocomputing.

[5]  D. Melcher.  Predictive remapping of visual features precedes saccadic eye movements , 2007, Nature Neuroscience.

[6]  Lokendra Shastri,et al.  Character Recognition Digit Recognition Pattern Recognition Spatiotemporal Neural Networks Modular Networks Segmentation Problem , 1995 .

[7]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[8]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[9]  Stephen Grossberg,et al.  STORE working memory networks for storage and recall of arbitrary temporal sequences , 1994, Biological Cybernetics.

[10]  Eric A. Wan,et al.  Time series prediction by using a connectionist network with internal delay lines , 1993 .

[11]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[12]  Stephen Grossberg,et al.  Working Memory Networks for Learning Temporal Order with Application to Three-Dimensional Visual Object Recognition , 1992, Neural Computation.

[13]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[14]  Lluís Vila,et al.  A Survey on Temporal Reasoning in Artificial Intelligence , 1994, AI Communications.

[15]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[16]  Raymond L. Watrous,et al.  Connected recognition with a recurrent network , 1990, Speech Commun..

[17]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[18]  S. Walczak,et al.  Artificial neural network medical decision support tool: predicting transfusion requirements of ER patients , 2005, IEEE Transactions on Information Technology in Biomedicine.

[19]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[20]  C. Lee Giles,et al.  Sequence learning: from recognition and prediction to sequential decision making , 2001, IEEE Intelligent Systems.

[21]  Irwin W. Sandberg,et al.  Uniform approximation of multidimensional myopic maps , 1997 .

[22]  R. Henson.  Coding position in short-term memory , 1999 .

[23]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[24]  Daniel Bullock,et al.  Adaptive neural models of queuing and timing in fluent action , 2004, Trends in Cognitive Sciences.

[25]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[26]  Barak A. Pearlmutter.  Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[27]  Lars Kai Hansen,et al.  On design and evaluation of tapped-delay neural network architectures , 1993, IEEE International Conference on Neural Networks.

[28]  Thomas P. Caudell,et al.  Ontologies and Worlds in Category Theory: Implications for Neural Systems , 2006 .

[29]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[30]  VilaLluís,et al.  A survey on temporal reasoning in artificial intelligence , 1994 .

[31]  Shawn E. Taylor,et al.  Categorical Mapping from Ontology to Neural Network: Initial Studies of Simple Neural Networks' Concept Capacity , 2007, 2007 International Joint Conference on Neural Networks.

[32]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..