Utilizing Time : Asynchronous Binding

Historically, connectionist systems have not excelled at representing and manipulating complex structures. How can a system composed of simple neuron-like computing elements encode complex relations? Recently, researchers have begun to appreciate that representations can extend in both time and space. Many researchers have proposed that the synchronous firing of units can encode complex representations. I identify the limitations of this approach and present an asynchronous model of binding that effectively represents complex structures. The asynchronous model extends the synchronous approach. I argue that our cognitive architecture utilizes a similar mechanism.

[1]  W Rall,et al.  Dendritic location of synapses and possible mechanisms for the monosynaptic EPSP in motoneurons. , 1967, Journal of neurophysiology.

[2]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[3]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[4]  R. Ratcliff,et al.  Speed and Accuracy in the Processing of False Statements About Semantic Information , 1982 .

[5]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[6]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Jordan B. Pollack,et al.  Recursive Distributed Representations , 1990, Artif. Intell..

[8]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[9]  Arthur B. Markman,et al.  Analogy-- Watershed or Waterloo? Structural alignment and the development of connectionist models of analogy , 1992, NIPS 1992.

[10]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[11]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[12]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[13]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[14]  Braitenberg,et al.  Brain theory : biological basis and computational principles , 1996 .

[15]  William R. Softky Fine analog coding minimizes information transmission , 1996, Neural Networks.