A Hierarchical Brain Inspired Computing System

In this paper we describe an abstract hierarchical model of the neocortex and its implementation in a connectionist network. This network has convergent feed-forward projections going from lower to higher levels in the processing hierarchy implementing competitive learning. There are also associative divergent backward projections going from higher to lower levels and associative recurrent projections at each level. Here we show that this type of multi-level attractor network extends the capabilities of a single layer network by enabling autoassociative storage of patterns not possible to store in the latter.

[1]  A. Thomson,et al.  Interlaminar connections in the neocortex. , 2003, Cerebral cortex.

[2]  Yali Amit,et al.  Attractor Networks for Shape Recognition , 2001, Neural Computation.

[3]  A. Lansner,et al.  A Bayesian attractor network with incremental learning. , 2002, Network.

[4]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[5]  Örjan Ekeberg,et al.  A One-Layer Feedback Artificial Neural Network with a Bayesian Learning Rule , 1989, Int. J. Neural Syst..

[6]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[7]  Anders Lansner,et al.  A Higher order Bayesian Neural Network with Spiking Units , 1996, Int. J. Neural Syst..

[8]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[9]  Naonori Ueda,et al.  A new competitive learning approach based on an equidistortion principle for designing optimal vector quantizers , 1994, Neural Networks.

[10]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Anders Lansner,et al.  Attractor Memory with Self-organizing Input , 2006, BioADIT.

[12]  Ronald Michaels,et al.  Associative Memory with Uncorrelated Inputs , 1996, Neural Computation.

[13]  T J Sejnowski,et al.  Learning viewpoint-invariant face representations from visual experience in an attractor network. , 1998, Network.

[14]  Dan W. Hammerstrom,et al.  Computational neurobiology meets semiconductor engineering , 2000, Proceedings 30th IEEE International Symposium on Multiple-Valued Logic (ISMVL 2000).

[15]  Ferdinand Peper,et al.  A categorizing associative memory using an adaptive classifier and sparse coding , 1996, IEEE Trans. Neural Networks.

[16]  Anders Lansner,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[17]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[18]  D. Buxhoeveden,et al.  The minicolumn hypothesis in neuroscience. , 2002, Brain : a journal of neurology.