Cortical columns: Building blocks for intelligent systems

The neocortex appears to be a very efficient, uniformly structured, and hierarchical computational system [25], [23], [24]. Researchers have made significant efforts to model intelligent systems that mimic these neocortical properties to perform a broad variety of pattern recognition and learning tasks. Unfortunately, many of these systems have drifted away from their cortical origins and incorporate or rely on attributes and algorithms that are not biologically plausible. In contrast, this paper describes a model for an intelligent system that is motivated by the properties of cortical columns, which can be viewed as the basic functional unit of the neocortex [35], [16]. Our model extends predictability minimization [30] to mimic the behavior of cortical columns and incorporates neocortical properties such as hierarchy, structural uniformity, and plasticity, and enables adaptive, hierarchical independent feature detection. Initial results for an unsupervised learning task-identifying independent features in image data-are quite promising, both in a single-level and a hierarchical organization modeled after the visual cortex. The model is also able to forget learned patterns that no longer appear in the dataset, demonstrating its adaptivity, resilience, and stability under changing input conditions.

[1]  J. Hawkins,et al.  On Intelligence , 2004 .

[2]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[3]  Thomas Dean,et al.  A Computational Model of the Cerebral Cortex , 2005, AAAI.

[4]  Judith A Hirsch,et al.  Laminar processing in the visual cortical column , 2006, Current Opinion in Neurobiology.

[5]  S. Grossberg.  Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. , 2007, Progress in brain research.

[6]  J. Nicholls.  From neuron to brain , 1976 .

[7]  Edmund T. Rolls,et al.  Invariant Object Recognition in the Visual System with Novel Views of 3D Objects , 2002, Neural Computation.

[8]  J. Ruiz-del-Solar,et al.  Biologically based face recognition using Gabor filters and log-polar images , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[9]  William H. Calvin.  Cortical columns, modules, and Hebbian cell assemblies , 1998 .

[10]  Jürgen Schmidhuber.  Neural Predictors for Detecting and Removing Redundant Information , 2000 .

[11]  H. Frahm,et al.  New and revised data on volumes of brain structures in insectivores and primates. , 1981, Folia primatologica; international journal of primatology.

[12]  Shekhar Y. Borkar,et al.  Designing reliable systems from unreliable components: the challenges of transistor variability and degradation , 2005, IEEE Micro.

[13]  Heiko Wersing,et al.  Learning Optimized Features for Hierarchical Models of Invariant Object Recognition , 2003, Neural Computation.

[14]  G. Roth,et al.  Evolution of the brain and intelligence , 2005, Trends in Cognitive Sciences.

[15]  Wulfram Gerstner,et al.  An online Hebbian learning rule that performs independent component analysis , 2008, BMC Neuroscience.

[16]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[17]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[18]  C. Koch,et al.  Category-specific visual responses of single neurons in the human medial temporal lobe , 2000, Nature Neuroscience.

[19]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[20]  M. A. Carreira-Perpiñán,et al.  Cortical Columns , 2002 .

[21]  P. Lennie.  Receptive fields , 2003, Current Biology.

[22]  T. Tsumoto,et al.  Acetylcholine suppresses the spread of excitation in the visual cortex revealed by optical recording: possible differential effect depending on the source of input , 1999, The European journal of neuroscience.

[23]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[24]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[25]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[26]  Jürgen Schmidhuber,et al.  Learning Factorial Codes by Predictability Minimization , 1992, Neural Computation.

[27]  Masao Ito,et al.  Purkinje cell functions in the in vitro cerebellum isolated from neonatal rats in a block with the pons and medulla , 2004, Neuroscience Research.

[28]  Julian Eggert,et al.  A Cortex-Inspired Neural-Symbolic Network for Knowledge Representation , 2007, NeSy.

[29]  D. George,et al.  A hierarchical Bayesian model of invariant pattern recognition in the visual cortex , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[30]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Shimon Ullman,et al.  Computation of pattern invariance in brain-like structures , 1999, Neural Networks.

[32]  S. Grillner.  Bridging the gap — from ion channels to networks and behaviour , 1999, Current Opinion in Neurobiology.

[33]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[34]  M. Carandini.  Amplification of Trial-to-Trial Response Variability by Neurons in Visual Cortex , 2004, PLoS biology.

[35]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[36]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[37]  S. Grossberg.  How does the cerebral cortex work? Learning, attention, and grouping by the laminar circuits of visual cortex. , 1999, Spatial vision.

[38]  Y. Yamane,et al.  Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns , 2001, Nature Neuroscience.

[39]  Gavriil Tsechpenakis,et al.  Analysis of nerve activity and optical signals from mouse brain stem to identify cells generating respiratory rhythms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[40]  Laurenz Wiskott,et al.  Is slowness a learning principle of the visual cortex? , 2003, Zoology.