Towards Hardware Realizations of Intelligent Systems: A Cortical Column Approach

Many researchers seek for alternatives to traditional computing architectures, often placing emphasis on modeling biological systems that possess intelligence and learning capabilities. Cortical columns have emerged as a high-level unsupervised learning model for extracting independent data features in a hierarchical manner. Previous cortical models simply rely on software based techniques and neglect the actual purpose of investigating these architectures: to diverge from the conventional Von Neumann approach to an actual hardware realization of an intelligent system. This work presents the hardware realization of a cortical column system, taking several factors into consideration which were previously disregarded by software models. We introduce a Neural Spike Dual-Rail communication scheme, and a temporal pooling unit capable of detecting data distortions during training and testing. This work concludes with a study on cortical columns and their hierarchical impact on hardware resources.

[1]  Jacques-Olivier Klein,et al.  Nanodevice-based novel computing paradigms and the neuromorphic approach , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[2]  Mikko H. Lipasti,et al.  Cortical columns: Building blocks for intelligent systems , 2009, 2009 IEEE Symposium on Computational Intelligence for Multimedia Signal and Vision Processing.

[3]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[4]  Stefan Wermter,et al.  Towards Novel Neuroscience-Inspired Computing , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[5]  Changjian Gao,et al.  CMOS / CMOL architectures for spiking cortical column , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[6]  Ruedi Stoop,et al.  Cortical columns for quick brains , 2012, 1204.4558.

[7]  M. Tarr,et al.  Visual object recognition: do we know more now than we did 20 years ago? , 2007, Annual review of psychology.

[8]  M. Breakspear,et al.  Complex mental activity and the aging brain: Molecular, cellular and cortical network mechanisms , 2007, Brain Research Reviews.

[9]  Judith A Hirsch,et al.  Laminar processing in the visual cortical column , 2006, Current Opinion in Neurobiology.

[10]  Taras Iakymchuk,et al.  Fast spiking neural network architecture for low-cost FPGA devices , 2012, 7th International Workshop on Reconfigurable and Communication-Centric Systems-on-Chip (ReCoSoC).

[11]  R. Kurzweil.  How to Create a Mind: The Secret of Human Thought Revealed , 2012 .

[12]  Mikko H. Lipasti,et al.  A case for neuromorphic ISAs , 2011, ASPLOS XVI.

[13]  Timo Hämäläinen,et al.  Comparison of GALS and Synchronous Architectures with MPEG-4 Video Encoder on Multiprocessor System-on-Chip FPGA , 2006, 9th EUROMICRO Conference on Digital System Design (DSD'06).

[14]  V. Mountcastle,et al.  An organizing principle for cerebral function : the unit module and the distributed system , 1978 .

[15]  A. Sillito,et al.  Always returning: feedback and sensory processing in visual cortex and thalamus , 2006, Trends in Neurosciences.

[16]  Michel Laurence.  Introduction to Octasic Asynchronous Processor Technology , 2012, 2012 IEEE 18th International Symposium on Asynchronous Circuits and Systems.

[17]  Mikko H. Lipasti,et al.  Automatic abstraction and fault tolerance in cortical microachitectures , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).