Toward a Sparse Self-Organizing Map for Neuromorphic Architectures

Neurobiological systems have often been a source of inspiration for computational science and engineering, but in the past their impact has also been limited by the understanding of biological models. Today, new technologies lead to an equilibrium situation where powerful and complex computers bring new biological knowledge of the brain behavior. At this point, we possess sufficient understanding to both imagine new brain-inspired computing paradigms and to sustain a classical paradigm which reaches its end programming and intellectual limitations. In this context, we propose to reconsider the computation problem first in the specific domain of mobile robotics. Our main proposal consists in considering computation as part of a global adaptive system, composed of sensors, actuators, a source of energy and a controlling unit. During the adaptation process, the proposed brain-inspired computing structure does not only execute the tasks of the application but also reacts to the external stimulation and acts on the emergent behavior of the system. This approach is inspired by cortical plasticity in mammalian brains and suggests developing the computation architecture along the system's experience. This article proposes modeling this plasticity as a problem of estimating a probability density function. This function would correspond to the nature and the richness of the environment perceived through multiple modalities. We define and develop a novel neural model solving the problem in a distributed and sparse manner. And we integrate this neural map into a bio-inspired hardware substrate that brings the plasticity property into parallel many-core architectures. The approach is then called Hardware Plasticity. The results show that the self-organization properties of our model solve the problem of multimodal sensory data clusterization. The properties of the proposed model allow envisaging the deployment of this adaptation layer into hardware architectures embedded into the robot's body in order to build intelligent controllers.

[1]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[2]  Laurent Rodriguez,et al.  A neural model for hardware plasticity in artificial vision systems , 2013, 2013 Conference on Design and Architectures for Signal and Image Processing.

[3]  RodriguezLaurent,et al.  Toward a Sparse Self-Organizing Map for Neuromorphic Architectures , 2015 .

[4]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[5]  L. Merabet,et al.  The plastic human brain cortex. , 2005, Annual review of neuroscience.

[6]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[7]  A. Clark,et al.  Supersizing The Mind Embodiment Action And Cognitive Extension Andy Clark , 2016 .

[8]  D. George,et al.  Hierarchical Temporal Memory Concepts , Theory , and Terminology , 2006 .

[9]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[10]  Ali Borji,et al.  What/Where to Look Next? Modeling Top-Down Visual Attention in Complex Interactive Environments , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[12]  Philippe Gaussier,et al.  Robustness of Visual Place Cells in Dynamic Indoor and Outdoor Environment , 2006 .

[13]  Lutz Jäncke,et al.  The plastic human brain. , 2009, Restorative neurology and neuroscience.

[14]  Yann Boniface,et al.  Dynamic self-organising map , 2011, Neurocomputing.

[15]  Nigel W. Daw,et al.  Mechanisms of Plasticity in the Visual Cortex , 1995 .

[16]  Eugene Santos,et al.  Infusing Social Networks With Culture , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  S. Dehaene,et al.  How Learning to Read Changes the Cortical Networks for Vision and Language , 2010, Science.

[18]  Joseph Sirosh and Risto Miikkulainen Self-Organizing Feature Maps With Lateral Connections: Modeling Ocular Dominance , 1994 .

[19]  A. Clark Supersizing the Mind , 2008 .

[20]  R. Miikkulainen,et al.  Self-Organization, Plasticity, and Low-Level Visual Phenomena in a Laterally Connected Map Model of the Primary Visual Cortex , 1997 .

[21]  Rolf Pfeifer,et al.  How the Body Shapes the Way We Think: A New View of Intelligence (Bradford Books) , 2006 .

[22]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[23]  Thomas Villmann,et al.  Magnification Control in Self-Organizing Maps and Neural Gas , 2006, Neural Computation.

[24]  Steven M. Nowick,et al.  ACM Journal on Emerging Technologies in Computing Systems , 2010, TODE.

[25]  Bertrand Granado,et al.  Embodied Computing: Self-adaptation in Bio-inspired Reconfigurable Architectures , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum.

[26]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[27]  D. Hubel,et al.  The period of susceptibility to the physiological effects of unilateral eye closure in kittens , 1970, The Journal of physiology.

[28]  Ennio Mingolla,et al.  From Synapses to Circuitry: Using Memristive Memory to Explore the Electronic Brain , 2011, Computer.

[29]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[30]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[31]  Laurent Fiack,et al.  Embedded and real-time architecture for bio-inspired vision-based robot navigation , 2015, Journal of Real-Time Image Processing.

[32]  Nicolas P. Rougier,et al.  Self-Organizing Dynamic Neural Fields , 2013 .