Cross-domain and within-domain synaptic maintenance for autonomous development of visual areas

Where-What Networks (WWNs) is a series of developmental networks for the recognition and attention of complex visual scenes. One of the most critical challenges of autonomous development is task non-specificity, namely, the network is meant to learn a variety of open-ended task skills without pre-defined tasks. Then how does a brain-like network develop skills for object relation that can generalize using implicit symbol-like rules? A preliminary scheme of uniform synaptic maintenance, which works across a neuron's sensory and motor domains, has been proposed in our WWN-9. In the new work here, we show that cross-domain and within-domain synaptic maintenance gains superior generalization than using the uniform synaptic maintenance scheme. This generalization enables the WWN to automatically discover symbol-like but implicit rules - detecting object groups from new combinations of object locations that were never observed. By “symbol-like but implicit rules”, we mean that the development program has no symbols and explicit rules, but symbol-like concepts (location, type) and implicit rule (two specific type objects must present concurrently - group) emerge as the firing patterns of the motor area and are used by the control. Moreover, the process of synaptic maintenance corresponds to the genesis (and adaptation) of cell connections and our model autonomously develops the Y area into two subarea, early area and later area, in charge of pattern recognition and symbolic reasoning respectively.

[1]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Juyang Weng,et al.  Skull-closed autonomous development: WWN-6 using natural video , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[3]  Juyang Weng,et al.  Where-what network 1: “Where” and “what” assist each other through top-down connections , 2008, 2008 7th IEEE International Conference on Development and Learning.

[4]  Juyang Weng,et al.  Dually Optimal Neuronal Layers: Lobe Component Analysis , 2009, IEEE Transactions on Autonomous Mental Development.

[5]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[6]  M. Paradiso,et al.  Neuroscience: Exploring the brain, 3rd ed. , 2007 .

[7]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[8]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[9]  I. K. Wood,et al.  Neuroscience: Exploring the brain , 1996 .

[10]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[11]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[12]  Juyang Weng,et al.  WWN-9: Cross-domain synaptic maintenance and its application to object groups recognition , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[13]  M. Sur,et al.  Patterning and Plasticity of the Cerebral Cortex , 2005, Science.

[14]  Narendra Ahuja,et al.  Learning Recognition and Segmentation Using the Cresceptron , 1997, International Journal of Computer Vision.

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[16]  Juyang Weng,et al.  Synapse maintenance in the Where-What Networks , 2011, The 2011 International Joint Conference on Neural Networks.