Inference and segmentation in cortical processing

We present a modelling framework for cortical processing aimed at understanding how, maintaining biological plausibility, neural network models can: (a) approximate general inference algorithms like belief propagation, combining bottom-up and top-down information, (b) solve Rosenblatt's classical superposition problem, which we link to the binding problem, and (c) do so based on an unsupervised learning approach. The framework leads to two related models: the first model shows that the use of top-down feedback significantly improves the network's ability to perform inference of corrupted inputs; the second model, including oscillatory behavior in the processing units, shows that the superposition problem can be efficiently solved based on the unit's phases.

[1]  J. Buhmann,et al.  Sensory segmentation by neural oscillators , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[2]  C. von der Malsburg The what and why of binding: the modeler's perspective. , 1999, Neuron.

[3]  A. Ravishankar Rao,et al.  Unsupervised Segmentation With Dynamical Units , 2008, IEEE Transactions on Neural Networks.

[4]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[6]  DeLiang Wang,et al.  Weight adaptation and oscillatory correlation for image segmentation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[8]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[9]  DeLiang Wang,et al.  Scene analysis by integrating primitive segmentation and associative memory , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[10]  D. George,et al.  A hierarchical Bayesian model of invariant pattern recognition in the visual cortex , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..