Pattern segmentation in a binary/analog world: unsupervised learning versus memory storing

We discuss the problem of segmentation in pattern recognition. We adopt the model and the general approach in the landmark paper by Wang, Buhmann and von der Malsburg (Neural Computation, (1990), 2, 94-106), and expand their model in a number of ways. We review their solution to the segmentation problem in associative memory, which consists in feature binding being expressed by synchrony relations between oscillators or populations of neurons. We extend the model by introducing a law of synaptic change, which allows the network to learn by structuring itself in response to stimuli with relevant features. We discuss the problem of interference between pattern completion and the learning of new memories. We also propose a form of multiplexing of input information taking advantage of the time-structure of the neurons' response. It is based on the assessment of analog as well as of binary properties of the stimuli and provides for an enhancement of the network's processing capacity. The relevance of the results for biological systems is pointed out.

[1]  S. Deadwyler,et al.  Long-term potentiation : from biophysics to behavior , 1988 .

[2]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[3]  P Andersen,et al.  An increase in dendritic spine density on hippocampal CA1 pyramidal cells following spatial learning in adult rats suggests the formation of new synapses. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Michael J. Rowan,et al.  Spatial exploration induces a persistent reversal of long-term potentiation in rat hippocampus , 1998, Nature.

[5]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[6]  Timo Honkela,et al.  Connectionism in a Broad Perspective , 1995 .

[7]  G. Stent.  A physiological mechanism for Hebb's postulate of learning. , 1973, Proceedings of the National Academy of Sciences of the United States of America.

[8]  James M. Bower,et al.  Sensitivity of Synaptic Plasticity to the Ca2+ Permeability of NMDA Channels: A Model of Long-Term Potentiation in Hippocampal Neurons , 1993, Neural Computation.

[9]  D. G. Laing,et al.  Quality and intensity of binary odor mixtures , 1984, Physiology & Behavior.

[10]  G. Laurent,et al.  Encoding of Olfactory Information with Oscillating Neural Assemblies , 1994, Science.

[11]  L. Haberly,et al.  NMDA-dependent induction of long-term potentiation in afferent and association fiber systems of piriform cortex in vitro , 1990, Brain Research.

[12]  W. Freeman.  The physiology of perception. , 1991, Scientific American.

[13]  Richard Durbin,et al.  The computing neuron , 1989 .

[14]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[15]  R. Nicoll,et al.  Long-term potentiation: evidence against an increase in transmitter release probability in the CA1 region of the hippocampus. , 1994, Science.

[16]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[17]  Yoshiki Kashimori,et al.  An olfactory recognition model based on spatio-temporal encoding of odor quality in the olfactory bulb , 1998, Biological Cybernetics.

[18]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[19]  W. Freeman.  Spatial properties of an EEG event in the olfactory bulb and cortex. , 1978, Electroencephalography and clinical neurophysiology.

[20]  E. Rolls.  The representation and storage of information in neural networks in the primate cerebral cortex and hippocampus , 1989 .

[21]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[22]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[23]  S. A. Robertson,et al.  NONLINEAR OSCILLATIONS, DYNAMICAL SYSTEMS, AND BIFURCATIONS OF VECTOR FIELDS (Applied Mathematical Sciences, 42) , 1984 .

[24]  G. Laurent,et al.  Odour encoding by temporal sequences of firing in oscillating neural assemblies , 1996, Nature.

[25]  M. Hasselmo,et al.  Cholinergic modulation of cortical associative memory function. , 1992, Journal of neurophysiology.

[26]  W. Singer,et al.  Stimulus‐Dependent Neuronal Oscillations in Cat Visual Cortex: Receptive Field Properties and Feature Dependence , 1990, The European journal of neuroscience.

[27]  B. Baird.  Nonlinear dynamics of pattern formation and pattern recognition in the rabbit olfactory bulb , 1986 .

[28]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[29]  F. Ventriglia.  Neural Modeling and Neural Networks , 1994 .

[30]  K. Doya,et al.  Memorizing oscillatory patterns in the analog neuron network , 1989, International 1989 Joint Conference on Neural Networks.

[31]  B. Baird,et al.  Relation of olfactory EEG to behavior: spatial analysis. , 1987, Behavioral neuroscience.

[32]  Ch. von der Malsburg,et al.  How are Nervous Structures Organized , 1983 .

[33]  E. Fetz,et al.  Coherent 25- to 35-Hz oscillations in the sensorimotor cortex of awake behaving monkeys. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Joachim M. Buhmann,et al.  Pattern Segmentation in Associative Memory , 1990, Neural Computation.

[35]  W. Singer,et al.  Stimulus‐Dependent Neuronal Oscillations in Cat Visual Cortex: Inter‐Columnar Interaction as Determined by Cross‐Correlation Analysis , 1990, The European journal of neuroscience.

[36]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[37]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[38]  P König,et al.  Direct physiological evidence for scene segmentation by temporal coding. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Yong Yao,et al.  Central pattern generating and recognizing in olfactory bulb: A correlation learning rule , 1988, Neural Networks.

[40]  D. G. Laing,et al.  The capacity of humans to identify odors in mixtures , 1989, Physiology & Behavior.

[41]  M. Hasselmo,et al.  Cholinergic suppression specific to intrinsic not afferent fiber synapses in rat piriform (olfactory) cortex. , 1992, Journal of neurophysiology.

[42]  T. Sejnowski,et al.  Associative long-term depression in the hippocampus induced by hebbian covariance , 1989, Nature.