A neural cocktail-party processor

Sensory segmentation is an outstanding unsolved problem of theoretical, practical and technical importance. The basic idea of a solution is described in the form of a model. The response of “neurons” within the sensory field is temporally unstable. Segmentation is expressed by synchronization within segments and desynchronization between segments. Correlations are generated by an autonomous pattern formation process. Neuronal coupling is the result both of peripheral evidence (similarity of local quality) and of central evidence (common membership in a stored pattern). The model is consistent with known anatomy and physiology. However, a new physiological function, synaptic modulation, has to be postulated. The present paper restricts explicit treatment to the peripheral evidence represented by amplitude modulations globally present in all components of a sound spectrum. Generalization to arbitrary sensory qualities will be the subject of a later paper. The model is an application and illustration of the Correlation Theory of brain function.

[1]  F. Crick.  Function of the thalamic reticular complex: the searchlight hypothesis. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Hans Werner Strube,et al.  Separation of several speakers recorded by two microphones (cocktail-party processing) , 1981 .

[3]  Tj Sejnowski,et al.  Skeleton filters in the brain , 2014 .

[4]  Terrence J. Sejnowski,et al.  Separating figure from ground with a Boltzmann machine , 1990 .

[5]  W. K. Taylor,et al.  Some Further Experiments upon the Recognition of Speech, with One and with Two Ears , 1954 .

[6]  S. Pinker,et al.  Auditory streaming and the building of timbre. , 1978, Canadian journal of psychology.

[7]  G. H. Yates,et al.  Signal Processing for a Cocktail Party Effect , 1969 .

[8]  E. Kandel,et al.  Classical conditioning and sensitization share aspects of the same molecular cascade in Aplysia. , 1983, Cold Spring Harbor symposia on quantitative biology.

[9]  C. Malsburg,et al.  Statistical Coding and Short-Term Synaptic Plasticity: A Scheme for Knowledge Representation in the Brain , 1986 .

[10]  C. Malsburg.  Nervous Structures with Dynamical Links , 1985 .

[11]  J. Grey,et al.  Perceptual evaluations of synthesized musical instrument tones , 1977 .

[12]  W. Freeman.  Spatial properties of an EEG event in the olfactory bulb and cortex. , 1978, Electroencephalography and clinical neurophysiology.

[13]  A S Bregman,et al.  Auditory continuity and amplitude edges. , 1977, Canadian journal of psychology.

[14]  A S Bregman,et al.  Streaming vs. fusion of sinusoidal components of complex tones , 1978, Perception & psychophysics.

[15]  T. W. Parsons.  Separation of speech from interfering speech by means of harmonic selection , 1976 .

[16]  Eitan M. Gurari,et al.  On the Difficulties Involved in the Segmentation of Pictures , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Werner Reichardt,et al.  Figure-ground discrimination by relative movement in the visual system of the fly , 2004, Biological Cybernetics.

[18]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[19]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[20]  Stephen McAdams,et al.  Spectral Fusion and the Creation of Auditory Images , 1982 .

[21]  H. Helmholtz,et al.  On the Sensations of Tone as a Physiological Basis for the Theory of Music , 2005 .