Redundancy reducing processes in single neurons

Interaction mechanisms between excitatory and inhibitory impulse sequences operating on neurons play an important role for the processing of information by the nervous system. For instance, the convergence of excitatory and inhibitory influences on retinal ganglion cells to form their receptive fields has been taken as an example for the process of neuronal sharpening by lateral inhibition. In order to analyze quantitatively the functional behavior of such a system, Shannon's entropy method for multiple access channels has been applied to biological two-inputs-one-output systems using the theoretical model developed by Tsukada et al. (1979). Here we give an extension of this procedure from the point of view to reduce redundancy of information in the input signal space of single neurons and attempt to obtain a new interpretation for the information processing of the system. The concept for the redundancy reducing mechanism in single neurons is examined and discussed for the following two processes. The first process is concerned with a signal space formed by superposing two random sequences on the input of a neuron. In this process, we introduce a coding technique to encode the inhibitory sequence by using the timing of the excitatory sequence, which is closely related to an encoding technique of multiple access channels with a correlated source (Marko, 1966, 1970, 1973; Slepian and Wolf, 1973) and which is an invariant transformation in the input signal space without changing the information contents of the input. The second process is concerned with a procedure of reducing redundant signals in the signal space mentioned before. In this connection, it is an important point to see how single neurons reduce the dimensionality of the signal space via transformation with a minimum loss of effective information. For this purpose we introduce the criterion that average transmission of information from signal space to the output does not change when redundant signals are added. This assumption is based on the fact that two signals are equivalent if and only if they have identical input-output behavior. The mechanism is examined and estimated by using a computer-simulated model. As the result of such a simulation we can estimate the minimal segmentation in the signal space which is necessary and sufficient for temporal pattern sensitivity in neurons.

[1]  V. Mountcastle,et al.  NEURAL ACTIVITY IN MECHANORECEPTIVE CUTANEOUS AFFERENTS: STIMULUS-RESPONSE RELATIONS, WEBER FUNCTIONS, AND INFORMATION TRANSMISSION. , 1965, Journal of neurophysiology.

[2]  Walter L. Smith,et al.  ON THE SUPERPOSITION OF RENEWAL PROCESSES , 1954 .

[3]  W. Levick,et al.  Statistical analysis of the dark discharge of lateral geniculate neurones , 1964, The Journal of physiology.

[4]  K. Naka,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. 3. Two-input white-noise analysis. , 1973, Journal of neurophysiology.

[5]  M. Tsukada,et al.  Stochastic automaton models for interaction of excitatory and inhibitory impulse sequences in neurons , 1977, Biological Cybernetics.

[6]  T W Calvert,et al.  Distribution coding in the visual pathway. , 1973, Biophysical journal.

[7]  Hans Marko,et al.  Die Theorie der bidirektionalen Kommunikation und ihre Anwendung auf die Nachrichtenübermittlung zwischen Menschen (Subjektive Information) , 1966, Kybernetik.

[8]  H. A. Reuver,et al.  Selective interaction of two independent recurrent processes , 1965, Journal of Applied Probability.

[9]  G. P. Moore,et al.  Input-output relations in computer-simulated nerve cells , 1968, Kybernetik.

[10]  W. A. Clark,et al.  Simultaneous Studies of Firing Patterns in Several Neurons , 1964, Science.

[11]  H. Barlow,et al.  Visual pattern analysis in machines and animals. , 1972, Science.

[12]  P Z Marmarelis,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. II. One-input white-noise analysis. , 1973, Journal of neurophysiology.

[13]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. I. The single spike train. , 1967, Biophysical journal.

[14]  R. Sato,et al.  Information transmission in multi-input-output stochastic neuron models , 1979, Biological Cybernetics.

[15]  R. Stein,et al.  The information capacity of nerve cells using a frequency code. , 1967, Biophysical journal.

[16]  P Z Marmarelis,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. I. Horizontal cell leads to ganglion cell chain. , 1973, Journal of neurophysiology.

[17]  M ten Hoopen.  Multimodal interval distributions. , 1966, Kybernetik.

[18]  H. Marko,et al.  The Bidirectional Communication Theory - A Generalization of Information Theory , 1973, IEEE Transactions on Communications.

[19]  Gerichtete Informationsgrößen zur Analyse gekoppelter Verhaltensweisen , 1968, Kybernetik.

[20]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[21]  Katsuhiko Shirai,et al.  On some properties of stochastic information processes in neurons and neuron populations , 1974, Kybernetik.

[22]  Joseph L. Gastwirth,et al.  Some models for interaction of renewal processes related to neuron firing , 1969, Journal of Applied Probability.

[23]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[24]  M Tsukada,et al.  [Statistical analysis and functional interpretation of input-output relation in computer-simulated nerve cells]. , 1972, Iyo denshi to seitai kogaku. Japanese journal of medical electronics and biological engineering.

[25]  M. ten Hoopen,et al.  Pooling of impulse sequences, with emphasis on applications to neuronal spike data , 1967, Kybernetik.

[26]  H. Barlow.  Trigger Features, Adaptation and Economy of Impulses , 1969 .

[27]  José Pedro Segundo,et al.  Spike probability in neurones: influence of temporal structure in the train of synaptic events , 1966, Kybernetik.

[28]  S. K. Srinivasan,et al.  Selective interaction between two independent stationary recurrent point processes , 1970, Journal of Applied Probability.

[29]  M. Tsukada,et al.  Temporal pattern discrimination of impulse sequences in the computer-simulated nerve cells , 2004, Biological Cybernetics.

[30]  William J. McGill.  Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[31]  H. Marko.  Information theory and cybernetics , 1967, IEEE Spectrum.

[32]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[33]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[34]  R. Sato,et al.  The stochastic properties of the basic neuron populations as information processing system , 1978, Biological Cybernetics.