Maximally Informative Dimensions: Analyzing Neural Responses to Natural Signals

We propose a method that allows for a rigorous statistical analysis of neural responses to natural stimuli, which are non-Gaussian and exhibit strong correlations. We have in mind a model in which neurons are selective for a small number of stimulus dimensions out of the high dimensional stimulus space, but within this subspace the responses can be arbitrarily nonlinear. Therefore we maximize the mutual information between the sequence of elicited neural responses and an ensemble of stimuli that has been projected on trial directions in the stimulus space. The procedure can be done iteratively by increasing the number of directions with respect to which information is maximized. Those directions that allow the recovery of all of the information between spikes and the full unprojected stimuli describe the relevant subspace. If the dimensionality of the relevant subspace indeed is much smaller than that of the overall stimulus space, it may become experimentally feasible to map out the neuron's input-output function even under fully natural stimulus conditions. This contrasts with methods based on correlations functions (reverse correlation, spike-triggered covariance, ...) which all require simplified stimulus statistics if we are to use them rigorously.

[1]  A. Dimitrov,et al.  Neural coding and decoding: communication channels and quantization , 2001, Network.

[2]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[3]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[4]  Alexander Borst,et al.  Real-Time Encoding of Motion: Answerable Questions and Questionable Answers from the Fly’s Visual System , 2000, physics/0004060.

[5]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[6]  William Bialek,et al.  Thinking About The Brain , 2002, physics/0205030.

[7]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[8]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[9]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[10]  G D Lewen,et al.  Neural coding of naturalistic motion stimuli , 2001, Network.

[11]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[12]  K. Sen,et al.  Spectral-temporal Receptive Fields of Nonlinear Auditory Neurons Obtained Using Natural Sounds , 2022 .

[13]  J. Gallant,et al.  Natural Stimulation of the Nonclassical Receptive Field Increases Information Transmission Efficiency in V1 , 2002, The Journal of Neuroscience.

[14]  T. Baker,et al.  Odour-plume dynamics influence the brain's olfactory code , 2001, Nature.

[15]  R. Reid,et al.  Low Response Variability in Simultaneously Recorded Retinal, Thalamic, and Cortical Neurons , 2000, Neuron.

[16]  L. Paninski Convergence Properties of Some Spike-Triggered Analysis Techniques , 2002 .

[17]  W. Bialek,et al.  Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  K. Sen,et al.  Feature analysis of natural sounds in the songbird auditory forebrain. , 2001, Journal of neurophysiology.

[19]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[20]  D. Macleod,et al.  Optimal nonlinear codes for the perception of natural colours , 2001, Network.

[21]  Stefano Panzeri,et al.  The Upward Bias in Measures of Information Derived from Limited Data Samples , 1995, Neural Computation.

[22]  William Bialek,et al.  Synergy in a Neural Code , 2000, Neural Computation.

[23]  Robert Shapley,et al.  Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequences. , 2002, Journal of vision.

[24]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[25]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[26]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[27]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  G D Lewen,et al.  Reproducibility and Variability in Neural Spike Trains , 1997, Science.

[29]  P Kuyper,et al.  Triggered correlation. , 1968, IEEE transactions on bio-medical engineering.