Evaluating information transfer between auditory cortical neurons.

Transfer entropy, presented as a new tool for investigating neural assemblies, quantifies the fraction of information in a neuron found in the past history of another neuron. The asymmetry of the measure allows feedback evaluations. In particular, this tool has potential applications in investigating windows of temporal integration and stimulus-induced modulation of firing rate. Transfer entropy is also able to eliminate some effects of common history in spike trains and obtains results that are different from cross-correlation. The basic transfer entropy properties are illustrated with simulations. The information transfer through a network of 16 simultaneous multiunit recordings in cat's auditory cortex was examined for a large number of acoustic stimulus types. Application of the transfer entropy to a large database of multiple single-unit activity in cat's primary auditory cortex revealed that most windows of temporal integration found during spontaneous activity range between 2 and 15 ms. The normalized transfer entropy shows similarities and differences with the strength of cross-correlation; these form the basis for revisiting the neural assembly concept.

[1]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[2]  Stanley Fahn.  Recent Advances in EEG and EMG Data Processing , 1983, Neurology.

[3]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[4]  A. M. Sillito,et al.  Orientation sensitive elements in the corticofugal influence on centre-surround interactions in the dorsal lateral geniculate nucleus , 1993, Experimental Brain Research.

[5]  J. Eggermont,et al.  Cross-correlation and joint spectro-temporal receptive field properties in auditory cortex. , 2005, Journal of neurophysiology.

[6]  V. Mountcastle,et al.  NEURAL ACTIVITY IN MECHANORECEPTIVE CUTANEOUS AFFERENTS: STIMULUS-RESPONSE RELATIONS, WEBER FUNCTIONS, AND INFORMATION TRANSMISSION. , 1965, Journal of neurophysiology.

[7]  M. Diamond,et al.  Population Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[9]  J. Eggermont,et al.  Spatial representation of neural responses to natural and altered conspecific vocalizations in cat auditory cortex. , 2007, Journal of neurophysiology.

[10]  W. Spain,et al.  Linear to supralinear summation of AMPA-mediated EPSPs in neocortical pyramidal neurons. , 2000, Journal of neurophysiology.

[11]  Daeyeol Lee,et al.  Neural Noise and Movement-Related Codes in the Macaque Supplementary Motor Area , 2003, The Journal of Neuroscience.

[12]  C. Hung,et al.  Weakly modulated spike trains: significance, precision, and correction for sample size. , 2002, Journal of neurophysiology.

[13]  C. Sotelo,et al.  Ultrastructural features of the isolated suprasylvian gyrus in the cat , 1974, The Journal of comparative neurology.

[14]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[15]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[16]  Jos J. Eggermont,et al.  Neural connectivity only accounts for a small part of neural correlation in auditory cortex , 1996, Experimental Brain Research.

[17]  Christian W. Eurich,et al.  Representational Accuracy of Stochastic Neural Populations , 2002, Neural Computation.

[18]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[19]  Daeyeol Lee,et al.  Coding and transmission of information by neural ensembles , 2004, Trends in Neurosciences.

[20]  Stefano Panzeri,et al.  A critical assessment of different measures of the information carried by correlated neuronal firing. , 2002, Bio Systems.

[21]  J. Victor.  Binless strategies for estimation of information from neural data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  J. Eggermont,et al.  Effects of Noise-Induced Hearing Loss at Young Age on Voice Onset Time and Gap-in-Noise Representations in Adult Cat Primary Auditory Cortex , 2006, Journal of the Association for Research in Otolaryngology.

[23]  F. Mechler,et al.  Independent and Redundant Information in Nearby Cortical Neurons , 2001, Science.

[24]  Idan Segev,et al.  The information efficacy of a synapse , 2002, Nature Neuroscience.

[25]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[26]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[27]  R. Willison.  Recent Advances in EEG and EMG Data Processing , 1982 .

[28]  P. Latham,et al.  Retinal ganglion cells act largely as independent encoders , 2001, Nature.

[29]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[31]  William B. Kristan,et al.  Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis , 2005, Neural Computation.

[32]  Neil Davey,et al.  High capacity, small world associative memory models , 2006, Connect. Sci..

[33]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[34]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[35]  K. Stratford,et al.  Synaptic transmission between individual pyramidal neurons of the rat visual cortex in vitro , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  Jos J Eggermont,et al.  Neuronal responses in cat primary auditory cortex to natural and altered species-specific calls , 2000, Hearing Research.

[37]  Xiaoqin Wang,et al.  Neural representations of temporally asymmetric stimuli in the auditory cortex of awake primates. , 2001, Journal of neurophysiology.

[38]  M. Margulis,et al.  Temporal integration can readily switch between sublinear and supralinear summation. , 1998, Journal of neurophysiology.

[39]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[40]  A. Zador,et al.  Neural representation and the cortical code. , 2000, Annual review of neuroscience.

[41]  David R. Cox,et al.  The statistical analysis of series of events , 1966 .

[42]  N Suga,et al.  Corticofugal Modulation of Time-Domain Processing of Biosonar Information in Bats , 1996, Science.

[43]  J. Hertz,et al.  Adjacent visual cortical complex cells share about 20% of their stimulus-related information. , 1996, Cerebral cortex.

[44]  Régine Le Bouquin-Jeannès,et al.  Linear and nonlinear causality between signals: methods, examples and neurophysiological applications , 2006, Biological Cybernetics.

[45]  J. Deuchars,et al.  Synaptic interactions in neocortical local circuits: dual intracellular recordings in vitro. , 1997, Cerebral cortex.

[46]  Jan W. H. Schnupp,et al.  Plasticity of Temporal Pattern Codes for Vocalization Stimuli in Primary Auditory Cortex , 2006, The Journal of Neuroscience.

[47]  M. Laubach,et al.  Redundancy and Synergy of Neuronal Ensembles in Motor Cortex , 2005, The Journal of Neuroscience.

[48]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[49]  James J. Wright,et al.  Intracortical connectivity of pyramidal and stellate cells: estimates of synaptic densities and coupling symmetry , 1994 .

[50]  K O Johnson,et al.  Sensory discrimination: decision process. , 1980, Journal of neurophysiology.

[51]  G. Gerstein,et al.  Networks with lateral connectivity. I. dynamic properties mediated by the balance of intrinsic excitation and inhibition. , 1996, Journal of neurophysiology.

[52]  M. Nicolelis,et al.  Immediate thalamic sensory plasticity depends on corticothalamic feedback. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[53]  M. Diamond,et al.  Population coding in somatosensory cortex , 2002, Current Opinion in Neurobiology.

[54]  Gal Chechik,et al.  Reduction of Information Redundancy in the Ascending Auditory Pathway , 2006, Neuron.

[55]  R. Yuste,et al.  Input Summation by Cultured Pyramidal Neurons Is Linear and Position-Independent , 1998, The Journal of Neuroscience.

[56]  Jan J. Koenderink,et al.  Information in channel-coded systems: correlated receivers , 1992, Biological Cybernetics.

[57]  R. Yuste,et al.  Linear Summation of Excitatory Inputs by CA1 Pyramidal Neurons , 1999, Neuron.

[58]  E. Oja,et al.  Independent Component Analysis , 2013 .

[59]  K Prank,et al.  Coding efficiency and information rates in transmembrane signaling. , 2000, Bio Systems.

[60]  R. Moddemeijer.  On estimation of entropy and mutual information of continuous distributions , 1989 .

[61]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[62]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[63]  Stefano Panzeri,et al.  A Unified Approach to the Study of Temporal, Correlational, and Rate Coding , 1999, Neural Computation.

[64]  Jerome A. Feldman,et al.  Dynamic connections in neural networks , 1990, Biological Cybernetics.

[65]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[66]  Daeyeol Lee,et al.  Activity in the supplementary motor area related to learning and performance during a sequential visuomotor task. , 2003, Journal of neurophysiology.

[67]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[68]  George L. Gerstein,et al.  Neural assemblies: technical issues, analysis, and modeling , 2001, Neural Networks.

[69]  V. Mountcastle,et al.  THE VARIABILITY OF CENTRAL NEURAL ACTIVITY IN A SENSORY SYSTEM, AND ITS IMPLICATIONS FOR THE CENTRAL REFLECTION OF SENSORY EVENTS. , 1963, Journal of neurophysiology.

[70]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[71]  Stefan Wermter,et al.  Temporal sequence detection with spiking neurons: towards recognizing robot language instructions , 2006, Connect. Sci..

[72]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[73]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[74]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[75]  Terrence J. Sejnowski,et al.  Inhibition synchronizes sparsely connected cortical neurons within and between columns in realistic network models , 1996, Journal of Computational Neuroscience.

[76]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[77]  C. Schreiner,et al.  Temporal processing in cat primary auditory cortex. , 1997, Acta oto-laryngologica. Supplementum.

[78]  Bernhard Hellwig,et al.  A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex , 2000, Biological Cybernetics.

[79]  Koichi Sameshima,et al.  Using partial directed coherence to describe neuronal ensemble interactions , 1999, Journal of Neuroscience Methods.

[80]  G. Gerstein,et al.  “A model of cortically induced synchronization in the lateral geniculate nucleus of the cat: a role for low-threshold calcium channels” [Vision Research 38(13), 2007–2022] , 1999, Vision Research.

[81]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[82]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[83]  J. A. Movshon,et al.  The dependence of response amplitude and variance of cat visual cortical neurones on stimulus contrast , 1981, Experimental Brain Research.

[84]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[85]  J J Eggermont,et al.  Neural interaction in cat primary auditory cortex II. Effects of sound stimulation. , 1994, Journal of neurophysiology.

[86]  Xiaoqin Wang,et al.  Cortical processing of temporal modulations , 2003, Speech Commun..

[87]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[88]  J. Eggermont.  Is There a Neural Code? , 1998, Neuroscience & Biobehavioral Reviews.

[89]  B. Richmond,et al.  Using response models to estimate channel capacity for neuronal classification of stationary visual stimuli using temporal coding. , 1999, Journal of neurophysiology.

[90]  José María Amigó,et al.  Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity , 2004, Neural Computation.

[91]  J. Eggermont.  Properties of correlated neural activity clusters in cat auditory cortex resemble those of neural assemblies. , 2006, Journal of neurophysiology.

[92]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[93]  Asif A Ghazanfar,et al.  Hebb's Dream: The Resurgence of Cell Assemblies , 1997, Neuron.

[94]  J. Eggermont.  Temporal modulation transfer functions in cat primary auditory cortex: separating stimulus effects from neural mechanisms. , 2002, Journal of neurophysiology.

[95]  Haim Sompolinsky,et al.  Nonlinear Population Codes , 2004, Neural Computation.

[96]  A. Georgopoulos,et al.  Parietal representation of hand velocity in a copy task. , 2005, Journal of neurophysiology.

[97]  J. Eggermont.  Sound-induced synchronization of neural activity between and within three auditory cortical areas. , 2000, Journal of neurophysiology.

[98]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[99]  P. Goldman-Rakic,et al.  Correlated discharges among putative pyramidal neurons and interneurons in the primate prefrontal cortex. , 2002, Journal of neurophysiology.

[100]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[101]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[102]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[103]  B J Richmond,et al.  Excess synchrony in motor cortical neurons provides redundant direction information with that from coarse temporal measures. , 2001, Journal of neurophysiology.

[104]  K. Saberi,et al.  Cognitive restoration of reversed speech , 1999, Nature.

[105]  Xiaoqin Wang,et al.  Differential representation of species-specific primate vocalizations in the auditory cortices of marmoset and cat. , 2001, Journal of neurophysiology.

[106]  David Willshaw,et al.  Capacity and information efficiency of the associative net , 1997 .

[107]  G. Jumarie.  Relative Information: Theories and Applications , 2011 .

[108]  M. Basseville.  Distance measures for signal processing and pattern recognition , 1989 .

[109]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[110]  D P Phillips,et al.  Responses of single neurons in posterior field of cat auditory cortex to tonal stimulation. , 1984, Journal of neurophysiology.

[111]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[112]  J. Eggermont,et al.  Separating local from global effects in neural pair correlograms. , 1995, Neuroreport.

[113]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. I. The single spike train. , 1967, Biophysical journal.

[114]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[115]  T. Tsumoto,et al.  Change of conduction velocity by regional myelination yields constant latency irrespective of distance between thalamus and cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[116]  Y. Dan,et al.  Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus , 1998, Nature Neuroscience.

[117]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[118]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[119]  George L. Gerstein,et al.  Improvements to the Sensitivity of Gravitational Clustering for Multiple Neuron Recordings , 2000, Neural Computation.

[120]  Craig Hiemstra,et al.  Testing for Linear and Nonlinear Granger Causality in the Stock Price-Volume Relation , 1994 .

[121]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[122]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[123]  R. Romo,et al.  Correlated Neuronal Discharges that Increase Coding Efficiency during Perceptual Discrimination , 2003, Neuron.

[124]  Leslie G. Valiant,et al.  A Quantitative Theory of Neural Computation , 2006, Biological Cybernetics.

[125]  S. Panzeri,et al.  An exact method to quantify the information transmitted by different mechanisms of correlational coding. , 2003, Network.

[126]  T. Sejnowski,et al.  Control of Spatiotemporal Coherence of a Thalamic Oscillation by Corticothalamic Feedback , 1996, Science.

[127]  Michael J. Berry,et al.  Redundancy in the Population Code of the Retina , 2005, Neuron.

[128]  R. Shapley,et al.  Information Tuning of Populations of Neurons in Primary Visual Cortex , 2004, The Journal of Neuroscience.

[129]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[130]  J J Eggermont,et al.  Synchrony between single-unit activity and local field potentials in relation to periodicity coding in primary auditory cortex. , 1995, Journal of neurophysiology.

[131]  Colin Blakemore,et al.  Patterns of Local Connectivity in the Neocortex , 1993, Neural Computation.