Application of Lempel–Ziv complexity to the analysis of neural discharges

Pattern matching is a simple method for studying the properties of information sources based on individual sequences (Wyner et al 1998 IEEE Trans. Inf. Theory 44 2045–56). In particular, the normalized Lempel–Ziv complexity (Lempel and Ziv 1976 IEEE Trans. Inf. Theory 22 75–88), which measures the rate of generation of new patterns along a sequence, is closely related to such important source properties as entropy and information compression ratio. We make use of this concept to characterize the responses of neurons of the primary visual cortex to different kinds of stimulus, including visual stimulation (sinusoidal drifting gratings) and intracellular current injections (sinusoidal and random currents), under two conditions (in vivo and in vitro preparations). Specifically, we digitize the neuronal discharges with several encoding techniques and employ the complexity curves of the resulting discrete signals as fingerprints of the stimuli ensembles. Our results show, for example, that if the neural discharges are encoded with a particular one-parameter method (‘interspike time coding’), the normalized complexity remains constant within some classes of stimuli for a wide range of the parameter. Such constant values of the normalized complexity allow then the differentiation of the stimuli classes. With other encodings (e.g. ‘bin coding’), the whole complexity curve is needed to achieve this goal. In any case, it turns out that the normalized complexity of the neural discharges in vivo are higher (and hence carry more information in the sense of Shannon) than in vitro for the same kind of stimulus.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  W. McCulloch,et al.  The limiting information capacity of a neuronal link , 1952 .

[3]  A. Hodgkin,et al.  Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo , 1952, The Journal of physiology.

[4]  J. McFadden The Entropy of a Point Process , 1965 .

[5]  R. Gallager Information Theory and Reliable Communication , 1968 .

[6]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[7]  Gregory J. Chaitin,et al.  Algorithmic Information Theory , 1987, IBM J. Res. Dev..

[8]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[9]  Jacob Ziv,et al.  Coding theorems for individual sequences , 1978, IEEE Trans. Inf. Theory.

[10]  Stafford E. Tavares,et al.  Sequence Complexity as a Test for Cryptographic Systems , 1985, CRYPTO.

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  P. Rapp,et al.  The algorithmic complexity of neural spike trains increases during focal seizures , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Serap A. Savari,et al.  On the entropy of DNA: algorithms and measurements based on memory and rapid convergence , 1995, SODA '95.

[14]  William R. Softky,et al.  Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. , 1996, Journal of neurophysiology.

[15]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[16]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[17]  Yuri M. Suhov,et al.  Nonparametric Entropy Estimation for Stationary Processesand Random Fields, with Applications to English Text , 1998, IEEE Trans. Inf. Theory.

[18]  Aaron D. Wyner,et al.  On the Role of Pattern Matching in Information Theory , 1998, IEEE Trans. Inf. Theory.

[19]  A. Zador Impact of synaptic unreliability on the information transmitted by spiking neurons. , 1998, Journal of neurophysiology.

[20]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[21]  Maria V. Sanchez-Vives,et al.  Cellular Mechanisms of Long-Lasting Adaptation in Visual Cortical Neurons In Vitro , 2000, The Journal of Neuroscience.

[22]  Maria V. Sanchez-Vives,et al.  Membrane Mechanisms Underlying Contrast Adaptation in Cat Area 17In Vivo , 2000, The Journal of Neuroscience.

[23]  S.L. Gonzalez Andino,et al.  Measuring the complexity of time series: An application to neurophysiological signals , 2000, Human brain mapping.

[24]  P E Rapp,et al.  Effective normalization of complexity measurements for epoch length and sampling frequency. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Werner Ebeling,et al.  Entropy, complexity, predictability, and data analysis of time series and letter sequences , 2002 .

[26]  BsnNr C. Srorn,et al.  CLASSIFYING SIMPLE AND COMPLEX CELLS ON THE BASIS OF RESPONSE MODULATION , 2002 .

[27]  J. Victor Binless strategies for estimation of information from neural data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Maria V. Sanchez-Vives,et al.  Adaptation and temporal decorrelation by single neurons in the primary visual cortex. , 2003, Journal of neurophysiology.

[29]  M V Sanchez-Vives,et al.  On the number of states of the neuronal sources. , 2003, Bio Systems.