Detecting higher-order interactions among the spiking events in a group of neurons

We propose a formal framework for the description of interactions among groups of neurons. This framework is not restricted to the common case of pair interactions, but also incorporates higher-order interactions, which cannot be reduced to lower-order ones. We derive quantitative measures to detect the presence of such interactions in experimental data, by statistical analysis of the frequency distribution of higher-order correlations in multiple neuron spike train data. Our first step is to represent a frequency distribution as a Markov field on the minimal graph it induces. We then show the invariance of this graph with regard to changes of state. Clearly, only linear Markov fields can be adequately represented by graphs. Higher-order interdependencies, which are reflected by the energy expansion of the distribution, require more complex graphical schemes, like constellations or assembly diagrams, which we introduce and discuss. The coefficients of the energy expansion not only point to the interactions among neurons but are also a measure of their strength. We investigate the statistical meaning of detected interactions in an information theoretic sense and propose minimum relative entropy approximations as null hypotheses for significance tests. We demonstrate the various steps of our method in the situation of an empirical frequency distribution on six neurons, extracted from data on simultaneous multineuron recordings from the frontal cortex of a behaving monkey and close with a brief outlook on future work.

[1]  W. Deming,et al.  On a Least Squares Adjustment of a Sampled Frequency Table When the Expected Marginal Totals are Known , 1940 .

[2]  G. Grimmett A THEOREM ABOUT RANDOM FIELDS , 1973 .

[3]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[4]  G. Palm Evidence, information, and surprise , 1981, Biological Cybernetics.

[5]  I. Csiszár $I$-Divergence Geometry of Probability Distributions and Minimization Problems , 1975 .

[6]  J. M. Hammersley,et al.  Markov fields on finite graphs and lattices , 1971 .

[7]  Solomon Kullback,et al.  Information Theory and Statistics , 1970, The Mathematical Gazette.

[8]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[9]  M. Abeles,et al.  Neuronal activities related to higher brain functions-theoretical and experimental implications , 1989, IEEE Transactions on Biomedical Engineering.

[10]  P. Holland,et al.  Discrete Multivariate Analysis. , 1976 .

[11]  S. Kullback,et al.  Contingency tables with given marginals. , 1968, Biometrika.

[12]  S. Kullback,et al.  The Information in Contingency Tables , 1980 .

[13]  E. R. Caianiello,et al.  Neuronic Equations Revisited and Completely Solved , 1986 .

[14]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[15]  Solomon Kullback,et al.  Approximating discrete probability distributions , 1969, IEEE Trans. Inf. Theory.

[16]  Shun-ichi Amari,et al.  Information geometry of Boltzmann machines , 1992, IEEE Trans. Neural Networks.

[17]  E. R. Caianiello,et al.  Synthesis of boolean nets and time behavior of a general mathematical neuron , 1975, Biological Cybernetics.

[18]  H. H. Ku Interaction in multidimensional contingency tables: an information theoretic approach , 1968 .

[19]  G L Gerstein,et al.  Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. , 1988, Journal of neurophysiology.

[20]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[21]  Shun-ichi Amari,et al.  Information geometry of the EM and em algorithms for neural networks , 1995, Neural Networks.

[22]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[23]  Gadi Pinkas,et al.  Energy Minimization and the Satisfiability of Propositional Logic , 1991 .

[24]  E. Ahissar,et al.  Correlated Activity of Neurons: A Neural Code for Higher Brain Functions? , 1991 .

[25]  Shun-ichi Amari,et al.  Statistical inference under multiterminal rate restrictions: A differential geometric approach , 1989, IEEE Trans. Inf. Theory.

[26]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[27]  S. Amari Differential Geometry of Curved Exponential Families-Curvatures and Information Loss , 1982 .

[28]  S. Kullback,et al.  The Information in Contingency Tables - An Application of Information- Theoretic Concepts to the Analysis of Contingency Tables , 1976 .

[29]  A Aertsen,et al.  Coherent activity in neuronal populations: analysis and interpretation , 1987 .

[30]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[31]  D. Griffeath,et al.  Introduction to Random Fields , 2020, 2007.09660.

[32]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[33]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[34]  A. Aertsen,et al.  Dynamic Aspects of Neuronal Cooperativity: Fast Stimulus-Locked Modulations of Effective Connectivity , 1991 .

[35]  A. Aertsen,et al.  On the significance of correlations among neuronal spike trains , 2004, Biological Cybernetics.

[36]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[37]  Shun-ichi Amari,et al.  Dualistic geometry of the manifold of higher-order neurons , 1991, Neural Networks.