Ensemble stacking mitigates biases in inference of synaptic connectivity

A promising alternative to directly measuring the anatomical connections in a neuronal population is inferring the connections from the activity. We employ simulated spiking neuronal networks to compare and contrast commonly used inference methods that identify likely excitatory synaptic connections using statistical regularities in spike timing. We find that simple adjustments to standard algorithms improve inference accuracy: A signing procedure improves the power of unsigned mutual-information-based approaches and a correction that accounts for differences in mean and variance of background timing relationships, such as those expected to be induced by heterogeneous firing rates, increases the sensitivity of frequency-based methods. We also find that different inference methods reveal distinct subsets of the synaptic network and each method exhibits different biases in the accurate detection of reciprocity and local clustering. To correct for errors and biases specific to single inference algorithms, we combine methods into an ensemble. Ensemble predictions, generated as a linear combination of multiple inference algorithms, are more sensitive than the best individual measures alone, and are more faithful to ground-truth statistics of connectivity, mitigating biases specific to single inference methods. These weightings generalize across simulated datasets, emphasizing the potential for the broad utility of ensemble-based approaches.Author SummaryMapping the routing of spikes through local circuitry is crucial for understanding neocortical computation. Under appropriate experimental conditions, these maps can be used to infer likely patterns of synaptic recruitment, linking activity to underlying anatomical connections. Such inferences help to reveal the synaptic implementation of population dynamics and computation. We compare a number of standard functional measures to infer underlying connectivity. We find that regularization impacts measures heterogeneously, and that individual algorithms have unique biases that impact their interpretation. These biases are nonoverlapping, and thus have the potential to mitigate one another. Combining individual algorithms into a single ensemble method results in a stronger inference algorithm than the best individual component measure. Ensemble-based inference can yield higher sensitivity to underlying connections and an improved estimate of the true statistics of synaptic recruitment.

[1]  Xingming Zhao,et al.  Conditional mutual inclusive information enables accurate quantification of associations in gene regulatory networks , 2014, Nucleic acids research.

[2]  P. Jesper Sjöström,et al.  Using Multiple Whole-Cell Recordings to Study Spike-Timing-Dependent Plasticity in Acute Neocortical Slices. , 2016, Cold Spring Harbor protocols.

[3]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[4]  Tomoki Fukai,et al.  Optimal spike-based communication in excitable networks with strong-sparse and weak-dense links , 2012, Scientific Reports.

[5]  Suchin S. Gururangan,et al.  Analysis of Graph Invariants in Functional Neocortical Circuitry Reveals Generalized Features Common to Three Areas of Sensory Cortex , 2014, PLoS Comput. Biol..

[6]  D. Perkel,et al.  Simultaneously Recorded Trains of Action Potentials: Analysis and Functional Interpretation , 1969, Science.

[7]  James P. Crutchfield,et al.  Information Flows? A Critique of Transfer Entropies , 2015, Physical review letters.

[8]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[9]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[10]  Hongkui Zeng,et al.  Differential tuning and population dynamics of excitatory and inhibitory neurons reflect differences in local intracortical connectivity , 2011, Nature Neuroscience.

[11]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[12]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  J. Schiller,et al.  Active properties of neocortical pyramidal neuron dendrites. , 2013, Annual review of neuroscience.

[15]  Alexander J. Sadovsky,et al.  Heuristically optimal path scanning for high-speed multiphoton circuit imaging. , 2011, Journal of neurophysiology.

[16]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[17]  Jason N. MacLean,et al.  Higher-Order Synaptic Interactions Coordinate Dynamics in Recurrent Networks , 2016, PLoS Comput. Biol..

[18]  Dietmar Plenz,et al.  Efficient Network Reconstruction from Dynamical Cascades Identifies Small-World Topology of Neuronal Avalanches , 2009, PLoS Comput. Biol..

[19]  Daniel Y. Little,et al.  Identification of Coevolving Residues and Coevolution Potentials Emphasizing Structure, Bond Formation and Catalytic Coordination in Protein Evolution , 2009, PloS one.

[20]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[21]  Katsunori Kitano,et al.  Impact of network topology on inference of synaptic connectivity from multi-neuronal spike data simulated by a large-scale cortical network model , 2013, Journal of Computational Neuroscience.

[22]  Brendan Chambers,et al.  Multineuronal activity patterns identify selective synaptic connections under realistic experimental constraints. , 2015, Journal of neurophysiology.

[23]  Jochen Triesch,et al.  Plasticity-Driven Self-Organization under Topological Constraints Accounts for Non-random Features of Cortical Synaptic Wiring , 2015, bioRxiv.

[24]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[25]  John M. Beggs,et al.  Functional Clusters, Hubs, and Communities in the Cortical Microconnectome , 2014, Cerebral cortex.

[26]  Maxym Myroshnychenko,et al.  High-Degree Neurons Feed Cortical Computations , 2016, PLoS Comput. Biol..

[27]  David D. Jensen,et al.  Why Stacked Models Perform Effective Collective Classification , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[28]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[29]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[30]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Jason N MacLean,et al.  Circuit reactivation dynamically regulates synaptic plasticity in neocortex , 2013, Nature Communications.

[32]  Günther Palm From Neural Dynamics to Cell Assemblies , 1982 .

[33]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[34]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[35]  Jaume Casademunt,et al.  Noise focusing and the emergence of coherent activity in neuronal cultures , 2013, Nature Physics.

[36]  Diogo M. Camacho,et al.  Wisdom of crowds for robust gene network inference , 2012, Nature Methods.

[37]  Alex Roxin,et al.  On the structure of cortical micro-circuits inferred from small sample sizes , 2017 .

[38]  Joshua T. Vogelstein,et al.  A Bayesian approach for inferring neuronal connectivity from calcium fluorescent imaging data , 2011, 1107.4228.

[39]  Alexander J. Sadovsky,et al.  Scaling of Topologically Similar Functional Modules Defines Mouse Primary Auditory and Somatosensory Microcircuitry , 2013, The Journal of Neuroscience.

[40]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[41]  Alípio Mário Jorge,et al.  Ensemble approaches for regression: A survey , 2012, CSUR.

[42]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[43]  Dietmar Plenz,et al.  The organization of strong links in complex networks , 2011, Nature Physics.

[44]  John M. Beggs,et al.  Extending Transfer Entropy Improves Identification of Effective Connectivity in a Spiking Cortical Network Model , 2011, PloS one.

[45]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[46]  Alexander J. Sadovsky,et al.  Acetylcholine functionally reorganizes neocortical microcircuits. , 2014, Journal of neurophysiology.

[47]  José Luis Peña,et al.  Spike-Threshold Adaptation Predicted by Membrane Potential Dynamics In Vivo , 2014, PLoS Comput. Biol..

[48]  Carlos Dias Maciel,et al.  Delayed mutual information infers patterns of synaptic connectivity in a proprioceptive neural network , 2015, Journal of Computational Neuroscience.

[49]  Bogdan Gabrys,et al.  Classifier selection for majority voting , 2005, Inf. Fusion.

[50]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[51]  Romain Brette,et al.  Sensitivity of Noisy Neurons to Coincident Inputs , 2011, The Journal of Neuroscience.

[52]  G. Gerstein,et al.  Repeated patterns of distributed synchrony in neuronal assemblies. , 1997, Journal of neurophysiology.

[53]  Moritz Deger,et al.  Reconstruction of recurrent synaptic connectivity of thousands of neurons from simulated spiking activity , 2015, Journal of Computational Neuroscience.

[54]  Theo Geisel,et al.  Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals , 2012, PLoS Comput. Biol..

[55]  Maxym Myroshnychenko,et al.  Rich-Club Organization in Effective Connectivity among Cortical Neurons , 2016, The Journal of Neuroscience.

[56]  Albert Y. Zomaya,et al.  Assortative mixing in directed biological networks , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[57]  Eve Marder,et al.  Successful Reconstruction of a Physiological Circuit with Known Connectivity from Spiking Activity Alone , 2013, PLoS Comput. Biol..