First Connectomics Challenge: From Imaging to Connectivity

We organized a Challenge to unravel the connectivity of simulated neuronal networks. The provided data was solely based on fluorescence time series of spontaneous activity in a network constituted by 1000 neurons. The task of the participants was to compute the effective connectivity between neurons, with the goal to reconstruct as accurately as possible the ground truth topology of the network. The procured dataset is similar to the one measured in in vivo and in vitro recordings of calcium fluorescence imaging, and therefore the algorithms developed by the participants may largely contribute in the future to unravel major topological features of living neuronal networks from just the analysis of recorded data, and without the need of slow, painstaking experimental connectivity labeling methods. Among 143 entrants, 16 teams participated in the final round of the challenge to compete for prizes. The winners significantly outperformed the baseline method provided by the organizers. To measure influences between neurons the participants used an array of diverse methods, including transfer entropy, regression algorithms, correlation, deep learning, and network deconvolution. The development of "connectivity reconstruction" techniques is a major step in brain science, with many ramifications in the comprehension of neuronal computation, as well as the understanding of network dysfunctions in neuropathologies.

[1]  Hossein Mobahi,et al.  Deep Learning via Semi-supervised Embedding , 2012, Neural Networks: Tricks of the Trade.

[2]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[3]  Jaume Casademunt,et al.  Noise focusing and the emergence of coherent activity in neuronal cultures , 2013, Nature Physics.

[4]  Greg Ridgeway,et al.  Generalized Boosted Models: A guide to the gbm package , 2006 .

[5]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  Christine Grienberger,et al.  Imaging Calcium in Neurons , 2012, Neuron.

[8]  Wojciech Czarnecki,et al.  Neural Connectivity Reconstruction from Calcium Imaging Signal using Random Forest with Topological Features , 2015, Neural Connectomics.

[9]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[10]  Isabelle Guyon,et al.  Design of the first neuronal connectomics challenge: From imaging to connectivity , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[11]  Muriel Médard,et al.  Network deconvolution as a general method to distinguish direct dependencies in networks , 2013, Nature Biotechnology.

[12]  Jianfeng Feng,et al.  Reconstruction of Excitatory Neuronal Connectivity via Metric Score Pooling and Regularization , 2014, Neural Connectomics.

[13]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[14]  MendesPedro,et al.  Discovery of meaningful associations in genomic data using partial correlation coefficients , 2004 .

[15]  Theo Geisel,et al.  Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals , 2012, PLoS Comput. Biol..

[16]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[17]  Kaustubh Supekar,et al.  Estimation of functional connectivity in fMRI data using stability selection-based sparse partial correlation with elastic net penalty , 2012, NeuroImage.

[18]  Boris Polyak.  Some methods of speeding up the convergence of iteration methods , 1964 .

[19]  Brendon O. Watson,et al.  Spike inference from calcium imaging using sequential Monte Carlo methods. , 2009, Biophysical journal.

[20]  Eamonn J. Keogh,et al.  Discovery of Meaningful Rules in Time Series , 2015, KDD.

[21]  Sten Grillner,et al.  Megascience Efforts and the Brain , 2014, Neuron.

[22]  Germán Sumbre,et al.  Fast functional imaging of multiple brain regions in intact zebrafish larvae using Selective Plane Illumination Microscopy , 2013, BMC Neuroscience.

[23]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[24]  K. Strimmer,et al.  Statistical Applications in Genetics and Molecular Biology A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics , 2011 .

[25]  Jean-Pierre Eckmann,et al.  The physics of living neural networks , 2007, 1007.5465.

[26]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[29]  Gilles Louppe,et al.  Simple Connectome Inference from Partial Correlation Statistics in Calcium Imaging , 2014, Neural Connectomics.

[30]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[31]  T. Geisel,et al.  Transfer Entropy Reconstruction and Labeling of Neuronal Connections from Simulated Calcium Imaging , 2013, PloS one.

[32]  Jordi Soriano,et al.  Identification of neuronal network properties from the spectral analysis of calcium imaging signals in neuronal cultures , 2013, Front. Neural Circuits.

[33]  Sooyoung Chung,et al.  Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex , 2005, Nature.

[34]  E. Kandel,et al.  Neuroscience thinks big (and collaboratively) , 2013, Nature Reviews Neuroscience.

[35]  Joshua T. Vogelstein.  OOPSI: A family of optimal optical spike inference algorithms for inferring neural connectivity from population calcium imaging , 2009 .

[36]  Rafael Yuste,et al.  The new century of the brain. , 2014, Scientific American.

[37]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[38]  Lukasz Romaszko,et al.  Signal Correlation Prediction Using Convolutional Neural Networks , 2015, Neural Connectomics.

[39]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[40]  Ann Nowé,et al.  Supervised Neural Network Structure Recovery , 2015, Neural Connectomics.

[41]  M. Spira,et al.  Multi-electrode array technologies for neuroscience and cardiology. , 2013, Nature nanotechnology.

[42]  Alberto de la Fuente,et al.  Discovery of meaningful associations in genomic data using partial correlation coefficients , 2004, Bioinform..

[43]  Bruce C. Wheeler,et al.  Designing Neural Networks in Culture , 2010, Proceedings of the IEEE.

[44]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.