Inferring collective dynamical states from widely unobserved systems

When assessing spatially extended complex systems, one can rarely sample the states of all components. We show that this spatial subsampling typically leads to severe underestimation of the risk of instability in systems with propagating events. We derive a subsampling-invariant estimator, and demonstrate that it correctly infers the infectiousness of various diseases under subsampling, making it particularly useful in countries with unreliable case reports. In neuroscience, recordings are strongly limited by subsampling. Here, the subsampling-invariant estimator allows to revisit two prominent hypotheses about the brain’s collective spiking dynamics: asynchronous-irregular or critical. We identify consistently for rat, cat, and monkey a state that combines features of both and allows input to reverberate in the network for hundreds of milliseconds. Overall, owing to its ready applicability, the novel estimator paves the way to novel insight for the study of spatially extended dynamical systems.From infectious diseases to brain activity, complex systems can be approximated using autoregressive models. Here, the authors show that incomplete sampling can bias estimates of the stability of such systems, and introduce a novel, unbiased metric for use in such situations.

[1]  S. Rachev,et al.  BARRIER OPTION PRICING BY BRANCHING PROCESSES , 2009 .

[2]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[3]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[4]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[5]  Minoru Asada,et al.  Information processing in echo state networks at the edge of chaos , 2011, Theory in Biosciences.

[6]  Joseph J Atick,et al.  Could information theory provide an ecological theory of sensory processing? , 2011, Network.

[7]  Linda Rass,et al.  Branching Processes in Biology.Interdisciplinary Applied Mathematics, Volume 19.ByMarek Kimmeland, David E Axelrod.New York: Springer.$59.95. xviii + 230 p; ill.; index. ISBN: 0–387–95340‐X. 2002. , 2003 .

[8]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[9]  Eugene Seneta,et al.  ESTIMATION THEORY FOR GROWTH AND IMMIGRATION RATES IN A MULTIPLICATIVE PROCESS , 1972 .

[10]  Michael Höhle,et al.  Estimating the under-reporting of norovirus illness in Germany utilizing enhanced awareness of diarrhoea during a large outbreak of Shiga toxin-producing E. coli O104:H4 in 2011 – a time series analysis , 2014, BMC Infectious Diseases.

[11]  Viola Priesemann,et al.  Neuronal Avalanches Differ from Wakefulness to Deep Sleep – Evidence from Intracranial Depth Recordings in Humans , 2013, PLoS Comput. Biol..

[12]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[13]  S. Carpenter,et al.  Anticipating Critical Transitions , 2012, Science.

[14]  M. Copelli,et al.  Undersampled Critical Branching Processes on Small-World and Random Networks Fail to Reproduce the Statistics of Spike Avalanches , 2014, PloS one.

[15]  W. Bialek,et al.  Are Biological Systems Poised at Criticality? , 2010, 1012.2242.

[16]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  G. Buzsáki,et al.  Theta Oscillations Provide Temporal Windows for Local Circuit Computation in the Entorhinal-Hippocampal Loop , 2009, Neuron.

[18]  James D. Hamilton Time Series Analysis , 1994 .

[19]  T. W. Epps Stock prices as branching processes , 1996 .

[20]  M. Kachour,et al.  First‐order rounded integer‐valued autoregressive (RINAR(1)) process , 2009 .

[21]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[22]  L Papoz,et al.  Case counting in epidemiology: limitations of methods based on multiple data sources. , 1996, International journal of epidemiology.

[23]  Shimon Marom,et al.  Neural timescales or lack thereof , 2010, Progress in Neurobiology.

[24]  Nicolas Brunel,et al.  Dynamics of networks of randomly connected excitatory and inhibitory spiking neurons , 2000, Journal of Physiology-Paris.

[25]  Amnon Pazy,et al.  On a branching process in neutron transport theory , 1973 .

[26]  H. Boucher,et al.  Epidemiology of methicillin-resistant Staphylococcus aureus. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[27]  Márton Ispány,et al.  Critical branching processes with immigration , 2010 .

[28]  K. N. Venkataraman A time series approach to the study of the simple subcritical Galton–Watson process with immigration , 1982, Advances in Applied Probability.

[29]  Lena Mamykina,et al.  Personalized glucose forecasting for type 2 diabetes using data assimilation , 2017, PLoS Comput. Biol..

[30]  H. Kesten Random difference equations and Renewal theory for products of random matrices , 1973 .

[31]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[32]  Jean-Pierre Eckmann,et al.  The physics of living neural networks , 2007, 1007.5465.

[33]  S. Lange,et al.  [Linear regression and correlation]. , 2007, Deutsche medizinische Wochenschrift.

[34]  P. Teunis,et al.  Norwalk virus: How infectious is it? , 2008, Journal of medical virology.

[35]  W. Singer,et al.  Performance- and Stimulus-Dependent Oscillations in Monkey Prefrontal Cortex During Short-Term Memory , 2009, Front. Integr. Neurosci..

[36]  Klaus Obermayer,et al.  An online spike detection and spike classification algorithm capable of instantaneous resolution of overlapping spikes , 2009, Journal of Computational Neuroscience.

[37]  Alexander Mellmann,et al.  The epidemiology of methicillin-resistant Staphylococcus aureus (MRSA) in Germany. , 2011, Deutsches Arzteblatt international.

[38]  D. Sornette,et al.  Quantifying Reflexivity in Financial Markets: Towards a Prediction of Flash Crashes , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  O. Diekmann,et al.  On the definition and the computation of the basic reproduction ratio R0 in models for infectious diseases in heterogeneous populations , 1990, Journal of mathematical biology.

[40]  R. Cormack,et al.  Problems with using capture-recapture in epidemiology: an example of a measles epidemic. , 1999, Journal of clinical epidemiology.

[41]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[42]  J. Winnicki,et al.  Estimation of the variances in the branching process with immigration , 1991 .

[43]  M. Loeffler,et al.  A stochastic branching model with formation of subunits applied to the growth of intestinal crypts. , 1991, Journal of theoretical biology.

[44]  T. E. Harris,et al.  The Theory of Branching Processes. , 1963 .

[45]  Cristopher Moore,et al.  Stability Analysis of Financial Contagion Due to Overlapping Portfolios , 2012, ArXiv.

[46]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[47]  D. Chialvo Emergent complex neural dynamics , 2010, 1010.2530.

[48]  V. Priesemann,et al.  On the ground state of spiking network activity in mammalian cortex , 2018 .

[49]  Naama Brenner,et al.  Synaptic Size Dynamics as an Effectively Stochastic Process , 2014, PLoS Comput. Biol..

[50]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[51]  L. Kiemeney,et al.  Obesity, metabolic factors and risk of different histological types of lung cancer: A Mendelian randomization study , 2017, PloS one.

[52]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[53]  Sabine Reiter,et al.  Progress toward measles elimination in Germany. , 2003, The Journal of infectious diseases.

[54]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[55]  Timothy J. Blanche,et al.  Nyquist interpolation improves neuron yield in multiunit recordings , 2006, Journal of Neuroscience Methods.

[56]  T. Geisel,et al.  The scaling laws of human travel , 2006, Nature.

[57]  Neal Marshall,et al.  Mother to child transmission (MTCT) of HIV - almost a thing of the past? A cohort study of HIV positive women starting antiretroviral drugs in pregnancy , 2014, BMC Infectious Diseases.

[58]  Michael Breakspear,et al.  Transitions in information processing dynamics at the whole-brain network level are driven by alterations in neural gain , 2019, PLoS Comput. Biol..

[59]  Alexander Borst,et al.  One Rule to Grow Them All: A General Theory of Neuronal Branching and Its Practical Application , 2010, PLoS Comput. Biol..

[60]  D. Earn,et al.  A simple model for complex dynamical transitions in epidemics. , 2000, Science.

[61]  David H. Bailey,et al.  Algorithms and applications , 1988 .

[62]  Mario Quagliariello,et al.  Stress Testing the Banking System: Methodologies and Applications , 2009 .

[63]  Roberta B Carey,et al.  Invasive methicillin-resistant Staphylococcus aureus infections in the United States. , 2007, JAMA.

[64]  Stefan Mihalas,et al.  Self-organized criticality occurs in non-conservative neuronal networks during Up states , 2010, Nature physics.

[65]  A. G. Pakes Branching processes with immigration , 1971 .

[66]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[67]  D. Sornette,et al.  Quantifying reflexivity in financial markets: towards a prediction of flash crashes , 2012, 1201.3572.

[68]  Manuel Mota,et al.  Bisexual branching processes to model extinction conditions for Y-linked genes. , 2009, Journal of theoretical biology.

[69]  David J Schwab,et al.  Zipf's law and criticality in multivariate data without fine-tuning. , 2013, Physical review letters.

[70]  M. Nicolelis,et al.  Spike Avalanches Exhibit Universal Dynamics across the Sleep-Wake Cycle , 2010, PloS one.

[71]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[72]  Albert Nienhaus,et al.  MRSA prevalence in european healthcare settings: a review , 2011, BMC infectious diseases.

[73]  Jochen Triesch,et al.  Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network , 2017, PloS one.

[74]  C P Farrington,et al.  Branching process models for surveillance of infectious diseases controlled by mass vaccination. , 2003, Biostatistics.

[75]  Klaus Obermayer,et al.  Spyke Viewer: a flexible and extensible platform for electrophysiological data analysis , 2013, Front. Neuroinform..

[76]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[77]  H. Andersson,et al.  Stochastic Epidemic Models and Their Statistical Analysis , 2000 .

[78]  G D Lewen,et al.  Reproducibility and Variability in Neural Spike Trains , 1997, Science.

[79]  Viola Priesemann,et al.  Control of criticality and computation in spiking neuromorphic networks with plasticity , 2020, Nature Communications.

[80]  F. DeLeo,et al.  Community-associated meticillin-resistant Staphylococcus aureus , 2010, The Lancet.

[81]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[82]  Michael J. Berry,et al.  Thermodynamics for a network of neurons: Signatures of criticality , 2014, 1407.5946.

[83]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[84]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[85]  C. R. Heathcote,et al.  A Branching Process Allowing Immigration , 1965 .

[86]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[87]  John M. Beggs,et al.  Quasicritical brain dynamics on a nonequilibrium Widom line. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[88]  Viola Priesemann,et al.  Subsampling effects in neuronal avalanche distributions recorded in vivo , 2009, BMC Neuroscience.

[89]  Gasper Tkacik,et al.  Probabilistic models for neural populations that naturally capture global coupling and criticality , 2017, PLoS Comput. Biol..

[90]  Gérard Krause,et al.  Further efforts needed to achieve measles elimination in Germany: results of an outbreak investigation. , 2009, Bulletin of the World Health Organization.

[91]  Mohamed Alosh,et al.  An integer-valued pth-order autoregressive structure (INAR(p)) process , 1990, Journal of Applied Probability.

[92]  H. Uphoff,et al.  Electronic Outbreak Surveillance in Germany: A First Evaluation for Nosocomial Norovirus Outbreaks , 2011, PloS one.

[93]  A. C. Webb,et al.  The spontaneous activity of neurones in the cat’s cerebral cortex , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[94]  Ralf Wessel,et al.  Cortical Circuit Dynamics Are Homeostatically Tuned to Criticality In Vivo , 2019, Neuron.