Bio-inspired decision-making and control: From honeybees and neurons to network design

We present nonlinear deterministic models and linear stochastic models of decision-making between alternatives that connect biological groups as diverse as honeybees and neurons. Using these models we explain how biological groups, with decentralized control and limited sensing and communication, select the highest quality alternative, flip a coin for nearly equal alternatives, optimally balance speed and accuracy, maintain robustness in the face of uncertainty, and leverage heterogeneity. Motivated by these remarkable behaviors, we present a generalizable agent-based model for the design and control of network dynamics with the advantageous features observed in the biological groups.

[1]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[2]  P. Holmes,et al.  Explicit moments of decision times for single- and double-threshold drift-diffusion processes , 2016, 1601.06420.

[3]  E. Charnov.  Optimal foraging, the marginal value theorem. , 1976, Theoretical population biology.

[4]  P. Taylor,et al.  Test of optimal sampling by foraging great tits , 1978 .

[5]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[6]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[7]  Vaibhav Srivastava,et al.  Distributed cooperative decision-making in multiarmed bandits: Frequentist and Bayesian algorithms , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[8]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[9]  Vaibhav Srivastava,et al.  A Realization Theory for Bio-inspired Collective Decision-Making , 2015, 1503.08526.

[10]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[11]  Andrew M. Hein,et al.  Natural search algorithms as a bridge between organisms, evolution, and ecology , 2016, Proceedings of the National Academy of Sciences.

[12]  Naomi Ehrich Leonard,et al.  Adaptive Network Dynamics and Evolution of Leadership in Collective Migration , 2013, ArXiv.

[13]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[14]  N. Franks,et al.  A Mechanism for Value-Sensitive Decision-Making , 2013, PloS one.

[15]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[16]  D. Sumpter.  Collective Animal Behavior , 2010 .

[17]  Bassam Bamieh,et al.  Leader selection for optimal network coherence , 2010, 49th IEEE Conference on Decision and Control (CDC).

[18]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[19]  Naomi Ehrich Leonard,et al.  Joint Centrality Distinguishes Optimal Leaders in Noisy Networks , 2014, IEEE Transactions on Control of Network Systems.

[20]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Naomi Ehrich Leonard,et al.  Investigating group behavior in dance: an evolutionary dynamics approach , 2016, 2016 American Control Conference (ACC).

[22]  Giuliano Punzo,et al.  Using Network Dynamical Influence to Drive Consensus , 2016, Scientific reports.

[23]  R. R. Krausz.  Living in Groups , 2013 .

[24]  Jonathan D. Cohen,et al.  Humans use directed and random exploration to solve the explore-exploit dilemma. , 2014, Journal of experimental psychology. General.

[25]  Paolo Braca,et al.  Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses , 2010, IEEE Transactions on Signal Processing.

[26]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[27]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Vaibhav Srivastava,et al.  On optimal foraging and multi-armed bandits , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[29]  Thomas Schlegel,et al.  Stop Signals Provide Cross Inhibition in Collective Decision-making , 2022 .

[30]  C. Gardiner.  Stochastic Methods: A Handbook for the Natural and Social Sciences , 2009 .

[31]  M. Golubitsky,et al.  Singularities and groups in bifurcation theory , 1985 .

[32]  Vaibhav Srivastava,et al.  Collective Decision-Making in Ideal Networks: The Speed-Accuracy Tradeoff , 2014, IEEE Transactions on Control of Network Systems.

[33]  Fu Lin,et al.  Algorithms for Leader Selection in Stochastically Forced Consensus Networks , 2013, IEEE Transactions on Automatic Control.

[34]  P. Holmes,et al.  The dynamics of choice among multiple alternatives , 2006 .

[35]  Philip Holmes,et al.  Simple Neural Networks that Optimize Decisions , 2005, Int. J. Bifurc. Chaos.

[36]  L. Edelstein-Keshet,et al.  Complexity, pattern, and evolutionary trade-offs in animal aggregation. , 1999, Science.

[37]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[38]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[39]  Vaibhav Srivastava,et al.  Modeling Human Decision Making in Generalized Gaussian Multiarmed Bandits , 2013, Proceedings of the IEEE.

[40]  J. Shamma,et al.  Belief consensus and distributed hypothesis testing in sensor networks , 2006 .

[41]  M. Zelen,et al.  Rethinking centrality: Methods and examples☆ , 1989 .

[42]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[43]  S. Garnier,et al.  Decision-making without a brain: how an amoeboid organism solves the two-armed bandit , 2016, Journal of The Royal Society Interface.

[44]  Arthur J. Krener,et al.  Control bifurcations , 2004, IEEE Transactions on Automatic Control.

[45]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[46]  José M. F. Moura,et al.  Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis , 2011, IEEE Transactions on Signal Processing.

[47]  Vaibhav Srivastava,et al.  A Theory of Decision Making Under Dynamic Context , 2015, NIPS.

[48]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[49]  Naomi Ehrich Leonard.  Multi-agent system dynamics: Bifurcation and behavior of animal groups , 2014, Annu. Rev. Control..

[50]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[51]  Radha Poovendran,et al.  A Supermodular Optimization Framework for Leader Selection Under Link Noise in Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[52]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[53]  Naomi Ehrich Leonard,et al.  Hopf Bifurcations and Limit Cycles in Evolutionary Network Dynamics , 2012, SIAM J. Appl. Dyn. Syst..

[54]  Andrew T. Hartnett,et al.  This PDF file includes: Materials and Methods SOM Text Figs. S1 to S12 Table S1 Full Reference List , 2022 .

[55]  Naomi Ehrich Leonard,et al.  Information Centrality and Ordering of Nodes for Accuracy in Noisy Decision-Making Networks , 2016, IEEE Transactions on Automatic Control.

[56]  Naomi Ehrich Leonard,et al.  Decision versus compromise for animal groups in motion , 2011, Proceedings of the National Academy of Sciences.

[57]  M. Randic,et al.  Resistance distance , 1993 .

[58]  Vaibhav Srivastava,et al.  A martingale analysis of first passage times of time-dependent Wiener diffusion models. , 2015, Journal of mathematical psychology.

[59]  Natalia L. Komarova,et al.  Eavesdropping and language dynamics. , 2010, Journal of theoretical biology.

[60]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[61]  Iain D. Couzin,et al.  Specialization and evolutionary branching within migratory populations , 2010, Proceedings of the National Academy of Sciences.

[62]  R. Bogacz.  Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[63]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[64]  Vaibhav Srivastava,et al.  An agent-based framework for bio-inspired, value-sensitive decision-making , 2017 .

[65]  I. Couzin,et al.  Social interactions, information use, and the evolution of collective migration , 2010, Proceedings of the National Academy of Sciences.

[66]  Vaibhav Srivastava,et al.  On distributed cooperative decision-making in multiarmed bandits , 2015, 2016 European Control Conference (ECC).

[67]  Vaibhav Srivastava,et al.  On first passage time problems in collective decision-making with heterogeneous agents , 2015, 2015 American Control Conference (ACC).

[68]  Vaibhav Srivastava,et al.  Honeybee-inspired dynamics for multi-agent decision-making , 2017 .