Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Case*

The tradeoff between accuracy and speed is considered fundamental to individual and collective decision-making. In this paper, we focus on collective estimation as an example of collective decision-making. The task is to estimate the average scalar intensity of a desired feature in the environment. The solution we propose consists of exploration and exploitation phases, where the switching time is a factor dictating the balance between the two phases. By decomposing the total accuracy into bias and variance, we explain that diversity and social interactions could promote accuracy of the collective decision. We also show how the exploration-vs-exploitation tradeoff relates to the speed-vs-accuracy tradeoff. One significant finding of our work is that there is an optimal duration for exploration to compromise between speed and accuracy. This duration cannot be determined offline for an unknown environment. Hence, we propose an adaptive, distributed mechanism enabling individual agents to decide in a decentralized manner when to switch. Moreover, the spatial consequence of the exploitation phase is an emergent collective movement, leading to the aggregation of the collective at the iso-contours of the mean intensity of the environmental field in the spatial domain. Examples of potential applications for such a fully distributed collective estimation model are spillage capturing and source localization.

[1]  D. Budescu,et al.  A survey of human judgement and quantitative forecasting methods , 2021, Royal Society Open Science.

[2]  S. Page The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies , 2007 .

[3]  T. Valone,et al.  Potential disadvantages of using socially acquired information. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Radhika Nagpal,et al.  Bayes Bots: Collective Bayesian Decision-Making in Decentralized Robot Swarms , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Andrew M Simons,et al.  Many wrongs: the advantage of group navigation. , 2004, Trends in ecology & evolution.

[6]  Andreagiovanni Reina,et al.  Improving collective decision accuracy via time-varying cross-inhibition , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Radhika Nagpal,et al.  Kilobot: A low cost scalable robot system for collective behaviors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Heiko Hamann,et al.  Swarm Robotics - A Formal Approach , 2018 .

[9]  M. Degroot Reaching a Consensus , 1974 .

[10]  Lu Hong,et al.  Groups of diverse problem solvers can outperform groups of high-ability problem solvers. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[11]  F. Galton Vox Populi , 1907, Nature.

[12]  R. Bogacz,et al.  The neural basis of the speed–accuracy tradeoff , 2010, Trends in Neurosciences.

[13]  Eliseo Ferrante,et al.  Collective Decision with 100 Kilobots Speed vs Accuracy in Binary Discrimination Problems , 2015 .

[14]  W. Ebeling,et al.  Active Brownian particles , 2012, The European Physical Journal Special Topics.

[15]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[16]  Damon Centola,et al.  Network dynamics of social influence in the wisdom of crowds , 2017, Proceedings of the National Academy of Sciences.

[17]  Ben R. Newell,et al.  Unpacking the Exploration–Exploitation Tradeoff: A Synthesis of Human and Animal Literatures , 2015 .

[18]  C. Ioannou,et al.  The effect of group size on the speed of decision making depends on compromise and predation risk across populations in the guppy Poecilia reticulata , 2020, Behaviour.

[19]  Vaibhav Srivastava,et al.  Distributed Cooperative Decision Making in Multi-agent Multi-armed Bandits , 2020, Autom..

[20]  Lars Chittka,et al.  Speed-accuracy tradeoffs in animal decision making. , 2009, Trends in ecology & evolution.

[21]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[22]  Nak Young Chong,et al.  Fast radiation mapping and multiple source localization using topographic contour map and incremental density estimation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Ralf H. J. M. Kurvers,et al.  Individuals fail to reap the collective benefits of diversity because of over-reliance on personal information , 2018, Journal of The Royal Society Interface.

[24]  Thomas T. Hills,et al.  Exploration versus exploitation in space, mind, and society , 2015, Trends in Cognitive Sciences.

[25]  Vaibhav Srivastava,et al.  Collective Decision-Making in Ideal Networks: The Speed-Accuracy Tradeoff , 2014, IEEE Transactions on Control of Network Systems.

[26]  Vaibhav Srivastava,et al.  Distributed cooperative decision-making in multiarmed bandits: Frequentist and Bayesian algorithms , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[27]  Pawel Romanczuk,et al.  Individual and collective encoding of risk in animal groups , 2019, Proceedings of the National Academy of Sciences.

[28]  Albert B. Kao,et al.  The wisdom of stalemates: consensus and clustering as filtering mechanisms for improving collective accuracy , 2020, bioRxiv.

[29]  D. Helbing,et al.  How social influence can undermine the wisdom of crowd effect , 2011, Proceedings of the National Academy of Sciences.

[30]  Anna Dornhaus,et al.  Speed versus accuracy in collective decision making , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[31]  Marco Dorigo,et al.  Efficient Decision-Making in a Self-Organizing Robot Swarm: On the Speed Versus Accuracy Trade-Off , 2015, AAMAS.

[32]  Ilan Yaniv,et al.  Using advice from multiple sources to revise and improve judgments , 2007 .

[33]  S. Levin,et al.  Diffusion and Ecological Problems: Modern Perspectives , 2013 .