Dense Neural Network used to Amplify the Forecasting Accuracy of real-time Human Swarms

Artificial Swarm Intelligence (ASI) is a hybrid AI technology that enables distributed human groups to "think together" in real-time systems modeled on natural swarms. Prior research has shown that by forming "human swarms," networked groups can substantially amplify their combined intelligence and produce significantly more accurate forecasts than traditional methods. The present study explores whether the rich behavioral data collected during "swarming" can be used to further increase the accuracy of swarm-based forecasts. To do this, a dense neural network was used to process the data collected during a set of swarm-based forecasts and generate a Conviction Index (CI) for each forecast that estimates its expected accuracy. This method was then tested in an authentic forecasting task – wagering on sporting events against the Vegas odds. Specifically, groups of sports fans, working as real-time swarms, were tasked with predicting the outcome of 238 NBA games over 25 consecutive weeks. As a baseline, the swarms achieved an impressive 25% net return on investment (ROI) against the Vegas Odds. This was compared to an enhanced method that used Conviction Index to (a) estimate the strength of each forecast and then (b) wager only on forecasts of sufficient strength. The CI-selected wagers yielded a 57% net ROI against Vegas Odds. This is a significant gain, equivalent to more than doubling the ROI of the naïve swarm betting strategy.

[1]  Louis B. Rosenberg Human Swarms, a real-time method for collective intelligence , 2015, ECAL.

[2]  T. Seeley,et al.  Nest-site selection in honey bees: how well do swarms implement the "best-of-N" decision rule? , 2001, Behavioral Ecology and Sociobiology.

[3]  Tim Kovacs,et al.  On optimal decision-making in brains and social insect colonies , 2009, Journal of The Royal Society Interface.

[4]  Safwan Halabi,et al.  Artificial Swarm Intelligence employed to Amplify Diagnostic Accuracy in Radiology , 2018, 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[5]  Louis B. Rosenberg,et al.  Amplifying the Social Intelligence of Teams Through Human Swarming , 2018, 2018 First International Conference on Artificial Intelligence for Industries (AI4I).

[6]  Gregg Willcox,et al.  Artificial Swarm Intelligence amplifies accuracy when predicting financial markets , 2017, 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON).

[7]  Gregg Willcox,et al.  Artificial Swarms find Social Optima : (Late Breaking Report) , 2018, 2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA).

[8]  Thomas Schlegel,et al.  Stop Signals Provide Cross Inhibition in Collective Decision-making , 2022 .

[9]  F. Galton Vox Populi , 1907, Nature.

[10]  Louis B. Rosenberg,et al.  Artificial Swarm Intelligence , 2019, IntelliSys.

[11]  Louis Rosenberg Artificial Swarm Intelligence vs human experts , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[12]  J. Davitz,et al.  A survey of studies contrasting the quality of group performance and individual performance, 1920-1957. , 1958, Psychological bulletin.

[13]  Louis B. Rosenberg,et al.  Crowds vs swarms, a comparison of intelligence , 2016, 2016 Swarm/Human Blended Intelligence Workshop (SHBI).

[14]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[15]  F. Ratnieks Honeybee Democracy Thomas D. Seeley Honeybee Democracy , 2011, Animal Behaviour.

[16]  Curtis P. Langlotz,et al.  Radiology SWARM: Novel Crowdsourcing Tool for CheXNet Algorithm Validation , 2018 .

[17]  T. Seeley,et al.  Choosing a home: how the scouts in a honey bee swarm perceive the completion of their group decision making , 2003, Behavioral Ecology and Sociobiology.

[18]  D. Helbing,et al.  How social influence can undermine the wisdom of crowd effect , 2011, Proceedings of the National Academy of Sciences.