Evolution of a Metaheuristic for Aggregating Wisdom from Artificial Crowds

Approximation algorithms are often employed on hard optimization problems due to the vastness of the search spaces. Many approximation methods, such as evolutionary search, are often indeterminate and tend to converge to solutions that vary with each search attempt. If multiple search instances are executed, then the wisdom among the crowd of stochastic outcomes can be exploited by aggregating them to form a new solution that surpasses any individual result. Wisdom of artificial crowds (WoAC), which is inspired by the wisdom of crowds phenomenon, is a post-processing metaheuristic that performs this function. The aggregation method of WoAC is instrumental in producing results that consistently outperform the best individual. This paper extends the contributions of existing work on WoAC by investigating the performance of several aggregation methods. Specifically, existing and newly proposed WoAC aggregation methods are used to synthesize parallel genetic algorithm (GA) searches on a series of traveling salesman problems (TSPs), and the performance of each approach is compared. Our proposed method of weighting the input of crowd members and incrementally increasing the crowd size is shown to improve the chances of finding a solution that is superior to the best individual solution by 51% when compared to previous methods.

[1]  Kian Hsiang Low,et al.  Hierarchical Bayesian Nonparametric Approach to Modeling and Learning the Wisdom of Crowds of Urban Traffic Route Planning Agents , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[2]  Alexey Tsymbal,et al.  A Dynamic Integration Algorithm for an Ensemble of Classifiers , 1999, ISMIS.

[3]  Roman V. Yampolskiy,et al.  Wisdom of Artificial Crowds—A Metaheuristic Algorithm for Optimization , 2012 .

[4]  Shmuel Peleg,et al.  Wisdom of the Crowd in Egocentric Video Curation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Ryan Hughes,et al.  Solving Sudoku Puzzles with Wisdom of Artificial Crowds , 2012, Int. J. Intell. Games Simul..

[6]  Roman V. Yampolskiy,et al.  Genetic algorithm and Wisdom of Artificial Crowds algorithm applied to Light up , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[7]  Tyler Moore,et al.  Evaluating the Wisdom of Crowds in Assessing Phishing Websites , 2008, Financial Cryptography.

[8]  M. Lee,et al.  The wisdom of the crowd playing The Price Is Right , 2010, Memory & cognition.

[9]  Marko Velic,et al.  Wisdom of crowds algorithm for stock market predictions , 2013, Proceedings of the ITI 2013 35th International Conference on Information Technology Interfaces.

[10]  Ayoung Suh,et al.  The Wisdom of Crowds: Impact of Collective Size and Expertise Transfer on Collective Performance , 2014, 2014 47th Hawaii International Conference on System Sciences.

[11]  Roman V. Yampolskiy,et al.  Wisdom of artificial crowds algorithm for solving NP-hard problems , 2011, Int. J. Bio Inspired Comput..

[12]  Roman V. Yampolskiy,et al.  Using a GA and Wisdom of Artificial Crowds to solve solitaire battleship puzzles , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[13]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[14]  Frank Neumann,et al.  Stochastic Search Algorithms , 2010 .