CrowdIQ: A New Opinion Aggregation Model

In this study, we investigate the problem of aggregating crowd opinions for decision making. The Wisdom of Crowds (WoC) theory explains how crowd opinions should be aggregated in order to improve the performance of decision making. Crowd independence and a weighting mechanism are two important factors to crowd wisdom. However, most existing crowd opinion aggregation methods fail to build a differential weighting mechanism for identifying the expertise of individuals and appropriately accounting for crowd dependence when aggregating their judgments. We propose a new crowd opinion aggregation model, namely CrowdIQ, that has a differential weighting mechanism and accounts for individual dependence. We empirically evaluate CrowdIQ in comparison to four baseline methods using real data collected from StockTwits. The results show that, CrowdIQ significantly outperforms all baseline methods in terms of both a quadratic prediction scoring measure and simulated investment returns.

[1]  J. Armstrong,et al.  The Seer-Sucker Theory: The Value of Experts in Forecasting , 2005 .

[2]  M. F. Luce,et al.  Constructive Consumer Choice Processes , 1998 .

[3]  Richard P. Larrick,et al.  Strategies for revising judgment: how (and how well) people use others' opinions. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Bin Gu,et al.  Research Note - The Allure of Homophily in Social Media: Evidence from Investor Responses on Virtual Communities , 2014, Inf. Syst. Res..

[5]  W. Aspinall A route to more tractable expert advice , 2010, Nature.

[6]  Richard P. Larrick,et al.  The social psychology of the wisdom of crowds. , 2012 .

[7]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[8]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[9]  R. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[10]  H. Vincent Poor,et al.  Aggregating Large Sets of Probabilistic Forecasts by Weighted Coherent Adjustment , 2011, Decis. Anal..

[11]  Theodoros Evgeniou,et al.  Competitive Dynamics in Forecasting: The Interaction of Skill and Uncertainty , 2013 .

[12]  S. Pokharel Wisdom of Crowds: The Value of Stock Opinions Transmitted through Social Media , 2014 .

[13]  D. Helbing,et al.  How social influence can undermine the wisdom of crowd effect , 2011, Proceedings of the National Academy of Sciences.

[14]  Reid Hastie,et al.  The robust beauty of majority rules in group decisions. , 2005, Psychological review.

[15]  S. Frederick,et al.  Intuitive Biases in Choice versus Estimation: Implications for the Wisdom of Crowds , 2011 .

[16]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[17]  Robert L. Winkler,et al.  Combining Probability Distributions From Experts in Risk Analysis , 1999 .

[18]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.