Truthfulness in Repeated Predictions

Proper scoring rules elicit truth-telling when making predictions, or otherwise revealing information. However, when multiple predictions are made of the same event, telling the truth is in general no longer optimal, as agents are motivated to distort early predictions to mislead competitors. We demonstrate this, and then prove a significant exception: In a multi-agent prediction setting where all agent signals belong to a jointly multivariate normal distribution, and signal variances are common knowledge, the (proper) logarithmic scoring rule will elicit truthful predictions from every agent at every prediction, regardless of the number, order and timing of predictions. The result applies in several financial models.

[1]  R. L. Winkler Scoring Rules and the Evaluation of Probability Assessors , 1969 .

[2]  David M. Pennock,et al.  Designing Markets for Prediction , 2010, AI Mag..

[3]  J. Sonnemans,et al.  A Truth Serum for Non-Bayesians: Correcting Proper Scoring Rules for Risk Attitudes* , 2009 .

[4]  T. Sargent,et al.  The multivariate normal distribution , 1989 .

[5]  Olivier Armantier,et al.  Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging , 2010 .

[6]  E. Elisabet Rutström,et al.  Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test , 2009, Games Econ. Behav..

[7]  R. Hanson LOGARITHMIC MARKETS CORING RULES FOR MODULAR COMBINATORIAL INFORMATION AGGREGATION , 2012 .

[8]  B. D. Finetti La prévision : ses lois logiques, ses sources subjectives , 1937 .

[9]  Ian A. Kash,et al.  Information elicitation for decision making , 2011, AAMAS.

[10]  F. Sanders On Subjective Probability Forecasting , 1963 .

[11]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[12]  A. Schotter,et al.  An Experimental Study of Belief Learning Using Elicited Beliefs , 2002 .

[13]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[14]  L. J. Savage Elicitation of Personal Probabilities and Expectations , 1971 .

[15]  Robin Hanson,et al.  Combinatorial Information Market Design , 2003, Inf. Syst. Frontiers.

[16]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[17]  Tuomas Sandholm,et al.  Decision rules and decision markets , 2010, AAMAS.

[18]  Lance Fortnow,et al.  Gaming Prediction Markets: Equilibrium Strategies with a Market Maker , 2010, Algorithmica.