A Geometric Perspective on Minimal Peer Prediction

Minimal peer prediction mechanisms truthfully elicit private information (e.g., opinions or experiences) from rational agents without the requirement that ground truth is eventually revealed. In this article, we use a geometric perspective to prove that minimal peer prediction mechanisms are equivalent to power diagrams, a type of weighted Voronoi diagram. Using this characterization and results from computational geometry, we show that many of the mechanisms in the literature are unique up to affine transformations. We also show that classical peer prediction is “complete” in that every minimal mechanism can be written as a classical peer prediction mechanism for some scoring rule. Finally, we use our geometric characterization to develop a general method for constructing new truthful mechanisms, and we show how to optimize for the mechanisms’ effort incentives and robustness.

[1]  Jens Witkowski Robust peer prediction mechanisms , 2015 .

[2]  Anirban Dasgupta,et al.  Crowdsourced judgement elicitation with endogenous proficiency , 2013, WWW.

[3]  David C. Parkes,et al.  Learning the Prior in Minimal Peer Prediction , 2013 .

[4]  David C. Parkes,et al.  A Robust Bayesian Truth Serum for Small Populations , 2012, AAAI.

[5]  Boi Faltings,et al.  A Robust Bayesian Truth Serum for Non-Binary Signals , 2013, AAAI.

[6]  Paul Resnick,et al.  Eliciting Informative Feedback: The Peer-Prediction Method , 2005, Manag. Sci..

[7]  Konstantin A. Rybnikov,et al.  Stresses and Liftings of Cell-Complexes , 1999, Discret. Comput. Geom..

[8]  D. Prelec A Bayesian Truth Serum for Subjective Data , 2004, Science.

[9]  Ian A. Kash,et al.  General Truthfulness Characterizations Via Convex Analysis , 2012, WINE.

[10]  Franz Aurenhammer,et al.  Power Diagrams: Properties, Algorithms and Applications , 1987, SIAM J. Comput..

[11]  Arpit Agarwal,et al.  Informed Truthfulness in Multi-Task Peer Prediction , 2016, EC.

[12]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[13]  Richard Nock,et al.  On Bregman Voronoi diagrams , 2007, SODA '07.

[14]  Goran Radanovic,et al.  Elicitation and Aggregation of Crowd Information , 2016 .

[15]  John C. Harsanyi,et al.  Games with Incomplete Information Played by "Bayesian" Players, I-III: Part I. The Basic Model& , 2004, Manag. Sci..

[16]  David C. Parkes,et al.  Peer prediction without a common prior , 2012, EC '12.

[17]  Franz Aurenhammer,et al.  A criterion for the affine equivalence of cell complexes inRd and convex polyhedra inRd+1 , 1987, Discret. Comput. Geom..

[18]  Boi Faltings,et al.  Robust Incentive-Compatible Feedback Payments , 2006, TADA/AMEC.

[19]  Franz Aurenhammer,et al.  Recognising Polytopical Cell Complexes and Constructing Projection Polyhedra , 1987, J. Symb. Comput..

[20]  Steffen Borgwardt,et al.  On Soft Power Diagrams , 2013, J. Math. Model. Algorithms Oper. Res..

[21]  J. Harsanyi Games with Incomplete Information Played by 'Bayesian' Players, Part III. The Basic Probability Distribution of the Game , 1968 .

[22]  R. Zeckhauser,et al.  Efficiency Despite Mutually Payoff-Relevant Private Information: The Finite Case , 1990 .

[23]  Kim C. Border,et al.  Infinite Dimensional Analysis: A Hitchhiker’s Guide , 1994 .

[24]  Boi Faltings,et al.  Incentives for Answering Hypothetical Questions , 2011 .

[25]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[26]  Yoav Shoham,et al.  Eliciting truthful answers to multiple-choice questions , 2009, EC '09.

[27]  Yoav Shoham,et al.  Eliciting properties of probability distributions , 2008, EC '08.

[28]  Boi Faltings,et al.  Incentives for expressing opinions in online polls , 2008, EC '08.