Learning Parameters by Prediction Markets and Kelly Rule for Graphical Models

We consider the case where a large number of human and machine agents collaborate to estimate a joint distribution on events. Some of these agents may be statistical learners processing large volumes of data, but typically any one agent will have access to only some of the data sources. Prediction markets have proven to be an accurate and robust mechanism for aggregating such estimates (Chen and Pennock, 2010), (Barbu and Lay, 2011). Agents in a prediction market trade on futures in events of interest. Their trades collectively determine a probability distribution. Crucially, limited trading resources force agents to prioritize adjustments to the market distribution. Optimally allocating these resources is a challenging problem. In the economic spirit of specialization, we expect prediction markets to do even better if agents can focus on beliefs, and hand off those beliefs to an optimal trading algorithm. Kelly (1956) solved the optimal investment problem for single-asset markets. In previous work, we developed efficient methods to update both the joint probability distribution and user's assets for the graphical model based prediction market (Sun et al., 2012). In this paper we create a Kelly rule automated trader for combinatorial prediction markets and evaluate its performance by numerical simulation.

[1]  Kathryn B. Laskey,et al.  Probability and Asset Updating using Bayesian Networks for Combinatorial Prediction Markets , 2012, UAI.

[2]  Nathan Lay,et al.  An introduction to artificial prediction markets for classification , 2011, J. Mach. Learn. Res..

[3]  Lance Fortnow,et al.  Complexity of combinatorial market makers , 2008, EC '08.

[4]  Klaus Reiner Schenk-Hoppé,et al.  Evolutionary stable stock markets , 2003 .

[5]  Ray J. Solomonoff,et al.  Complexity-based induction systems: Comparisons and convergence theorems , 1978, IEEE Trans. Inf. Theory.

[6]  A. P. Dawid,et al.  Applications of a general propagation algorithm for probabilistic expert systems , 1992 .

[7]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[8]  Rabah Amir,et al.  Market Selection and Survival of Investment Strategies , 2001 .

[9]  John L. Kelly,et al.  A new interpretation of information rate , 1956, IRE Trans. Inf. Theory.

[10]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[11]  Michael I. Jordan,et al.  Probabilistic Networks and Expert Systems , 1999 .

[12]  David M. Pennock,et al.  Designing Markets for Prediction , 2010, AI Mag..

[13]  Klaus Reiner Schenk-Hoppé,et al.  On the Evolution of Investment Strategies and the Kelly Rule – A Darwinian Approach , 2006 .

[14]  Robin Hanson,et al.  Combinatorial Information Market Design , 2003, Inf. Syst. Frontiers.

[15]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[16]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.