The Effects of Prediction Market Design and Price Elasticity on Trading Performance of Users: An Experimental Analysis

We employ a 2x3 factorial experiment to study two central factors in the design of prediction markets (PMs) for idea evaluation: the overall design of the PM, and the elasticity of market prices set by a market maker. The results show that 'multi-market designs' on which each contract is traded on a separate PM lead to significantly higher trading performance than 'single-markets' that handle all contracts one on PM. Price elasticity has no direct effect on trading performance, but a significant interaction effect with market design implies that the performance difference between the market designs is highest in settings of moderate price elasticity. We contribute to the emerging research stream of PM design through an unprecedented experiment which compares current market designs.

[1]  Stefan Luckner,et al.  HOW TO PAY TRADERS IN INFORMATION MARKETS: RESULTS FROM A FIELD EXPERIMENT , 2012 .

[2]  Teresa M. Amabile,et al.  Creativity In Context: Update To The Social Psychology Of Creativity , 1996 .

[3]  E. Fama.  EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK* , 1970 .

[4]  Martin Spann,et al.  New Product Development 2.0: Preference Markets—How Scalable Securities Markets Identify Winning Product Concepts and Attributes* , 2010 .

[5]  W. Lyddon.  Creativity in Context: Update to "The Social Psychology of Creativity" , 1998 .

[6]  Li Chen,et al.  Design and Use of Preference Markets for Evaluation of Early Stage Technologies , 2009, J. Manag. Inf. Syst..

[7]  L. V. Williams,et al.  Prediction Markets , 2003 .

[8]  Edwin Mansfield,et al.  A Note on the Accuracy of Industrial Forecasts of the Profitability of New Products and Processes , 1978 .

[9]  Peter A. Koen,et al.  Improving the Idea Screening Process within Organizations using Prediction Markets: A Theoretical Perspective , 2012 .

[10]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[11]  Martin Spann,et al.  NEW PRODUCT DEVELOPMENT 2.0: Preference Markets How Scalable Securities Markets Identify Winning Product Concepts & Attributes , 2009 .

[12]  Yves Pigneur,et al.  Preparing a Negotiated R&D Portfolio with a Prediction Market , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[13]  Dominik Walcher,et al.  Toolkits for Idea Competitions: A Novel Method to Integrate Users in New Product Development , 2006 .

[14]  Min Basadur,et al.  Assessing ideational and evaluative skills and creative styles and attitudes , 1990, IEEE International Conference on Engineering Management, Gaining the Competitive Advantage.

[15]  Justin Wolfers,et al.  Nber Working Paper Series Explaining the Favorite-longshot Bias: Is It Risk-love or Misperceptions? , 2022 .

[16]  Gregoris Mentzas,et al.  Collective intelligence for idea management with Internet-based information aggregation markets , 2009, Internet Res..

[17]  D. Littler.  Design and Marketing of New Products , 1981 .

[18]  Sonali K. Shah,et al.  How Communities Support Innovative Activities: An Exploration of Assistance and Sharing Among End-Users , 2003 .

[19]  John R. Hauser,et al.  Design and marketing of new products , 1980 .

[20]  Lian Jian,et al.  Aggregation and manipulation in prediction markets: effects of trading mechanism and information distribution , 2010, EC '10.

[21]  Christina Ann LaComb,et al.  The imagination market , 2007, Inf. Syst. Frontiers.

[22]  Wolfgang Jank,et al.  Second-Generation Prediction Markets for Information Aggregation: A Comparison of Payoff Mechanisms: Second-Generation Prediction Markets , 2012 .

[23]  D. MacKenzie,et al.  The use of knowledge about society , 2008 .

[24]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[25]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[26]  J. Füller,et al.  Online Forum Discussion-Based Forecasting of New Product Market Performance , 2011 .

[27]  Arnold Kamis,et al.  Using an Attribute-Based Decision Support System for User-Customized Products Online: An Experimental Investigation , 2008, MIS Q..

[28]  Jan Marco Leimeister,et al.  Idea Evaluation Mechanisms for Collective Intelligence in Open Innovation Communities: Do Traders Outperform Raters? , 2011, ICIS.

[29]  H. Chesbrough.  The Era of Open Innovation , 2003 .

[30]  Wolfgang Jank,et al.  Second-Generation Prediction Markets for Information Aggregation: A Comparison of Payoff Mechanisms , 2009 .

[31]  David M. Pennock,et al.  Algorithmic Game Theory: Computational Aspects of Prediction Markets , 2007 .

[32]  Henry G. Berg,et al.  Hanson's Automated Market Maker , 2012 .

[33]  B. Skiera,et al.  Sourcing, Filtering, and Evaluating New Product Ideas: An Empirical Exploration of the Performance of Idea Markets , 2012 .

[34]  GoesPaulo,et al.  Design and Use of Preference Markets for Evaluation of Early Stage Technologies , 2009 .

[35]  Robin Hanson,et al.  Combinatorial Information Market Design , 2003, Inf. Syst. Frontiers.