The risk elicitation puzzle

Evidence shows that people’s preference for risk changes considerably when measured using different methods, which led us to question whether the common practice of using a single behavioural elicitation method (EM) reflects a valid measure. The present study addresses this question by examining the across-methods consistency of observed risk preferences in 1,507 healthy participants using six EMs. Our analyses show that risk preferences are not consistent across methods when operationalized on an absolute scale, a rank scale or the level of model parameters of cumulative prospect theory. This is at least partly explained by the finding that participants do not consistently follow the same decision strategy across EMs. After controlling for methodological and human factors that may impede consistency, our results challenge the view that different EMs manage to stably capture risk preference. Instead, we interpret the results as suggesting that risk preferences may be constructed when they are elicited, and different cognitive processes can lead to varying preferences.Pedroni et al. show that risk preferences vary across behavioural elicitation methods, challenging the view that risk preferences can be consistently captured by a single method.

[1]  Ralph Hertwig,et al.  Risk preference shares the psychometric structure of major psychological traits , 2017, Science Advances.

[2]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[3]  David W Harless,et al.  The predictive utility of generalized expected utility theories , 1994 .

[4]  R. Hertwig,et al.  Who Dares, Who Errs? Disentangling Cognitive and Motivational Roots of Age Differences in Decisions Under Risk , 2017, Psychological science.

[5]  G. Loomes,et al.  Measuring Individual Risk Attitudes When Preferences are Imprecise , 2014 .

[6]  Chetan Dave,et al.  Eliciting risk preferences: When is simple better? , 2008 .

[7]  C. M. Jagacinski Evaluation of job candidates with missing information: Effects of attribute importance and interattribute correlation , 1994 .

[8]  S. Engel,et al.  Consistency of Risk Preference Measures and the Role of Ambiguity: An Artefactual Field Experiment from China , 2016 .

[9]  J. Hey,et al.  Mixture models of choice under risk , 2011, Experiments in Economics.

[10]  U. Dulleck,et al.  Within-Subject Intra- and Inter-Method Consistency of Two Experimental Risk Attitude Elicitation Methods , 2011 .

[11]  Paolo Crosetto,et al.  A theoretical and experimental appraisal of four risk elicitation methods , 2013 .

[12]  D. Streiner,et al.  Stability of maternal preferences for pediatric health states in the perinatal period and 1 year later. , 2003, Archives of pediatrics & adolescent medicine.

[13]  G. Hunanyan,et al.  Portfolio Selection , 2019, Finanzwirtschaft, Banken und Bankmanagement I Finance, Banks and Bank Management.

[14]  D. Prelec The Probability Weighting Function , 1998 .

[15]  J. Lusk,et al.  What can multiple price lists really tell us about risk preferences? , 2016 .

[16]  Li-Wei Chao,et al.  Predicting (un)healthy behavior: A comparison of risk-taking propensity measures. , 2012, Judgment and decision making.

[17]  Duncan James,et al.  Just Who Are You Calling Risk Averse? , 2000 .

[18]  J. Hey,et al.  INVESTIGATING GENERALIZATIONS OF EXPECTED UTILITY THEORY USING EXPERIMENTAL DATA , 1994, Experiments in Economics.

[19]  R. Hertwig,et al.  Stability and change in risk-taking propensity across the adult life span. , 2016, Journal of personality and social psychology.

[20]  F Sainfort,et al.  Eliciting consumer preferences for health plans. , 1999, Health services research.

[21]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[22]  K. Arrow,et al.  Aspects of the theory of risk-bearing , 1966 .

[23]  J. Rieskamp,et al.  Comparing perceptual and preferential decision making , 2016, Psychonomic bulletin & review.

[24]  Lisa R. Anderson,et al.  Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure , 2008 .

[25]  Ferdinand M. Vieider,et al.  Common components of risk and uncertainty attitudes across contexts and domains: evidence from 30 countries , 2015 .

[26]  Eliot R. Smith,et al.  The Mind in Context , 2010 .

[27]  Timothy J. Pleskac,et al.  Modeling behavior in a clinically diagnostic sequential risk-taking task. , 2005, Psychological review.

[28]  C. Starmer Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk , 2000 .

[29]  G. Charness,et al.  Experimental methods: Pay one or pay all , 2016 .

[30]  C. Ferguson A meta-analysis of normal and disordered personality across the life span. , 2010, Journal of personality and social psychology.

[31]  William T. Harbaugh,et al.  The Fourfold Pattern of Risk Attitudes in Choice and Pricing Tasks , 2009 .

[32]  Cary A. Deck,et al.  Investing versus gambling: experimental evidence of multi-domain risk attitudes , 2014 .

[33]  Joyce E. Berg,et al.  Risk preference instability across institutions: a dilemma. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[34]  P. Samuelson LIFETIME PORTFOLIO SELECTION BY DYNAMIC STOCHASTIC PROGRAMMING , 1969 .

[35]  P. Slovic,et al.  Preference Reversals: A Broader Perspective , 1983 .

[36]  Lukas Menkhoff,et al.  Estimating Risky Behavior with Multiple-Item Risk Measures , 2017 .

[37]  Thea Nielsen,et al.  Assessing farmers’ risk preferences and their determinants in a marginal upland area of Vietnam: a comparison of multiple elicitation techniques , 2013 .

[38]  C. Picton A broader perspective. , 2005, Emergency nurse : the journal of the RCN Accident and Emergency Nursing Association.

[39]  O. Musshoff,et al.  Do Changing Probabilities or Payoffs in Lottery-Choice Experiments Affect Risk Preference Outcomes? Evidence from Rural Uganda , 2016 .

[40]  E. Weber,et al.  Affective and deliberative processes in risky choice: age differences in risk taking in the Columbia Card Task. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[41]  Gregory L. Stuart,et al.  Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). , 2002, Journal of experimental psychology. Applied.

[42]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[43]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[44]  J. Rieskamp The probabilistic nature of preferential choice. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[45]  Edward T. Cokely,et al.  Berlin Numeracy Test , 2016 .

[46]  David M. Bruner,et al.  Changing the probability versus changing the reward , 2009 .

[47]  Cary Deck,et al.  A failed attempt to explain within subject variation in risk taking behavior using domain specific risk attitudes , 2013 .

[48]  P. Slovic,et al.  Reversals of preference between bids and choices in gambling decisions. , 1971 .

[49]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[50]  Andreas Glöckner,et al.  Cognitive models of risky choice: Parameter stability and predictive accuracy of prospect theory , 2012, Cognition.

[51]  Arnaud Reynaud,et al.  Stability of risk preference measures: results from a field experiment on French farmers , 2012 .

[52]  R. Hertwig,et al.  Decisions from Experience: From Monetary to Medical Gambles , 2016 .

[53]  J. Neumann,et al.  Theory of Games and Economic Behavior. , 1945 .

[54]  Steven J. Robbins,et al.  The role of framing effects in performance on the Balloon Analogue Risk Task (BART) , 2007 .

[55]  Adrian Bruhin,et al.  Risk and Rationality: Uncovering Heterogeneity in Probability Distortion , 2009 .

[56]  Vincent T. Covello,et al.  Environmental Impact Assessment, Technology Assessment, and Risk Analysis , 1985 .

[57]  P. Slovic The Construction of Preference , 1995 .

[58]  Edward T. Cokely,et al.  Measuring Risk Literacy: The Berlin Numeracy Test , 2012, Judgment and Decision Making.

[59]  Jeffrey M. Gillespie,et al.  A COMPARATIVE ANALYSIS OF RISK PREFERENCE ELICITATION PROCEDURES USING MAIL SURVEY RESULTS , 2000 .

[60]  J. Hodgson The dilemma , 2004, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[61]  A. Tversky,et al.  Contingent weighting in judgment and choice , 1988 .

[62]  Bettina von Helversen,et al.  Does the Influence of Stress on Financial Risk Taking Depend on the Riskiness of the Decision? , 2013, CogSci.