Experimentally revealed stochastic preferences for multi-component choice options

Realistic, everyday rewards contain multiple components. An apple has taste and size. However, we choose in single dimensions, simply preferring some apples to others. How can such single-dimensional preference relationships refer to multi-component choice options? Here, we measured how stochastic choices revealed preferences for two-component milkshakes. The preferences were intuitively graphed as indifference curves that represented the orderly integration of the two components as trade-off: parts of one component were given up for obtaining one additional unit of the other component without a change in preference. The well-ordered, non-overlapping curves satisfied leave-one-out tests, followed predictions by machine learning decoders and correlated with single-dimensional Becker-DeGroot-Marschak (BDM) auction-like bids for the two-component rewards. This accuracy suggests a decision process that integrates multiple reward components into single-dimensional estimates in a systematic fashion. In inter-species comparisons, human performance matched that of highly experienced laboratory monkeys, as measured by accuracy of the critical trade-off between bundle components. These data describe the nature of choices of multi-component choice options and attest to the validity of the rigorous economic concepts and their convenient graphic schemes for explaining choices of human and non-human primates. The results encourage formal behavioral and neural investigations of normal, irrational and pathological economic choices.

[1]  Louis Leon Thurstone,et al.  The indifference function. , 1931 .

[2]  John P O'Doherty,et al.  Elucidating the underlying components of food valuation in the human orbitofrontal cortex , 2017, Nature Neuroscience.

[3]  Matthew C. Rousu,et al.  Designing Experimental Auctions for Marketing Research: The Effect of Values, Distributions, and Mechanisms on Incentives for Truthful Bidding , 2007 .

[4]  J. O'Doherty,et al.  Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions , 2007, The Journal of Neuroscience.

[5]  A. Mohammad,et al.  Let a monkey do your bidding: Reward valuation in an auction-like mechanism , 2019 .

[6]  W. Schultz,et al.  Neural Basis for Economic Saving Strategies in Human Amygdala-Prefrontal Reward Circuits , 2016, Current Biology.

[7]  Katharina Wagner,et al.  INTRODUCTION TO MICROECONOMICS , 2016 .

[8]  L. Fellows.  Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. , 2006, Brain : a journal of neurology.

[9]  M. Toda,et al.  The Experimental Determination of Indifference Curves , 1969 .

[10]  Kristina F. Pattison,et al.  Suboptimal choice by dogs: when less is better than more , 2014, Animal Cognition.

[11]  J. Busemeyer,et al.  Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice , 2006 .

[12]  Alireza Soltani,et al.  A Range-Normalization Model of Context-Dependent Choice: A New Model and Evidence , 2012, PLoS Comput. Biol..

[13]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[14]  D. McFadden.  Revealed stochastic preference: a synthesis , 2005 .

[15]  A. Dagher,et al.  Supra-Additive Effects of Combining Fat and Carbohydrate on Food Reward. , 2018, Cell metabolism.

[16]  Frode Alfnes,et al.  Eliciting Consumer WTP for Food Characteristics in a Developing Context: Application of Four Valuation Methods in an African Market , 2017 .

[17]  J. Knetsch,et al.  Willingness to Pay and Compensation Demanded: Experimental Evidence of an Unexpected Disparity in Measures of Value , 1984 .

[18]  C. Summerfield,et al.  Gain control explains the effect of distraction in human perceptual, cognitive, and economic decision making , 2018, Proceedings of the National Academy of Sciences.

[19]  P. Glimcher,et al.  Measuring the subjective value of risky and ambiguous options using experimental economics and functional MRI methods. , 2012, Journal of visualized experiments : JoVE.

[20]  J. Kagel,et al.  Economic Choice Theory: An Experimental Analysis of Animal Behavior , 1995 .

[21]  P. Samuelson.  A Note on Measurement of Utility , 1937 .

[22]  A. Harris,et al.  Accounting for Taste: A Multi-Attribute Neurocomputational Model Explains the Neural Dynamics of Choices for Self and Others , 2018, The Journal of Neuroscience.

[23]  I. Simonson,et al.  Choice Based on Reasons: The Case of Attraction and Compromise Effects , 1989 .

[24]  John W. Payne,et al.  Measuring Constructed Preferences: Towards a Building Code , 1999 .

[25]  W. Schultz,et al.  Primate amygdala neurons evaluate the progress of self-defined economic choice sequences , 2016, eLife.

[26]  T. Zentall.  What Suboptimal Choice Tells Us About the Control of Behavior , 2019, Comparative Cognition & Behavior Reviews.

[27]  Benjamin Y. Hayden,et al.  Utility-free heuristic models of two-option choice can mimic predictions of utility-stage models under many conditions , 2015, Front. Neurosci..

[28]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[29]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[30]  Gordon D. A. Brown,et al.  Does the brain calculate value? , 2011, Trends in Cognitive Sciences.

[31]  Fabian Grabenhorst,et al.  A dynamic code for economic object valuation in prefrontal cortex neurons , 2016, Nature Communications.

[32]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[33]  S. Pfeifer.  A Course In Microeconomic Theory , 2016 .

[34]  J. Knetsch.  The Endowment Effect and Evidence of Nonreversible Indifference Curves. , 1989 .

[35]  R. L. Basmann,et al.  EXPERIMENTAL STUDIES OF CONSUMER DEMAND BEHAVIOR USING LABORATORY ANIMALS , 1975 .

[36]  Nils Kolling,et al.  A neural mechanism underlying failure of optimal choice with multiple alternatives , 2014, Nature Neuroscience.

[37]  Dino J Levy,et al.  The neural computation of inconsistent choice behavior , 2019, Nature Communications.

[38]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[39]  W. Schultz,et al.  Orbitofrontal signals for two-component choice options comply with indifference curves of Revealed Preference Theory , 2019, Nature Communications.

[40]  A. Tversky.  Elimination by aspects: A theory of choice. , 1972 .

[41]  J. Anderson,et al.  Natural choice in nonhuman primates. , 1998, Journal of experimental psychology. Animal behavior processes.

[42]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[43]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[44]  Lesley K Fellows,et al.  Necessary Contributions of Human Frontal Lobe Subregions to Reward Learning in a Dynamic, Multidimensional Environment , 2016, The Journal of Neuroscience.

[45]  Hsin-Ju Lee,et al.  Why Do Irrelevant Alternatives Matter? An fMRI-TMS Study of Context-Dependent Preferences , 2017, The Journal of Neuroscience.

[46]  A. Tversky.  Intransitivity of preferences. , 1969 .

[47]  H. Stott.  Cumulative prospect theory's functional menagerie , 2006 .

[48]  Juan R. Vidal,et al.  Intracerebral γ modulations reveal interaction between emotional processing and action outcome evaluation in the human orbitofrontal cortex. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  A. Tversky,et al.  Context-dependent preferences , 1993 .

[50]  P. Samuelson.  A Note on the Pure Theory of Consumer's Behaviour , 1938 .

[51]  Ravi Dhar,et al.  Beyond rationality: The content of preferences , 2008 .

[52]  W. Schultz,et al.  Monkeys choose as if maximizing utility compatible with basic principles of revealed preference theory , 2017, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Caleb Warren,et al.  Values and Preferences: Defining Preference Construction , 2011, Wiley interdisciplinary reviews. Cognitive science.

[54]  Itamar Simonson,et al.  Will I Like a 'Medium' Pillow? Another Look at Constructed and Inherent Preferences , 2008 .

[55]  M. Beran,et al.  Natural Choice in Chimpanzees (Pan troglodytes): Perceptual and Temporal Effects on Selective Value. , 2009, Learning and motivation.

[56]  Gabriel Pelletier,et al.  A Critical Role for Human Ventromedial Frontal Lobe in Value Comparison of Complex Objects Based on Attribute Configuration , 2019, The Journal of Neuroscience.

[57]  W. Schultz,et al.  Dopamine Modulates the Neural Representation of Subjective Value of Food in Hungry Subjects , 2014, The Journal of Neuroscience.

[58]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[59]  W. Schultz,et al.  Reward Value Revealed by Auction in Rhesus Monkeys , 2019, The Journal of Neuroscience.

[60]  Syngjoo Choi,et al.  Consistency and heterogeneity of individual behavior under uncertainty , 2007 .

[61]  A. Mas-Colell,et al.  Microeconomic Theory , 1995 .

[62]  I. Fisher.  Mathematical Investigations in the Theory of Value and Prices , 1893 .

[63]  Value elicitation using BDM and a discrete choice mechanism , 2010 .

[64]  I. Bateman,et al.  A Test of the Theory of Reference-Dependent Preferences , 1997 .

[65]  M. Degroot,et al.  Measuring utility by a single-response sequential method. , 1964, Behavioral science.

[66]  M. Razzaghi.  The Probit Link Function in Generalized Linear Models for Data Mining Applications , 2013 .