Utility maximization and melioration: Internalities in individual choice

How do people go about choosing between alternatives in relatively simple settings? This study explores some of the variables that past work suggests may be relevant. Volunteer subjects worked for money in six procedures in which the probability of a payment from either of two alternatives was 1.0, but the rate of pay (i.e. the speed with which a payment was delivered or the size of the payment) interacted with the subjects recent allocation of choices, which we define as the ‘internalities’. Because of the internalities, choosing the currently more profitable alternative did not maximize total earnings. Subjects were more likely to fail to maximize when the interaction between present pay and past choices was spread over longer sequences of choices, or when the reward variable was the speed, rather than the value, of each payment. Subjects often disregarded the internalities and were instead guided by the current yields of the two alternatives, which is a frequently observed tendency, called ‘melioration’, in experiments on choices by animals. The tendency toward melioration was only partially counteracted by explicit instructions on how to maximize earnings. We discuss a theoretical framework for melioration that postulates both motivational and cognitive sources.

[1]  S. S. Stevens,et al.  Handbook of experimental psychology , 1951 .

[2]  Rita Ricardo Campbell,et al.  Compulsory Health Insurance: The Economic Issues , 1952 .

[3]  A. Tversky Intransitivity of preferences. , 1969 .

[4]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[5]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[6]  R. L. Basmann,et al.  EXPERIMENTAL STUDIES OF CONSUMER DEMAND BEHAVIOR USING LABORATORY ANIMALS , 1975 .

[7]  G M Heyman,et al.  Is matching compatible with reinforcement maximization on concurrent variable interval variable ratio? , 1979, Journal of the experimental analysis of behavior.

[8]  R. Herrnstein,et al.  CHAPTER 5 – Melioration and Behavioral Allocation1 , 1980 .

[9]  J. Kagel,et al.  Demand Curves for Animal Consumers , 1981 .

[10]  Christopher P. Puto,et al.  Adding Asymmetrically Dominated Alternatives: Violations of Regularity & the Similarity Hypothesis. , 1981 .

[11]  R. Thaler,et al.  An Economic Theory of Self-Control , 1977, Journal of Political Economy.

[12]  J. Kagel,et al.  Maximization theory in behavioral psychology , 1981, Behavioral and Brain Sciences.

[13]  R. Thaler,et al.  An Economic Theory of Self-Control , 1977, Journal of Political Economy.

[14]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[15]  H Rachlin,et al.  Matching and maximizing with concurrent ratio-interval schedules. , 1983, Journal of the experimental analysis of behavior.

[16]  Thomas C. Schelling,et al.  Self-Command in Practice, in Policy, and in a Theory of Rational Choice , 1984 .

[17]  G M Heyman,et al.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR MORE ON CONCURRENT INTERVAL-RATIO SCHEDULES : A REPLICATION AND REVIEW GENE , 2005 .

[18]  Colin Camerer Do Biases in Probability Judgment Matter in Markets? Experimental Evidence , 1987 .

[19]  R. Herrnstein Rational Choice Theory Necessary but Not Sufficient , 1990 .

[20]  R. Herrnstein,et al.  Melioration: A Theory of Distributed Choice , 1991 .