Specious reward: a behavioral theory of impulsiveness and impulse control.

In a choice among assured, familiar outcomes of behavior, impulsiveness is the choice of less rewarding over more rewarding alternatives. Discussions of impulsiveness in the literature of economics, sociology, social psychology, dynamic psychology and psychiatry, behavioral psychology, and "behavior therapy" are reviewed. 'Impulsiveness seems to be best accounted for by the hyberbolic curves that have been found to describe the decline in effectiveness of rewards as the rewards are delayed from the time of choice. Such curves predict a reliable change of choice between some alternative rewards as a function of time. This change of choice provides a rationale for the known kinds of impulse control and relates them to several hitherto perplexing phenomena: behavioral rigidity, time-out from positive reinforcement, willpower, self-reward, compulsive traits, projection, boredom, and the capacity of punishing stimuli to attract attention.

[1]  J. Mill.  Principles of Political Economy , 2011, Forerunners of Realizable Values Accounting in Financial Reporting.

[2]  Alexander Bain,et al.  The Emotions and the Will , 1860, The British and foreign medico-chirurgical review.

[3]  J. Sully.  Outlines of Psychology , 1886 .

[4]  W. Jevons.  Theory of Political Economy , 1965 .

[5]  Alvin S. Johnson,et al.  The Sociological Theory of Capital. , 1907 .

[6]  S. Freud.  Beyond the Pleasure Principle , 1925 .

[7]  C. Warden,et al.  2. The Effect of Short Intervals of Delay in Feeding upon Speed of Maze Learning , 1927 .

[8]  J. B. Wolfe.  The effect of delayed reward upon learning in the white rat. , 1934 .

[9]  P. Samuelson.  A Note on Measurement of Utility , 1937 .

[10]  J. Dollard,et al.  Children of bondage , 1940 .

[11]  J. Dollard,et al.  Children of Bondage. , 1941 .

[12]  C. T. Perin.  The effect of delayed reinforcement upon the differentiation of bar responses in white rats. , 1943 .

[13]  C. T. Perin.  A quantitative investigation of the delay-of-reinforcement gradient. , 1943 .

[14]  William Foote Whyte,et al.  Street Corner Society , 1943 .

[15]  B. Skinner,et al.  Principles of Behavior , 1944 .

[16]  O. Mowrer,et al.  Time as a determinant in integrative learning. , 1945 .

[17]  C. L. Hull.  Principles of Behavior , 1945 .

[18]  R. Havighurst,et al.  Social Class and Color Differences in Child-Rearing , 1946 .

[19]  O. Mowrer.  On the dual nature of learning—a re-interpretation of "conditioning" and "problem-solving." , 1947 .

[20]  C. C. Perkins.  The relation of secondary reward to gradients of reinforcement. , 1947, Journal of experimental psychology.

[21]  On the psycho-analytic theory of thinking. , 1950 .

[22]  D. Berlyne.  NOVELTY AND CURIOSITY AS DETERMINANTS OF EXPLORATORY BEHAVIOUR1 , 1950 .

[23]  T. Parsons.  The Social System , 1953 .

[24]  F A LOGAN,et al.  The role of delay of reinforcement in determining reaction potential. , 1952, Journal of experimental psychology.

[25]  L. Leshan,et al.  Time orientation and social class. , 1952, Journal of abnormal psychology.

[26]  B. Skinner,et al.  Science and human behavior , 1953 .

[27]  D. Mcclelland,et al.  The Achievement Motive , 1954 .

[28]  C. Pechtel,et al.  NEUROSES IN MONKEYS: A PRELIMINARY REPORT OF EXPERIMENTAL OBSERVATIONS , 1953, Annals of the New York Academy of Sciences.

[29]  C. B. Ferster.  Sustained behavior under delayed reinforcement. , 1953, Journal of experimental psychology.

[30]  S. Freud.  The Standard Edition of the Complete Psychological Works of Sigmund Freud , 1953 .

[31]  H F HARLOW,et al.  Mice, monkeys, men, and motives. , 1953, Psychological review.

[32]  L. Schneider,et al.  The Deferred Gratification Pattern: A Preliminary Study , 1953 .

[33]  J. Singer.  Delayed gratification and ego development: implications for clinical and experimental research. , 1955, Journal of consulting psychology.

[34]  Donald M. Johnson,et al.  Time orientation in delinquents. , 1955, Journal of abnormal psychology.

[35]  D. Hebb.  Drives and the C.N.S. (conceptual nervous system). , 1955, Psychological review.

[36]  R. H. Strotz.  Myopia and Inconsistency in Dynamic Utility Maximization , 1955 .

[37]  R. T. Kelleher.  Conditioned reinforcement in chimpanzees. , 1957, Journal of Comparative and Physiological Psychology.

[38]  R. Woodworth.  Dynamics of behavior , 1958 .

[39]  J E TEAHAN,et al.  Future time perspective, optimism, and academic achievement. , 1958, Journal of abnormal psychology.

[40]  M. Glanzer.  Curiosity, exploratory drive, and stimulus satiation. , 1958, Psychological bulletin.

[41]  W. N. Dember,et al.  Spontaneous alternation behavior. , 1958, Psychological bulletin.

[42]  R. W. White.  Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[43]  Eugen von Böhm-Bawerk,et al.  Positive theory of capital , 2006 .

[44]  G. Spivack,et al.  Incentive, time conception and self control in a group of emotionally disturbed boys. , 1959, Journal of clinical psychology.

[45]  L. Melikian.  Preference for Delayed Reinforcement: An Experimental Study among Palestinian Arab Refugee Children , 1959 .

[46]  H. Becker.  Notes on the Concept of Commitment , 1960, American Journal of Sociology.

[47]  J. H. Curtis,et al.  Learning Theory and Behavior , 1960 .

[48]  J. Bastian,et al.  The achievement motive, goal setting, and probability preferences. , 1960, Journal of abnormal and social psychology.

[49]  T. Schelling,et al.  The Strategy of Conflict. , 1961 .

[50]  CORRELATED DELAY OF REINFORCEMENT 1 , 1961 .

[51]  G. Kimble,et al.  Hilgard and Marquis' Conditioning and learning , 1961 .

[52]  N H AZRIN,et al.  Time-out from Positive Reinforcement , 1961, Science.

[53]  S H REVUSKY,et al.  Collateral behavior in humans. , 1961, Journal of the experimental analysis of behavior.

[54]  A. W. Siegman.  The relationship between future time perspective, time. estimation, and impulse control in a group of young offenders and in a control group. , 1961, Journal of consulting psychology.

[55]  I. Bialer.  Conceptualization of success and failure in mentally retarded and normal children1 , 1961 .

[56]  M. Reich,et al.  Time orientation in male and female juvenile delinquents. , 1962, Journal of abnormal and social psychology.

[57]  M. Straus.  Deferred gratification, social class, and the achievement syndrome. , 1962 .

[58]  J. Davenport,et al.  The interaction of magnitude and delay of reinforcement in spatial discrimination. , 1962, Journal of comparative and physiological psychology.

[59]  W. Mischel,et al.  Preference for delayed reward as a function of age, intelligence, and length of delay interval. , 1962, Journal of abnormal and social psychology.

[60]  R. T. Kelleher,et al.  PERSISTENT BEHAVIOR MAINTAINED BY UNAVOIDABLE SHOCKS. , 1963, Journal of the experimental analysis of behavior.

[61]  A. Z. Weisz,et al.  Stratagems for controlling pain: Contributions of auditory stimulation and suggestion , 1963 .

[62]  J. B. Appel,et al.  Aversive aspects of a schedule of positive reinforcement. , 1963, Journal of The Experimental Analysis of Behavior.

[63]  A. Bandura,et al.  TRANSMISSION OF PATTERNS OF SELF-REINFORCEMENT THROUGH MODELING. , 1964, Journal of abnormal psychology.

[64]  C. B. Ferster,et al.  SOME NOTES ON TIME OUT FROM REINFORCEMENT. , 1964, Journal of the experimental analysis of behavior.

[65]  K. Renner.  DELAYED OF REINFORCEMENT: A HISTORICAL REVIEW. , 1964, Psychological bulletin.

[66]  W. Mischel,et al.  DELAY OF GRATIFICATION, MOTIVATION FOR THE PROHIBITED GRATIFICATION, AND RESPONSES TO TEMPTATION. , 1964, Journal of abnormal psychology.

[67]  SOME NOTES ON TIME OUT FROM REINFORCEMENT. , 1964, Journal of the experimental analysis of behavior.

[68]  W. Mischel,et al.  Effects of expectancy on working and waiting for larger rewards. , 1965, Journal of personality and social psychology.

[69]  A. Bandura,et al.  Modification of self-imposed delay of reward through exposure to live and symbolic models. , 1965, Journal of personality and social psychology.

[70]  Israel Goldiamond,et al.  Self-Control Procedures in Personal Behavior Problems , 1965, Psychological reports.

[71]  S. H. Chung,et al.  Effects of delayed reinforcement in a concurrent situation. , 1965, Journal of the experimental analysis of behavior.

[72]  F A LOGAN,et al.  DECISION MAKING BY RATS: DELAY VERSUS AMOUNT OF REWARD. , 1965, Journal of comparative and physiological psychology.

[73]  L. Homme.  Contiguity Theory and Contingency Management , 1966 .

[74]  Virginia E. Johnson,et al.  Human Sexual Response , 1966 .

[75]  A. Bandura,et al.  The influence of antecedent reinforcement and divergent modeling cues on patterns of self-reward. , 1966, Journal of personality and social psychology.

[76]  W. Mischel,et al.  Theory and research on the antecedents of self-imposed delay of reward. , 1966, Progress in experimental personality research.

[77]  John W. Atkinson,et al.  A theory of achievement motivation , 1966 .

[78]  E. Fantino.  Immediate reward followed by extinction vs. later reward without extinction , 1966 .

[79]  A J Neuringer,et al.  Effects of reinforcement magnitude on choice and rate of responding. , 1967, Journal of the experimental analysis of behavior.

[80]  R. Herrnstein,et al.  Choice and delay of reinforcement. , 1967, Journal of the experimental analysis of behavior.

[81]  H. Hartmann.  [Notes on the reality principle]. , 1967, Revue francaise de psychanalyse.

[82]  W. Mischel,et al.  Effects of success and failure on self-gratification. , 1968 .

[83]  J. Shybut.  Delay of gratification and severity of psychological disturbance among hospitalized psychiatric patients. , 1968, Journal of consulting and clinical psychology.

[84]  D. Pond.  Textbook of Clinical Psychiatry. , 1968 .

[85]  P. Killeen.  On the measurement of reinforcement frequency in the study of preference. , 1968, Journal of the experimental analysis of behavior.

[86]  J. Kulik,et al.  Future time perspective: its relation to the socialization process and the delinquent role. , 1968, Journal of consulting and clinical psychology.

[87]  J. Raynor,et al.  Future orientation and motivation of immediate activity: An elaboration of the theory of achievement motivation. , 1969 .

[88]  A. Davids.  Ego functions in disturbed and normal children: aspiration, inhibition, time estimation, and delayed gratification. , 1969, Journal of consulting and clinical psychology.

[89]  S. Schroeder,et al.  Reinforcement of eye movement with concurrent schedules. , 1969, Journal of the experimental analysis of behavior.

[90]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[91]  R. Herrnstein.  Method and theory in the study of avoidance. , 1969, Psychological review.

[92]  C P Shimp,et al.  The concurrent reinforcement of two interresponse times: the relative frequency of an interresponse time equals its relative harmonic length. , 1969, Journal of the experimental analysis of behavior.

[93]  S. Schroeder,et al.  REINFORCEMENT OF EYE MOVEMENT WITH CONCURRENT SCHEDULES1 , 1969 .

[94]  N. J. Lavik,et al.  FUTURE TIME PERSPECTIVE AND ADOLESCENT BEHAVIOUR DISORDERS , 1969, Acta psychiatrica Scandinavica.

[95]  J W McKearney,et al.  Fixed-interval schedules of electric shock presentation: extinction and recovery of performance under different shock intensities and fixed-interval durations. , 1969, Journal of the experimental analysis of behavior.

[96]  E W Herbert.  Two-key concurrent responding: response-reinforcement dependencies and blackouts. , 1970, Journal of the experimental analysis of behavior.

[97]  E. Ebbesen,et al.  Attention in delay of gratification. , 1970 .

[98]  N. Moray.  Attention: selective processes in vision and hearing , 1970 .

[99]  F. H. Kanfer.  Self-monitoring: Methodological limitations and clinical applications. , 1970 .

[100]  W. Parry‐Jones,et al.  Behaviour therapy in a case of hysterical blindness. , 1970, Behaviour research and therapy.

[101]  F. Logan,et al.  Relative effect of delay of food and water reward. , 1970 .

[102]  P. Killeen.  Preference for fixed-interval schedules of reinforcement. , 1970, Journal of the experimental analysis of behavior.

[103]  R. Walls,et al.  Development of preference for delayed reinforcement in disadvantaged children. , 1970, Journal of educational psychology.

[104]  M. Rilling,et al.  Differential reinforcement of low rates: A selective critique. , 1970 .

[105]  O. Pomerleau.  The effect of stimuli followed by response-independent shock on shock-avoidance behavior. , 1970, Journal of the experimental analysis of behavior.

[106]  F. H. Kanfer,et al.  Learning foundations of behavior therapy , 1970 .

[107]  R. McFall,et al.  Effects of self-monitoring on normal smoking behavior. , 1970, Journal of consulting and clinical psychology.

[108]  K. Renner,et al.  Self-punitive behavior-masochism or confusion? , 1971, Psychological review.

[109]  R. Stuart.  A three-dimensional program for the treatment of obesity. , 1971, Behaviour research and therapy.

[110]  B. Skinner.  Beyond Freedom and Dignity , 1972 .

[111]  B. Schwartz,et al.  Discrete-trials spaced responding in the pigeon: the dependence of efficient performance on the availability of a stimulus for collateral pecking. , 1971, Journal of the experimental analysis of behavior.

[112]  F. H. Kanfer,et al.  Self-control: A behavioristic excursion into the lion's den , 1972 .

[113]  M. Harris,et al.  Teaching self-control of study behavior. , 1972, Behaviour research and therapy.

[114]  E B Ebbesen,et al.  Cognitive and attentional mechanisms in delay of gratification. , 1972, Journal of personality and social psychology.

[115]  R. Herrnstein,et al.  Food-avoidance in hungry pigeons, and other perplexities. , 1972, Journal of the experimental analysis of behavior.

[116]  Seduction. A Conceptual Model in the Drug Dependencies and Other Contagious Ills , 1972 .

[117]  M. Mahoney,et al.  Research issues in self-management , 1972 .

[118]  H Rachlin,et al.  Commitment, choice and self-control. , 1972, Journal of the experimental analysis of behavior.

[119]  B. Strickland.  Delay of Gratification as a Function of Race of the Experimenter. , 1972 .

[120]  W. Mischel.  Toward a cognitive social learning reconceptualization of personality. , 1973, Psychological review.

[121]  D R Schmitt.  Effects of reinforcement rate and reinforcer magnitude on choice behavior of humans. , 1974, Journal of the experimental analysis of behavior.

[122]  Walter Mischel,et al.  Internal-external control and persistence: Validation and implications of the Stanford Preschool Internal-External Scale. , 1974 .

[123]  G. Ainslie,et al.  Impulse control in pigeons. , 1974, Journal of the experimental analysis of behavior.

[124]  M Sidman,et al.  Timeout as a reinforcer for errors in a serial position task. , 1974, Journal of the experimental analysis of behavior.