Do we expect natural selection to produce rational behaviour?

We expect that natural selection should result in behavioural rules which perform well; however, animals (including humans) sometimes make bad decisions. Researchers account for these with a variety of explanations; we concentrate on two of them. One explanation is that the outcome is a side effect; what matters is how a rule performs (in terms of reproductive success). Several rules may perform well in the environment in which they have evolved, but their performance may differ in a ‘new’ environment (e.g. the laboratory). Some rules may perform very badly in this environment. We use the debate about whether animals follow the matching law rather than maximizing their gains as an illustration. Another possibility is that we were wrong about what is optimal. Here, the general idea is that the setting in which optimal decisions are investigated is too simple and may not include elements that add extra degrees of freedom to the situation.

[1]  Alasdair I. Houston,et al.  Natural selection and context-dependent values , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[2]  Colin W. Clark,et al.  Antipredator behavior and the asset-protection principle , 1994 .

[3]  G. Medley,et al.  The epidemiological consequences of optimisation of the individual host immune response , 2002, Parasitology.

[4]  A. Kacelnik,et al.  Risky Theories—The Effects of Variance on Foraging Decisions , 1996 .

[5]  J. Jokela,et al.  Dr. Pangloss restrained by the Red Queen : steps towards a unified defence theory , 2000 .

[6]  A. Houston,et al.  Violations of transitivity under fitness maximization , 2007, Biology Letters.

[7]  H. Arkes,et al.  The sunk cost and Concorde effects: Are humans less rational than lower animals? , 1999 .

[8]  Sergio Romagnani,et al.  The increased prevalence of allergy and the hygiene hypothesis: missing immune deviation, reduced immune suppression, or both? , 2004, Immunology.

[9]  A. Houston,et al.  The Common Currency for Behavioral Decisions , 1986, The American Naturalist.

[10]  K. Passino,et al.  Paradoxical preferences when options are identical , 2006, Behavioral Ecology and Sociobiology.

[11]  A. Houston,et al.  A theoretical investigation into the direct and indirect effects of state on the risk of predation. , 2001, Journal of theoretical biology.

[12]  Steven A. Frank,et al.  Models of Parasite Virulence , 1996, The Quarterly Review of Biology.

[13]  Howard Raiffa,et al.  Games And Decisions , 1958 .

[14]  S. Shettleworth Foraging, Memory, and Constraints on Learning , 1985, Annals of the New York Academy of Sciences.

[15]  Edmund Fantino,et al.  The delay-reduction hypothesis: Extension to three-alternative choice. , 1983 .

[16]  K. Binmore Rationality and Backward Induction , 1997 .

[17]  E. Dickson Rational Choice Epistemology and Belief Formation in Mass Politics , 2006 .

[18]  S Hale,et al.  Practical implications of the matching law. , 1984, Journal of applied behavior analysis.

[19]  M. Haselton,et al.  Adaptations, exaptations, and spandrels. , 1998, The American psychologist.

[20]  E. Fantino,et al.  Choice, optimal foraging, and the delay-reduction hypothesis , 1985, Behavioral and Brain Sciences.

[21]  R. Meisch,et al.  Human Methadone Self-Administration and the Generalized Matching Law , 2005 .

[22]  Edmund Fantino,et al.  Stochastic transitivity and the unidimensional control of choice , 1975 .

[23]  Franz J Weissing,et al.  The Evolutionary Economics of Immunity , 2004, The American Naturalist.

[24]  D. Stephens,et al.  Impulsiveness without discounting: the ecological rationality hypothesis , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  A. Houston Matching and ideal free distributions , 2008 .

[26]  A. Houston Violations of stochastic transitivity on concurrent chains: Implications for theories of choice. , 1991, Journal of the experimental analysis of behavior.

[27]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[28]  D. P. Strachan,et al.  Hay fever, hygiene, and household size. , 1989, BMJ.

[29]  M. Kirkpatrick,et al.  Mate choice rules in animals , 2006, Animal Behaviour.

[30]  T. Waite Intransitive preferences in hoarding gray jays (Perisoreus canadensis) , 2001, Behavioral Ecology and Sociobiology.

[31]  E. Dickson Expected utility violations evolve under status-based selection mechanisms. , 2008, Journal of theoretical biology.

[32]  Arthur J. Robson,et al.  Evolution and Human Nature , 2002 .

[33]  Edward Stein,et al.  Without good reason : the rationality debate in philosophy and cognitive science , 1996 .

[34]  S. Aoki,et al.  How many soldiers are optimal for an aphid colony? , 2004, Journal of theoretical biology.

[35]  Alasdair I. Houston,et al.  The optimal allocation of time during the diving cycle , 1992 .

[36]  Sasha R. X. Dall,et al.  Interruptions to foraging and learning in a changing environment , 1999, Animal Behaviour.

[37]  J. E. Mazur Two- versus three-alternative concurrent-chain schedules: a test of three models. , 2000, Journal of experimental psychology. Animal behavior processes.

[38]  S. Sutherland Irrationality: The Enemy Within , 1992 .

[39]  Michael Waldman,et al.  Systematic Errors and the Theory of Natural Selection , 1994 .

[40]  S. Shettleworth Animals foraging in the lab: Problems and promises. , 1989 .

[41]  A I Houston,et al.  How to maximize reward rate on two variable-interval paradigms. , 1981, Journal of the experimental analysis of behavior.

[42]  R. Karban,et al.  Defended Fortresses or Moving Targets? Another Model of Inducible Defenses Inspired by Military Metaphors , 1994, The American Naturalist.

[43]  R. Noland,et al.  Building new roads really does create extra traffic: a response to Prakash et al. , 2003 .

[44]  K. Arrow,et al.  Social Choice and Individual Values , 1951 .

[45]  J. M. Stahl,et al.  Optimal behavior and concurrent variable interval schedules , 2004 .

[46]  V. Smith Constructivist and Ecological Rationality in Economics , 2003 .

[47]  J. McNamara Optimal patch use in a stochastic environment , 1982 .

[48]  H. Simon,et al.  From substantive to procedural rationality , 1976 .

[49]  A. Silberberg,et al.  Human choice on concurrent variable-interval variable-ratio schedules. , 1991, Journal of the experimental analysis of behavior.

[50]  R. Luce,et al.  The Choice Axiom after Twenty Years , 1977 .

[51]  S. L. Lima Nonlethal Effects in the Ecology of Predator-Prey Interactions What are the ecological effects of anti-predator decision-making? , 1998 .

[52]  Alasdair I. Houston,et al.  The value of food: effects of open and closed economies , 1989, Animal Behaviour.

[53]  Charles Darwin,et al.  Journal of Researches into the Geology and Natural History of the Various Countries visited by H. M. S. Beagle , 2009 .

[54]  J. March Learning to be risk averse. , 1996 .

[55]  T. Day,et al.  A General Theory for the Evolutionary Dynamics of Virulence , 2004, The American Naturalist.

[56]  Anil K. Seth Evolving Behavioural Choice: An Investigation into Herrnstein's Matching Law , 1999, ECAL.

[57]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[58]  A. Kacelnik,et al.  State-Dependent Decisions Cause Apparent Violations of Rationality in Animal Choice , 2004, PLoS biology.

[59]  H. Simon Method and Appraisal in Economics: From substantive to procedural rationality , 1976 .

[60]  E. Fantino,et al.  Human choice in concurrent ratio-interval schedules of reinforcement. , 1994, Journal of the experimental analysis of behavior.

[61]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[62]  Maria Yazdanbakhsh,et al.  Allergy, parasites, and the hygiene hypothesis. , 2002, Science.

[63]  J. Busemeyer,et al.  A quantum probability explanation for violations of ‘rational’ decision theory , 2009, Proceedings of the Royal Society B: Biological Sciences.

[64]  Y. Iwasa,et al.  Optimal Mixed Strategies in Stochastic Environments , 1995 .

[65]  S. Hampton,et al.  Domain Mismatches, Scruffy Engineering, Exaptations and Spandrels , 2004 .

[66]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[67]  P. Abrams,et al.  ADAPTIVE RESPONSES OF PREDATORS TO PREY AND PREY TO PREDATORS: THE FAILURE OF THE ARMS‐RACE ANALOGY , 1986, Evolution; international journal of organic evolution.

[68]  Meanings of rationality , 2006 .

[69]  G M Heyman,et al.  OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR MORE ON CONCURRENT INTERVAL-RATIO SCHEDULES : A REPLICATION AND REVIEW GENE , 2005 .

[70]  S. Ellner,et al.  THE EVOLUTIONARILY STABLE PHENOTYPE DISTRIBUTION IN A RANDOM ENVIRONMENT , 1995, Evolution; international journal of organic evolution.

[71]  E. Sober The evolution of rationality , 2005, Synthese.

[72]  Arthur J. Robson,et al.  The evolution of rationality and the Red Queen , 2003, J. Econ. Theory.

[73]  S. Peltzman The Effects of Automobile Safety Regulation , 1975, Journal of Political Economy.

[74]  Rufus A. Johnstone,et al.  Optimal assessment of multiple cues , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[75]  G Blomquist A utility maximization model of driver traffic safety behavior. , 1986, Accident; analysis and prevention.

[76]  T. A. Hurly,et al.  Context–dependent foraging decisions in rufous hummingbirds , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[77]  R. A. Preston,et al.  Delay reduction: current status. , 1993, Journal of the experimental analysis of behavior.

[78]  J. McNamara THE POLICY WHICH MAXIMISES LONG-TERM SURVIVAL OF AN ANIMAL FACED WITH THE RISKS OF STARVATION AND PREDATION , 1990 .

[79]  Caste and ecology in the social insects , 1979 .

[80]  J. Busemeyer,et al.  Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice , 2006 .

[81]  E. Tenner Why things bite back : technology and the revenge effect , 1996 .

[82]  T. Keeler Highway Safety, Economic Behavior, and Driving Environment , 1991 .

[83]  A I Houston,et al.  Memory and the efficient use of information. , 1987, Journal of theoretical biology.

[84]  S. L. Lima Stress and Decision Making under the Risk of Predation: Recent Developments from Behavioral, Reproductive, and Ecological Perspectives , 1998 .

[85]  N Squires,et al.  A model for choice in simple concurrent and concurrent-chains schedules. , 1971, Journal of the experimental analysis of behavior.

[86]  E Fantino,et al.  Choice: Some quantitative relations. , 1983, Journal of the experimental analysis of behavior.

[87]  Gerd Gigerenzer,et al.  How can we open up the adaptive toolbox , 2000 .

[88]  Y. Iwasa,et al.  Dynamic optimization of host defense, immune memory, and post-infection pathogen levels in mammals. , 2004, Journal of theoretical biology.

[89]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[90]  Melissa Bateson,et al.  Context-dependent foraging choices in risk-sensitive starlings , 2002, Animal Behaviour.

[91]  A. Houston,et al.  The effect of foraging parameters on the probability that a dive is successful , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[92]  A. Houston,et al.  Optimal foraging and learning , 1985 .

[93]  W H Janssen,et al.  Considerations on speed selection and risk homeostasis in driving. , 1988, Accident; analysis and prevention.

[94]  A. Houston,et al.  Partial preferences and foraging , 1987, Animal Behaviour.

[95]  E Fantino,et al.  Transitivity as a property of choice. , 1972, Journal of the experimental analysis of behavior.

[96]  Alasdair I. Houston,et al.  Flying in the face of nature , 2009, Behavioural Processes.

[97]  Alan Grafen,et al.  Formal Darwinism, the individual–as–maximizing–agent analogy and bet–hedging , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[98]  L. A. Goodman,et al.  Social Choice and Individual Values , 1951 .

[99]  Richard Feldman Rationality, Reliability, and Natural Selection , 1988, Philosophy of Science.

[100]  E. Fantino Choice and rate of reinforcement. , 1969, Journal of the experimental analysis of behavior.

[101]  M. V. von Herrath,et al.  Infections and Autoimmunity—Good or Bad?1 , 2005, The Journal of Immunology.

[102]  J. J. McDowell,et al.  Two Modern Developments in Matching Theory , 1989, The Behavior analyst.

[103]  R. Cervero Road Expansion, Urban Growth, and Induced Travel: A Path Analysis , 2001 .

[104]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[105]  J. Hutchinson,et al.  Simple heuristics and rules of thumb: Where psychologists and behavioural biologists might meet , 2005, Behavioural Processes.

[106]  The control of foraging decisions , 1984, Behavioural Processes.

[107]  R. Herrnstein On the law of effect. , 1970, Journal of the experimental analysis of behavior.

[108]  Paul K. Moser,et al.  Rationality in action : contemporary approaches , 1990 .

[109]  Alasdair I. Houston,et al.  Risk-sensitive foraging: A review of the theory , 1992 .

[110]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[111]  S. Shafir Intransitivity of preferences in honey bees: support for 'comparative' evaluation of foraging options , 1994, Animal Behaviour.

[112]  A Houston,et al.  The matching law applies to wagtails' foraging in the wild. , 1986, Journal of the experimental analysis of behavior.

[113]  Donald L. Kramer,et al.  The behavioral ecology of air breathing by aquatic animals , 1988 .

[114]  I. Cuthill,et al.  Body mass regulation in response to changes in feeding predictability and overnight energy expenditure , 2000 .

[115]  A. Seth The ecology of action selection: insights from artificial life , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[116]  S. Shafir,et al.  Context-dependent violations of rational choice in honeybees (Apis mellifera) and gray jays (Perisoreus canadensis) , 2001, Behavioral Ecology and Sociobiology.

[117]  G. Heyman,et al.  How to teach a pigeon to maximize overall reinforcement rate. , 1995, Journal of the experimental analysis of behavior.

[118]  J. McNamara Implicit frequency dependence and kin selection in fluctuating environments , 1995, Evolutionary Ecology.

[119]  Melissa Bateson,et al.  Comparative evaluation and its implications for mate choice. , 2005, Trends in ecology & evolution.

[120]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[121]  A. Houston,et al.  A theoretical investigation of the effect of predators on foraging behaviour and energy reserves , 2005, Proceedings of the Royal Society B: Biological Sciences.

[122]  Alasdair I. Houston,et al.  Learning rules, matching and frequency dependence , 1987 .

[123]  Y. Iwasa,et al.  Prey Distribution as a Factor Determining the Choice of Optimal Foraging Strategy , 1981, The American Naturalist.

[124]  A Houston,et al.  The application of statistical decision theory to animal behaviour. , 1980, Journal of theoretical biology.

[125]  K. Manktelow,et al.  Rationality: Psychological and Philosophical Perspectives , 1993 .

[126]  J. McNamara,et al.  Risk-Prone Behaviour Under Rules Which Have Evolved in a Changing Environment , 1996 .

[127]  Y. Iwasa,et al.  Inducible defense against pathogens and parasites: optimal choice among multiple options. , 2001, Journal of theoretical biology.

[128]  A. Houston The optimal flight velocity for a bird exploiting patches of food , 1986 .

[129]  A. Houston,et al.  A framework for the functional analysis of behaviour , 1988, Behavioral and Brain Sciences.

[130]  K. Arrow Social Choice and Individual Values , 1951 .

[131]  R. Fuqua Comments on the applied relevance of the matching law. , 1984, Journal of applied behavior analysis.

[132]  Anil K. Seth,et al.  Modeling Group Foraging: Individual Suboptimality, Interference, and a Kind of Matching , 2001, Adapt. Behav..

[133]  R. Norberg,et al.  Optimal Flight Speed in Birds when Feeding Young , 1981 .

[134]  Takuya Kubo,et al.  Optimal distribution of defences: Are plants smart investors? , 1996 .

[135]  P. Abrams Why Predation Rate Should Not be Proportional to Predator Density , 1993 .

[136]  A. Houston,et al.  Starvation and Predation as Factors Limiting Population Size , 1987 .

[137]  John D. Hey,et al.  Experimental Economics and the Theory of Decision Making Under Risk and Uncertainty , 2002 .

[138]  R. Nozick THE NATURE OF RATIONALITY , 1995 .

[139]  R. Noland,et al.  A review of the evidence for induced travel and changes in transportation and environmental policy in the US and the UK , 2002 .

[140]  W D Pierce,et al.  The applied importance of research on the matching law. , 1995, Journal of applied behavior analysis.

[141]  Edmund Fantino,et al.  Stochastic transitivity and unidimensional behavior theories , 1974 .

[142]  I. Welch,et al.  On the Evolution of Overconfidence and Entrepreneurs , 2001 .

[143]  A. Houston,et al.  General results concerning the trade-off between gaining energy and avoiding predation , 1993 .

[144]  Steven Peterson,et al.  The Impact of Airbag Adoption on Relative Personal Injury and Absolute Collision Insurance Claims , 1994 .

[145]  Edmund J. Collins,et al.  Optimality Models in Behavioral Biology , 2001, SIAM Rev..

[146]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[147]  A. Tversky,et al.  Context-dependent preferences , 1993 .

[148]  John E. R. Staddon,et al.  Optimality principles and behavior: It's all for the best , 1981, Behavioral and Brain Sciences.

[149]  Alasdair I. Houston,et al.  The Effect of a Change in Foraging Options on Intake Rate and Predation Rate , 1994, The American Naturalist.

[150]  Peter Hammerstein,et al.  The second wave of evolutionary economics in biology. , 2005, Trends in ecology & evolution.

[151]  San Marco and evolutionary biology , 2009 .

[152]  C. Darwin Journal of researches into the geology and natural history of the various countries visited by H. M. S. Beagle, under the command of Captain Fitzroy, R. N. from 1832 to 1836 , 1839 .

[153]  A. Houston,et al.  The value of fat reserves and the tradeoff between starvation and predation , 1990, Acta biotheoretica.

[154]  C. Harley Learning the evolutionarily stable strategy. , 1981, Journal of theoretical biology.

[155]  S. Gould,et al.  The exaptive excellence of spandrels as a term and prototype. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[156]  Xiao-Jing Wang,et al.  A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses , 2006, The Journal of Neuroscience.

[157]  C. M. Bradshaw,et al.  Quantification of Steady-State Operant Behavior , 1982 .

[158]  A. Bender,et al.  The value of food , 1975 .

[159]  T. A. Hurly,et al.  Irrational choices in hummingbird foraging behaviour , 2002, Animal Behaviour.

[160]  Thomas A. Waite,et al.  Background context and decision making in hoarding gray jays , 2001 .

[161]  J. McNamara,et al.  Stress, resource allocation, and mortality , 2005 .

[162]  R. Luce,et al.  Operant matching is not a logical consequence of maximizing reinforcement rate , 1979 .

[163]  Raymond J. O'Connor,et al.  Models of Adaptive Behaviour: An Approach Based on State. , 2001 .

[164]  T. Andrew Hurly,et al.  Context-dependent, risk-sensitive foraging preferences in wild rufous hummingbirds , 1999, Animal Behaviour.