Possibly optimal decision-making under self-sufficiency and autonomy

Any self sufficient autonomous agent faces multiple tasks to which it must sequence its behaviour if it is to manage its time appropriately. This paper considers the minimal multiple task scenario - the two resouce problem. Some possible mechanisms, inspired from ideas in ethology and having claim to perform optimally when analysed mathematically, are considered: one based on cost function and another based on motivational tendancies. Several variants of the mechanisms are implemented and tested in a continuous two dimensional simulation environment under a variety of conditions. Those mechanisms closely linked to cost functions do not perform well, are not adaptive, and dither. The mechansisms based on motivational tendancies perform better, are more adaptive, and demonstrate opportunism. The difficulty of finding effective mechanisms by using a functional perspective is noted.Copyright 1997 Academic Press Limited Copyright 1997 Academic Press Limited

[1]  A. Ludlow,et al.  Animal Behaviour: A Systems Approach, Frederick M. Toates. John Wiley, Chichester (1980), xi, +299. Price £6.40 , 1982 .

[2]  Bruce Blumberg,et al.  Action-selection in hamsterdam: lessons from ethology , 1994 .

[3]  M. Toda.  Man, robot, and society , 1981 .

[4]  M. Cabanac.  Pleasure: the common currency. , 1992, Journal of theoretical biology.

[5]  R. Sibly.  How incentive and deficit determine feeding tendency , 1975, Animal Behaviour.

[6]  Robin I. M. Dunbar.  Quantitative Ethology: The State Space Approach, D.J. McFarland, A. Houston. Pitman Books, London (1981), 204, Price £17.50 , 1983 .

[7]  R. McCleery,et al.  On satiation curves , 1977, Animal Behaviour.

[8]  David McFarland,et al.  On the measurement of motivational variables , 1976, Animal Behaviour.

[9]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[10]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[11]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[12]  Toby Tyrrell.  The Use of Hierarchies for Action Selection , 1993, Adapt. Behav..

[14]  J. Lichtenberg.  On motivational systems. , 1990, Journal of the American Psychoanalytic Association.

[15]  B. Habibi,et al.  Pengi : An Implementation of A Theory of Activity , 1998 .

[16]  J. R. P. Halperin,et al.  Machine motivation , 1991 .

[17]  J. K. Rosenblatt,et al.  A fine-grained alternative to the subsumption architecture for mobile robot control , 1989, International 1989 Joint Conference on Neural Networks.

[18]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[19]  Emmet Spier,et al.  A Finer-Grained Motivational Model of Behaviour Sequencing , 1996 .

[20]  Dave Cliff,et al.  Adding "Foveal Vision" to Wilson's Animat , 1993, Adapt. Behav..

[21]  Stewart W. Wilson.  The animat path to AI , 1991 .

[22]  Inman Harvey,et al.  Explorations in Evolutionary Robotics , 1993, Adapt. Behav..

[23]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[24]  D. McFarland,et al.  Intelligent behavior in animals and robots , 1993 .

[25]  H. Simon,et al.  Rational Choice and the Structure , 1956 .

[26]  D J McFarland,et al.  The behavioural final common path. , 1975, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  Pattie Maes,et al.  Toward the Evolution of Dynamical Neural Networks for Minimally Cognitive Behavior , 1996 .