Hormonal Modulation of Perception in Motivation-Based Action Selection Architectures

The animat approach to artificial intelligence proposes biologically-inspired control mechanisms for autonomous robots. One of the related subproblems is action selection or “what to do next”. Many action selection architectures have been proposed. Motivation-based architectures implement a combination between internal and external stimuli to choose the appropriate behavior. Recent studies have pointed out that a second order mechanism to control motivation-based architectures would improve dramatically their performance. Drawing on the notion of biological hormones we have modeled two of the functionalities ascribed to them in order to improve the adaptivity of motivation-based architectures. We have tested our “hormone-like” mechanisms in dynamic and unpredictable robotic scenarios. We analyze the results in terms of interesting behavioral phenomena that emerge from the interaction of these artificial hormones with the rest of architectural elements.

[1]  Bruce Blumberg,et al.  Action-selection in hamsterdam: lessons from ethology , 1994 .

[2]  Jonathan Timmis,et al.  Timidity: A Useful Emotional Mechanism for Robot Control? , 2003, Informatica.

[3]  E. P. Animal Behaviour , 1901, Nature.

[4]  C. McKittrick,et al.  Animal models of social stress: effects on behavior and brain neurochemical systems , 2001, Physiology & Behavior.

[5]  William Rowan,et al.  The Study of Instinct , 1953 .

[6]  Martin Kavaliers,et al.  Antipredator responses and defensive behavior: ecological and ethological approaches for the neurosciences , 2001, Neuroscience & Biobehavioral Reviews.

[7]  Spier,et al.  Possibly optimal decision-making under self-sufficiency and autonomy , 1997, Journal of theoretical biology.

[8]  Christopher G. Langton,et al.  Artificial Life , 2019, Philosophical Posthumanism.

[9]  Jeffrey Meyer The animat approach to cognitive science , 1994 .

[10]  Stewart W. Wilson Knowledge Growth in an Artificial Animal , 1985, ICGA.

[11]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[12]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[13]  Kenneth L. Artis Design for a Brain , 1961 .

[14]  E. Kravitz Hormonal control of behavior: amines and the biasing of behavioral output in lobsters. , 1988, Science.

[15]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[16]  Pattie Maes,et al.  Modeling Adaptive Autonomous Agents , 1993, Artificial Life.

[17]  D. McFarland Motivational control systems analysis , 1974 .

[18]  Jean-Arcady Meyer,et al.  Computer simulations of adaptive behavior in animals , 1994, Proceedings of Computer Animation '94.

[19]  G. Griebel,et al.  Benzodiazepine and Serotonergic Modulation of Antipredator and Conspecific Defense , 1998, Neuroscience & Biobehavioral Reviews.

[20]  Ronald C. Arkin Homeostatic control for a mobile robot: Dynamic replanning in hazardous environments , 1992, J. Field Robotics.

[21]  I. René J. A. te Boekhorst,et al.  Analyzing the Performance of "Winner-Take-All" and "Voting-Based" Action Selection Policies within the Two-Resource Problem , 2003, ECAL.

[22]  S. L. Lima,et al.  Behavioral decisions made under the risk of predation: a review and prospectus , 1990 .

[23]  E. Curio,et al.  Proximate and Developmental Aspects of Antipredator Behavior , 1993 .

[24]  Trevor W. Robbins,et al.  Motivation and Reward , 2004, Science.

[25]  Orlando Avila-García,et al.  Using Hormonal Feedback to Modulate Action Selection in a Competitive Scenario , 2004 .

[26]  J. Lichtenberg On motivational systems. , 1990, Journal of the American Psychoanalytic Association.

[27]  Jean-Marc Fellous,et al.  From human emotions to robot emotions , 2004, AAAI 2004.

[28]  C. Blackstone The Neuron: Cell and Molecular Biology , 2003 .

[29]  H. Evans The Study of Instinct , 1952 .

[30]  Luc Steels,et al.  The "Artificial Life" Route to "Artificial Intelligence": Building Situated Embodied Agents , 1995 .