Hierarchy and Sequence vs. Full Parallelism in Action Selection

Hierarchical organization has become an unfashionable model of intelligent control within some communities of both natural and artificial intelligence. What has replaced it are models based on parallel distributed processes, both neural and behavior based, or dynamical systems theory, which denies modularity, let alone rigorous structure. In this paper we present experimental results demonstrating an artificial reactive hierarchybased system that outperforms fully parallel systems in a highly dynamic environment with a large number of conflicting goals. This work is conducted in Tyrrell’s (1993) Simulated Environment and can be seen as an extension of his work on comparing action selection mechanisms. We observe that the hierarchical strategy has also been well demonstrated in nature. We argue that, for complex intelligences, preserving full reactivity may not be worth the cost in terms of the complexity of action selection.

[1]  Kristinn R. Th—risson A Mind Model for Multimodal Communicative Creatures & Humanoids , 1999 .

[2]  Hiroaki Kitano,et al.  RoboCup: The Robot World Cup Initiative , 1997, AGENTS '97.

[3]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[4]  J. K. Rosenblatt,et al.  A fine-grained alternative to the subsumption architecture for mobile robot control , 1989, International 1989 Joint Conference on Neural Networks.

[5]  Joanna J. Bryson,et al.  Making Modularity Work: Combining Memory Systems and Intelligent Processes in a Dialog Agent , 2000 .

[6]  L. Mandolesi Physiology of Behavior , 2002 .

[7]  E. Goldfield Emergent Forms: Origins and Early Development of Human Action and Perception , 1995 .

[8]  S. Ullman Visual routines , 1984, Cognition.

[9]  Jay Apt,et al.  A Mind Model for Multimodal Communicative Creatures & Humanoids , 1999 .

[10]  Nils J. Nilsson,et al.  Teleo-Reactive Programs for Agent Control , 1993, J. Artif. Intell. Res..

[11]  William Rowan,et al.  The Study of Instinct , 1953 .

[12]  Ian Horswill,et al.  Visual Routines and Visual Search: A Real-Time Implementation and an Automata-Theoretic Analysis , 1995, IJCAI.

[13]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[14]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[15]  N. Chater,et al.  Rational models of cognition , 1998 .

[16]  David Chapman,et al.  What are plans for? , 1990, Robotics Auton. Syst..

[17]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[18]  Joanna J. Bryson,et al.  The Study of Sequential and Hierarchical Organisation of Behaviour via Artificial Mechanisms of Acti , 2000 .

[19]  Joanna Bryson,et al.  Cross-paradigm analysis of autonomous agent architecture , 2000, J. Exp. Theor. Artif. Intell..

[20]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[21]  H. Evans The Study of Instinct , 1952 .

[22]  Kristinn R. Thórisson,et al.  Mind Model for Multimodal Communicative Creatures and Humanoids , 1999, Appl. Artif. Intell..

[23]  Steven Douglas Whitehead,et al.  Reinforcement learning for the adaptive control of perception and action , 1992 .

[24]  David P. Miller,et al.  Experiences with an architecture for intelligent, reactive agents , 1995, J. Exp. Theor. Artif. Intell..

[25]  Erann Gat,et al.  Reliable goal-directed reactive control of autonomous mobile robots , 1991 .

[26]  Mark Mayfield,et al.  Object models (2nd ed.): strategies, patterns, and applications , 1997 .

[27]  Leslie Pack Kaelbling,et al.  A Situated View of Representation and Control , 1995, Artif. Intell..

[28]  H. Hendriks-Jansen Catching Ourselves in the Act: Situated Activity, Interactive Emergence, Evolution, and Human Thought , 1996 .

[29]  T. Gelder,et al.  The dynamical hypothesis in cognitive science , 1998, Behavioral and Brain Sciences.

[30]  Joanna Bryson,et al.  Agent Architecture as Object Oriented Design , 1997, ATAL.

[31]  Toby Tyrrell,et al.  Computational mechanisms for action selection , 1993 .

[32]  Mark Humphreys,et al.  Action selection methods using reinforcement learning , 1997 .

[33]  David Chapman,et al.  Planning for Conjunctive Goals , 1987, Artif. Intell..

[35]  S. Wiener Spatial, behavioral and sensory correlates of hippocampal CA1 complex spike cell activity: Implications for information processing functions , 1996, Progress in Neurobiology.

[36]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[37]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[38]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[39]  Robin R. Murphy,et al.  Artificial intelligence and mobile robots: case studies of successful robot systems , 1998 .

[40]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[41]  Mark Mayfield,et al.  Object Models: Strategies, Patterns, and Applications , 1995 .