A hybrid cognitive-reactive multi-agent controller

The purpose of this paper is to introduce a hybrid cognitive-reactive system, which integrates a machine-learning algorithm (SAMUEL, an evolutionary algorithm-based rule-learning system) with a computational cognitive model (written in ACT-R). In this system, the learning algorithm handles reactive aspects of the task and provides an adaptation mechanism, while the cognitive model handles cognitive aspects of the task and ensures the realism of the behavior. In this study, the controller architecture is used to implement a controller for a team of micro-air vehicles performing reconnaissance and surveillance.

[1]  Magdalena D. Bugajska,et al.  Building Adaptive Computer-Generated Forces: The Effect of Increasing Task Reactivity on Human and Machine Control Abilities , 2001 .

[2]  John J. Grefenstette,et al.  Learning sequential decision rules using simulation models and competition , 2004, Machine Learning.

[3]  Alan C. Schultz,et al.  Using a Genetic Algorithm to Learn Strategies for Collision Avoidance and Local Navigation. , 1990 .

[4]  James S. Albus,et al.  Four-dimensional/RCS reference model architecture for unmanned ground vehicles , 1999, Defense, Security, and Sensing.

[5]  Erann Gat,et al.  Experiences with an architecture for intelligent, reactive agents , 1997, J. Exp. Theor. Artif. Intell..

[6]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[7]  A. Newell.  Unified Theories of Cognition , 1990 .

[8]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[9]  J. G. Trafton,et al.  An activation-based model of memory for goals , 2002 .

[10]  Erwin R. Boer,et al.  Toward an Integrated Model of Driver Behavior in Cognitive Architecture , 2001 .

[11]  Magdalena D. Bugajska,et al.  An Investigation of How Humans and Machines Deal with Increases in Reactivity , 2001 .

[12]  Robert S. Cohen,et al.  On Scientific Discovery , 1981 .

[13]  James S. Albus,et al.  4-D/RCS reference model architecture for unmanned ground vehicles , 1999, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[14]  Annie S. Wu,et al.  Evolving control for distributed micro air vehicles , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[15]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[16]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[17]  John J. Grefenstette,et al.  Evolutionary Algorithms for Reinforcement Learning , 1999, J. Artif. Intell. Res..

[18]  Ronald Lumia,et al.  A Reference Model Architecture for ARTICS , 1991 .

[19]  Diego Calvanese,et al.  Unifying Class-Based Representation Formalisms , 2011, J. Artif. Intell. Res..

[20]  James S. Albus,et al.  The NIST Real-time Control System (RCS): an approach to intelligent systems research , 1997, J. Exp. Theor. Artif. Intell..