Behavior analysis and training-a methodology for behavior engineering

We propose Behavior Engineering as a new technological area whose aim is to provide methodologies and tools for developing autonomous robots. Building robots is a very complex engineering enterprise that requires the exact definition and scheduling of the activities which a designer, or a team of designers, should follow. Behavior Engineering is, within the autonomous robotics realm, the equivalent of more established disciplines like Software Engineering and Knowledge Engineering. In this article we first give a detailed presentation of a Behavior Engineering methodology, which we call Behavior Analysis and Training (BAT), where we stress the role of learning and training. Then we illustrate the application of the BAT methodology to three cases involving different robots: two mobile robots and a manipulator. Results show the feasibility of the proposed approach.

[1]  W. Royce.  Managing the development of large software systems: concepts and techniques , 2021, ICSE '87.

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[4]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[5]  Rodney A. Brooks,et al.  Learning to Coordinate Behaviors , 1990, AAAI.

[6]  Ronald C. Arkin,et al.  Integrating behavioral, perceptual, and world knowledge in reactive navigation , 1990, Robotics Auton. Syst..

[7]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[8]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[9]  Steven D. Whitehead,et al.  A Complexity Analysis of Cooperative Mechanisms in Reinforcement Learning , 1991, AAAI.

[10]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[11]  Marco Dorigo,et al.  Alecsys: A Parallel Laboratory for Learning Classifier Systems , 1991, ICGA.

[12]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[13]  Randall D. Beer,et al.  Evolving Dynamical Neural Networks for Adaptive Behavior , 1992, Adapt. Behav..

[14]  Marco Dorigo,et al.  Genetics-based machine learning and behavior-based robotics: a new synthesis , 1993, IEEE Trans. Syst. Man Cybern..

[15]  Marco Dorigo,et al.  Genetic and Non-Genetic Operators in ALECSYS , 1993, Evolutionary Computation.

[16]  Marco Colombetti,et al.  The Role of the Trainer in Reinforcement Learning , 1994, COLT 1994.

[17]  Marco Colombetti,et al.  The Effect of Sensory Information on Reinforcement Learning by a Robot Arm , 1994 .

[18]  Marco Colombetti,et al.  Robot Shaping: Developing Autonomous Agents Through Learning , 1994, Artif. Intell..

[19]  Marco Colombetti,et al.  Training Agents to Perform Sequential Behavior , 1994, Adapt. Behav..

[20]  Marco Dorigo,et al.  A comparison of Q-learning and classifier systems , 1994 .

[21]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[22]  M. Dorigo.  ALECSYS and the AutonoMouse: Learning to Control a Real Robot by Distributed Classifier Systems , 1995, Machine Learning.

[23]  Alessandro Saffiotti,et al.  A Multivalued Logic Approach to Integrating Planning and Control , 1995, Artif. Intell..