Generation and Organization of Behaviors for Autonomous Robots

In this thesis, the generation and organization of behaviors for autonomous robots is studied within the framework of behavior-based robotics (BBR). Several different behavioral architectures have been considered in applications involving both bipedal and wheeled robots. In the case of bipedal robots, generalized finite-state machines (GFSMs) were used for generating a smooth gait for a (simulated) five-link bipedal model, constrained to move in the sagittal plane. In addition, robust balancing was achieved, even in the presence of perturbations. Furthermore, in simulations of a three-dimensional bipedal robot, gaits were generated using clusters of central pattern generators (CPGs) connected via a feedback network. A third architecture, namely a recurrent neural network (RNN), was used for generating several behaviors in a simulated, one-legged hopping robot. In all cases, evolutionary algorithms (EAs) were used for optimizing the behaviors. The important problem of behavioral organization has been studied using the utility function (UF) method, in which behavior selection is obtained through evolutionary optimization of utility functions that provide a common currency for the comparison of behaviors. In general, the UF method requires the use of simulations. Thus, an important part of this thesis has been the development of a general-purpose software library (UFLib) implementing the UF method. In order to study the properties of the UF method, several behavioral organization problems, mostly involving wheeled robots, have been considered. Most importantly, it was found that the UF method greatly simplifies the search for solutions to a wide variety of behavioral organization problems and requires a minimum of hand-coding. Furthermore, the results show that the use of multiple simulations (for the evaluation of a robot) significantly improves the ability of the robot to select appropriate behaviors. For the EA, it was found that the standard crossover procedure, which swaps entire utility functions between individuals, performed at least as well as several modified operators, and that the mutation rate should be set so as to generate around three parameter modifications per individual. Finally, some early results are presented concerning the use of the UF method in connection with a robot intended for transportation and delivery.

[1]  Paolo Pirjanian,et al.  Behavior Coordination Mechanisms - State-of-the-art , 1999 .

[2]  Julio Rosenblatt,et al.  DAMN: a distributed architecture for mobile navigation , 1997, J. Exp. Theor. Artif. Intell..

[3]  Inman Harvey,et al.  Optimal Mutation Rates and Selection Pressure in Genetic Algorithms , 2000, GECCO.

[4]  E. Ott.  Chaos in Dynamical Systems: Contents , 1993 .

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[7]  Chandana Paul,et al.  The road less travelled: morphology in the optimization of biped robot locomotion , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[8]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[9]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[10]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[11]  Pattie Maes,et al.  The Dynamics of Action Selection , 1989, IJCAI.

[12]  Kiyotoshi Matsuoka,et al.  Mechanisms of frequency and pattern control in the neural rhythm generators , 1987, Biological Cybernetics.

[13]  Charles H. Brown,et al.  Animal Behavior: Psychobiology, Ethology and Evolution, David McFarland. Benjamin/Cummings, Menlo Park, California (1985), xiv, +576, Price $28.95 , 1986 .

[14]  T. Brown.  The intrinsic factors in the act of progression in the mammal , 1911 .

[15]  Phil Husbands,et al.  Evolution of central pattern generators for bipedal walking in a real-time physics environment , 2002, IEEE Trans. Evol. Comput..

[16]  David E. Orin,et al.  Efficient Dynamic Computer Simulation of Robotic Mechanisms , 1982 .

[17]  Mattias Wahde.  A method for behavioural organization for autonomous robots based on evolutionary optimization of utility functions , 2003 .

[18]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[19]  Maja J. Mataric,et al.  A decision-theoretic approach to fuzzy behavior coordination , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[20]  Masaki Ogino,et al.  Reinforcement learning of humanoid rhythmic walking parameters based on visual information , 2004, Adv. Robotics.

[21]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[22]  Scott McMillan,et al.  Computational dynamics for robotic systems on land and under water , 1995 .

[23]  Hans P. Moravec.  Robot: Mere Machine to Transcendent Mind , 1998 .