Intelligent robot control using an adaptive critic with a task control center and dynamic database

The purpose of this paper is to describe the design, development and simulation of a real time controller for an intelligent, vision guided robot. The use of a creative controller that can select its own tasks is demonstrated. This creative controller uses a task control center and dynamic database. The dynamic database stores both global environmental information and local information including the kinematic and dynamic models of the intelligent robot. The kinematic model is very useful for position control and simulations. However, models of the dynamics of the manipulators are needed for tracking control of the robot's motions. Such models are also necessary for sizing the actuators, tuning the controller, and achieving superior performance. Simulations of various control designs are shown. Also, much of the model has also been used for the actual prototype Bearcat Cub mobile robot. This vision guided robot was designed for the Intelligent Ground Vehicle Contest. A novel feature of the proposed approach is that the method is applicable to both robot arm manipulators and robot bases such as wheeled mobile robots. This generality should encourage the development of more mobile robots with manipulator capability since both models can be easily stored in the dynamic database. The multi task controller also permits wide applications. The use of manipulators and mobile bases with a high-level control are potentially useful for space exploration, certain rescue robots, defense robots, and medical robotics aids.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  Keigo Watanabe,et al.  Control of nonholonomic mobile robot by an adaptive actor-critic method with simulated experience based value-functions , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Bernard Widrow,et al.  Punish/Reward: Learning with a Critic in Adaptive Threshold Systems , 1973, IEEE Trans. Syst. Man Cybern..

[4]  M. M. Lamego,et al.  Neurointerfaces - Control Systems Technology, IEEE Transactions on , 2001 .

[5]  Frank L. Lewis,et al.  Neural Network Control Of Robot Manipulators And Non-Linear Systems , 1998 .

[6]  Frank L. Lewis,et al.  Adaptive critic neural network for feedforward compensation , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[7]  G.G. Yen,et al.  Dynamic database approach for fault tolerant control using dual heuristic programming , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[8]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[9]  P. J. Werbos,et al.  Backpropagation and neurocontrol: a review and prospectus , 1989, International 1989 Joint Conference on Neural Networks.

[10]  Anthony Stentz,et al.  A mission planning system for multiple mobile robots in unknown, unstructured, and changing environments , 1998 .

[11]  Ernest L. Hall,et al.  Beyond adaptive-critic creative learning for intelligent mobile robots , 2001, SPIE Optics East.

[12]  ERNEST L. HALL,et al.  1 CREATIVE CONTROL FOR INTELLIGENT AUTONOMOUS MOBILE ROBOTS , 2003 .

[13]  Ernest L. Hall,et al.  A framework for the natural-language-perception-based creative control of unmanned ground vehicles , 2004, SPIE Defense + Commercial Sensing.

[14]  P. J. Werbos,et al.  Generalized maze navigation: SRN critics solve what feedforward or Hebbian nets cannot , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[15]  Frank L. Lewis,et al.  Robot Manipulator Control: Theory and Practice , 2003 .

[16]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .