Partial, noisy and qualitative models for adaptive critic based neurocontrol

The roles of plant models in adaptive critic methods for approximate dynamic programming are considered, with primary focus given to the dynamic heuristic programming (DHP) methodology. For complete system identification, partial, approximate, and qualitative models of plant dynamics are considered. Such models are found to be sufficient for successful controller design. As classification is in general easier than regression, the results for qualitative models suggest an avenue for simplifying ongoing system identification in adaptive control applications.

[1]  Roberto A. Santiago,et al.  Adaptive critic designs: A case study for neurocontrol , 1995, Neural Networks.

[2]  Donald A. Sofge,et al.  Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches , 1992 .

[3]  Donald C. Wunsch,et al.  Adaptive critic designs and their applications , 1997 .

[4]  Nikita A. Visnevski.  Control of a nonlinear multivariable system with adaptive critic designs , 1997 .

[5]  George G. Lendaris,et al.  Training strategies for critic and action neural networks in dual heuristic programming method , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[6]  Eduardo D. Sontag,et al.  Neural Networks for Control , 1993 .

[7]  Paul J. Webros.  A menu of designs for reinforcement learning over time , 1990 .

[8]  Snehasis Mukhopadhyay,et al.  Adaptive control of nonlinear multivariable systems using neural networks , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[9]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  T. T. Shannon,et al.  Application considerations for the DHP methodology , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[11]  George G. Lendaris,et al.  More on training strategies for critic and action neural networks in dual heuristic programming method , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[12]  Paul J. Werbos,et al.  Approximate dynamic programming for real-time control and neural modeling , 1992 .