A systematic classification of neural-network-based control

Successful industrial applications and favorable comparisons with conventional alternatives have motivated the development of a large number of schemes for neural-network-based control. Each scheme is usually composed of several independent functional features, which makes it difficult to identify precisely what is new in the scheme. Help from available overviews is therefore often inadequate, since they usually discuss only the most important overall schemes. This work breaks the available schemes down to their essential functional features and organizes the latter into a multi-level classification. The classification reveals that similar schemes often get placed in different categories, fundamentally different features often get lumped into a single category, and proposed new schemes are often merely permutations and combinations of the well-established fundamental features. The classification has two main sections: neural network only as an aid; and neural network as controller.

[1]  Alberto Leva,et al.  Model-specific autotuning of classical regulators: A neural approach to structural identification , 1996 .

[2]  Wei-Song Lin,et al.  A neural network approach of input-output linearization of affine nonlinear systems , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[3]  Douglas J. Cooper,et al.  Using Pattern Recognition in Controller Adaptation and Performance Evaluation , 1993, 1993 American Control Conference.

[4]  S. M. Smith,et al.  Improving the dynamic response of neural network controllers using velocity reference feedback , 1993, IEEE Trans. Neural Networks.

[5]  L. P. J. Veelenturf,et al.  Neural Adaptive Feedback Linearization Control , 1996 .

[6]  Daniel Sbarbaro,et al.  Neural Networks for Nonlinear Internal Model Control , 1991 .

[7]  Frank L. Lewis,et al.  Multilayer neural-net robot controller with guaranteed tracking performance , 1996, IEEE Trans. Neural Networks.

[8]  Susan Rickard,et al.  Adaptive neuro-control for spacecraft attitude control , 1995, Neurocomputing.

[9]  R. Russell Rhinehart,et al.  Experimental comparison of a novel, simple, neural network controller and linear model based controllers , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[10]  Mitsuo Kawato,et al.  Recognition of manipulated objects by motor learning with modular architecture networks , 1991, Neural Networks.

[11]  M. M. Bayoumi,et al.  Feedback stabilization: control Lyapunov functions modelled by neural networks , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[12]  Panos J. Antsaklis,et al.  A Gaussian neural network implementation for control scheduling , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.

[13]  A. Sideris,et al.  A multilayered neural network controller , 1988, IEEE Control Systems Magazine.

[14]  Hiromitsu Ohmori,et al.  Novel Configuration of Nonlinear Adaptive Control Incorporating Neural Network , 1993 .

[15]  Sunwon Park,et al.  A new scheme combining neural feedforward control with model‐predictive control , 1992 .

[16]  Malur K. Sundareshan,et al.  Identification and decentralized adaptive control using dynamical neural networks with application to robotic manipulators , 1993, IEEE Trans. Neural Networks.

[17]  Jovan D. Bošković,et al.  Comparison of linear, nonlinear and neural-network-based adaptive controllers for a class of fed-batch fermentation processes , 1995, Autom..

[18]  Yoshitaka Togari,et al.  Piecewise linear controller improving its own reliability , 1996 .

[19]  Jong-Hwan Kim,et al.  CMAC network-based robust controller for systems with friction , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[20]  Ruo-Li Yang,et al.  Neural networks for exact solution of constrained optimal control problems , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[21]  A. Klopf,et al.  Drive-reinforcement learning: a self-supervised model for adaptive control , 1990 .

[22]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[23]  Edward S. Plumer,et al.  Optimal control of terminal processes using neural networks , 1996, IEEE Trans. Neural Networks.

[24]  Q. Henry Wu,et al.  A neural network regulator for turbogenerators , 1992, IEEE Trans. Neural Networks.

[25]  Liang Jin,et al.  Adaptive control of discrete-time nonlinear systems using recurrent neural networks , 1994 .

[26]  Santanu Chaudhury,et al.  Inversion of RBF networks and applications to adaptive control of nonlinear systems , 1995 .

[27]  Dale E. Seborg,et al.  Nonlinear internal model control strategy for neural network models , 1992 .

[28]  Thomas Niesler,et al.  Time-optimal control by means of neural networks , 1995 .

[29]  Marios M. Polycarpou,et al.  Stable adaptive neural control scheme for nonlinear systems , 1996, IEEE Trans. Autom. Control..

[30]  Imran A. Tasadduq,et al.  Neural-net controller for nonlinear plants: design approach through linearisation , 1994 .

[31]  Yoshiaki Ichikawa,et al.  Neural network application for direct feedback controllers , 1992, IEEE Trans. Neural Networks.

[32]  D. Sbarbaro,et al.  A nonlinear receding horizon controller based on connectionist models , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[33]  J. De Leon,et al.  Mechanical system tracking using neural networks , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[34]  Qi Chen,et al.  Dynamic optimization of nonlinear processes by combining neural net model with UDMC , 1994 .

[35]  Toshio Fukuda,et al.  Hierarchical intelligent control for robotic motion , 1994, IEEE Trans. Neural Networks.

[36]  Aah Ad Damen,et al.  Neural state transition controller for a polymerization reactor , 1996 .

[37]  Richard S. Sutton,et al.  Reinforcement Learning is Direct Adaptive Optimal Control , 1992, 1991 American Control Conference.

[38]  Hongbin Luo,et al.  Investigation of kinematics and inverse dynamics algorithm with a DSP implementation of a neural network , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[39]  S. Leonhardt,et al.  Parameter Estimation of Shock Absorbers with Artificial Neural Networks , 1993, 1993 American Control Conference.

[40]  V. H. Quintana,et al.  Neural Network Regulators for Synchronous Machines , 1993 .

[41]  T. H. Lee,et al.  A neural net control system with parallel adaptive enhancements , 1992, 1992 American Control Conference.

[42]  Nader Sadegh,et al.  A perceptron network for functional identification and control of nonlinear systems , 1993, IEEE Trans. Neural Networks.

[43]  Robert E. Jenkins,et al.  A simplified neural network solution through problem decomposition: the case of the truck backer-upper , 1993, IEEE Trans. Neural Networks.

[44]  P. Rujan,et al.  Hierarchical neural networks for time-series analysis and control , 1994 .

[45]  B. Ydstie Forecasting and control using adaptive connectionist networks , 1990 .

[46]  George W. Irwin,et al.  A novel neural internal model control structure , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[47]  Bernard Widrow,et al.  Application of neural networks to load-frequency control in power systems , 1994, Neural Networks.

[48]  Yao Zhang,et al.  An on-line trained adaptive neural controller , 1995 .

[49]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[50]  Douglas J. Cooper,et al.  Comparing two neural networks for pattern based adaptive process control , 1992 .

[51]  L.G. Kraft,et al.  A comparison between CMAC neural network control and two traditional adaptive control systems , 1990, IEEE Control Systems Magazine.

[52]  Jun Wang,et al.  A multilayer recurrent neural network for on-line synthesis of minimum-norm linear feedback control systems via pole assignment , 1996, Autom..

[53]  Robert F. Stengel,et al.  A System Identification Model for Adaptive Nonlinear Control , 1991 .

[54]  G. Allen Pugh Ship Directional Control by Synthetic Neural Network , 1990, 1990 American Control Conference.

[55]  Lyle H. Ungar,et al.  Adaptive networks for fault diagnosis and process control , 1990 .

[56]  Yaman Arkun,et al.  Study of the control-relevant properties of backpropagation neural network models of nonlinear dynamical systems , 1992 .

[57]  R. R. Rhinehart,et al.  A very simple structure for neural network control of distillation , 1995 .

[58]  Thomas Parisini,et al.  Neural networks for feedback feedforward nonlinear control systems , 1994, IEEE Trans. Neural Networks.

[59]  Bernard Widrow,et al.  Neural networks: applications in industry, business and science , 1994, CACM.

[60]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[61]  Julian Morris,et al.  Artificial neural networks in process estimation and control , 1992, Autom..

[62]  Dejan J. Sobajic,et al.  Neural-net computing and the intelligent control of systems , 1992 .

[63]  B. Widrow,et al.  Neural networks for self-learning control systems , 1990, IEEE Control Systems Magazine.

[64]  Frank L. Lewis,et al.  Feedback linearization using neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[65]  M. Agarwal Combining neural and conventional paradigms for modeling, prediction, and control , 1995, Proceedings of International Conference on Control Applications.

[66]  Kenneth A. Marko,et al.  Investigation of the Application of Neural Networks to Fault Tolerant Control of an Active Suspension System , 1992, 1992 American Control Conference.

[67]  R. Richter,et al.  A neural-network approach to the control of surface ships , 1996 .

[68]  Malur K. Sundareshan,et al.  A recurrent neural network-based adaptive variable structure model-following control of robotic manipulators , 1995, Autom..

[69]  R. De Keyser,et al.  Auto-tuning PID control using neural predictor to compensate large time-delay , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[70]  Abhijit S. Pandya,et al.  A recurrent neural network controller and learning algorithm for the on-line learning control of autonomous underwater vehicles , 1994, Neural Networks.

[71]  C. J. Li,et al.  Powell's method applied to learning neural control of three unknown dynamic systems , 1995 .

[72]  Mukul Agarwal,et al.  Predictive control of a bench-scale chemical reactor based on neural-network models , 1998, IEEE Trans. Control. Syst. Technol..

[73]  J. Suykens,et al.  Neural control theory : an overview , 1996 .

[74]  Y. M. Enab,et al.  Intelligent controller design for the ship steering problem , 1996 .

[75]  David M. Himmelblau,et al.  Process control via artificial neural networks and reinforcement learning , 1992 .

[76]  Anthony J. Calise,et al.  Helicopter adaptive flight control using neural networks , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[77]  H.E. Rauch Intelligent fault diagnosis and control reconfiguration , 1994, IEEE Control Systems.

[78]  J. Suykens,et al.  Nonlinear system identification using neural state space models, applicable to robust control design , 1995 .

[79]  Anuradha M. Annaswamy,et al.  Control of nonlinear dynamic systems using a stability based neural network approach , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[80]  Kwang Y. Lee,et al.  An optimal tracking neuro-controller for nonlinear dynamic systems , 1996, IEEE Trans. Neural Networks.

[81]  Enis Ersü,et al.  Learning control with interpolating memories―general ideas, design lay-out, theoretical approaches and practical applications , 1992 .

[82]  Mitsuo Kawato,et al.  Neural network control for a closed-loop System using Feedback-error-learning , 1993, Neural Networks.

[83]  Ah Chung Tsoi,et al.  Single net indirect learning architecture , 1994, IEEE Trans. Neural Networks.

[84]  Albert Y. Zomaya,et al.  Feedback Control of Minimum-Time Optimal Control Problems using Neural Networks , 1993 .

[85]  Thierry Catfolis,et al.  Neural network architecture for process control based on the RTRL algorithm , 1996 .

[86]  B. Roffel,et al.  Neural network based control of chemical processes , 1996 .

[87]  Ole Henning Sørensen Non-linear Pole-placement Control with a Neural Network , 1996, Eur. J. Control.

[88]  B. Bavarian,et al.  Compensation of unstructured uncertainty in manipulators using neural networks , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[89]  Wolfram Schiffmann,et al.  Adaptive control of dynamic systems by back propagation networks , 1993, Neural Networks.

[90]  Marco Saerens,et al.  Neural controller based on back-propagation algorithm , 1991 .

[91]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[92]  David Shan-Hill Wong,et al.  Optimal multiloop feedback design using simulated annealing and neural network , 1995 .

[93]  Malur K. Sundareshan,et al.  Adaptive variable structure control of flexible manipulators by neural network payload identification , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[94]  Sangbong Park,et al.  A neuro-genetic controller for nonminimum phase systems , 1995, IEEE Trans. Neural Networks.

[95]  Thomas J. McAvoy,et al.  Neural net based model predictive control , 1991 .

[96]  Denny K. Miu,et al.  Unsupervised Adaptive Neural-Network Control of Complex Mechanical Systems , 1991, 1991 American Control Conference.

[97]  Vijaykumar Gullapalli,et al.  Direct associative reinforcement learning methods for dynamic systems control , 1995, Neurocomputing.

[98]  C. J. Goh,et al.  On the nonlinear optimal regulator problem , 1993, Autom..

[99]  Snehasis Mukhopadhyay,et al.  Adaptive control of nonlinear multivariable systems using neural networks , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[100]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[101]  Derek A. Linkens,et al.  FCMAC: A fuzzified cerebellar model articulation controller with self-organizing capacity , 1994, Autom..

[102]  K. Khorasani,et al.  A neural network architecture, for model reference adaptive control , 1990, 29th IEEE Conference on Decision and Control.

[103]  Dale E. Seborg,et al.  A Nonlinear Predictive Control Strategy Based on Radial Basis Function Networks , 1992 .

[104]  Richard S. Sutton,et al.  Connectionist Learning for Control , 1995 .

[105]  A. Guez,et al.  A Comparison of Three Nonlinear Controller Designs Applied to a Non-Adiabatic First-Order Exothermic Reaction in a CSTR , 1992, 1992 American Control Conference.

[106]  Petros A. Ioannou,et al.  Traffic flow modeling and control using artificial neural networks , 1996 .

[107]  Sebastian Engell,et al.  Model Predictive Control Using Neural Networks [25 Years Ago] , 1995, IEEE Control Systems.

[108]  Hideaki Sakai,et al.  A nonlinear regulator design in the presence of system uncertainties using multilayered neural network , 1991, IEEE Trans. Neural Networks.

[109]  Russell C. Eberhart Standardization of neural network terminology , 1990, IEEE Trans. Neural Networks.

[110]  Charles C. Jorgensen,et al.  A neural network baseline problem for control of aircraft flare and touchdown , 1990 .

[111]  J.-P. Jiang,et al.  Supervised learning control of a nonlinear polymerisation reactor using the CMAC neural network for knowledge storage , 1994 .

[112]  P. S. Sastry,et al.  Memory neuron networks for identification and control of dynamical systems , 1994, IEEE Trans. Neural Networks.

[113]  Dejan J. Sobajic,et al.  Nonlinear process control with neural nets , 1990, Neurocomputing.

[114]  Heikki N. Koivo,et al.  Real-Time Neural Network Control - An IMC Approach , 1993 .

[115]  K. Warwick,et al.  Dynamic recurrent neural network for system identification and control , 1995 .

[116]  Jenq-Neng Hwang,et al.  Iterative inversion of neural networks and its application to adaptive control , 1992, IEEE Trans. Neural Networks.

[117]  Daniel Sbarbaro,et al.  Control of a pH Plant Using Connectionist Representations , 1993 .

[118]  H. M. Mashaly,et al.  A photovoltaic maximum power tracking using neural networks , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[119]  R.T. Newton,et al.  Neural network control of a space manipulator , 1993, IEEE Control Systems.

[120]  George W. Irwin,et al.  Direct neural model reference adaptive control , 1995 .

[121]  Frank L. Lewis,et al.  Multilayer discrete-time neural-net controller with guaranteed performance , 1996, IEEE Trans. Neural Networks.

[122]  R. J. Green,et al.  Neural network learning approach of intelligent multimodel controller , 1996 .

[123]  Baxter F. Womack,et al.  Adaptive Control Using Neural Networks , 1991 .

[124]  Mitsuo Kawato,et al.  A neural network model for arm trajectory formation using forward and inverse dynamics models , 1993, Neural Networks.

[125]  Michael Nikolaou,et al.  Control of nonlinear dynamical systems modeled by recurrent neural networks , 1993 .

[126]  K S Narendra,et al.  Control of nonlinear dynamical systems using neural networks. II. Observability, identification, and control , 1996, IEEE Trans. Neural Networks.

[127]  V. Gullapalli,et al.  Acquiring robot skills via reinforcement learning , 1994, IEEE Control Systems.

[128]  D. Lowe On the iterative inversion of RBF networks: a statistical interpretation , 1991 .

[129]  Douglas J. Cooper,et al.  A neural network strategy for disturbance pattern classification and adaptive multivariable control , 1995 .

[130]  Kumpati S. Narendra,et al.  Regulation of Nonlinear Dynamical Systems Using Multiple Neural Networks , 1991, 1991 American Control Conference.

[131]  Peter H. Meckl,et al.  An analytical comparison of a neural network and a model-based adaptive controller , 1993, IEEE Trans. Neural Networks.

[132]  Luigi Piroddi,et al.  GMV technique for nonlinear control with neural networks , 1994 .

[133]  Kumpati S. Narendra,et al.  Control of nonlinear dynamical systems using neural networks: controllability and stabilization , 1993, IEEE Trans. Neural Networks.

[134]  P.J. Werbos,et al.  An overview of neural networks for control , 1991, IEEE Control Systems.

[135]  J. Sitte,et al.  A cartpole experiment benchmark for trainable controllers , 1993, IEEE Control Systems.

[136]  Joos Vandewalle,et al.  A Rule-Based Neural Controller For Inverted Pendulum System , 1993, Int. J. Neural Syst..

[137]  Eduardo F. Camacho,et al.  Neural network based adaptive control , 1994 .

[138]  J. Spall,et al.  Direct adaptive control of nonlinear systems using neural networks and stochastic approximation , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[139]  Mukul Agarwal,et al.  Combining neural and conventional paradigms for modelling, prediction and control , 1997, Int. J. Syst. Sci..

[140]  C. J. Harris,et al.  Neural Networks for Modelling and Control , 1994 .

[141]  Hassan K. Khalil,et al.  Adaptive control of a class of nonlinear discrete-time systems using neural networks , 1995, IEEE Trans. Autom. Control..

[142]  S. Schaal,et al.  Robot juggling: implementation of memory-based learning , 1994, IEEE Control Systems.

[143]  Ai Poh Loh,et al.  Neural network modelling and control strategies for a pH process , 1995 .

[144]  Seul Jung,et al.  A new neural network control technique for robot manipulators , 1995, Robotica.

[145]  Manolis A. Christodoulou,et al.  Adaptive control of unknown plants using dynamical neural networks , 1994, IEEE Trans. Syst. Man Cybern..

[146]  R.N.K. Loh,et al.  Neural network-based successive one-step-ahead control of nonlinear systems , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[147]  Mohammad Bahrami,et al.  Model Reference Direct Adaptive Control of Nonlinear Plants Using Neural Networks , 1994, Int. J. Neural Syst..

[148]  A. L. Dexter,et al.  Neural control of non-linear HVAC plant , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[149]  Satish S. Nair,et al.  A New Neural Network Control Architecture for a Class of Nonlinear Dynamic Systems , 1993, 1993 American Control Conference.

[150]  Anthony Tzes,et al.  Neural network design with genetic learning for control of a single link flexible manipulator , 1994, J. Intell. Robotic Syst..

[151]  Stefen Hui,et al.  Application of feedforward neural networks to dynamical system identification and control , 1993, IEEE Trans. Control. Syst. Technol..

[152]  Marzuki Khalid,et al.  MIMO furnace control with neural networks , 1993, IEEE Trans. Control. Syst. Technol..

[153]  Umit Ozguner,et al.  Synthesis of feedback linearization and variable structure control with neural net compensation , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.

[154]  M. E. Ahmed Block partial derivative and its application to neural-net-based direct model-reference adaptive control , 1994 .

[155]  M.M. Gupta,et al.  Dynamic Neural Adaptive Control Schemes for Linear and Nonlinear Systems , 1993, 1993 American Control Conference.

[156]  James E. Steck,et al.  Linear and neural network feedback for flight control decoupling , 1996 .

[157]  G. M. Geary,et al.  A neural network based RLS parameter estimation algorithm and its application in predictive control , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[158]  Roberto A. Santiago,et al.  Adaptive critic designs: A case study for neurocontrol , 1995, Neural Networks.

[159]  W. Harmon Ray,et al.  Experiences with model-based controllers based on neural network process models , 1993 .

[160]  Eduardo F. Camacho,et al.  Adaptive control and neural networks , 1996 .

[161]  Q. H. Wu,et al.  Reinforcement learning control of unknown dynamic systems , 1993 .