Toward the realization of intelligent controls

This is a paper of expository nature reflecting the author's past experiences, his current research efforts, and his aspirations about the future of automatic-control systems. It is not intended to give a quantitative analysis of modern control methodologies, which may be found in the bibliography at the end of the text, but rather emphasize the importance of a growing area in control engineering. Reviewing the classical, optimal, and stochastic control systems, the reader is led into the uncertainties and controversies of adaptive and learning controls. While self-organizing control was proposed for a systematic unification of these most advanced control methodologies, intelligent control--a discipline capable of high-level decision making and task execution--is predicted as the next level of sophistication in the hierarchy of control systems. A case study on a hierarchically intelligent controlled prosthesis, summarized herein, establishes the feasibility of the suggested methodologies. Future applications to other larse scale systems of general or specific scientific interest may prove the importance of such a discipline.

[1]  G. Saridis,et al.  Parameter identification and control of linear discrete-time systems , 1972 .

[2]  Jayant G. Deshpande,et al.  Optimal adaptive control: A non-linear separation theorem† , 1972 .

[3]  E. Tse,et al.  Further comments on "Adaptive stochastic control for a class of linear systems" , 1972 .

[4]  Rob J. Roy,et al.  A design procedure for discrete adaptive control systems. , 1966 .

[5]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[6]  Björn Wittenmark,et al.  On Self Tuning Regulators , 1973 .

[7]  J. S. Riordon.  An adaptive automaton controller for discrete-time Markov processes , 1969 .

[8]  King-Sun Fu,et al.  Formulation of learning automata and automata games , 1969, Inf. Sci..

[9]  V. S. Pugachev.  Optimal learning systems , 1971, Kybernetika.

[10]  R. Curry,et al.  A new algorithm for suboptimal stochastic control , 1969 .

[11]  Virgil W. Eveleigh,et al.  Adaptive Control And Optimization Techniques , 1967 .

[12]  Yaakov Bar-Shalom,et al.  Adaptive dual control for stochastic nonlinear systems with free end-time , 1974, CDC 1974.

[13]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[14]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .

[15]  Y. Bar-Shalom,et al.  On the optimal control of discrete-time linear systems with random parameters , 1969 .

[16]  Jerry M. Mendel,et al.  Survey of learning control systems for space vehicle applications , 1966 .

[17]  A. Butz.  Learning bang-bang regulators , 1968 .

[18]  Amos Freedy,et al.  A Computer-Based Learning System for Remote Manipulator Control , 1971, IEEE Trans. Syst. Man Cybern..

[19]  King-Sun Fu,et al.  An algorithm for learning without external supervision and its application to learning control systems , 1966 .

[20]  King-Sun Fu,et al.  Learning control systems--Review and outlook , 1970 .

[21]  R. Konakovsky,et al.  A Multimodal Searching Technique Using a Learning Controller , 1973 .

[22]  Kiyoji Asai,et al.  A method for optimizing control of multimodal systems using fuzzy automata , 1971, Inf. Sci..

[23]  W. Murphy.  Optimal stochastic control of discrete linear systems with unknown gain , 1968 .

[24]  George N. Saridis,et al.  Self-Organizing Approach to the Stochastic Fuel Regulator Problem , 1970, IEEE Trans. Syst. Sci. Cybern..

[25]  Daniel E. Whitney,et al.  State Space Models of Remote Manipulation Tasks , 1969, IJCAI.

[26]  N. Ula,et al.  An empirical Bayes approach to adaptive control , 1965 .

[27]  George N. Saridis,et al.  A learning approach to the parameter-adaptive self-organizing control problem , 1972 .

[28]  Nils J. Nilsson,et al.  A mobius automation: an application of artificial intelligence techniques , 1969, IJCAI 1969.

[29]  M. Levine,et al.  Learning control heuristics , 1968 .

[30]  King-Sun Fu,et al.  A Formulation of Fuzzy Automata and Its Application as a Model of Learning Systems , 1969, IEEE Trans. Syst. Sci. Cybern..

[31]  Fred C. Schweppe,et al.  Uncertain dynamic systems , 1973 .

[32]  King-Sun Fu,et al.  A variable structure automaton used as a multi-modal searching technique , 1965 .

[33]  Jerry M. Mendel,et al.  The Application of Techniques of Artificial Intelligence to Control System Design , 1968 .

[34]  K. Narendra,et al.  An adaptive procedure for controlling undefined linear processes , 1964 .

[35]  Ya.Z. Tsypkin.  Principles of Dynamic Adaptation in Automatic Systems , 1972 .

[36]  Henry Cox,et al.  On the estimation of state variables and parameters for noisy dynamic systems , 1964 .

[37]  Anthony Mucciardi,et al.  Elements of learning control systems with applications to industrial processes , 1972, CDC 1972.

[38]  David Sworder,et al.  Optimal adaptive control systems , 1966 .

[39]  Oscar Firschein,et al.  Forecasting and Assessing the Impact of Artificial Intelligence on Society , 1973, IJCAI.

[40]  Bernard Widrow,et al.  Pattern Recognition and Adaptive Control , 1964, IEEE Transactions on Applications and Industry.

[41]  J. Zaborszky,et al.  Stochastic optimal control of continuous time systems with unknown gain , 1968 .

[42]  J. Mendel,et al.  Discrete Techniques of Parameter Estimation: The Equation Error Formulation , 1973 .

[43]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[44]  Edward A. Patrick,et al.  On a class of unsupervised estimation problems , 1968, IEEE Trans. Inf. Theory.

[45]  Ian H. Witten,et al.  Comments on "Use of Stochastic Automata for Parameter Self-Optimization with Multimodal Performance Criteria" , 1972, IEEE Trans. Syst. Man Cybern..

[46]  K. S. Fuf.  Stochastic Automata, Stochastic Languages and Pattern Recognition , 1971 .

[47]  Karl K. Pingle,et al.  Computer control of a mechanical arm through visual input , 1968, IFIP Congress.

[48]  Kumpati S. Narendra,et al.  Stochastic Automata Models with Applications to Learning Systems , 1973, IEEE Trans. Syst. Man Cybern..

[49]  D. Naidu,et al.  Optimal Control Systems , 2018 .

[50]  King-Sun Fu,et al.  Stochastic Learning of Time-Varying Parameters in Random Environment , 1969, IEEE Trans. Syst. Sci. Cybern..

[51]  K. Fu,et al.  On state estimation in switching environments , 1968 .

[52]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[53]  Kumpati S. Narendra,et al.  A two-level system of stochastic automata for periodic random environments , 1971, CDC 1971.

[54]  J. J. Florentin,et al.  Optimal, Probing, Adaptive Control of a Simple Bayesian System† , 1962 .

[55]  Arthur M. Breipohl,et al.  An Error Correcting Procedure for Learning with an Imperfect Teacher , 1971, IEEE Trans. Syst. Man Cybern..

[56]  King-Sun Fu,et al.  Learning control systems and intelligent control systems: An intersection of artifical intelligence and automatic control , 1971 .

[57]  K. Fu,et al.  A heuristic approach to reinforcement learning control systems , 1965 .

[58]  S. Lakshmivarahan,et al.  Optimal non-linear reinforcement schemes for stochastic automata , 1972, Inf. Sci..

[59]  P. H. Swain,et al.  On Syntactic Pattern Recognition , 1971 .

[60]  Lloyd Jones.  On the choice of subgoals for learning control systems , 1967 .

[61]  Yaakov Bar-Shalom,et al.  Application of stochastic control theory to resource allocation under uncertainty , 1974 .

[62]  R. W. McLaren.  A Continuous-Valued Learning Controller for the global optimization of Stochastic Control Systems , 1971 .

[63]  Martin D. Levine,et al.  A two-stage learning control system , 1970 .

[64]  V. A. Yacubovich.  On a Method of Adaptive Control Under Conditions of Great Uncertainty , 1972 .

[65]  V. I. Varahavsky.  Automata Games and Control Problems , 1972 .

[66]  Daniel Graupe,et al.  Investigation of a Learning Control System with Interpolation , 1972, IEEE Trans. Syst. Man Cybern..

[67]  Jayant G. Deshpande,et al.  Adaptive control of linear stochastic systems , 1973 .

[68]  C. Desoer,et al.  Linear System Theory , 1963 .

[69]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[70]  James S. Meditch,et al.  Stochastic Optimal Linear Estimation and Control , 1969 .

[71]  Y. Bar-Shalom,et al.  Wide-sense adaptive dual control for nonlinear stochastic systems , 1973 .

[72]  Lotfi A. Zadeh,et al.  On Fuzzy Mapping and Control , 1996, IEEE Trans. Syst. Man Cybern..

[73]  J. H. Curtis,et al.  Learning Theory and Behavior , 1960 .

[74]  K. S. Fu,et al.  Learning Control Systems , 1969 .

[75]  B. Chandrasekaran,et al.  On Expediency and Convergence in Variable-Structure Automata , 1968, IEEE Trans. Syst. Sci. Cybern..

[76]  Harry E. Stephanou,et al.  A Hierarchical Approach to the Control of a Prosthetic Arm , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[77]  George N. Saridis.  Self-Organizing Control and Applications to Trainable Manipulators and Learning Prostheses , 1975 .

[78]  R. N. Lobbia,et al.  Identification and Control of Multivariable Stochastic Feedback Systems , 1973 .

[79]  R. W. Mclaren,et al.  A stochastic automaton model for the synthesis of learning systems , 1966 .

[80]  J. Farison,et al.  Identification and control of linear discrete systems , 1967, IEEE Transactions on Automatic Control.

[81]  Murray Garden,et al.  Learning control of valve actuators in direct digital control systems , 1967 .

[82]  J. M. Mendel,et al.  Applications of artificial intelligence techniques to a spacecraft control problem , 1967 .

[83]  H. Spang.  Optimum control of an unknown linear plant using Bayesian estimation of the error , 1964 .

[84]  J. Sklansky,et al.  Learning systems for automatic control , 1966 .

[85]  K. Narendra,et al.  Multiparameter self-optimizing systems using correlation techniques , 1964 .