Learning control systems--Review and outlook

The basic concept of learning control is introduced. The following five learning schemes are briefly reviewed: 1) trainable controllers using pattern classifiers, 2) reinforcement learning control systems, 3) Bayesian estimation, 4) stochastic approximation, and 5) stochastic automata models. Potential applications and problems for further research in learning control are outlined.

[1]  C. K. Chow,et al.  An optimum character recognition system using decision functions , 1957, IRE Trans. Electron. Comput..

[2]  Norman M. Abramson,et al.  Learning to recognize patterns in a random environment , 1962, IRE Trans. Inf. Theory.

[3]  J. Hsu,et al.  Decision-making in adaptive control systems , 1962 .

[4]  H. Robbins,et al.  On Optimal Stopping Rules , 1963 .

[5]  H. Teicher.  Identifiability of Finite Mixtures , 1963 .

[6]  K. Fu,et al.  A heuristic approach to reinforcement learning control systems , 1965 .

[7]  N. Ula,et al.  An empirical Bayes approach to adaptive control , 1965 .

[8]  King-Sun Fu,et al.  A learning control system using stochastic approximation for hill-climbing , 1965 .

[9]  J. Spragins,et al.  A note on the iterative application of Bayes' rule , 1965, IEEE Trans. Inf. Theory.

[10]  Daniel G. Keehn,et al.  A note on learning for Gaussian properties , 1965, IEEE Trans. Inf. Theory.

[11]  King-Sun Fu,et al.  A variable structure automaton used as a multi-modal searching technique , 1965 .

[12]  King-Sun Fu,et al.  A modified sequential recognition machine using time-varying stopping boundaries , 1966, IEEE Trans. Inf. Theory.

[13]  Jerry M. Mendel,et al.  Survey of learning control systems for space vehicle applications , 1966 .

[14]  K. Fu,et al.  On some reinforcement techniques and their relation to the stochastic approximation , 1966 .

[15]  R. W. Mclaren,et al.  A stochastic automaton model for the synthesis of learning systems , 1966 .

[16]  J. T. Tou,et al.  Steps toward learning control , 1966 .

[17]  King-Sun Fu,et al.  An algorithm for learning without external supervision and its application to learning control systems , 1966 .

[18]  B. Chandrasekaran,et al.  On expediency and convergence in variable structure automata , 1966 .

[19]  K. Fu,et al.  Learning system heuristics , 1966 .

[20]  Azaria Paz,et al.  Some aspects of Probabilistic Automata , 1966, Inf. Control..

[21]  John D. Spragins,et al.  Learning without a teacher , 1966, IEEE Trans. Inf. Theory.

[22]  J. Sklansky,et al.  Learning systems for automatic control , 1966 .

[23]  King-Sun Fu,et al.  A Dynamic Programming Approach to Sequential Pattern Recognition , 1967, IEEE Trans. Electron. Comput..

[24]  Lloyd Jones.  On the choice of subgoals for learning control systems , 1967 .

[25]  Y. T. CHIEN,et al.  On Bayesian Learning and Stochastic Approximation , 1967, IEEE Trans. Syst. Sci. Cybern..

[26]  Stanley C. Fralick,et al.  Learning to recognize patterns without a teacher , 1967, IEEE Trans. Inf. Theory.

[27]  Murray Garden,et al.  Learning control of valve actuators in direct digital control systems , 1967 .

[28]  A. Butz.  Learning bang-bang regulators , 1968 .

[29]  Ya Tsypkin,et al.  Self-learning--What is it? , 1968 .

[30]  Yu-Chi Ho,et al.  On pattern classification algorithms--Introduction and survey , 1968 .

[31]  M. Levine,et al.  Learning control heuristics , 1968 .

[32]  King-Sun Fu,et al.  Calamity Detection Using Nonparametric Statistics , 1969, IEEE Trans. Syst. Sci. Cybern..

[33]  King-Sun Fu,et al.  Formulation of learning automata and automata games , 1969, Inf. Sci..

[34]  King-Sun Fu,et al.  Stochastic Approximation Algorithms for System Identification, Estimation, and Decomposition of Mixtures , 1969, IEEE Trans. Syst. Sci. Cybern..

[35]  King-Sun Fu,et al.  A Formulation of Fuzzy Automata and Its Application as a Model of Learning Systems , 1969, IEEE Trans. Syst. Sci. Cybern..

[36]  K. S. Fu,et al.  Learning Control Systems , 1969 .

[37]  King-Sun Fu,et al.  On the selection of a subgoal and the use of a priori information in learning control systems , 1969, Autom..

[38]  King-Sun Fu,et al.  Stochastic Learning of Time-Varying Parameters in Random Environment , 1969, IEEE Trans. Syst. Sci. Cybern..

[39]  B. Chandrasekaran,et al.  Stochastic Automata Games , 1969, IEEE Trans. Syst. Sci. Cybern..

[40]  J. S. Riordon.  An adaptive automaton controller for discrete-time Markov processes , 1969 .

[41]  A. Ivakhnenko.  Heuristic self-organization in problems of engineering cybernetics , 1970 .

[42]  Martin D. Levine,et al.  A two-stage learning control system , 1970 .

[43]  Ray A. Jarvis,et al.  Adaptive Global Search in a Time-Variant Environment Using a Probabilistic Automaton with Pattern Recognition Supervision , 1970, IEEE Trans. Syst. Sci. Cybern..