Optimization Strategies in Adaptive Control: A Selective Survey

A great number of techniques have been applied to the general problem of adaptive control. What began as a study of engineering adaptive control problems involving dynamics, system and measurement noise, monitoring, transduction, and on-line instrumentation seems to have moved towards learning theory and methodology research that uses a refined plant/environment model as a vehicle of demonstration. An attempt is made to bring together, order, and briefly discuss many contributions in this field, bridging the era of earlier engineering practice to more recent artificial intelligence speculation. Both unimodal and multimodal strategies are discussed, together with problems arising in nonstationary environmental situations where information conservation, update, and retrieval are of considerable importance. Methods discussed include gradient, correlation, random, stochastic automata, fuzzy automata, pattern recognition, and mixed strategies. A selected reference list is provided.

[1]  George H. Mealy,et al.  A method for synthesizing sequential circuits , 1955 .

[2]  J. Aseltine,et al.  A survey of adaptive control systems , 1958 .

[3]  Samuel H. Brooks.  A Discussion of Random Methods for Seeking Maxima , 1958 .

[4]  Samuel H. Brooks.  A Comparison of Maximum-Seeking Methods , 1959 .

[5]  V. Fabian.  STOCHASTIC APPROXIMATION METHODS , 1960 .

[6]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[7]  A. Bishop,et al.  Regression techniques in multivariate adaptive control systems , 1962 .

[8]  P.M.E.M. van der Grinten.  The application of random test signals in process optimization , 1963 .

[9]  P. H. Hammond,et al.  Automatic optimization by continuous perturbation of parameters , 1963, Autom..

[10]  J. L. Douce,et al.  The development and performance of a self-optimizing system , 1963 .

[11]  G. A. Bekey,et al.  Computing methods in optimization problems - Gradient methods for the optimization of dynamic system parameters by hybrid computation , 1963 .

[12]  Dean C. Karnopp,et al.  Random search techniques for optimization problems , 1963, Autom..

[13]  W. K. Taylor.  A pattern recognizing adaptive controller , 1963 .

[14]  K. C. Ng.  High-frequency perturbation in hill-climbing systems , 1964 .

[15]  J. L. Douce,et al.  The Response of Multichannel Adaptive Systems , 1964, IEEE Transactions on Applications and Industry.

[16]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[17]  S. H. Tsao.  Generation of delayed replicas of maximal-length linear binary sequences , 1964 .

[18]  M. Orban.  Some Questions of Learning Optimization of Large-Scale Processes , 1965 .

[19]  J. Roberts.  Extremum or hill-climbing regulation: a statistical theory involving lags, disturbances and noise , 1965 .

[20]  J. C. Hill,et al.  Hillclimbing on Hills with Many Minima , 1965 .

[21]  A.D.G. Hazlerigg,et al.  Application of crosscorrelating equipment to linear-system identification , 1965 .

[22]  L. Cooper,et al.  Sequential Search: A Method for Solving Constrained Optimization Problems , 1965, JACM.

[23]  Baxter F. Womack,et al.  A two-parameter adaptive system using a sinusoidal test signal , 1965 .

[24]  King-Sun Fu,et al.  A variable structure automaton used as a multi-modal searching technique , 1965 .

[25]  K. R. Godfrey,et al.  Pseudorandom signals for the dynamic analysis of multivariable systems , 1966 .

[26]  K. C. Ng,et al.  Dynamics of the parameter-perturbation process , 1966 .

[27]  D. Clarke,et al.  Simultaneous estimation of first and second derivatives of a cost function , 1966 .

[28]  David Clarke,et al.  Simulation study of a two-derivative hill climber , 1967 .

[29]  V. Fabian.  On the choice of design in stochastic approximation , 1968 .

[30]  B. Chandrasekaran,et al.  On Expediency and Convergence in Variable-Structure Automata , 1968, IEEE Trans. Syst. Sci. Cybern..

[31]  Kumpati S. Narendra,et al.  Use of Stochastic Automata for Parameter Self-Optimization with Multimodal Performance Criteria , 1969, IEEE Trans. Syst. Sci. Cybern..

[32]  J. Douglas Hill.  A Search Technique for Multimodal Surfaces , 1969, IEEE Trans. Syst. Sci. Cybern..

[33]  Moriya Oda.  Heuristic method of searching an optimum point of a two-dimensional multimodal criterion function , 1969 .

[34]  Nils J. Nilsson,et al.  A mobius automation: an application of artificial intelligence techniques , 1969, IJCAI 1969.

[35]  King-Sun Fu,et al.  A Formulation of Fuzzy Automata and Its Application as a Model of Learning Systems , 1969, IEEE Trans. Syst. Sci. Cybern..

[36]  B. Chandrasekaran,et al.  Stochastic Automata Games , 1969, IEEE Trans. Syst. Sci. Cybern..

[37]  Ray A. Jarvis,et al.  Adaptive Global Search in a Time-Variant Environment Using a Probabilistic Automaton with Pattern Recognition Supervision , 1970, IEEE Trans. Syst. Sci. Cybern..

[38]  Jasna Opacic.  A Heuristic Method for Finding Most Extrema of a Nonlinear Functional , 1973, IEEE Trans. Syst. Man Cybern..

[39]  Baxter F. Womack,et al.  A Survey of Heuristic Search Method of Multimodal Optimum Point , 1974 .

[40]  Ray A. Jarvis,et al.  Adaptive Global Search by the Process of Competitive Evolution , 1975, IEEE Transactions on Systems, Man, and Cybernetics.