Extremum seeking from 1922 to 2010

Extremum seeking is a form of adaptive control where the steady-state input-output characteristic is optimized, without requiring any explicit knowledge about this input-output characteristic other than that it exists and that it has an extremum. Because extremum seeking is model free, it has proven to be both robust and effective in many different application domains. Equally being model free, there are clear limitations to what can be achieved. Perhaps paradoxically, although being model free, extremum seeking is a gradient based optimization technique. Extremum seeking relies on an appropriate exploration of the process to be optimized to provide the user with an approximate gradient, and hence the means to locate an extremum. These observations are elucidated in the paper. Using averaging and time-scale separation ideas more generally, the main behavioral characteristics of the simplest (model free) extremum seeking algorithm are established.

[1]  Michel Perrier,et al.  A global optimization method based on multi-unit extremum-seeking for scalar nonlinear systems , 2011, Comput. Chem. Eng..

[2]  Chris Manzie,et al.  Newton-Like Extremum-Seeking for the Control of Thermoacoustic Instability , 2010, IEEE Transactions on Automatic Control.

[3]  Miroslav Krstic,et al.  Stochastic averaging in continuous time and its applications to extremum seeking , 2010, Proceedings of the 2010 American Control Conference.

[4]  Eugenio Schuster,et al.  Boundary feedback control for heat exchange enhancement in 2D magnetohydrodynamic channel flow by extremum seeking , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[5]  Milos S. Stankovic,et al.  Discrete time extremum seeking by autonomous vehicles in a stochastic environment , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[6]  Takao Sato,et al.  Design of weigh feeder control system using extremum-seeking method , 2009, 2009 7th Asian Control Conference.

[7]  Dragan Nešić,et al.  Extremum seeking control: Convergence analysis , 2009, 2009 European Control Conference (ECC).

[8]  Maarten Steinbuch,et al.  Improving pushbelt continuously variable transmission efficiency via extremum seeking control , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[9]  Yaoyu Li,et al.  Extremum seeking control for efficient and reliable operation of air-side economizers , 2009, 2009 American Control Conference.

[10]  Ümit Özgüner,et al.  Variable structure extremum seeking control based on sliding mode gradient estimation for a class of nonlinear systems , 2009, 2009 American Control Conference.

[11]  Miroslav Krstic,et al.  Extremum seeking with very slow or drifting sensors , 2009, 2009 American Control Conference.

[12]  Scott J. Moura,et al.  Air flow control in fuel cell systems: An extremum seeking approach , 2009, 2009 American Control Conference.

[13]  Eugenio Schuster,et al.  Mixing enhancement in 2D magnetohydrodynamic channel flow by extremum seeking boundary control , 2009, 2009 American Control Conference.

[14]  Sanjeev R. Kulkarni,et al.  Maximum power point tracking for photovoltaic optimization using extremum seeking , 2009, 2009 34th IEEE Photovoltaic Specialists Conference (PVSC).

[15]  A. Astolfi,et al.  A new extremum seeking technique and its application to maximize RF heating on FTU , 2009 .

[16]  Ying Tan,et al.  On extremum seeking in bioprocesses with multivalued cost functions , 2009, Biotechnology progress.

[17]  Miroslav Krstic,et al.  HCCI Engine Combustion-Timing Control: Optimizing Gains and Fuel Consumption Via Extremum Seeking , 2009, IEEE Transactions on Control Systems Technology.

[18]  Roberto Oboe,et al.  Automatic Mode Matching in MEMS Vibrating Gyroscopes Using Extremum-Seeking Control , 2009, IEEE Transactions on Industrial Electronics.

[19]  Miroslav Krstic,et al.  Nonholonomic Source Seeking With Tuning of Angular Velocity , 2009, IEEE Transactions on Automatic Control.

[20]  Chris Manzie,et al.  Extremum Seeking With Stochastic Perturbations , 2009, IEEE Transactions on Automatic Control.

[21]  Chunlei Zhang,et al.  Robust and adaptive design of numerical optimization-based extremum seeking control , 2009, Autom..

[22]  H. Ishigaki,et al.  Optimum integrated design of mechanical structure/controller using bargaining game theory , 2008, 2008 International Conference on Control, Automation and Systems.

[23]  R. Oboe,et al.  Mode-matching in vibrating microgyros using an extremum seeking controller with switching logic , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[24]  M. Walker,et al.  Design and simulation of extremum-seeking open-loop optimal control of current profile in the DIII-D tokamak , 2008 .

[25]  Masaki Yamakita,et al.  Liquid environment-adaptive IPMC fish-like robot using extremum seeking feedback , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Denis Dochain,et al.  Extremum-seeking control of retention for a microparticulate system , 2008 .

[27]  Mihaela Cistelecan,et al.  Power control in mobile wireless networks using sliding mode extremum seeking control implementing bifurcations , 2008, 2008 IEEE International Conference on Control Applications.

[28]  R. King,et al.  Extensions of adaptive slope-seeking for active flow control , 2008 .

[29]  M. Krstic,et al.  Extremum seeking for motion optimization: From bacteria to nonholonomic vehicles , 2008, 2008 Chinese Control and Decision Conference.

[30]  Dragan Nesic,et al.  Extremum Seeking Control of Cascaded Raman Optical Amplifiers , 2008, IEEE Transactions on Control Systems Technology.

[31]  L. Gurvich,et al.  Analysis and methods for control of objects with quasi-static time-dependent characteristic - objects with elastic and plastic static characteristic , 2008, 2008 IEEE 25th Convention of Electrical and Electronics Engineers in Israel.

[32]  Yuan Ren,et al.  Adaptive maximum power point tracking control of fuel cell power plants , 2008 .

[33]  Cosku Kasnakoglu,et al.  Extremum-Seeking Control of Subsonic Cavity Flow , 2008 .

[34]  S. Epure,et al.  Energetic Optimization of Variable Speed Wind Energy Conversion Systems by Extremum Seeking Control , 2007, EUROCON 2007 - The International Conference on "Computer as a Tool".

[35]  S. Sugihira,et al.  Starting speed control of si engine based on online extremum control , 2007, SICE Annual Conference 2007.

[36]  Murat Arcak,et al.  Gradient climbing in formation via extremum seeking and passivity-based coordination rules , 2007, 2007 46th IEEE Conference on Decision and Control.

[37]  R. Oboe,et al.  Mode-matching in vibrating microgyros using extremum seeking control , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[38]  Denis Dochain,et al.  Flatness-Based Extremum-Seeking Control Over Periodic Orbits , 2007, IEEE Transactions on Automatic Control.

[39]  Warren E. Dixon,et al.  An extremum seeking method for non-isometric neuromuscular electrical stimulation , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[40]  Christopher G. Mayhew,et al.  Robust Source-Seeking Hybrid Controllers for Autonomous Vehicles , 2007, 2007 American Control Conference.

[41]  M.L. Walker,et al.  Extremum-Seeking Finite-Time Optimal Control of Plasma Current Profile at the DIII-D Tokamak , 2007, 2007 American Control Conference.

[42]  A. El Aroudi,et al.  Analysis and Comparison of Extremum Seeking Control Techniques , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[43]  Chunlei Zhang,et al.  Numerical Optimization-Based Extremum Seeking Control With Application to ABS Design , 2007, IEEE Transactions on Automatic Control.

[44]  Miroslav Krstic,et al.  Source seeking with non-holonomic unicycle without position measurement and with tuning of forward velocity , 2007, Syst. Control. Lett..

[45]  Christian Oliver Paschereit,et al.  Two-Parameter Extremum Seeking for Control of Thermoacoustic Instabilities and Characterization of Linear Growth , 2007 .

[46]  Chunlei Zhang,et al.  Extremum Seeking Control based on Numerical Optimization and State Regulation - Part II: Robust and Adaptive Control Design , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[47]  Chunlei Zhang,et al.  Extremum Seeking Control based on Numerical Optimization and State Regulation - Part I: Theory and Framework , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[48]  C. Dixon,et al.  Controlling the Mobility of Network Nodes using Decentralized Extremum Seeking , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[49]  Chunlei Zhang,et al.  Non-gradient Extremum Seeking Control of Feedback Linearizable Systems with Application to ABS Design , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[50]  Yaodong Pan,et al.  Variable Structure Control by Switching among Feedback Control Laws , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[51]  Ying Tan,et al.  On global extremum seeking in the presence of local extrema , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[52]  I. Mareels,et al.  On the Choice of Dither in Extremum Seeking Systems: a Case Study , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[53]  Bin Zuo,et al.  The Application of an Annealing Recurrent Neural Network for Extremum Seeking Algorithm to Optimize UAV Tight Formation Flight , 2006, The Proceedings of the Multiconference on "Computational Engineering in Systems Applications".

[54]  Alessandro Astolfi,et al.  Non-local extremum seeking control for active braking control systems , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[55]  Jean-François Beaudoin,et al.  Bluff-body drag reduction by extremum-seeking control , 2006 .

[56]  W. Neise,et al.  Adaptive flow control using slope seeking , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[57]  R. Moser,et al.  Extremum seeking control for simultaneous beam steering and wavefront correction , 2006, 2006 American Control Conference.

[58]  I. Haskara,et al.  Multivariable EGR/spark timing control for IC engines via extremum seeking , 2006, 2006 American Control Conference.

[59]  V. Tyagi,et al.  An extremum seeking algorithm for determining the set point temperature for condensed water in a cooling tower , 2006, 2006 American Control Conference.

[60]  M. Krstic,et al.  Optimal beam matching in particle accelerators via extremum seeking , 2006, 2006 American Control Conference.

[61]  Miroslav Krstic,et al.  Extremum seeking for moderately unstable systems and for autonomous vehicle target tracking without position measurements , 2006, 2006 American Control Conference.

[62]  Robert King,et al.  Adaptive Closed-Loop Separation Control on a High-Lift Configuration Using Extremum Seeking , 2006 .

[63]  Martin Guay,et al.  Adaptive output feedback extremum seeking receding horizon control of linear systems , 2006 .

[64]  Ying Tan,et al.  On non-local stability properties of extremum seeking control , 2006, Autom..

[65]  D. Popovic,et al.  Extremum seeking methods for optimization of variable cam timing engine operation , 2006, IEEE Transactions on Control Systems Technology.

[66]  W.E. Dixon,et al.  Extremum-seeking nonlinear controllers for a human exercise machine , 2006, IEEE/ASME Transactions on Mechatronics.

[67]  I. Queinnec,et al.  MPPT of photovoltaic systems using extremum - seeking control , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[68]  M. Krstic,et al.  PID tuning using extremum seeking: online, model-free performance optimization , 2006, IEEE Control Systems.

[69]  V. Vitale,et al.  Extremum seeking applied to the plasma control system of the Frascati Tokamak Upgrade , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[70]  Ximing Zhang,et al.  Autopilot-based Nonlinear UAV Formation Controller with Extremum-Seeking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[71]  R. Ordóñez,et al.  Numerical Optimization-based Extremum Seeking Control of LTI Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[72]  H. Ohmori,et al.  Nonlinear adaptive extremum seeking control for time delayed index in the presence of deterministic disturbance , 2005, Proceedings. 2005 International Conference Physics and Control, 2005..

[73]  Hitoshi Takata,et al.  Design of Extremum Seeking Control with Accelerator , 2005, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[74]  Denis Dochain,et al.  Adaptive extremum-seeking control of nonisothermal continuous stirred tank reactors , 2005 .

[75]  M. Guay,et al.  Adaptive extremum seeking control of a tubular reactor with limited actuation , 2005, Proceedings of the 2005, American Control Conference, 2005..

[76]  L. Gurvich.  Fuzzy logic base extremum seeking control system , 2004, 2004 23rd IEEE Convention of Electrical and Electronics Engineers in Israel.

[77]  Miroslav Krstic,et al.  An adaptive algorithm for control of combustion instability , 2004, Autom..

[78]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[79]  Bin Zuo,et al.  Optimizing UAV close formation flight via extremum seeking , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[80]  Anna G. Stefanopoulou,et al.  Extremum seeking control for soft landing of an electromechanical valve actuator , 2004, Autom..

[81]  Denis Dochain,et al.  Adaptive extremum seeking control of continuous stirred tank bioreactors with unknown growth kinetics , 2004, Autom..

[82]  Denis Dochain,et al.  Adaptive extremum-seeking control of a continuous stirred tank bioreactor with Haldane's Kinetics , 2004 .

[83]  T. Hachino,et al.  An Extremum Seeking Control via Chebyshev Polynomial Identification and LQ Control (適応信号処理特集号) , 2003 .

[84]  M. Krstić,et al.  Real-Time Optimization by Extremum-Seeking Control , 2003 .

[85]  Tao Zhang,et al.  Adaptive extremum seeking control of nonlinear dynamic systems with parametric uncertainties , 2003, Autom..

[86]  Nusawardhana,et al.  Extremum seeking using analog nonderivative optimizers , 2003, Proceedings of the 2003 American Control Conference, 2003..

[87]  Anthony J. Calise,et al.  Adaptive extremum seeking control design , 2003, Proceedings of the 2003 American Control Conference, 2003..

[88]  Miroslav Krstic,et al.  Multivariable adaptive control of instabilities arising in jet engines , 2003, Proceedings of the 2003 American Control Conference, 2003..

[89]  Umit Ozguner,et al.  Smooth extremum-seeking control via second order sliding mode , 2003, Proceedings of the 2003 American Control Conference, 2003..

[90]  Ravi N. Banavar,et al.  Extremum seeking loops with quadratic functions: Estimation and control , 2003 .

[91]  Ü. Özgüner,et al.  Extremum-seeking control via sliding mode with periodic search signals , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[92]  M. Krstic,et al.  Slope seeking and application to compressor instability control , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[93]  U. Ozguner,et al.  Nash solution by extremum seeking control approach , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[94]  Jin Soo Lee,et al.  Extremum seeking control for discrete-time systems , 2002, IEEE Trans. Autom. Control..

[95]  Umit Ozguner,et al.  Extremum-seeking control strategy for ABS system with time delay , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[96]  K.B. Ariyur,et al.  Control of formation flight via extremum seeking , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[97]  Ravi N. Banavar,et al.  Extremum seeking loops with assumed functions: estimation and control , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[98]  Umit Ozguner,et al.  Discrete-time extremum seeking algorithms , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[99]  K.B. Ariyur,et al.  Analysis and design of multivariable extremum seeking , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[100]  Ravi N. Banavar,et al.  Functional feedback in an extremum seeking loop , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[101]  I. Tunay,et al.  Antiskid control for aircraft via extremum-seeking , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[102]  A. Teel,et al.  Solving smooth and nonsmooth multivariable extremum seeking problems by the methods of nonlinear programming , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[103]  G. Schneider,et al.  Tuning of a combustion controller by extremum seeking: a simulation study , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[104]  Ravi N. Banavar,et al.  Extremum seeking loops with assumed functions , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[105]  Sigurd Skogestad,et al.  Plantwide control: the search for the self-optimizing control structure , 2000 .

[106]  K.B. Ariyur,et al.  A case study of performance improvement in extremum seeking control , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[107]  Mario A. Rotea,et al.  Analysis of multivariable extremum seeking algorithms , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[108]  Andrzej Banaszuk,et al.  Adaptive control of combustion instability using extremum-seeking , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[109]  Y. Zhang,et al.  Stability and performance tradeoff with discrete time triangular search minimum seeking , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[110]  G. C. Walsh,et al.  On the application of multi-parameter extremum seeking control , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[111]  Miroslav Krstic,et al.  Performance improvement and limitations in extremum seeking control , 2000 .

[112]  Miroslav Krstic,et al.  Stability of extremum seeking feedback for general nonlinear dynamic systems , 2000, Autom..

[113]  Jason L. Speyer,et al.  Peak-seeking control with application to formation flight , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[114]  Miroslav Krstic,et al.  Towards faster adaptation in extremum seeking control , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[115]  Miroslav Krstic,et al.  Optimizing bioreactors by extremum seeking , 1999 .

[116]  M. Krstić,et al.  Extremum seeking for limit cycle minimization , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[117]  J. Spall.  Implementation of the simultaneous perturbation algorithm for stochastic optimization , 1998 .

[118]  M. Krstic,et al.  Experimental application of extremum seeking on an axial-flow compressor , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[119]  Payman Sadegh,et al.  Constrained optimization via stochastic approximation with a simultaneous perturbation gradient approximation , 1997, Autom..

[120]  Karl Johan Åström,et al.  Adaptive control around 1960 , 1995 .

[121]  Sergey V. Drakunov,et al.  ABS control using optimum search via sliding modes , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[122]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[123]  P. E. Wellstead,et al.  Self-tuning extremum control , 1990 .

[124]  P.E. Wellstead,et al.  Self-tuning optimization of spark ignition automotive engines , 1990, IEEE Control Systems Magazine.

[125]  Peter G. Scotson,et al.  Self Tuning Optimisation Of Spark Ignition Automotive Engines , 1989, 1989 American Control Conference.

[126]  Brian D. O. Anderson,et al.  Stability of adaptive systems: passivity and averaging analysis , 1986 .

[127]  F. Verhulst,et al.  Averaging Methods in Nonlinear Dynamical Systems , 1985 .

[128]  Rolf Isermann,et al.  Adaptive on-line steady-state optimization of slow dynamic processes , 1978, Autom..

[129]  D. Titterington.  An example of a perturbation-type extremum controller , 1974, Journal of Applied Probability.

[130]  S. K. Korovin,et al.  Using sliding modes in static optimization and nonlinear programming , 1974, Autom..

[131]  John C. Luxat,et al.  Design and Analysis of an Electronic Peak-Holding Controller , 1974, IEEE Transactions on Industrial Electronics and Control Instrumentation.

[132]  D. Titterington.  A Method of Extremum Adaptation , 1973 .

[133]  L. H. Lees,et al.  Stability of Peak-Holding Control Systems , 1971, IEEE Transactions on Industrial Electronics and Control Instrumentation.

[134]  O. Jacobs,et al.  An optimal extremal control system , 1970 .

[135]  M. Hamza,et al.  Extremum control of continuous systems , 1966 .

[136]  R. E. Kalman,et al.  Optimum Seeking Methods. , 1964 .

[137]  L. Pun,et al.  Comments on adaptation concepts and on analysis of control systems , 1963 .

[138]  Donald P. Eckman,et al.  Optimizing Control of Single Input Extremum Systems , 1962 .

[139]  V. V. Petrov,et al.  The principles of construction of one class of extremal control systems for automatized circuits in production processes , 1960 .

[140]  P. Eykhoff,et al.  Adaptive and optimalizing control systems , 1960 .

[141]  Hsue-shen Tsien,et al.  Analysis of peak-holding optimalizing control , 1955 .

[142]  Hassan K. Khalil,et al.  Nonlinear Systems Third Edition , 2008 .

[143]  Martin Guay,et al.  PARAMETER CONVERGENCE IN ADAPTIVE EXTREMUM SEEKING CONTROL , 2006 .

[144]  M. Guay,et al.  Extremum seeking control of nonlinear systems with parametric uncertainties and state constraints , 2004, Proceedings of the 2004 American Control Conference.

[145]  Nusawardhana,et al.  Simultaneous perturbation extremum seeking method for dynamic optimization problems , 2004, Proceedings of the 2004 American Control Conference.

[146]  M. Guay,et al.  Adaptive extremum-seeking receding horizon control of nonlinear systems , 2004, Proceedings of the 2004 American Control Conference.

[147]  U. Ozguner,et al.  Sliding mode extremum seeking control for linear quadratic dynamic game , 2004, Proceedings of the 2004 American Control Conference.

[148]  Yaoyu Li,et al.  Extremum seeking control of tunable thermoacoustic cooler , 2004, Proceedings of the 2004 American Control Conference.

[149]  Denis Dochain,et al.  Adaptive Extremum Seeking Control of Fed-Batch Bioreactors , 2003, Eur. J. Control.

[150]  James C. Spall,et al.  A one-measurement form of simultaneous perturbation stochastic approximation , 1997, Autom..

[151]  Jan Sternby,et al.  Extremum control systems¿An area for adaptive control? , 1980 .

[152]  O. Jacobs,et al.  Design of a single-input sinusoidal-perturbation extremum-control system , 1968 .

[153]  Rufus Oldenburger,et al.  Optimal and self-optimizing control , 1966 .

[154]  J. Roberts.  Extremum or hill-climbing regulation: a statistical theory involving lags, disturbances and noise , 1965 .

[155]  Y. T. Li,et al.  Principles of optimalizing control systems and an application to the internal combusion engine , 1951 .