Gradient climbing in formation via extremum seeking and passivity-based coordination rules

We consider a gradient climbing problem where the objective is to steer a group of vehicles to the extrema of an unknown scalar field distribution while keeping a prescribed formation. We address this task by developing a scheme in which the leader performs extremum seeking for the minima or maxima of the field, and other vehicles follow according to passivity-based coordination rules. The extremum-seeking approach generates approximate gradients of the field locally by "dithering" sensor positions. We show that if there is sufficient time-scale separation between the fast dither and slow gradient motions of the leader vehicle, the followers only respond to the gradient motion, and filter out the dither component, while keeping the prescribed formation.

[1]  J.T. Wen,et al.  Group Coordination when the Reference Velocity is Available Only to the Leader: An Adaptive Design , 2007, 2007 American Control Conference.

[2]  R. Ordóñez,et al.  Numerical Optimization-based Extremum Seeking Control of LTI Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[3]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[4]  C. Kelley.  Iterative Methods for Linear and Nonlinear Equations , 1987 .

[5]  Jason L. Speyer,et al.  Peak-seeking control with application to formation flight , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[6]  Miroslav Krstic,et al.  Real-Time Optimization by Extremum-Seeking Control: Ariyur/Extremum Seeking , 2004 .

[7]  Miroslav Krstic,et al.  Extremum seeking for moderately unstable systems and for autonomous vehicle target tracking without position measurements , 2006 .

[8]  Naomi Ehrich Leonard,et al.  Virtual leaders, artificial potentials and coordinated control of groups , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[9]  Naomi Ehrich Leonard,et al.  Vehicle networks for gradient descent in a sampled environment , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[10]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[11]  K.B. Ariyur,et al.  Control of formation flight via extremum seeking , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[12]  Kartik B. Ariyur,et al.  Real-Time Optimization by Extremum-Seeking Control , 2003 .

[13]  J. Kiefer,et al.  Stochastic Estimation of the Maximum of a Regression Function , 1952 .

[14]  A. Teel,et al.  Solving smooth and nonsmooth multivariable extremum seeking problems by the methods of nonlinear programming , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[15]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[16]  J. Blum.  Multidimensional Stochastic Approximation Methods , 1954 .

[17]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[18]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[19]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[20]  Paul S. Schenker,et al.  CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[21]  Chunlei Zhang,et al.  Extremum Seeking Control based on Numerical Optimization and State Regulation - Part I: Theory and Framework , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[22]  Norman Biggs.  Algebraic Graph Theory: Index , 1974 .

[24]  J. McCarthy,et al.  Biological markers of environmental and ecological contamination: an overview. , 1992, Risk analysis : an official publication of the Society for Risk Analysis.

[25]  K.M. Passino,et al.  Stability analysis of social foraging swarms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  M. Areak,et al.  Passivity as a design tool for group coordination , 2006, 2006 American Control Conference.

[27]  J. Spall.  Adaptive stochastic approximation by the simultaneous perturbation method , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[28]  Chunlei Zhang,et al.  Source Seeking With Nonholonomic Unicycle Without Position Measurement---Part I: Tuning of Forward Velocity , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.