Cooperatively learning mobile agents for gradient climbing

This paper presents a novel class of self-organizing autonomous sensing agents that form a swarm and learn the static field of interest through noisy measurements from neighbors for gradient climbing. In particular, each sensing agent maintains its own smooth map which estimates the field. It updates its map using measurements from itself and its neighbors and simultaneously moves toward a maximum of the field using the gradient of its map. The proposed cooperatively learning control consists of motion coordination based on the recursive spatial estimation of an unknown field of interest with measurement noise. The convergence properties of the proposed coordination algorithm are analyzed using the ODE approach and verified by a simulation study.

[1]  Lennart Ljung,et al.  Theorems for the Asymptotic Analysis of Recursive Stochastic Algorithms , 1975 .

[2]  J. Adler Chemotaxis in bacteria. , 1976, Journal of supramolecular structure.

[3]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[4]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .

[5]  Tamer Basar,et al.  Analysis of Recursive Stochastic Algorithms , 2001 .

[6]  F. Bullo,et al.  Coverage control for mobile sensing networks , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[8]  George J. Pappas,et al.  Stability of Flocking Motion , 2003 .

[9]  D. Grünbaum Schooling as a strategy for taxis in a noisy environment , 1998, Evolutionary Ecology.

[10]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[11]  Gaurav S. Sukhatme,et al.  Bacterium-inspired robots for environmental monitoring , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[13]  Francesco Bullo,et al.  Esaim: Control, Optimisation and Calculus of Variations Spatially-distributed Coverage Optimization and Control with Limited-range Interactions , 2022 .

[14]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.