Distributed Nonconvex Optimization of Multiagent Systems Using Boosting Functions to Escape Local Optima

We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting functions. The underlying idea is to temporarily transform the gradient at a local optimum into a boosted gradient with a non-zero magnitude. We develop a Distributed Boosting Scheme (DBS) based on a gradient-based optimization algorithm using a novel optimal variable step size mechanism so as to guarantee convergence. Even though our motivation is based on the coverage control problem setting, our analysis applies to a broad class of multi-agent problems. Simulation results are provided to compare the performance of different boosting functions families and to demonstrate the effectiveness of the boosting function approach in attaining improved (still generally local) optima.

[1]  Lili Wang,et al.  Distributed Formation Control of Multi-Agent Systems Using Complex Laplacian , 2014, IEEE Transactions on Automatic Control.

[2]  Tim Roughgarden,et al.  Generalized Efficiency Bounds in Distributed Resource Allocation , 2014, IEEE Trans. Autom. Control..

[3]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[4]  Christos G. Cassandras,et al.  Distributed Coverage Control and Data Collection With Mobile Sensor Networks , 2010, IEEE Transactions on Automatic Control.

[5]  P. Chiu,et al.  A simulated annealing algorithm to support the sensor placement for target location , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[6]  C. Cassandras,et al.  Optimal Composition of Heterogeneous Multi-Agent Teams for Coverage Problems with Performance Bound Guarantees , 2020, Autom..

[7]  Moez Draief,et al.  Distributed binary consensus algorithm and wireless sensor network , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[8]  Christodoulos A. Floudas,et al.  A review of recent advances in global optimization , 2009, J. Glob. Optim..

[9]  Christos G. Cassandras,et al.  Distributed Non-convex Optimization of Multi-agent Systems Using Boosting Functions to Escape Local Optima , 2019, 2020 American Control Conference (ACC).

[10]  Michael I. Jordan,et al.  First-order methods almost always avoid saddle points: The case of vanishing step-sizes , 2019, NeurIPS.

[11]  Christos G. Cassandras,et al.  Optimal dynamic formation control of multi-agent systems in constrained environments , 2016, Autom..

[12]  Ruggero Carli,et al.  A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[13]  Theodoros Anagnostopoulos,et al.  A stochastic multi-agent system for Internet of Things-enabled waste management in smart cities , 2018, Waste management & research : the journal of the International Solid Wastes and Public Cleansing Association, ISWA.

[14]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[15]  Angelia Nedic,et al.  Distributed Optimization for Control , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[16]  M. Pipattanasomporn,et al.  Multi-agent systems in a distributed smart grid: Design and implementation , 2009, 2009 IEEE/PES Power Systems Conference and Exposition.

[17]  John H. Holland,et al.  Genetic Algorithms and Adaptation , 1984 .

[18]  Bernardetta Addis,et al.  Local optima smoothing for global optimization , 2005, Optim. Methods Softw..

[19]  Christos G. Cassandras,et al.  A submodularity-based approach for multi-agent optimal coverage problems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  Yongduan Song,et al.  Fully distributed flocking with a moving leader for Lagrange networks with parametric uncertainties , 2015, Autom..

[22]  Mihaela van der Schaar,et al.  Distributed Multi-Agent Online Learning Based on Global Feedback , 2015, IEEE Transactions on Signal Processing.

[23]  Francesco Bullo,et al.  A ladybug exploration strategy for distributed adaptive coverage control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[24]  Mariagrazia Dotoli,et al.  A multi-agent Decision Support System for optimization of co-modal transportation route planning services , 2013, 52nd IEEE Conference on Decision and Control.

[25]  Henrik Sandberg,et al.  A Survey of Distributed Optimization and Control Algorithms for Electric Power Systems , 2017, IEEE Transactions on Smart Grid.

[26]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[27]  Christos G. Cassandras,et al.  Escaping local optima in a class of multi-agent distributed optimization problems: A boosting function approach , 2014, 53rd IEEE Conference on Decision and Control.

[28]  Zongli Lin,et al.  Distributed Consensus Control of Multi-Agent Systems With Higher Order Agent Dynamics and Dynamically Changing Directed Interaction Topologies , 2016, IEEE Transactions on Automatic Control.

[29]  Yungang Liu,et al.  A survey on optimal consensus of multi-agent systems , 2017, 2017 Chinese Automation Congress (CAC).

[30]  O. A. Elwakeil,et al.  Global optimization methods for engineering applications: A review , 1995 .

[31]  Harley Flanders,et al.  Differentiation Under the Integral Sign , 1973 .

[32]  Juan M. Corchado,et al.  Multi-Agent Systems Applications in Energy Optimization Problems: A State-of-the-Art Review , 2018, Energies.