Design and Analysis of Distributed Multi-Agent Saddle Point Algorithm Based on Gradient-Free Oracle

In the paper, we are interested in one convex-concave function problem in network applications. Motivated by the saddle-point subgradient methods, we deal with a kind of saddle-point problem for multi-agent systems whose objective function for the underlying issue must be non-smooth but Lipschitz continuous. With the convex constrain set and global convex inequality constraints, we present a kind of distributed gradient-free algorithm in order to solve the issue of multi-agent convex-concave optimization. Under Slater’s condition, We give the results of convergence rate and the effect of smoothing parameters on error bounds.

[1]  Shengyuan Xu,et al.  Distributed average consensus via gossip algorithm with real-valued and quantized data for 0q , 2010, Syst. Control. Lett..

[2]  Convex Optimization in Signal Processing and Communications , 2010 .

[3]  Yongcan Cao,et al.  Optimal Linear-Consensus Algorithms: An LQR Perspective , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[5]  R. Srikant,et al.  Quantized Consensus , 2006, 2006 IEEE International Symposium on Information Theory.

[6]  Asuman Ozdaglar,et al.  Cooperative distributed multi-agent optimization , 2010, Convex Optimization in Signal Processing and Communications.

[7]  Angelia Nedic,et al.  Subgradient Methods for Saddle-Point Problems , 2009, J. Optimization Theory and Applications.

[8]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[9]  Shengyuan Xu,et al.  Distributed Primal–Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[11]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[12]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[13]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[14]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[15]  Shengyuan Xu,et al.  Distributed dual averaging method for multi-agent optimization with quantized communication , 2012, Syst. Control. Lett..

[16]  Daniel W. C. Ho,et al.  Randomized Gradient-Free Method for Multiagent Optimization Over Time-Varying Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Karl Henrik Johansson,et al.  Subgradient methods and consensus algorithms for solving convex optimization problems , 2008, 2008 47th IEEE Conference on Decision and Control.

[18]  John S. Baras,et al.  Performance Evaluation of the Consensus-Based Distributed Subgradient Method Under Random Communication Topologies , 2011, IEEE Journal of Selected Topics in Signal Processing.

[19]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[20]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[21]  Jürgen Kurths,et al.  Consensus over directed static networks with arbitrary finite communication delays. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Yurii Nesterov,et al.  Primal-dual subgradient methods for convex problems , 2005, Math. Program..

[23]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[24]  Choon Yik Tang,et al.  Gossip Algorithms for Convex Consensus Optimization Over Networks , 2010, IEEE Transactions on Automatic Control.