Distributed continuous-time approximate projection protocols for shortest distance optimization problems

In this paper, we investigate the distributed shortest distance optimization problem for a multi-agent network to cooperatively minimize the sum of the quadratic distances from some convex sets, where each set is only associated with one agent. To deal with the optimization problem with projection uncertainties, we propose a distributed continuous-time dynamical protocol based on a new concept of approximate projection. Here each agent can only obtain an approximate projection point on the boundary of its convex set, and communicate with its neighbors over a time-varying communication graph. First, we show that no matter how large the approximate angle is, the system states are always bounded for any initial condition, and uniformly bounded with respect to all initial conditions if the inferior limit of the stepsize is greater than zero. Then, in the two cases, nonempty intersection and empty intersection of convex sets, we provide stepsize and approximate angle conditions to ensure the optimal convergence, respectively. Moreover, we give some characterizations about the optimal solutions for the empty intersection case and also present the convergence error between agents' estimates and the optimal point in the case of constant stepsizes and approximate angles.

[1]  Boris Polyak,et al.  The method of projections for finding the common point of convex sets , 1967 .

[2]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  H. Piaggio Differential Geometry of Curves and Surfaces , 1952, Nature.

[4]  Guodong Shi,et al.  Global target aggregation and state agreement of nonlinear multi-agent systems with switching topologies , 2009, Autom..

[5]  Karl Henrik Johansson,et al.  Robust Consensus for Continuous-Time Multiagent Dynamics , 2013, SIAM J. Control. Optim..

[6]  Bahman Gharesifard,et al.  Distributed convergence to Nash equilibria in two-network zero-sum games , 2012, Autom..

[7]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[8]  Stefanie Seiler,et al.  Facility Layout And Location An Analytical Approach , 2016 .

[9]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[10]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[11]  Wei Ren,et al.  Distributed shortest distance consensus problem in multi-agent systems , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[12]  Choon Yik Tang,et al.  Gossip Algorithms for Convex Consensus Optimization Over Networks , 2010, IEEE Transactions on Automatic Control.

[13]  Yiguang Hong,et al.  Target containment control of multi-agent systems with random switching interconnection topologies , 2012, Autom..

[14]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[15]  C. Badea,et al.  The rate of convergence in the method of alternating projections , 2010, 1006.2047.

[16]  Heinz H. Bauschke,et al.  Projection algorithms and monotone operators , 1996 .

[17]  Lihua Xie,et al.  Distributed Projection-Based Algorithms for Source Localization in Wireless Sensor Networks , 2015, IEEE Transactions on Wireless Communications.

[18]  Jing Wang,et al.  A control perspective for centralized and distributed convex optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[19]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[20]  Karl Henrik Johansson,et al.  Multi-agent Robust Consensus: Convergence Analysis and Application , 2011, ArXiv.

[21]  Jiangping Hu,et al.  Distributed tracking control of leader-follower multi-agent systems under noisy measurement , 2011, Autom..

[22]  Karl Henrik Johansson,et al.  Reaching an Optimal Consensus: Dynamical Systems That Compute Intersections of Convex Sets , 2011, IEEE Transactions on Automatic Control.

[23]  Choon Yik Tang,et al.  Zero-Gradient-Sum Algorithms for Distributed Convex Optimization: The Continuous-Time Case , 2011, IEEE Transactions on Automatic Control.

[24]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[25]  José M. F. Moura,et al.  Cooperative Convex Optimization in Networked Systems: Augmented Lagrangian Algorithms With Directed Gossip Communication , 2010, IEEE Transactions on Signal Processing.

[26]  Lacra Pavel,et al.  A continuous-time decentralized optimization scheme with positivity constraints , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[27]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[28]  Lihua Xie,et al.  A Projection Based Fully Distributed Approach for Source Localization in Wireless Sensor Networks , 2013, Ad Hoc Sens. Wirel. Networks.

[29]  Mikael Johansson,et al.  A Randomized Incremental Subgradient Method for Distributed Optimization in Networked Systems , 2009, SIAM J. Optim..

[30]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[31]  Karl Henrik Johansson,et al.  Convergence of random sleep algorithms for optimal consensus , 2013, Syst. Control. Lett..

[32]  Youcheng Lou,et al.  Distributed Surrounding Design of Target Region With Complex Adjacency Matrices , 2015, IEEE Transactions on Automatic Control.

[33]  Karl Henrik Johansson,et al.  Randomized optimal consensus of multi-agent systems , 2011, Autom..

[34]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[35]  Karl Henrik Johansson,et al.  Approximate Projected Consensus for Convex Intersection Computation: Convergence Analysis and Critical Error Angle , 2014, IEEE Transactions on Automatic Control.

[36]  J. Danskin The Theory of Max-Min, with Applications , 1966 .

[37]  Magnus Egerstedt,et al.  Continuous-time proportional-integral distributed optimisation for networked systems , 2013, 1309.6613.