A Total Variation based approach for robust consensus in distributed networks

Consider a connected network of agents endowed with local cost functions representing private objectives. Agents seek to find an agreement on some minimizer of the aggregate cost, by means of repeated communications between neighbors. This paper investigates the case where some agents are unreliable in the sense that they permanently inject some false value in the network. We introduce a new relaxation of the initial optimization problem. We show that the relaxed problem is equivalent to the initial one under some regularity conditions which are characterized. We propose two iterative distributed algorithms for finding minimizers of the relaxed problem. When all agents are reliable, these algorithms converge to the sought consensus provided that the above regularity conditions are satisfied. In the presence of misbehaving agents, we show in simple scenario that our algorithms converge to a solution which remains in the vicinity of the sought consensus. Unlike standard distributed algorithms, our approach turns out to be unsensitive to large perturbations. Numerical experiments complete our theoretical results.

[1]  Pascal Bianchi,et al.  Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization , 2011, IEEE Transactions on Automatic Control.

[2]  Antonio Bicchi,et al.  Consensus Computation in Unreliable Networks: A System Theoretic Approach , 2010, IEEE Transactions on Automatic Control.

[3]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[4]  José M. F. Moura,et al.  Fast Distributed Gradient Methods , 2011, IEEE Transactions on Automatic Control.

[5]  Ali H. Sayed,et al.  Distributed processing over adaptive networks , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[6]  Pascal Bianchi,et al.  Robust average consensus using Total Variation Gossip Algorithm , 2012, 6th International ICST Conference on Performance Evaluation Methodologies and Tools.

[7]  Alejandro Ribeiro,et al.  Distributed Network Optimization With Heuristic Rational Agents , 2012, IEEE Transactions on Signal Processing.

[8]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[9]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[10]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[11]  Asuman E. Ozdaglar,et al.  Opinion fluctuations and persistent disagreement in social networks , 2011, IEEE Conference on Decision and Control and European Control Conference.

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[14]  Stephen P. Boyd,et al.  Subgradient Methods , 2007 .

[15]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[16]  Heinz H. Bauschke,et al.  Fixed-Point Algorithms for Inverse Problems in Science and Engineering , 2011, Springer Optimization and Its Applications.

[17]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..