Random Pairwise Gossip on Hadamard manifolds

In the context of sensor networks, the consensus problem is an important problem. The goal is to find a distributed algorithm to reach a consensus, i.e. some common value shared by all the agents in the network. Such a well known algorithm is the so-called Random Pairwise Gossip (RPG) [BGPS06]. This algorithm relies on pairwise arithmetic averages. Therefore, it does not apply to some situations of interest where computing arithmetic averages is meaningless. For instance, consensus on axis orientation, or subspace tracking, or camera position, cannot be addressed by RPG. However, all these cases exhibit a common underlying structure: the data belong to some Riemannian manifold [DC92]. The goal of this paper is to adapt the RPG algorithm to the Riemannian manifolds framework. Replacing arithmetic average by midpoints for the metric is a natural idea, promoted in this paper. However, due to curvature, and contrarily to the Euclidean case, convergence is no more guaranteed. However, we show that under suitable curvature assumptions - namely, nonpositive curvature - convergence can still be ensured. Numerical experiments validate our approach.

[1]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[2]  Alain Sarlette,et al.  Synchronization and balancing on the N-torus , 2007, Syst. Control. Lett..

[3]  Carlos S. Kubrusly,et al.  Stochastic approximation algorithms and applications , 1973, CDC 1973.

[4]  Brett D. Fleisch,et al.  The Chubby lock service for loosely-coupled distributed systems , 2006, OSDI '06.

[5]  I. Holopainen Riemannian Geometry , 1927, Nature.

[6]  Shun-ichi Amari,et al.  Differential geometry of statistical inference , 1983 .

[7]  Alain Sarlette,et al.  Coordinated Motion Design on Lie Groups , 2008, IEEE Transactions on Automatic Control.

[8]  Luca Schenato,et al.  A distributed consensus protocol for clock synchronization in wireless sensor network , 2007, 2007 46th IEEE Conference on Decision and Control.

[9]  Alain Sarlette,et al.  Consensus Optimization on Manifolds , 2008, SIAM J. Control. Optim..

[10]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[11]  甘利 俊一 Differential geometry in statistical inference , 1987 .

[12]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[13]  Silvere Bonnabel,et al.  Stochastic Gradient Descent on Riemannian Manifolds , 2011, IEEE Transactions on Automatic Control.

[14]  René Vidal,et al.  Average consensus on Riemannian manifolds with bounded curvature , 2011, IEEE Conference on Decision and Control and European Control Conference.