Practical sufficient conditions for convergence of distributed optimisation algorithms over communication networks with interference

Information exchange over networks can be affected by various forms of delay. This causes challenges for using the network by a multi-agent system to solve a distributed optimisation problem. Distributed optimisation schemes, however, typically do not assume network models that are representative for real-world communication networks, since communication links are most of the time abstracted as lossless. Our objective is therefore to formulate a representative network model and provide practically verifiable network conditions that ensure convergence of distributed algorithms in the presence of interference and possibly unbounded delay. Our network is modelled by a sequence of directed-graphs, where to each network link we associate a process for the instantaneous signal-tointerference-plus-noise ratio. We then formulate practical conditions that can be verified locally and show that the age of information (AoI) associated with data communicated over the network is in O( √ n). Under these conditions we show that a penalty-based gradient descent algorithm can be used to solve a rich class of stochastic, constrained, distributed optimisation problems. The strength of our result lies in the bridge between practical verifiable network conditions and an abstract optimisation theory. We illustrate numerically that our algorithm converges in an extreme scenario where the average AoI diverges. §Supported by the German Research Foundation (DFG) 315248657. † Computer Networks Group Dept. of Computer Science Paderborn University. ‡ Heinz Nixdorf Institute and the Dept. of Computer Science Paderborn University 1 ar X iv :2 10 5. 04 23 0v 1 [ m at h. O C ] 1 0 M ay 2 02 1

[1]  E. Beckenbach CONVEX FUNCTIONS , 2007 .

[2]  Han-Fu Chen,et al.  Asymptotic Properties of Primal-Dual Algorithm for Distributed Stochastic Optimization over Random Networks with Imperfect Communications , 2016, SIAM J. Control. Optim..

[3]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[4]  V. Borkar Stochastic approximation with two time scales , 1997 .

[5]  Mathew D. Penrose,et al.  Lectures on the Poisson Process , 2017 .

[6]  Yang Wang,et al.  Coverage problem with uncertain properties in wireless sensor networks: A survey , 2017, Comput. Networks.

[7]  Gerhard Venter,et al.  Review of optimization techniques , 2010 .

[8]  Daniel E. Quevedo,et al.  Asynchronous stochastic approximations with asymptotically biased errors and deep multi-agent learning , 2018 .

[9]  Gesualdo Scutari,et al.  Distributed nonconvex constrained optimization over time-varying digraphs , 2018, Mathematical Programming.

[10]  Arunselvan Ramaswamy,et al.  Optimization over time-varying networks with unbounded delays , 2019, 1912.07055.

[11]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[12]  Catherine Rosenberg,et al.  What is the right model for wireless channel interference? , 2006, IEEE Transactions on Wireless Communications.

[13]  Yiguang Hong,et al.  Distributed Subgradient-Free Stochastic Optimization Algorithm for Nonsmooth Convex Functions over Time-Varying Networks , 2019, SIAM J. Control. Optim..

[14]  Wei Shyy,et al.  Encyclopedia of Aerospace Engineering , 2010 .

[15]  Hong Shen Wang,et al.  Finite-state Markov channel-a useful model for radio communication channels , 1995 .

[16]  Chong-Kwon Kim,et al.  Flooding in wireless ad hoc networks , 2001, Comput. Commun..

[17]  Laurent Massoulié,et al.  Asynchronous Accelerated Proximal Stochastic Gradient for Strongly Convex Distributed Finite Sums , 2019, ArXiv.

[18]  Daniel W. C. Ho,et al.  Distributed Stochastic Optimization over Time-Varying Noisy Network , 2020, ArXiv.