Random walk based in-network computation of arbitrary functions

We study in-network computation on general network topologies. Specifically, we are given the description of a function, and a network with distinct nodes at which the operands of the function are made available, and a designated sink where the computed value of the function is to be consumed. We want to compute the function during the process of moving the data towards the sink. Such settings have been studied in the literature, but mainly for symmetric functions, e.g. average, parity etc., which have the specific property that the output is invariant to permutation of the operands. To the best of our knowledge, we present the first fully decentralised algorithms for arbitrary functions, which we model as those functions whose computation schema is structured as a binary tree. We propose two algorithms, Fixed Random-Compute and Flexible Random-Compute, for this problem, both of which use simple random walks on the network as their basic primitive. Assuming a stochastic model for the generation of streams of data at each source, we provide a lower and an upper bound on the rate at which Fixed Random-Compute can compute the stream of associated function values. Note that the lower bound on rate though computed for our algorithm serves as a general lower bound for the function computation problem and to the best of our knowledge is first such lower bound for asymmetric functions. We also provide upper bounds on the average time taken to compute the function, characterising this time in terms of the fundamental parameters of the random walk on the network: the hitting time in the case of Fixed Random-Compute, and the mixing time in the case of Flexible Random-Compute.

[1]  Kunihiko Sadakane,et al.  The hitting and cover times of Metropolis walks , 2010, Theor. Comput. Sci..

[2]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[3]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[4]  Sanjay Shakkottai,et al.  Towards a queueing-based framework for in-network function computation , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[5]  Stephen P. Boyd,et al.  Gossip algorithms: design, analysis and applications , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[6]  Wojciech Szpankowski,et al.  Stability of token passing rings , 1992, Queueing Syst. Theory Appl..

[7]  D. Manjunath,et al.  Network Flows for Function Computation , 2013, IEEE Journal on Selected Areas in Communications.

[8]  Thomas Sauerwald,et al.  Tight Bounds for Randomized Load Balancing on Arbitrary Network Topologies , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[9]  Devavrat Shah,et al.  Gossip Algorithms , 2009, Found. Trends Netw..

[10]  Pooja Vyavahare,et al.  Decentralized Random Walk-Based Data Collection in Networks , 2017, ArXiv.

[11]  Frank Thomson Leighton,et al.  Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms , 1999, JACM.

[12]  Aslan Tchamkerten,et al.  Distributed Function Computation Over a Rooted Directed Tree , 2016, IEEE Transactions on Information Theory.

[13]  Deborah Estrin,et al.  Directed diffusion for wireless sensor networking , 2003, TNET.

[14]  C. Avin,et al.  Efficient and robust query processing in dynamic environments using random walk techniques , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[15]  Francesco Bullo,et al.  The Hitting Time of Multiple Random Walks , 2016, SIAM J. Matrix Anal. Appl..

[16]  Ness B. Shroff,et al.  On distributed computation rate optimization for deploying cloud computing programming frameworks , 2013, PERV.

[17]  Jaikumar Radhakrishnan,et al.  Lower Bounds for Noisy Wireless Networks using Sampling Algorithms , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[18]  D. Manjunath,et al.  On Distributed Function Computation in Structure-Free Random Wireless Networks , 2014, IEEE Transactions on Information Theory.

[19]  Noman Islam,et al.  A review of wireless sensors and networks' applications in agriculture , 2014, Comput. Stand. Interfaces.

[20]  Hadas Shachnai,et al.  Fast information spreading in graphs with large weak conductance , 2011, SODA '11.

[21]  Munther A. Dahleh,et al.  Information Theoretic Bounds for Distributed Computation Over Networks of Point-to-Point Channels , 2010, IEEE Transactions on Information Theory.

[22]  Amitabha Bagchi,et al.  A Group-to-Group Version of Random Walk Betweenness Centrality , 2020, COMAD/CODS.

[23]  Maxim Raginsky,et al.  Information-Theoretic Lower Bounds for Distributed Function Computation , 2015, IEEE Transactions on Information Theory.

[24]  Alexandros G. Dimakis,et al.  Order-Optimal Consensus Through Randomized Path Averaging , 2010, IEEE Transactions on Information Theory.

[25]  Devavrat Shah,et al.  Computing separable functions via gossip , 2005, PODC '06.

[26]  David Ndzi,et al.  Wireless sensor network coverage measurement and planning in mixed crop farming , 2014 .

[27]  Yin Tat Lee,et al.  An Almost-Linear-Time Algorithm for Approximate Max Flow in Undirected Graphs, and its Multicommodity Generalizations , 2013, SODA.

[28]  Amitabha Bagchi,et al.  A queueing network-based distributed Laplacian solver for directed graphs , 2021, Inf. Process. Lett..

[29]  Gwillerm Froc,et al.  Random walk based routing protocol for wireless sensor networks , 2007, Valuetools 2007.

[30]  C. Harris,et al.  Fundamentals of Queueing Theory, Fourth Edition , 2008 .

[31]  Alistair Sinclair,et al.  Algorithms for Random Generation and Counting: A Markov Chain Approach , 1993, Progress in Theoretical Computer Science.

[32]  Ulrike von Luxburg,et al.  Hitting and commute times in large random neighborhood graphs , 2014, J. Mach. Learn. Res..

[33]  Peter Robinson,et al.  On the Distributed Complexity of Large-Scale Graph Computations , 2016, SPAA.

[34]  Massimo Franceschetti,et al.  Time and Energy Complexity of Function Computation Over Networks , 2011, IEEE Transactions on Information Theory.

[35]  Devavrat Shah Network gossip algorithms , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[36]  Growth codes: maximizing sensor network data persistence , 2006, SIGCOMM '06.

[37]  Donald F. Towsley,et al.  Distributed Operator Placement and Data Caching in Large-Scale Sensor Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[38]  Noga Alon,et al.  Many Random Walks Are Faster Than One , 2011, Comb. Probab. Comput..

[39]  Rosdiadee Nordin,et al.  Energy-Efficient Wireless Sensor Networks for Precision Agriculture: A Review , 2017, Sensors.

[40]  D. Manjunath,et al.  Optimal Embedding of Functions for In-Network Computation: Complexity Analysis and Algorithms , 2014, IEEE/ACM Transactions on Networking.

[41]  Philippe Bonnet,et al.  Adaptive and Decentralized Operator Placement for In-Network Query Processing , 2004, Telecommun. Syst..

[42]  Omer Reingold,et al.  How Well Do Random Walks Parallelize? , 2009, APPROX-RANDOM.

[43]  Masafumi Yamashita,et al.  The hitting and cover times of random walks on finite graphs using local degree information , 2009, Theor. Comput. Sci..

[44]  David J. Aldous,et al.  Lower bounds for covering times for reversible Markov chains and random walks on graphs , 1989 .

[45]  Thomas Sauerwald,et al.  On Coalescence Time in Graphs: When Is Coalescing as Fast as Meeting? , 2016, SODA.

[46]  Wojciech Szpankowski,et al.  Towards computable stability criteria for some multidimensional stochastic processes , 1989 .

[47]  Ness B. Shroff,et al.  Delay and Capacity Trade-Offs in Mobile Ad Hoc Networks: A Global Perspective , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[48]  Colin Cooper,et al.  Coalescing Random Walks and Voting on Connected Graphs , 2012, SIAM J. Discret. Math..

[49]  Eytan Modiano,et al.  An Overlay Architecture for Throughput Optimal Multipath Routing , 2017, IEEE/ACM Transactions on Networking.

[50]  Jie Wu,et al.  A local average broadcast gossip algorithm for fast global consensus over graphs , 2017, J. Parallel Distributed Comput..

[51]  D. Manjunath,et al.  On the Maximum Rate of Networked Computation in a Capacitated Network , 2015, IEEE/ACM Transactions on Networking.

[52]  Prithwish Basu,et al.  Exact Analysis of Latency of Stateless Opportunistic Forwarding , 2009, IEEE INFOCOM 2009.

[53]  Qi Han,et al.  On random routing in wireless sensor grids: A mathematical model for rendezvous probability and performance optimization , 2011, J. Parallel Distributed Comput..

[54]  Roberto Beraldi,et al.  A Biased Random Walk Routing Protocol for Wireless Sensor Networks: The Lukewarm Potato Protocol , 2010, IEEE Transactions on Mobile Computing.

[55]  Yonggang Wen,et al.  Toward Efficient Distributed Algorithms for In-Network Binary Operator Tree Placement in Wireless Sensor Networks , 2013, IEEE Journal on Selected Areas in Communications.

[56]  Wei Luo,et al.  Stability of N interacting queues in random-access systems , 1999, IEEE Trans. Inf. Theory.

[57]  Sreeram Kannan,et al.  Multi-Session Function Computation and Multicasting in Undirected Graphs , 2013, IEEE Journal on Selected Areas in Communications.

[58]  Alan M. Frieze,et al.  Multiple Random Walks and Interacting Particle Systems , 2009, ICALP.

[59]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[60]  Anurag Kumar,et al.  Time and energy complexity of distributed computation in wireless sensor networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[61]  D. Manjunath,et al.  In-Network Computation in Random Wireless Networks: A PAC Approach to Constant Refresh Rates with Lower Energy Costs , 2011, IEEE Transactions on Mobile Computing.

[62]  Jon Feldman,et al.  Growth codes: maximizing sensor network data persistence , 2006, SIGCOMM 2006.

[63]  Shang-Hua Teng,et al.  Electrical flows, laplacian systems, and faster approximation of maximum flow in undirected graphs , 2010, STOC '11.

[64]  Panganamala Ramana Kumar,et al.  Computing and communicating functions over sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[65]  W. Szpankowski Stability conditions for some distributed systems: buffered random access systems , 1994, Advances in Applied Probability.