Clock Synchronization and Distributed Estimation in Highly Dynamic Networks: An Information Theoretic Approach

We consider the External Clock Synchronization problem in dynamic sensor networks. Initially, sensors obtain inaccurate estimations of an external time reference and subsequently collaborate in order to synchronize their internal clocks with the external time. For simplicity, we adopt the drift-free assumption, where internal clocks are assumed to tick at the same pace. Hence, the problem is reduced to an estimation problem, in which the sensors need to estimate the initial external time. This work is further relevant to the problem of collective approximation of environmental values by biological groups. Unlike most works on clock synchronization that assume static networks, this paper focuses on an extreme case of highly dynamic networks. Specifically, we assume a non-adaptive scheduler adversary that dictates in advance an arbitrary, yet independent, meeting pattern. Such meeting patterns fit, for example, with short-time scenarios in highly dynamic settings, where each sensor interacts with only few other arbitrary sensors. We propose an extremely simple clock synchronization algorithm that is based on weighted averages, and prove that its performance on any given independent meeting pattern is highly competitive with that of the best possible algorithm, which operates without any resource or computational restrictions, and knows the meeting pattern in advance. In particular, when all distributions involved are Gaussian, the performances of our scheme coincide with the optimal performances. Our proofs rely on an extensive use of the concept of Fisher information. We use the Cramer-Rao bound and our definition of a Fisher Channel Capacity to quantify information flows and to obtain lower bounds on collective performance. This opens the door for further rigorous quantifications of information flows within collaborative sensors.

[1]  Fikret Sivrikaya,et al.  Time synchronization in sensor networks: a survey , 2004, IEEE Network.

[2]  Bernhard Haeupler,et al.  Breathe before speaking: efficient information dissemination despite noisy, limited and anonymous communication , 2014, PODC '14.

[3]  A I Houston,et al.  Memory and the efficient use of information. , 1987, Journal of theoretical biology.

[4]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[5]  Yingyu Wan,et al.  Accurate Time Synchronization for Wireless Sensor Networks , 2005, MSN.

[6]  David L. Mills,et al.  Improved algorithms for synchronizing computer network clocks , 1995, TNET.

[7]  Leslie Lamport,et al.  Proving the Correctness of Multiprocess Programs , 1977, IEEE Transactions on Software Engineering.

[8]  Y. S. Sathe,et al.  Minimum Variance Unbiased Estimation , 2018, Statistical Inference for Engineers and Data Scientists.

[9]  Kay Römer,et al.  Wireless sensor networks: a new regime for time synchronization , 2003, CCRV.

[10]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[11]  Nancy A. Lynch,et al.  An Upper and Lower Bound for Clock Synchronization , 1984, Inf. Control..

[12]  Flaviu Cristian,et al.  Integrating External and Internal Clock Synchronization , 2004, Real-Time Systems.

[13]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[14]  K. Yıldırım CLOCK SYNCHRONIZATION IN WIRELESS SENSOR NETWORKS , 2012 .

[15]  Ajay D. Kshemkalyani,et al.  Clock synchronization for wireless sensor networks: a survey , 2005, Ad Hoc Networks.

[16]  Hagit Attiya,et al.  Optimal clock synchronization under different delay assumptions , 1993, PODC '93.

[17]  David L. Mills,et al.  Internet time synchronization: the network time protocol , 1991, IEEE Trans. Commun..

[18]  Ram Zamir,et al.  A Proof of the Fisher Information Inequality via a Data Processing Argument , 1998, IEEE Trans. Inf. Theory.

[19]  Frank R. Kschischang,et al.  Coding for Errors and Erasures in Random Network Coding , 2007, IEEE Transactions on Information Theory.

[20]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[21]  Christoph Lenzen,et al.  Tight bounds for clock synchronization , 2010, JACM.

[22]  Olivier Rioul,et al.  Information Theoretic Proofs of Entropy Power Inequalities , 2007, IEEE Transactions on Information Theory.

[23]  John A. Gubner,et al.  Distributed estimation and quantization , 1993, IEEE Trans. Inf. Theory.

[24]  Boaz Patt-Shamir,et al.  Optimal and efficient clock synchronization under drifting clocks , 1999, PODC '99.

[25]  Bernhard Haeupler,et al.  Breathe before speaking: efficient information dissemination despite noisy, limited and anonymous communication , 2013, Distributed Computing.

[26]  Deborah Estrin,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Fine-grained Network Time Synchronization Using Reference Broadcasts , 2022 .

[27]  Christoph Lenzen,et al.  Clock Synchronization: Open Problems in Theory and Practice , 2009, SOFSEM.

[28]  A. J. Stam Some Inequalities Satisfied by the Quantities of Information of Fisher and Shannon , 1959, Inf. Control..

[29]  Vivek S. Borkar,et al.  A New Distributed Time Synchronization Protocol for Multihop Wireless Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[30]  Jennifer L. Welch,et al.  Closed form bounds for clock synchronization under simple uncertainty assumptions , 2001, Inf. Process. Lett..

[31]  David Peleg,et al.  Distributed Computing: A Locality-Sensitive Approach , 1987 .

[32]  Christoph Lenzen,et al.  PulseSync: An Efficient and Scalable Clock Synchronization Protocol , 2015, IEEE/ACM Transactions on Networking.

[33]  Boaz Patt,et al.  A theory of clock synchronization , 1994 .

[34]  Sam Toueg,et al.  Optimal clock synchronization , 1985, PODC '85.

[35]  Flaviu Cristian,et al.  Probabilistic clock synchronization , 1989, Distributed Computing.

[36]  Yik-Chung Wu,et al.  On joint synchronization of clock offset and skew for Wireless Sensor Networks under exponential delay , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[37]  Amos Korman,et al.  Confidence Sharing: An Economic Strategy for Efficient Information Flows in Animal Groups , 2014, PLoS Comput. Biol..

[38]  Yik-Chung Wu,et al.  Improved Estimation of Clock Offset in Sensor Networks , 2009, 2009 IEEE International Conference on Communications.

[39]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[40]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[41]  Daniel R. Jeske,et al.  On maximum-likelihood estimation of clock offset , 2005, IEEE Transactions on Communications.

[42]  Ziv Bar-Yossef,et al.  Information theory methods in communication complexity , 2002, Proceedings 17th IEEE Annual Conference on Computational Complexity.

[43]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[44]  Danny Dolev,et al.  Dynamic fault-tolerant clock synchronization , 1995, JACM.

[45]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[46]  Nelson M. Blachman,et al.  The convolution inequality for entropy powers , 1965, IEEE Trans. Inf. Theory.

[47]  Mihail L. Sichitiu,et al.  Simple, accurate time synchronization for wireless sensor networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[48]  Christoph Lenzen,et al.  Optimal gradient clock synchronization in dynamic networks , 2010, PODC.