Privacy-Preserving Push-sum Average Consensus via State Decomposition

Average consensus is extensively used in distributed networks for computing and control, where all the agents constantly communicate with each other and update their states in order to reach an agreement. Under the general average consensus algorithm, information exchanged through wireless or wired communication networks could lead to the disclosure of sensitive and private information. In this paper, we propose a privacy-preserving push-sum approach for directed networks that can maintain the privacy of all agents while achieving average consensus simultaneously. Each node {decomposes} its initial state arbitrarily into two substates, the average of which equals to the initial state, in order to guarantee the convergence to the accurate average. Only one substate is exchanged by the node with its neighbours over time, and the other one is kept private. That is to say, only the exchanged substate would be visible to an adversary, preventing the private state information from leakage. Different from the existing state-decomposition approach which only applies to undirected graphs, our proposed approach is applicable to strongly connected digraphs. In addition, in direct contrast to offset-adding based privacy-preserving push-sum algorithm, which is vulnerable to an external eavesdropper, our proposed approach can ensure privacy against both an honest-but-curious node and an external eavesdropper. A numerical simulation is provided to illustrate the effectiveness of the proposed approach.

[1]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[2]  Christoforos N. Hadjicostis,et al.  Privacy-Preserving Average Consensus over Digraphs in the Presence of Time Delays , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  E. Seneta Non-negative Matrices and Markov Chains , 2008 .

[4]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.

[5]  Jian-Xin Xu,et al.  Consensus based approach for economic dispatch problem in a smart grid , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[6]  Richard M. Murray,et al.  Privacy preserving average consensus , 2014, 53rd IEEE Conference on Decision and Control.

[7]  Yongqiang Wang,et al.  Secure and Privacy-Preserving Consensus , 2017, IEEE Transactions on Automatic Control.

[8]  Bahman Gharesifard,et al.  Push-Sum on Random Graphs: Almost Sure Convergence and Convergence Rate , 2017, IEEE Transactions on Automatic Control.

[9]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[10]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[11]  Jorge Cortés,et al.  Differentially private average consensus: Obstructions, trade-offs, and optimal algorithm design , 2015, Autom..

[12]  Yongqiang Wang,et al.  Privacy-Preserving Average Consensus on Directed Graphs Using Push-Sum , 2018, 2018 IEEE Conference on Communications and Network Security (CNS).

[13]  Minghui Zhu,et al.  On privacy preserving data release of linear dynamic networks , 2019, Autom..

[14]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[15]  Mehran Mesbahi,et al.  Adaptive communication networks with privacy guarantees , 2017, 2017 American Control Conference (ACC).

[16]  I. Kaminer,et al.  Coordinated Path Following Control of Multiple Wheeled Robots with Directed Communication Links , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[17]  Oded Goldreich,et al.  Foundations of Cryptography: Volume 1, Basic Tools , 2001 .

[18]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[19]  Yongqiang Wang,et al.  Privacy-Preserving Average Consensus via State Decomposition , 2019, IEEE Transactions on Automatic Control.

[20]  M. Degroot Reaching a Consensus , 1974 .

[21]  ASHWIN MACHANAVAJJHALA,et al.  L-diversity: privacy beyond k-anonymity , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[22]  Christoforos N. Hadjicostis,et al.  Privacy-Preserving Distributed Averaging via Homomorphically Encrypted Ratio Consensus , 2020, IEEE Transactions on Automatic Control.

[23]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..