Privacy-Preserving Push-Sum Average Consensus via State Decomposition

Average consensus is extensively used in distributed networks for computation and control, where all the agents constantly communicate with each other and update their states in order to reach an agreement. Under a general average consensus algorithm, information exchanged through wireless or wired communication networks could lead to the disclosure of sensitive and private information. In this article, we propose a privacy-preserving push-sum approach for directed networks that can protect the privacy of all agents while achieving average consensus simultaneously. Each node decomposes its initial state arbitrarily into two substates, and their average equals to the initial state, guaranteeing that the agent's state will converge to the accurate average consensus. Only one substate is exchanged by the node with its neighbors over time, and the other one is reserved. That is to say, only the exchanged substate would be visible to an adversary, preventing the initial state information from leakage. Different from the existing state-decomposition approach, which only applies to undirected graphs, our proposed approach is applicable to strongly connected digraphs. In addition, in direct contrast to offset-adding-based privacy-preserving push-sum algorithm, which is vulnerable to an external eavesdropper, our proposed approach can ensure privacy against both an honest-but-curious node and an external eavesdropper. A numerical simulation is provided to illustrate the effectiveness of the proposed approach.

[1]  Christoforos N. Hadjicostis,et al.  Privacy-Preserving Distributed Averaging via Homomorphically Encrypted Ratio Consensus , 2020, IEEE Transactions on Automatic Control.

[2]  Minghui Zhu,et al.  On privacy preserving data release of linear dynamic networks , 2019, Autom..

[3]  Christoforos N. Hadjicostis,et al.  Privacy-Preserving Average Consensus over Digraphs in the Presence of Time Delays , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Yongqiang Wang,et al.  Privacy-Preserving Average Consensus via State Decomposition , 2019, IEEE Transactions on Automatic Control.

[5]  Yongqiang Wang,et al.  Privacy-Preserving Average Consensus on Directed Graphs Using Push-Sum , 2018, 2018 IEEE Conference on Communications and Network Security (CNS).

[6]  Bahman Gharesifard,et al.  Push-Sum on Random Graphs: Almost Sure Convergence and Convergence Rate , 2017, IEEE Transactions on Automatic Control.

[7]  Yongqiang Wang,et al.  Secure and Privacy-Preserving Consensus , 2017, IEEE Transactions on Automatic Control.

[8]  Mehran Mesbahi,et al.  Adaptive communication networks with privacy guarantees , 2017, 2017 American Control Conference (ACC).

[9]  Jorge Cortés,et al.  Differentially private average consensus: Obstructions, trade-offs, and optimal algorithm design , 2015, Autom..

[10]  Richard M. Murray,et al.  Privacy preserving average consensus , 2014, 53rd IEEE Conference on Decision and Control.

[11]  Jian-Xin Xu,et al.  Consensus based approach for economic dispatch problem in a smart grid , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[12]  E. Seneta Non-negative Matrices and Markov Chains , 2008 .

[13]  Oded Goldreich Foundations of Cryptography: Volume 1 , 2006 .

[14]  ASHWIN MACHANAVAJJHALA,et al.  L-diversity: privacy beyond k-anonymity , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[15]  I. Kaminer,et al.  Coordinated Path Following Control of Multiple Wheeled Robots with Directed Communication Links , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[16]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[17]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[18]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[19]  Oded Goldreich,et al.  Foundations of Cryptography: Volume 1, Basic Tools , 2001 .

[20]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..

[21]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[22]  M. Hautus Strong detectability and observers , 1983 .

[23]  E. Seneta,et al.  Towards consensus: some convergence theorems on repeated averaging , 1977, Journal of Applied Probability.

[24]  M. Degroot Reaching a Consensus , 1974 .

[25]  M. Bartlett,et al.  Weak ergodicity in non-homogeneous Markov chains , 1958, Mathematical Proceedings of the Cambridge Philosophical Society.