Information-Theoretic Privacy in Distributed Average Consensus

We present a distributed average consensus protocol that preserves the privacy of agents' inputs. Unlike the differential privacy mechanisms, the presented protocol does not affect the accuracy of the output. It is shown that the protocol preserves the information-theoretic privacy of the agents' inputs against colluding passive adversarial (or honest-but-curious) agents in the network, if the adversarial agents do not constitute a vertex cut in the underlying communication network. This implies that we can guarantee information-theoretic privacy of all the honest agents' inputs against $t$ arbitrary colluding passive adversarial agents if the network is $(t+1)$-connected. The protocol is constructed by composing a distributed privacy mechanism that we propose with any (non-private) distributed average consensus algorithm.

[1]  Soummya Kar,et al.  Design of communication networks for distributed computation with privacy guarantees , 2014, 53rd IEEE Conference on Decision and Control.

[2]  Solmaz S. Kia,et al.  Privacy preservation in continuous-time average consensus algorithm via deterministic additive perturbation signals , 2019, ArXiv.

[3]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[4]  Christoforos N. Hadjicostis,et al.  Privacy-preserving asymptotic average consensus , 2013, 2013 European Control Conference (ECC).

[5]  Paolo Braca,et al.  Secure multi-party consensus gossip algorithms , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Pascal Paillier,et al.  Public-Key Cryptosystems Based on Composite Degree Residuosity Classes , 1999, EUROCRYPT.

[7]  John N. Tsitsiklis,et al.  Weighted Gossip: Distributed Averaging using non-doubly stochastic matrices , 2010, 2010 IEEE International Symposium on Information Theory.

[8]  Yehuda Lindell,et al.  Introduction to Modern Cryptography , 2004 .

[9]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[10]  Avi Wigderson,et al.  Completeness Theorems for Non-Cryptographic Fault-Tolerant Distributed Computation (Extended Abstract) , 1988, STOC.

[11]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[12]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[13]  Jorge Cortés,et al.  Differentially private average consensus: Obstructions, trade-offs, and optimal algorithm design , 2015, Autom..

[14]  Claudio Altafini,et al.  A system-theoretic framework for privacy preservation in continuous-time multiagent dynamics , 2019, Autom..

[15]  Yongqiang Wang,et al.  Secure and Privacy-Preserving Average Consensus , 2017, CPS-SPC@CCS.

[16]  Xiaoqiang Ren,et al.  Secure and privacy preserving average consensus , 2017, 2017 11th Asian Control Conference (ASCC).

[17]  Jonathan Katz,et al.  Privacy in Distributed Average Consensus , 2017 .

[18]  Yongqiang Wang,et al.  Secure and Privacy-Preserving Consensus , 2017, IEEE Transactions on Automatic Control.

[19]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[20]  Richard M. Murray,et al.  Privacy preserving average consensus , 2014, 53rd IEEE Conference on Decision and Control.

[21]  Jorge Cortes,et al.  Dynamic average consensus under limited control authority and privacy requirements , 2014, 1401.6463.

[22]  Christoforos N. Hadjicostis,et al.  Privary Preserving Distributed Average Consensus via Homomorphic Encryption , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[23]  Mehran Mesbahi,et al.  Adaptive communication networks with privacy guarantees , 2017, 2017 American Control Conference (ACC).

[24]  Rafail Ostrovsky,et al.  Almost-Everywhere Secure Computation , 2008, EUROCRYPT.

[25]  Paolo Braca,et al.  Learning With Privacy in Consensus $+$ Obfuscation , 2016, IEEE Signal Processing Letters.

[26]  Jian-Xin Xu,et al.  Consensus Based Approach for Economic Dispatch Problem in a Smart Grid , 2013, IEEE Transactions on Power Systems.

[27]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[28]  Wenwu Yu,et al.  Accurate Privacy Preserving Average Consensus , 2020, IEEE Transactions on Circuits and Systems II: Express Briefs.

[29]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[30]  Yongqiang Wang,et al.  Privacy-Preserving Average Consensus via State Decomposition , 2019, IEEE Transactions on Automatic Control.

[31]  David Chaum,et al.  Multiparty unconditionally secure protocols , 1988, STOC '88.

[32]  Nikhil Chopra,et al.  Confidentiality in distributed average information consensus , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[33]  Georgios B. Giannakis,et al.  Consensus-Based Distributed Support Vector Machines , 2010, J. Mach. Learn. Res..

[34]  Geir E. Dullerud,et al.  Differentially private iterative synchronous consensus , 2012, WPES '12.

[35]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[36]  Moti Yung,et al.  Perfectly secure message transmission , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[37]  Jonathan Katz,et al.  Statistical Privacy in Distributed Average Consensus on Bounded Real Inputs , 2019, 2019 American Control Conference (ACC).

[38]  Emmanuel Abbe,et al.  Privacy-Preserving Methods for Sharing Financial Risk Exposures , 2012 .