Privacy Preservation in Distributed Optimization via Dual Decomposition and ADMM

In this work, we explore distributed optimization problems, as they are often stated in energy and resource optimization. More precisely, we consider systems consisting of a number of subsystems that are solely connected through linear constraints on the optimized solutions. The focus is put on two approaches; namely dual decomposition and alternating direction method of multipliers (ADMM), and we are interested in the case where it is desired to keep information about subsystems secret. To this end, we propose a privacy preserving algorithm based on secure multiparty computation (SMPC) and secret sharing that ensures privacy of the subsystems while converging to the optimal solution. To gain efficiency in our method, we modify the traditional ADMM algorithm.

[1]  Erich Kaltofen,et al.  On Wiedemann's Method of Solving Sparse Linear Systems , 1991, AAECC.

[2]  Jorge Cortés,et al.  Differentially private distributed convex optimization via objective perturbation , 2016, 2016 American Control Conference (ACC).

[3]  Octavian Catrina,et al.  Improved Primitives for Secure Multiparty Integer Computation , 2010, SCN.

[4]  Payman Mohassel,et al.  SecureML: A System for Scalable Privacy-Preserving Machine Learning , 2017, 2017 IEEE Symposium on Security and Privacy (SP).

[5]  Bingsheng He,et al.  On Full Jacobian Decomposition of the Augmented Lagrangian Method for Separable Convex Programming , 2015, SIAM J. Optim..

[6]  Peeter Laud,et al.  Automatic Proofs of Privacy of Secure Multi-party Computation Protocols against Active Adversaries , 2015, 2015 IEEE 28th Computer Security Foundations Symposium.

[7]  Benny Pinkas,et al.  Faster Secure Cloud Computations with a Trusted Proxy , 2017, IEEE Security & Privacy.

[8]  Riccardo M. G. Ferrari,et al.  Differentially-private distributed fault diagnosis for large-scale nonlinear uncertain systems , 2018 .

[9]  Zhenqi Huang,et al.  Differentially Private Distributed Optimization , 2014, ICDCN.

[10]  Yang Lu,et al.  Privacy preserving distributed optimization using homomorphic encryption , 2018, Autom..

[11]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[12]  Ivan Damgård,et al.  Secure Multiparty Computation and Secret Sharing , 2015 .

[13]  Ivan Damgård,et al.  Secure Distributed Linear Algebra in a Constant Number of Rounds , 2001, CRYPTO.

[14]  Peter Rindal,et al.  ABY3: A Mixed Protocol Framework for Machine Learning , 2018, IACR Cryptol. ePrint Arch..

[15]  Prashant J. Shenoy,et al.  Private memoirs of a smart meter , 2010, BuildSys '10.

[16]  Quanyan Zhu,et al.  Secure and Resilient Control Design for Cloud Enabled Networked Control Systems , 2015, CPS-SPC '15.

[17]  Paulo Tabuada,et al.  Privacy-aware quadratic optimization using partially homomorphic encryption , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[18]  Yongqiang Wang,et al.  ADMM Based Privacy-Preserving Decentralized Optimization , 2017, IEEE Transactions on Information Forensics and Security.