Differentially Private Distributed Resource Allocation via Deviation Tracking

This paper studies the distributed resource allocation problem where all the agents cooperatively minimize the sum of their cost functions. To prevent private information from being disclosed, agents need to keep their cost functions private against potential adversaries and other agents. We first propose a completely distributed algorithm via deviation tracking that deals with constrained resource allocation problem and preserve differential privacy for cost functions by masking states and directions with decaying Laplace noise. Adopting constant stepsizes, we prove that the proposed algorithm converges linearly in mean square. The linear convergence is established under the standard assumptions of Lipschitz gradients and strong convexity instead of the assumption of bounded gradients that is usually imposed in most existing works. Moreover, we show that the algorithm preserves differential privacy for every agent's cost function and establish the trade-off between privacy and convergence accuracy. Furthermore, we apply the proposed algorithm to economic dispatch problem in IEEE 14-bus system to verify the theoretical results.

[1]  Karl Henrik Johansson,et al.  Distributed Energy Resource Coordination Over Time-Varying Directed Communication Networks , 2019, IEEE Transactions on Control of Network Systems.

[2]  Allen J. Wood,et al.  Power Generation, Operation, and Control , 1984 .

[3]  Yuzhe Tang,et al.  PADS: Privacy-Preserving Auction Design for Allocating Dynamically Priced Cloud Resources , 2017, 2017 IEEE 3rd International Conference on Collaboration and Internet Computing (CIC).

[4]  Rui Wang,et al.  Distributed Consensus Based Algorithm for Economic Dispatch in a Microgrid , 2019, IEEE Transactions on Smart Grid.

[5]  Zhenqi Huang,et al.  Differentially Private Distributed Optimization , 2014, ICDCN.

[6]  Yan Yang,et al.  Fast Economic Dispatch in Smart Grids Using Deep Learning: An Active Constraint Screening Approach , 2020, IEEE Internet of Things Journal.

[7]  Xiaoli Ma,et al.  Consensus Based Estimation Over Relay Assisted Sensor Networks for Situation Monitoring , 2015, IEEE Journal of Selected Topics in Signal Processing.

[8]  Xin-Ping Guan,et al.  Consensus-based Distributed Optimization in Multi-agent Systems: Convergence and Differential Privacy , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[9]  Xinping Guan,et al.  Differentially Private Distributed Optimization via State and Direction Perturbation in Multiagent Systems , 2022, IEEE Transactions on Automatic Control.

[10]  Xinping Guan,et al.  Preserving Data-Privacy With Added Noises: Optimal Estimation and Privacy Analysis , 2017, IEEE Transactions on Information Theory.

[11]  Ziyang Meng,et al.  A survey of distributed optimization , 2019, Annu. Rev. Control..

[12]  Xiaofeng Liao,et al.  Achieving Acceleration for Distributed Economic Dispatch in Smart Grids Over Directed Networks , 2020, IEEE Transactions on Network Science and Engineering.

[13]  Lihua Xie,et al.  A Dual Splitting Approach for Distributed Resource Allocation With Regularization , 2019, IEEE Transactions on Control of Network Systems.

[14]  Ping He,et al.  Design and management of a distributed hybrid energy system through smart contract and blockchain , 2019, Applied Energy.

[15]  Lihua Xie,et al.  Convergence of Asynchronous Distributed Gradient Methods Over Stochastic Networks , 2018, IEEE Transactions on Automatic Control.

[16]  David K. Y. Yau,et al.  Cost of differential privacy in demand reporting for smart grid economic dispatch , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[17]  Giacomo Verticale,et al.  A security framework for smart metering with multiple data consumers , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[18]  Yang Lu,et al.  Privacy preserving distributed optimization using homomorphic encryption , 2018, Autom..

[19]  Suhas N. Diggavi,et al.  Differentially Private Consensus-Based Distributed Optimization , 2019, ArXiv.

[20]  Shanying Zhu,et al.  An ADMM-based Distributed Algorithm for Economic Dispatch in Multi-energy Systems , 2021, 2021 IEEE Power & Energy Society General Meeting (PESGM).

[21]  Prodromos Daoutidis,et al.  Microgrid/Macrogrid Energy Exchange: A Novel Market Structure and Stochastic Scheduling , 2017, IEEE Transactions on Smart Grid.

[22]  Ufuk Topcu,et al.  Differentially Private Distributed Constrained Optimization , 2014, IEEE Transactions on Automatic Control.

[23]  Jianfeng Guan,et al.  Differentially Private Distributed Online Algorithms Over Time-Varying Directed Networks , 2018, IEEE Transactions on Signal and Information Processing over Networks.

[24]  Richard Heusdens,et al.  Distributed Optimization Using the Primal-Dual Method of Multipliers , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[25]  Dario Pompili,et al.  Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing Networks , 2017, IEEE Transactions on Vehicular Technology.

[26]  Kannan Ramchandran,et al.  Customized Local Differential Privacy for Multi-Agent Distributed Optimization , 2018, ArXiv.

[27]  Haitao Zhao,et al.  A Simple Distributed Channel Allocation Algorithm for D2D Communication Pairs , 2018, IEEE Transactions on Vehicular Technology.

[28]  Lihua Xie,et al.  A Bregman Splitting Scheme for Distributed Optimization Over Networks , 2018, IEEE Transactions on Automatic Control.

[29]  Tingwen Huang,et al.  Distributed Power Management for Dynamic Economic Dispatch in the Multimicrogrids Environment , 2019, IEEE Transactions on Control Systems Technology.

[30]  Sergio Barbarossa,et al.  Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing , 2014, IEEE Transactions on Signal and Information Processing over Networks.

[31]  Bart Jacobs,et al.  Privacy-Friendly Energy-Metering via Homomorphic Encryption , 2010, STM.

[32]  Shanying Zhu,et al.  A Dual Splitting Method for Distributed Economic Dispatch in Multi-energy Systems , 2020 .

[33]  Jorge Cortés,et al.  Differentially Private Distributed Convex Optimization via Functional Perturbation , 2015, IEEE Transactions on Control of Network Systems.

[34]  Ferdinando Fioretto,et al.  Privacy-Preserving Power System Obfuscation: A Bilevel Optimization Approach , 2020, IEEE Transactions on Power Systems.

[35]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[36]  Hao Jiang,et al.  Privacy-Preserving Online Task Allocation in Edge-Computing-Enabled Massive Crowdsensing , 2019, IEEE Internet of Things Journal.

[37]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[38]  Cynthia Dwork,et al.  Differential Privacy: A Survey of Results , 2008, TAMC.

[39]  Lin Chen,et al.  Small-Scale Renewable Energy Source Trading: A Contract Theory Approach , 2018, IEEE Transactions on Industrial Informatics.