Privacy preserving region optimal algorithms for symmetric and asymmetric DCOPs

Abstract Region-optimal algorithms are local search algorithms for solving Distributed Constraint Optimization Problems (DCOPs). In each iteration of the search in such algorithms, every agent selects a group of agents that comply with some selection criteria (each algorithm specifies different criteria). Then, the agent who selected the group, called the mediator, collects assignment information from the group and neighboring agents outside the group, in order to find an optimal set of assignments for its group's agents. A contest between mediators of adjacent groups determines which groups will replace their assignments in that iteration to the found optimal ones. In this work we present a framework called RODA (Region Optimal DCOP Algorithm) that encompasses the algorithms in the region optimality family, and in particular any method for selecting groups. We devise a secure implementation of RODA, called P-RODA, which preserves constraint privacy and partial decision privacy. Our discussion covers both symmetric and asymmetric DCOPs. The two main cryptographic means that enable this privacy preservation are secret sharing and homomorphic encryption. We estimate the computational overhead of P-RODA with respect to RODA and give an upper bound that depends on the group and domain sizes and on the graph topology, but not on the number of agents. The estimations are substantiated with experimental results, including experiments on a simulator, that compare the performance of P-RODA to that of its competing algorithm, P-Max-Sum.

[1]  Amnon Meisels,et al.  Efficient Equilibria in a Public Goods Game , 2015, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT).

[2]  Milind Tambe,et al.  Quality guarantees for region optimal DCOP algorithms , 2011, AAMAS.

[3]  Milind Tambe,et al.  Privacy Loss in Distributed Constraint Reasoning: A Quantitative Framework for Analysis and its Applications , 2006, Autonomous Agents and Multi-Agent Systems.

[4]  Makoto Yokoo,et al.  Pseudo-Tree-Based Incomplete Algorithm for Distributed Constraint Optimization with Quality Bounds , 2011, CP.

[5]  Boi Faltings,et al.  Secure Combinatorial Optimization Simulating DFS Tree-Based Variable Elimination , 2006, AI&M.

[6]  Makoto Yokoo,et al.  Secure Distributed Constraint Satisfaction: Reaching Agreement without Revealing Private Information , 2002, CP.

[7]  Rachel Greenstadt An overview of privacy improvements to k-optimal DCOP algorithms , 2009, AAMAS.

[8]  Milind Tambe,et al.  A Family of Graphical-Game-Based Algorithms for Distributed Constraint Optimization Problems , 2006 .

[9]  Tamir Tassa,et al.  Max-Sum Goes Private , 2015, IJCAI.

[10]  Josh Benaloh,et al.  Secret Sharing Homomorphisms: Keeping Shares of A Secret Sharing , 1986, CRYPTO.

[11]  V. R. Lesser,et al.  Asynchronous Partial Overlay: A New Algorithm for Solving Distributed Constraint Satisfaction Problems , 2011, J. Artif. Intell. Res..

[12]  Tamir Tassa,et al.  Preserving Privacy in Region Optimal DCOP Algorithms , 2016, IJCAI.

[13]  Makoto Yokoo,et al.  The distributed breakout algorithms , 2005, Artif. Intell..

[14]  Meritxell Vinyals,et al.  Divide-and-coordinate: DCOPs by agreement , 2010, AAMAS.

[15]  Amnon Meisels,et al.  Asynchronous Forward Bounding for Distributed COPs , 2014, J. Artif. Intell. Res..

[16]  Amnon Meisels,et al.  Taxation search in boolean games , 2013, AAMAS.

[17]  Enrico Pontelli,et al.  A Multiagent System Approach to Scheduling Devices in Smart Homes , 2017, AAMAS.

[18]  Makoto Yokoo,et al.  Distributed Private Constraint Optimization , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[19]  Makoto Yokoo,et al.  Distributed Partial Constraint Satisfaction Problem , 1997, CP.

[20]  Steven Okamoto,et al.  Balancing exploration and exploitation in incomplete Min/Max-sum inference for distributed constraint optimization , 2017, Autonomous Agents and Multi-Agent Systems.

[21]  Milind Tambe,et al.  Asynchronous algorithms for approximate distributed constraint optimization with quality bounds , 2010, AAMAS.

[22]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[23]  Pascal Paillier,et al.  Public-Key Cryptosystems Based on Composite Degree Residuosity Classes , 1999, EUROCRYPT.

[24]  Jonathan P. Pearce,et al.  KOPT : Distributed DCOP Algorithm for Arbitrary k-optima with Monotonically Increasing Utility , 2007 .

[25]  Tal Grinshpoun,et al.  When You Say (DCOP) Privacy, What do You Mean? - Categorization of DCOP Privacy and Insights on Internal Constraint Privacy , 2012, ICAART.

[26]  Milind Tambe,et al.  Quality Guarantees on k-Optimal Solutions for Distributed Constraint Optimization Problems , 2007, IJCAI.

[27]  Paul Scerri,et al.  Coordination of Large-Scale Multiagent Systems , 2005 .

[28]  Gauthier Picard,et al.  Using Message-Passing DCOP Algorithms to Solve Energy-Efficient Smart Environment Configuration Problems , 2016, IJCAI.

[29]  Pedro Meseguer,et al.  Improving DPOP with function filtering , 2010, AAMAS.

[30]  Milind Tambe,et al.  Analysis of Privacy Loss in Distributed Constraint Optimization , 2006, AAAI.

[31]  Michael D. Smith,et al.  SSDPOP: improving the privacy of DCOP with secret sharing , 2007, AAMAS '07.

[32]  Nicholas R. Jennings,et al.  Bounded approximate decentralised coordination via the max-sum algorithm , 2009, Artif. Intell..

[33]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[34]  Ehud Gudes,et al.  Secure distributed computation of anonymized views of shared databases , 2012, TODS.

[35]  Boi Faltings,et al.  Privacy Guarantees through Distributed Constraint Satisfaction , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[36]  Kobbi Nissim,et al.  Secure DisCSP Protocols – From Centralized Towards Distributed Solutions , 2005 .

[37]  Boi Faltings,et al.  Approximations in Distributed Optimization , 2005, CP.

[38]  Amnon Meisels,et al.  Completeness and Performance Of The APO Algorithm , 2008, J. Artif. Intell. Res..

[39]  Weixiong Zhang,et al.  Distributed stochastic search and distributed breakout: properties, comparison and applications to constraint optimization problems in sensor networks , 2005, Artif. Intell..

[40]  Robert N. Lass,et al.  DCOPolis: a framework for simulating and deploying distributed constraint reasoning algorithms , 2008, AAMAS.

[41]  Makoto Yokoo,et al.  Secure distributed constraint satisfaction: reaching agreement without revealing private information , 2002, Artif. Intell..

[42]  Amnon Meisels,et al.  Distributed envy minimization for resource allocation , 2015, Autonomous Agents and Multi-Agent Systems.

[43]  Steven Okamoto,et al.  Distributed constraint optimization for teams of mobile sensing agents , 2014, Autonomous Agents and Multi-Agent Systems.

[44]  J. Christopher Beck,et al.  A negotiation framework for linked combinatorial optimization problems , 2011, Autonomous Agents and Multi-Agent Systems.

[45]  Nicholas R. Jennings,et al.  Agent-based decentralised coordination for sensor networks using the max-sum algorithm , 2014, Autonomous Agents and Multi-Agent Systems.

[46]  Boi Faltings,et al.  Protecting Privacy through Distributed Computation in Multi-agent Decision Making , 2013, J. Artif. Intell. Res..

[47]  Tamir Tassa,et al.  A privacy-preserving algorithm for distributed constraint optimization , 2014, AAMAS.

[48]  Enrico Pontelli,et al.  Multi-Variable Agents Decomposition for DCOPs , 2016, AAAI Conference on Artificial Intelligence.

[49]  Tamir Tassa,et al.  Privacy Preserving Implementation of the Max-Sum Algorithm and its Variants , 2017, J. Artif. Intell. Res..

[50]  Amnon Meisels,et al.  Scheduling Meetings by Agents , 2008 .

[51]  Nicholas R. Jennings,et al.  Max-sum decentralised coordination for sensor systems , 2008, AAMAS.

[52]  Sven Koenig,et al.  BnB-ADOPT: an asynchronous branch-and-bound DCOP algorithm , 2008, AAMAS.

[53]  Tamir Tassa,et al.  P-SyncBB: A Privacy Preserving Branch and Bound DCOP Algorithm , 2016, J. Artif. Intell. Res..

[54]  Amnon Meisels,et al.  Congestion Games for V2G-Enabled EV Charging , 2014, AAAI.

[55]  Milind Tambe,et al.  Distributed Algorithms for DCOP: A Graphical-Game-Based Approach , 2004, PDCS.

[56]  Makoto Yokoo,et al.  DCOPs meet the realworld: exploring unknown reward matrices with applications to mobile sensor networks , 2009, IJCAI 2009.

[57]  Enrico Pontelli,et al.  Multi-Variable Agent decomposition for DCOPs , 2016, AAAI 2016.

[58]  Marius-Calin Silaghi,et al.  Distributed constraint satisfaction and optimization with privacy enforcement , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[59]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[60]  Amnon Meisels,et al.  Asymmetric Distributed Constraint Optimization Problems , 2013, J. Artif. Intell. Res..

[61]  Nicholas R. Jennings,et al.  Decentralised coordination of low-power embedded devices using the max-sum algorithm , 2008, AAMAS.

[62]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[63]  Victor R. Lesser,et al.  Solving distributed constraint optimization problems using cooperative mediation , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[64]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[65]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[66]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[67]  Steven Okamoto,et al.  Explorative anytime local search for distributed constraint optimization , 2014, Artif. Intell..

[68]  Tal Grinshpoun Clustering Variables by Their Agents , 2015, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT).

[69]  Amnon Meisels,et al.  AgentZero: A Framework for Simulating and Evaluating Multi-agent Algorithms , 2014, Agent-Oriented Software Engineering.