Improved Differentially Private Densest Subgraph: Local and Purely Additive

We study the Densest Subgraph problem under the additional constraint of differential privacy. In the LEDP (local edge differential privacy) model, introduced recently by Dhulipala et al. [FOCS 2022], we give an $(\epsilon, \delta)$-differentially private algorithm with no multiplicative loss: the loss is purely additive. This is in contrast to every previous private algorithm for densest subgraph (local or centralized), all of which incur some multiplicative loss as well as some additive loss. Moreover, our additive loss matches the best-known previous additive loss (in any version of differential privacy) when $1/\delta$ is at least polynomial in $n$, and in the centralized setting we can strengthen our result to provide better than the best-known additive loss. Additionally, we give a different algorithm that is $\epsilon$-differentially private in the LEDP model which achieves a multiplicative ratio arbitrarily close to $2$, along with an additional additive factor. This improves over the previous multiplicative $4$-approximation in the LEDP model. Finally, we conclude with extensions of our techniques to both the node-weighted and the directed versions of the problem.

[1]  Quanquan C. Liu,et al.  Differential Privacy from Locally Adjustable Graph Algorithms: k-Core Decomposition, Low Out-Degree Ordering, and Densest Subgraphs , 2022, 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS).

[2]  Silvio Lattanzi,et al.  Near-Optimal Correlation Clustering with Privacy , 2022, NeurIPS.

[3]  Manuel R. Torres,et al.  Densest Subgraph: Supermodularity, Iterative Peeling, and Flow , 2022, SODA.

[4]  E. Shi,et al.  Differentially Private Densest Subgraph , 2021, AISTATS.

[5]  Anil Vullikanti,et al.  Differentially Private Densest Subgraph Detection , 2021, ICML.

[6]  O. Papaspiliopoulos High-Dimensional Probability: An Introduction with Applications in Data Science , 2020 .

[7]  Janardhan Kulkarni,et al.  Differentially Private Release of Synthetic Graphs , 2020, SODA.

[8]  Richard Peng,et al.  Flowless: Extracting Densest Subgraphs Without Flow Computations , 2019, WWW.

[9]  Saurabh Sawlani,et al.  Near-optimal fully dynamic densest subgraph , 2019, STOC.

[10]  Silvio Lattanzi,et al.  Improved Parallel Algorithms for Density-Based Network Clustering , 2019, ICML.

[11]  Kunal Talwar,et al.  Private selection from private candidates , 2018, STOC.

[12]  Ninghui Li,et al.  Privacy at Scale: Local Dierential Privacy in Practice , 2018 .

[13]  Salil P. Vadhan,et al.  Differential Privacy on Finite Computers , 2017, ITCS.

[14]  David P. Woodruff,et al.  Brief Announcement: Applications of Uniform Sampling: Densest Subgraph and Beyond , 2015, SPAA.

[15]  Sofya Vorotnikova,et al.  Densest Subgraph in Dynamic Graph Streams , 2015, MFCS.

[16]  Silvio Lattanzi,et al.  Efficient Densest Subgraph Computation in Evolving Graphs , 2015, WWW.

[17]  Charalampos E. Tsourakakis,et al.  Space- and Time-Efficient Algorithm for Maintaining Dense Subgraphs on One-Pass Dynamic Streams , 2015, STOC.

[18]  Aaron Roth,et al.  The Algorithmic Foundations of Differential Privacy , 2014, Found. Trends Theor. Comput. Sci..

[19]  Tim Roughgarden,et al.  Privately Solving Linear Programs , 2014, ICALP.

[20]  Takuya Akiba,et al.  Fast exact shortest-path distance queries on large networks by pruned landmark labeling , 2013, SIGMOD '13.

[21]  Yousef Saad,et al.  Dense Subgraph Extraction with Application to Community Detection , 2012, IEEE Transactions on Knowledge and Data Engineering.

[22]  Sanjeev Arora,et al.  The Multiplicative Weights Update Method: a Meta-Algorithm and Applications , 2012, Theory Comput..

[23]  Divesh Srivastava,et al.  Dense subgraph maintenance under streaming edge weight updates for real-time story identification , 2012, The VLDB Journal.

[24]  Sergei Vassilvitskii,et al.  Densest Subgraph in Streaming and MapReduce , 2012, Proc. VLDB Endow..

[25]  Guy N. Rothblum,et al.  A Multiplicative Weights Mechanism for Privacy-Preserving Data Analysis , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[26]  Samir Khuller,et al.  Dense Subgraphs with Restrictions and Applications to Gene Annotation Graphs , 2010, RECOMB.

[27]  Frank McSherry Privacy integrated queries , 2010, Commun. ACM.

[28]  Aaron Roth,et al.  Differentially private combinatorial optimization , 2009, SODA '10.

[29]  Tim Roughgarden,et al.  Universally utility-maximizing privacy mechanisms , 2008, STOC '09.

[30]  Sofya Raskhodnikova,et al.  What Can We Learn Privately? , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[31]  Kunal Talwar,et al.  Mechanism Design via Differential Privacy , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[32]  Sofya Raskhodnikova,et al.  Smooth sensitivity and sampling in private data analysis , 2007, STOC '07.

[33]  Marco Pellegrini,et al.  Extraction and classification of dense communities in the web , 2007, WWW '07.

[34]  Ravi Kumar,et al.  Structure and evolution of online social networks , 2006, KDD '06.

[35]  Cynthia Dwork,et al.  Calibrating Noise to Sensitivity in Private Data Analysis , 2006, TCC.

[36]  Ravi Kumar,et al.  Discovering Large Dense Subgraphs in Massive Graphs , 2005, VLDB.

[37]  Moses Charikar,et al.  Greedy approximation algorithms for finding dense components in a graph , 2000, APPROX.

[38]  Éva Tardos,et al.  Fast approximation algorithms for fractional packing and covering problems , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[39]  P. Li,et al.  Private Graph All-Pairwise-Shortest-Path Distance Release with Improved Error Rate , 2022, NeurIPS.

[40]  Raman Arora,et al.  On Differentially Private Graph Sparsification and Applications , 2019, NeurIPS.

[41]  Salil P. Vadhan,et al.  The Complexity of Differential Privacy , 2017, Tutorials on the Foundations of Cryptography.

[42]  Andrew V. Goldberg,et al.  Finding a Maximum Density Subgraph , 1984 .