Context-Aware Local Differential Privacy

Local differential privacy (LDP) is a strong notion of privacy for individual users that often comes at the expense of a significant drop in utility. The classical definition of LDP assumes that all elements in the data domain are equally sensitive. However, in many applications, some symbols are more sensitive than others. This work proposes a context-aware framework of local differential privacy that allows a privacy designer to incorporate the application's context into the privacy definition. For binary data domains, we provide a universally optimal privatization scheme and highlight its connections to Warner's randomized response (RR) and Mangat's improved response. Motivated by geolocation and web search applications, for $k$-ary data domains, we consider two special cases of context-aware LDP: block-structured LDP and high-low LDP. We study discrete distribution estimation and provide communication-efficient, sample-optimal schemes and information-theoretic lower bounds for both models. We show that using contextual information can require fewer samples than classical LDP to achieve the same accuracy.

[1]  J. Sylvester LX. Thoughts on inverse orthogonal matrices, simultaneous signsuccessions, and tessellated pavements in two or more colours, with applications to Newton's rule, ornamental tile-work, and the theory of numbers , 1867 .

[2]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[3]  J. Kalbfleisch Statistical Inference Under Order Restrictions , 1975 .

[4]  L. Devroye,et al.  Nonparametric density estimation : the L[1] view , 1987 .

[5]  N. S. Mangat,et al.  An Improved Randomized Response Strategy , 1994 .

[6]  Luc Devroye,et al.  Combinatorial methods in density estimation , 2001, Springer series in statistics.

[7]  S. Sheather Density Estimation , 2004 .

[8]  Cynthia Dwork,et al.  Calibrating Noise to Sensitivity in Private Data Analysis , 2006, TCC.

[9]  Sofya Raskhodnikova,et al.  What Can We Learn Privately? , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[10]  Eran Omri,et al.  Distributed Private Data Analysis: On Simultaneously Solving How and What , 2008, CRYPTO.

[11]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[12]  Sanjeev Khanna,et al.  Distributed Private Heavy Hitters , 2012, ICALP.

[13]  Martin J. Wainwright,et al.  Local privacy and statistical minimax rates , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Catuscia Palamidessi,et al.  Broadening the Scope of Differential Privacy Using Metrics , 2013, Privacy Enhancing Technologies.

[15]  Úlfar Erlingsson,et al.  RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response , 2014, CCS.

[16]  Pramod Viswanath,et al.  Extremal Mechanisms for Local Differential Privacy , 2014, J. Mach. Learn. Res..

[17]  Raef Bassily,et al.  Local, Private, Efficient Protocols for Succinct Histograms , 2015, STOC.

[18]  Ilias Diakonikolas,et al.  Differentially Private Learning of Structured Discrete Distributions , 2015, NIPS.

[19]  Peter Kairouz,et al.  Discrete Distribution Estimation under Local Privacy , 2016, ICML.

[20]  Chunming Qiao,et al.  Mutual Information Optimally Local Private Discrete Distribution Estimation , 2016, ArXiv.

[21]  Ninghui Li,et al.  Locally Differentially Private Protocols for Frequency Estimation , 2017, USENIX Security Symposium.

[22]  Catuscia Palamidessi,et al.  Efficient Utility Improvement for Location Privacy , 2017, Proc. Priv. Enhancing Technol..

[23]  Raef Bassily,et al.  Practical Locally Private Heavy Hitters , 2017, NIPS.

[24]  A. Barg,et al.  Optimal Schemes for Discrete Distribution Estimation Under Locally Differential Privacy , 2017, IEEE Transactions on Information Theory.

[25]  Uri Stemmer,et al.  Heavy Hitters and the Structure of Local Privacy , 2017, PODS.

[26]  Christian Borgs,et al.  Revealing Network Structure, Confidentially: Improved Rates for Node-Private Graphon Estimation , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[27]  Takao Murakami,et al.  Restricted Local Differential Privacy for Distribution Estimation with High Data Utility , 2018, ArXiv.

[28]  Mário S. Alvim,et al.  Invited Paper: Local Differential Privacy on Metric Spaces: Optimizing the Trade-Off with Utility , 2018, 2018 IEEE 31st Computer Security Foundations Symposium (CSF).

[29]  Jayadev Acharya,et al.  Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters , 2019, ICML.

[30]  Zhiwei Steven Wu,et al.  Locally Private Bayesian Inference for Count Models , 2018, ICML.

[31]  Adam D. Smith,et al.  Distributed Differential Privacy via Shuffling , 2018, IACR Cryptol. ePrint Arch..

[32]  Tom Diethe,et al.  Leveraging Hierarchical Representations for Preserving Privacy and Utility in Text , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[33]  Kamalika Chaudhuri,et al.  Profile-based Privacy for Locally Private Computations , 2019, 2019 IEEE International Symposium on Information Theory (ISIT).

[34]  Himanshu Tyagi,et al.  Test without Trust: Optimal Locally Private Distribution Testing , 2018, AISTATS.

[35]  John Duchi,et al.  Element Level Differential Privacy: The Right Granularity of Privacy , 2019, ArXiv.

[36]  Huanyu Zhang,et al.  Hadamard Response: Estimating Distributions Privately, Efficiently, and with Little Communication , 2018, AISTATS.

[37]  H. Brendan McMahan,et al.  Federated Heavy Hitters Discovery with Differential Privacy , 2019, AISTATS.

[38]  Himanshu Tyagi,et al.  Inference Under Information Constraints I: Lower Bounds From Chi-Square Contraction , 2018, IEEE Transactions on Information Theory.

[39]  Ashwin Machanavajjhala,et al.  One-sided Differential Privacy , 2017, 2020 IEEE 36th International Conference on Data Engineering (ICDE).

[40]  Jingren Zhou,et al.  Linear and Range Counting under Metric-based Local Differential Privacy , 2019, 2020 IEEE International Symposium on Information Theory (ISIT).

[41]  Aaron Roth,et al.  Gaussian differential privacy , 2019, Journal of the Royal Statistical Society: Series B (Statistical Methodology).