A Privacy-preserving Diffusion Strategy over Multitask Networks

We develop a privacy-preserving distributed strategy over multitask diffusion networks, where each agent is interested in not only improving its local inference performance via in-network cooperation, but also protecting its own individual task against privacy leakage. In the proposed strategy, at each time instant, each agent sends a noisy estimate, which is its local intermediate estimate corrupted by a zero-mean additive noise, to its neighboring agents. We derive a sufficient condition to determine the amount of noise to add to each agent’s intermediate estimate to achieve an optimal trade-off between the steady-state network mean-square-deviation and an inference privacy constraint. We show that the proposed noise powers are bounded and convergent, which leads to mean-square convergence of the proposed privacy-preserving multitask diffusion scheme. Simulation results demonstrate that the proposed strategy is able to balance the trade-off between estimation accuracy and privacy preservation.

[1]  Sun-Yuan Kung,et al.  Data privacy protection by kernel subspace projection and generalized eigenvalue decomposition , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[2]  Shancang Li,et al.  5G Internet of Things: A survey , 2018, J. Ind. Inf. Integr..

[3]  Anand D. Sarwate,et al.  Randomized requantization with local differential privacy , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Xintao Wu,et al.  Using Randomized Response for Differential Privacy Preserving Data Collection , 2016, EDBT/ICDT Workshops.

[5]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[6]  Wee Peng Tay Whose Opinion to Follow in Multihypothesis Social Learning? A Large Deviations Perspective , 2014, IEEE Journal of Selected Topics in Signal Processing.

[7]  Behrooz Razeghi,et al.  Privacy-Preserving Outsourced Media Search Using Secure Sparse Ternary Codes , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  S. Y. Kung,et al.  A Compressive Privacy approach to Generalized Information Bottleneck and Privacy Funnel problems , 2017, J. Frankl. Inst..

[9]  Meng Sun,et al.  Privacy-preserving nonparametric decentralized detection , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Moe Z. Win,et al.  Data Fusion Trees for Detection: Does Architecture Matter? , 2008, IEEE Transactions on Information Theory.

[11]  Anand D. Sarwate,et al.  A rate-disortion perspective on local differential privacy , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  Hyundong Shin,et al.  Distributed Local Linear Parameter Estimation Using Gaussian SPAWN , 2014, IEEE Transactions on Signal Processing.

[13]  Martin J. Wainwright,et al.  Local privacy and statistical minimax rates , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Anand D. Sarwate,et al.  Differentially Private Distributed Principal Component Analysis , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Xin He,et al.  Privacy-aware decentralized detection using linear precoding , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[16]  Cédric Richard,et al.  Diffusion LMS for Multitask Problems With Local Linear Equality Constraints , 2016, IEEE Transactions on Signal Processing.

[17]  Meng Sun,et al.  Inference and data privacy in IoT networks , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[18]  V. Tan,et al.  Hypothesis testing under maximal leakage privacy constraints , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[19]  Moni Naor,et al.  Our Data, Ourselves: Privacy Via Distributed Noise Generation , 2006, EUROCRYPT.

[20]  Philip S. Yu,et al.  $\textsf{LoPub}$ : High-Dimensional Crowdsourced Data Publication With Local Differential Privacy , 2016, IEEE Transactions on Information Forensics and Security.

[21]  Sun-Yuan Kung,et al.  Ratio Utility and Cost Analysis for Privacy Preserving Subspace Projection , 2017, ArXiv.

[22]  Xin He,et al.  Multilayer Nonlinear Processing for Information Privacy in Sensor Networks , 2017, ArXiv.

[23]  Meng Sun,et al.  Toward Information Privacy for the Internet of Things: A Nonparametric Learning Approach , 2018, IEEE Transactions on Signal Processing.

[24]  Anurag Agarwal,et al.  The Internet of Things—A survey of topics and trends , 2015, Inf. Syst. Frontiers.

[25]  Edwin K. P. Chong,et al.  Robust Decentralized Detection and Social Learning in Tandem Networks , 2015, IEEE Transactions on Signal Processing.

[26]  Cédric Richard,et al.  Toward privacy-preserving diffusion strategies for adaptation and learning over networks , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[27]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[28]  Sajjad Hussain Shah,et al.  A survey: Internet of Things (IOT) technologies, applications and challenges , 2016, 2016 IEEE Smart Energy Grid Engineering (SEGE).