Uncertainty-Aware Opinion Inference Under Adversarial Attacks

Inference of unknown opinions with uncertain, adversarial (e.g., incorrect or conflicting) evidence in large datasets is not a trivial task. Without proper handling, it can easily mislead decision making in data mining tasks. In this work, we propose a highly scalable opinion inference probabilistic model, namely Adversarial Collective Opinion Inference (Adv-COI), which provides a solution to infer unknown opinions with high scalability and robustness under the presence of uncertain, adversarial evidence by enhancing Collective Subjective Logic (CSL) which is developed by combining SL and Probabilistic Soft Logic (PSL). The key idea behind the Adv-COI is to learn a model of robust ways against uncertain, adversarial evidence which is formulated as a min-max problem. We validate the out-performance of the Adv-COI compared to baseline models and its competitive counterparts under possible adversarial attacks on the logic-rule based structured data and white and black box adversarial attacks under both clean and perturbed semi-synthetic and real-world datasets in three real world applications. The results show that the Adv-COI generates the lowest mean absolute error in the expected truth probability while producing the lowest running time among all.

[1]  Le Song,et al.  Adversarial Attack on Graph Structured Data , 2018, ICML.

[2]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[3]  Sandy H. Huang,et al.  Adversarial Attacks on Neural Network Policies , 2017, ICLR.

[4]  Prateek Mittal,et al.  SybilBelief: A Semi-Supervised Learning Approach for Structure-Based Sybil Detection , 2013, IEEE Transactions on Information Forensics and Security.

[5]  Stephen H. Bach,et al.  Hinge-Loss Markov Random Fields and Probabilistic Soft Logic , 2015, J. Mach. Learn. Res..

[6]  Lise Getoor,et al.  A Flexible Framework for Probabilistic Models of Social Trust , 2013, SBP.

[7]  Zhen Qian,et al.  Road Traffic Congestion Monitoring in Social Media with Hinge-Loss Markov Random Fields , 2014, 2014 IEEE International Conference on Data Mining.

[8]  Ben Taskar,et al.  Posterior Regularization for Structured Latent Variable Models , 2010, J. Mach. Learn. Res..

[9]  Simaan M. AbouRizk,et al.  FITTING BETA DISTRIBUTIONS BASED ON SAMPLE DATA , 1994 .

[10]  Aleksander Madry,et al.  Towards Deep Learning Models Resistant to Adversarial Attacks , 2017, ICLR.

[11]  Dawn Xiaodong Song,et al.  Delving into Transferable Adversarial Examples and Black-box Attacks , 2016, ICLR.

[12]  Stephan Günnemann,et al.  Adversarial Attacks on Neural Networks for Graph Data , 2018, KDD.

[13]  Audun Jøsang,et al.  A Logic for Uncertain Probabilities , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[14]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[15]  Audun Jøsang,et al.  Trust network analysis with subjective logic , 2006, ACSC.

[16]  David A. Wagner,et al.  Towards Evaluating the Robustness of Neural Networks , 2016, 2017 IEEE Symposium on Security and Privacy (SP).

[17]  Samy Bengio,et al.  Adversarial Machine Learning at Scale , 2016, ICLR.

[18]  David Wagner,et al.  Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods , 2017, AISec@CCS.

[19]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[20]  Jin-Hee Cho,et al.  Deep Learning Based Scalable Inference of Uncertain Opinions , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[21]  Le Zhang,et al.  Structure-Based Sybil Detection in Social Networks via Local Rule-Based Propagation , 2018, IEEE Transactions on Network Science and Engineering.

[22]  Jin-Hee Cho,et al.  Collective subjective logic: Scalable uncertainty-based opinion inference , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[23]  Audun Jøsang,et al.  Subjective Logic: A Formalism for Reasoning Under Uncertainty , 2016 .

[24]  Lise Getoor,et al.  Probabilistic soft logic for trust analysis in social networks , 2012 .