Adversarial Attacks on Deep Graph Matching

Despite achieving remarkable performance, deep graph learning models, such as node classification and network embedding, suffer from harassment caused by small adversarial perturbations. However, the vulnerability analysis of graph matching under adversarial attacks has not been fully investigated yet. This paper proposes an adversarial attack model with two novel attack techniques to perturb the graph structure and degrade the quality of deep graph matching: (1) a kernel density estimation approach is utilized to estimate and maximize node densities to derive imperceptible perturbations, by pushing attacked nodes to dense regions in two graphs, such that they are indistinguishable from many neighbors; and (2) a meta learning-based projected gradient descent method is developed to well choose attack starting points and to improve the search performance for producing effective perturbations. We evaluate the effectiveness of the attack model on real datasets and validate that the attacks can be transferable to other graph learning models.

[1]  Hanghang Tong,et al.  Attributed Network Alignment: Problem Definitions and Fast Solutions , 2019, IEEE Transactions on Knowledge and Data Engineering.

[2]  Mingjie Sun,et al.  Data Poisoning Attack against Unsupervised Node Embedding Methods , 2018, ArXiv.

[3]  Nguyen Quoc Viet Hung,et al.  A comparative study on network alignment techniques , 2020, Expert Syst. Appl..

[4]  Jianxi Fan,et al.  TransLink: User Identity Linkage across Heterogeneous Social Networks via Translating Embeddings , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[5]  Charu C. Aggarwal,et al.  Meta Diagram Based Active Social Networks Alignment , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[6]  Zhonghai Wu,et al.  TopicKA: Generating Commonsense Knowledge-Aware Dialogue Responses Towards the Recommended Topic Fact , 2020, IJCAI.

[7]  Yanfang Ye,et al.  αCyber: Enhancing Robustness of Android Malware Detection System against Adversarial Attacks on Heterogeneous Graph based Model , 2019, CIKM.

[8]  Stephan Günnemann,et al.  Adversarial Attacks on Graph Neural Networks , 2019, GI-Jahrestagung.

[9]  Luca Bertinetto,et al.  Meta-learning with differentiable closed-form solvers , 2018, ICLR.

[10]  Mark Heimann,et al.  REGAL: Representation Learning-based Graph Alignment , 2018, CIKM.

[11]  Chunyan Feng,et al.  User identity linkage across social networks via linked heterogeneous network embedding , 2018, World Wide Web.

[12]  Philip S. Yu,et al.  Integrated Anchor and Social Link Predictions across Social Networks , 2015, IJCAI.

[13]  Guoyin Wang,et al.  Deep multi-granularity graph embedding for user identity linkage across social networks , 2020, Knowl. Based Syst..

[14]  Liming Zhu,et al.  Adversarial Examples on Graph Data: Deep Insights into Attack and Defense , 2019 .

[15]  R. Karp,et al.  Conserved pathways within bacteria and yeast as revealed by global protein network alignment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Qi Xuan,et al.  GA-Based Q-Attack on Community Detection , 2018, IEEE Transactions on Computational Social Systems.

[17]  Nils M. Kriege,et al.  Deep Graph Matching Consensus , 2020, ICLR.

[18]  Sijia Liu,et al.  Topology Attack and Defense for Graph Neural Networks: An Optimization Perspective , 2019, IJCAI.

[19]  Philip S. Yu,et al.  DNA: Dynamic Social Network Alignment , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[20]  Qi Zhang,et al.  GraphTwist: Fast Iterative Graph Computation with Two-tier Optimizations , 2015, Proc. VLDB Endow..

[21]  Saba A. Al-Sayouri,et al.  All You Need Is Low (Rank): Defending Against Adversarial Attacks on Graphs , 2020, WSDM.

[22]  Ling Liu,et al.  Integrating Vertex-centric Clustering with Edge-centric Clustering for Meta Path Graph Analysis , 2015, KDD.

[23]  Hong Cheng,et al.  Graph Clustering Based on Structural/Attribute Similarities , 2009, Proc. VLDB Endow..

[24]  Zhoujun Li,et al.  Adversarial Learning for Weakly-Supervised Social Network Alignment , 2019, AAAI.

[25]  D. Dou,et al.  Robust Meta Network Embedding against Adversarial Attacks , 2020, 2020 IEEE International Conference on Data Mining (ICDM).

[26]  Vipin Vijayan,et al.  Multiple Network Alignment via MultiMAGNA++ , 2016, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[27]  Reza Zafarani,et al.  User Identity Linkage across Online Social Networks: A Review , 2017, SKDD.

[28]  Yizheng Chen,et al.  Practical Attacks Against Graph-based Clustering , 2017, CCS.

[29]  Vasant Honavar,et al.  Node Injection Attacks on Graphs via Reinforcement Learning , 2019, ArXiv.

[30]  Pietro Hiram Guzzi,et al.  Survey of local and global biological network alignment: the need to reconcile the two sides of the same coin , 2017, Briefings Bioinform..

[31]  Stephan Günnemann,et al.  Adversarial Attacks on Node Embeddings via Graph Poisoning , 2018, ICML.

[32]  Ramayya Krishnan,et al.  HYDRA: large-scale social identity linkage via heterogeneous behavior modeling , 2014, SIGMOD Conference.

[33]  D. W. Scott,et al.  On Locally Adaptive Density Estimation , 1996 .

[34]  Chenglin Miao,et al.  Data Poisoning Attack against Knowledge Graph Embedding , 2019, IJCAI.

[35]  Talal Rahwan,et al.  Attacking Similarity-Based Link Prediction in Social Networks , 2018, AAMAS.

[36]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[37]  Ruoming Jin,et al.  Integrating Local Vertex/Edge Embedding via Deep Matrix Fusion and Siamese Multi-label Classification , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[38]  Tsubasa Takahashi,et al.  Indirect Adversarial Attacks via Poisoning Neighbors for Graph Convolutional Networks , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[39]  Jinyin Chen,et al.  MGA: Momentum Gradient Attack on Network , 2020, IEEE Transactions on Computational Social Systems.

[40]  Binghui Wang,et al.  Attacking Graph-based Classification via Manipulating the Graph Structure , 2019, CCS.

[41]  Raymond Y. K. Lau,et al.  Anchor Link Prediction across Attributed Networks via Network Embedding , 2019, Entropy.

[42]  Ling Liu,et al.  Analyzing Enterprise Storage Workloads With Graph Modeling and Clustering , 2016, IEEE Journal on Selected Areas in Communications.

[43]  Hanghang Tong,et al.  FINAL: Fast Attributed Network Alignment , 2016, KDD.

[44]  Ling Liu,et al.  Activity-edge centric multi-label classification for mining heterogeneous information networks , 2014, KDD.

[45]  Qi Xuan,et al.  Fast Gradient Attack on Network Embedding , 2018, ArXiv.

[46]  Philip S. Yu,et al.  Inferring anchor links across multiple heterogeneous social networks , 2013, CIKM.

[47]  Jie Chen,et al.  Graph Universal Adversarial Attacks: A Few Bad Actors Ruin Graph Learning Models , 2020, IJCAI.

[48]  Talal Rahwan,et al.  Hiding individuals and communities in a social network , 2016, Nature Human Behaviour.

[49]  Jing Xiao,et al.  User Identity Linkage by Latent User Space Modelling , 2016, KDD.

[50]  Jiliang Tang,et al.  Adversarial Attacks and Defenses in Images, Graphs and Text: A Review , 2019, International Journal of Automation and Computing.

[51]  Stephan Günnemann,et al.  Adversarial Attacks on Neural Networks for Graph Data , 2018, KDD.

[52]  Stephan Gunnemann,et al.  Adversarial Attacks on Graph Neural Networks via Meta Learning , 2019, ICLR.

[53]  Philip S. Yu,et al.  Predicting Social Links for New Users across Aligned Heterogeneous Social Networks , 2013, 2013 IEEE 13th International Conference on Data Mining.

[54]  Hanghang Tong,et al.  FIRST: Fast Interactive Attributed Subgraph Matching , 2017, KDD.

[55]  Ananth Grama,et al.  Rigid Graph Alignment , 2019, COMPLEX NETWORKS.

[56]  Cho-Jui Hsieh,et al.  A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning , 2019, NeurIPS.

[57]  Hong Cheng,et al.  Clustering Large Attributed Graphs: A Balance between Structural and Attribute Similarities , 2011, TKDD.

[58]  Aleksander Madry,et al.  Towards Deep Learning Models Resistant to Adversarial Attacks , 2017, ICLR.

[59]  Le Song,et al.  Adversarial Attack on Graph Structured Data , 2018, ICML.

[60]  Hong Cheng,et al.  Clustering large attributed information networks: an efficient incremental computing approach , 2012, Data Mining and Knowledge Discovery.

[61]  Yong Li,et al.  DPLink: User Identity Linkage via Deep Neural Network From Heterogeneous Mobility Data , 2019, WWW.

[62]  Shahin Mohammadi,et al.  Low Rank Spectral Network Alignment , 2018, WWW.

[63]  Yang Zhou,et al.  Improving Collaborative Filtering with Social Influence over Heterogeneous Information Networks , 2020, ACM Trans. Internet Techn..

[64]  Bonnie Berger,et al.  Global alignment of multiple protein interaction networks with application to functional orthology detection , 2008, Proceedings of the National Academy of Sciences.

[65]  Hongyuan Zha,et al.  Joint Link Prediction and Network Alignment via Cross-graph Embedding , 2019, IJCAI.

[66]  Philip S. Yu,et al.  MC2:Unsupervised Multiple Social Network Alignment , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[67]  Lei Liu,et al.  DeepLink: A Deep Learning Approach for User Identity Linkage , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[68]  Fan Zhou,et al.  Disentangled Network Alignment with Matching Explainability , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[69]  Heinrich Jiang,et al.  Uniform Convergence Rates for Kernel Density Estimation , 2017, ICML.

[70]  Abdurrahman Yacsar,et al.  An Iterative Global Structure-Assisted Labeled Network Aligner , 2018, 1803.03882.

[71]  Ruoming Jin,et al.  Density-Adaptive Local Edge Representation Learning with Generative Adversarial Network Multi-label Edge Classification , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[72]  Yong Cao,et al.  CoLink: An Unsupervised Framework for User Identity Linkage , 2018, AAAI.

[73]  Hanghang Tong,et al.  ORIGIN: Non-Rigid Network Alignment , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[74]  Bo Song,et al.  Community-Based Network Alignment for Large Attributed Network , 2017, CIKM.

[75]  Si Zhang,et al.  Multilevel Network Alignment , 2019, WWW.

[76]  Philip S. Yu,et al.  COSNET: Connecting Heterogeneous Social Networks with Local and Global Consistency , 2015, KDD.

[77]  N. Hjort,et al.  Nonparametric Density Estimation with a Parametric Start , 1995 .

[78]  Yansong Feng,et al.  Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network , 2019, ACL.

[79]  Li Sun,et al.  MASTER: across Multiple social networks, integrate Attribute and STructure Embedding for Reconciliation , 2018, IJCAI.

[80]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[81]  Jingping Bi,et al.  Cross-Network Embedding for Multi-Network Alignment , 2019, WWW.

[82]  Pang-Ning Tan,et al.  OPTANE: An OPtimal Transport Algorithm for NEtwork Alignment , 2019, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[83]  Oriol Vinyals,et al.  Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML , 2019, ICLR.

[84]  Suhang Wang,et al.  Adversarial Attacks on Graph Neural Networks via Node Injections: A Hierarchical Reinforcement Learning Approach , 2020, WWW.

[85]  Kevin Chen-Chuan Chang,et al.  Heterogeneous Embedding Propagation for Large-Scale E-Commerce User Alignment , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[86]  Ling Liu,et al.  Social Influence Based Clustering and Optimization over Heterogeneous Information Networks , 2015, ACM Trans. Knowl. Discov. Data.

[87]  Honglei Zhang,et al.  Adversarial Attack on Community Detection by Hiding Individuals , 2020, WWW.

[88]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[89]  Hanghang Tong,et al.  FASTEN: Fast Sylvester Equation Solver for Graph Mining , 2018, KDD.

[90]  Ling Liu,et al.  Social influence based clustering of heterogeneous information networks , 2013, KDD.

[91]  Yang Zhou,et al.  Dual Adversarial Learning Based Network Alignment , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[92]  Wenbing Huang,et al.  A Restricted Black-Box Adversarial Framework Towards Attacking Graph Embedding Models , 2019, AAAI.

[93]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[94]  Hong Cheng,et al.  Clustering Large Attributed Graphs: An Efficient Incremental Approach , 2010, 2010 IEEE International Conference on Data Mining.

[95]  Xiaoming Zhang,et al.  Distribution Distance Minimization for Unsupervised User Identity Linkage , 2018, CIKM.

[96]  Xiaofei Zhou,et al.  Neighborhood-Aware Attentional Representation for Multilingual Knowledge Graphs , 2019, IJCAI.

[97]  Yahong Han,et al.  Curls & Whey: Boosting Black-Box Adversarial Attacks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[98]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[99]  Xiaolong Jin,et al.  Predict Anchor Links across Social Networks via an Embedding Approach , 2016, IJCAI.

[100]  Ee-Peng Lim,et al.  AD-Link: An Adaptive Approach for User Identity Linkage , 2019, 2019 IEEE International Conference on Big Knowledge (ICBK).

[101]  Stephan Günnemann,et al.  Making Kernel Density Estimation Robust towards Missing Values in Highly Incomplete Multivariate Data without Imputation , 2018, SDM.

[102]  Mingchu Li,et al.  Reliable and Resilient Trust Management in Distributed Service Provision Networks , 2015, ACM Trans. Web.

[103]  Aryan Mokhtari,et al.  On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithms , 2019, AISTATS.

[104]  D. Dou,et al.  Unsupervised Multiple Network Alignment with Multinominal GAN and Variational Inference , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[105]  Calton Pu,et al.  Fast Iterative Graph Computation with Resource Aware Graph Parallel Abstractions , 2015, HPDC.

[106]  Li Liu,et al.  Aligning Users across Social Networks Using Network Embedding , 2016, IJCAI.

[107]  Ling Liu,et al.  Clustering Analysis in Large Graphs with Rich Attributes , 2012 .

[108]  Richard Socher,et al.  Taming MAML: Efficient unbiased meta-reinforcement learning , 2019, ICML.

[109]  P. Dey,et al.  Manipulating Node Similarity Measures in Network , 2019, AAMAS.

[110]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[111]  Aristides Gionis,et al.  Active Network Alignment: A Matching-Based Approach , 2016, CIKM.

[112]  Calton Pu,et al.  Scaling iterative graph computations with GraphMap , 2015, SC15: International Conference for High Performance Computing, Networking, Storage and Analysis.

[113]  Zhoujun Li,et al.  Partially Shared Adversarial Learning For Semi-supervised Multi-platform User Identity Linkage , 2019, CIKM.

[114]  Zhonghai Wu,et al.  Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness , 2020, ACL.

[115]  Tijana Milenkovic,et al.  Pairwise versus multiple network alignment , 2017 .

[116]  Hanghang Tong,et al.  iNEAT: Incomplete Network Alignment , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[117]  Wei Xie,et al.  Unsupervised User Identity Linkage via Factoid Embedding , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[118]  Ruoming Jin,et al.  Density-aware Local Siamese Autoencoder Network Embedding with Autoencoder Graph Clustering , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[119]  Hongyuan Zha,et al.  Gromov-Wasserstein Learning for Graph Matching and Node Embedding , 2019, ICML.

[120]  Wenwu Zhu,et al.  Robust Graph Convolutional Networks Against Adversarial Attacks , 2019, KDD.

[121]  Jinhui Xu,et al.  Novel Geometric Approach for Global Alignment of PPI Networks , 2017, AAAI.

[122]  Bo Yang,et al.  Learning node and edge embeddings for signed networks , 2018, Neurocomputing.

[123]  Xiaoyong Du,et al.  Structure Based User Identification across Social Networks , 2018, IEEE Transactions on Knowledge and Data Engineering.