Individual Fairness for Graph Neural Networks: A Ranking based Approach

Recent years have witnessed the pivotal role of Graph Neural Networks (GNNs) in various high-stake decision-making scenarios due to their superior learning capability. Close on the heels of the successful adoption of GNNs in different application domains has been the increasing societal concern that conventional GNNs often do not have fairness considerations. Although some research progress has been made to improve the fairness of GNNs, these works mainly focus on the notion of group fairness regarding different subgroups defined by a protected attribute such as gender, age, and race. Beyond that, it is also essential to study the GNN fairness at a much finer granularity (i.e., at the node level) to ensure that GNNs render similar prediction results for similar individuals to achieve the notion of individual fairness. Toward this goal, in this paper, we make an initial investigation to enhance the individual fairness of GNNs and propose a novel ranking based framework---REDRESS. Specifically, we refine the notion of individual fairness from a ranking perspective, and formulate the ranking based individual fairness promotion problem. This naturally addresses the issue of Lipschitz constant specification and distance calibration resulted from the Lipschitz condition in the conventional individual fairness definition. Our proposed framework REDRESS encapsulates the GNN model utility maximization and the ranking-based individual fairness promotion in a joint framework to enable end-to-end training. It is noteworthy mentioning that REDRESS is a plug-and-play framework and can be easily generalized to any prevalent GNN architectures. Extensive experiments on multiple real-world graphs demonstrate the superiority of REDRESS in achieving a good balance between model utility maximization and individual fairness promotion. Our open source code can be found here: https://github.com/yushundong/REDRESS.

[1]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[2]  Jure Leskovec,et al.  Learning to Discover Social Circles in Ego Networks , 2012, NIPS.

[3]  Jie Tang,et al.  ArnetMiner: extraction and mining of academic social networks , 2008, KDD.

[4]  Michael Backes,et al.  Fairwalk: Towards Fair Graph Embedding , 2019, IJCAI.

[5]  Lina Yao,et al.  Adversarially Regularized Graph Autoencoder , 2018, IJCAI.

[6]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[7]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[8]  Kilian Q. Weinberger,et al.  Simplifying Graph Convolutional Networks , 2019, ICML.

[9]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[10]  Bryan Perozzi,et al.  MONET: Debiasing Graph Embeddings via the Metadata-Orthogonal Training Unit , 2019, ArXiv.

[11]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[12]  Xia Hu,et al.  Fairness in Deep Learning: A Computational Perspective , 2019, IEEE Intelligent Systems.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[15]  Krishna P. Gummadi,et al.  Operationalizing Individual Fairness with Pairwise Fair Representations , 2019, Proc. VLDB Endow..

[16]  Huan Liu,et al.  Relational learning via latent social dimensions , 2009, KDD.

[17]  Mohammad Al Hasan,et al.  Link prediction using supervised learning , 2006 .

[18]  Suhang Wang,et al.  Say No to the Discrimination: Learning Fair Graph Neural Networks with Limited Sensitive Attribute Information. , 2020 .

[19]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[20]  Luca Oneto,et al.  Fairness in Machine Learning , 2020, INNSBDDL.

[21]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[22]  T. D. Bie,et al.  DeBayes: a Bayesian method for debiasing network embeddings , 2020, ICML.

[23]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[24]  Maxim Panov,et al.  Linking bank clients using graph neural networks powered by rich transactional data , 2020, International Journal of Data Science and Analytics.

[25]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[26]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[27]  William L. Hamilton,et al.  Compositional Fairness Constraints for Graph Embeddings , 2019, ICML.

[28]  Guosheng Pan,et al.  Bringing Order to Network Embedding: A Relative Ranking based Approach , 2020, CIKM.

[29]  Jun Zhou,et al.  A Semi-Supervised Graph Attentive Network for Financial Fraud Detection , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[30]  Carlos Eduardo Scheidegger,et al.  Certifying and Removing Disparate Impact , 2014, KDD.

[31]  Hanghang Tong,et al.  InFoRM: Individual Fairness on Graph Mining , 2020, KDD.

[32]  Toniann Pitassi,et al.  Learning Fair Representations , 2013, ICML.

[33]  Krishna P. Gummadi,et al.  From Parity to Preference-based Notions of Fairness in Classification , 2017, NIPS.

[34]  Olivier Chapelle,et al.  Expected reciprocal rank for graded relevance , 2009, CIKM.

[35]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[36]  Xiao Han,et al.  CreditPrint: Credit Investigation via Geographic Footprints by Deep Learning , 2019, ArXiv.

[37]  Stephan Günnemann,et al.  Pitfalls of Graph Neural Network Evaluation , 2018, ArXiv.

[38]  Chrysanthos Dellarocas,et al.  Credit Scoring with Social Network Data , 2014, Mark. Sci..

[39]  Krishna P. Gummadi,et al.  iFair: Learning Individually Fair Data Representations for Algorithmic Decision Making , 2018, 2019 IEEE 35th International Conference on Data Engineering (ICDE).