Learning Informative Representation for Fairness-aware Multivariate Time-series Forecasting: A Group-based Perspective

—Multivariate time series (MTS) forecasting has penetrated and benefited our daily life. However, the unfair forecasting of MTSs not only degrades their practical benefit but even brings about serious potential risks. Such unfair MTS forecasting may be attributed to variable disparity leading to advantaged and disadvantaged variables. This issue has rarely been studied in the existing MTS forecasting models. To address this significant gap, we formulate the MTS fairness modeling problem as learning informative representations attending to both advantaged and disadvantaged variables. Accordingly, we propose a novel framework, named FairFor , for fairness-aware MTS forecasting. FairFor is based on adversarial learning to generate both group-irrelevant and -relevant representations for downstream forecasting. FairFor first adopts the recurrent graph convolution to capture spatio-temporal variable correlations and to group variables by leveraging a spectral relaxation of the K-means objective. Then, it utilizes a novel filtering & fusion module to filter the group-relevant information and generate group-irrelevant representations by orthogonality regularization. The group-irrelevant and -relevant representations form highly informative representations, facilitating to share the knowledge from advantaged variables to disadvantaged variables and guarantee fairness. Extensive experiments on four public datasets demonstrate the FairFor effectiveness for fair forecasting and significant performance improvement.

[1]  Zhendong Niu,et al.  Distributional Drift Adaptation with Temporal Conditional Variational Autoencoder for Multivariate Time Series Forecasting , 2022, ArXiv.

[2]  Ninghao Liu,et al.  GUIDE: Group Equality Informed Individual Fairness in Graph Neural Networks , 2022, KDD.

[3]  Jungseock Joo,et al.  FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification , 2022, ECCV.

[4]  Qi Zhang,et al.  CATN: Cross Attentive Tree-Aware Network for Multivariate Time Series Forecasting , 2022, AAAI.

[5]  Ruobing Xie,et al.  Selective Fairness in Recommendation via Prompts , 2022, SIGIR.

[6]  P. Piantanida,et al.  Learning Disentangled Textual Representations via Statistical Measures of Similarity , 2022, ACL.

[7]  Chuhan Wu,et al.  ProFairRec: Provider Fairness-aware News Recommendation , 2022, SIGIR.

[8]  Christian S. Jensen,et al.  Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection , 2022, 2022 IEEE 38th International Conference on Data Engineering (ICDE).

[9]  Noseong Park,et al.  Graph Neural Controlled Differential Equations for Traffic Forecasting , 2021, AAAI.

[10]  Yu Tong,et al.  TS2Vec: Towards Universal Representation of Time Series , 2021, AAAI.

[11]  Rui Zhang,et al.  Explainable Tensorized Neural Ordinary Differential Equations for Arbitrary-Step Time Series Prediction , 2020, IEEE Transactions on Knowledge and Data Engineering.

[12]  Xiangnan He,et al.  Bias and Debias in Recommender System: A Survey and Future Directions , 2020, ACM Trans. Inf. Syst..

[13]  Jose F. Rodrigues-Jr,et al.  Pay Attention to Evolution: Time Series Forecasting With Deep Graph-Evolution Learning , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[15]  Alex X. Liu,et al.  Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting , 2022, ICLR.

[16]  Shun Li,et al.  HATR-I: Hierarchical Adaptive Temporal Relational Interaction for Stock Trend Prediction , 2023, IEEE Transactions on Knowledge and Data Engineering.

[17]  X. Zhang,et al.  Time-Aware Context-Gated Graph Attention Network for Clinical Risk Prediction , 2023, IEEE Transactions on Knowledge and Data Engineering.

[18]  Enyan Dai,et al.  Learning Fair Graph Neural Networks With Limited and Private Sensitive Attribute Information , 2023, IEEE Transactions on Knowledge and Data Engineering.

[19]  Jundong Li,et al.  Individual Fairness for Graph Neural Networks: A Ranking based Approach , 2021, KDD.

[20]  Yunqi Li,et al.  Towards Personalized Fairness based on Causal Notion , 2021, SIGIR.

[21]  Deeparnab Chakrabarty,et al.  Better Algorithms for Individually Fair k-Clustering , 2021, NeurIPS.

[22]  John P. Dickerson,et al.  Fair Clustering Under a Bounded Cost , 2021, NeurIPS.

[23]  Garrison W. Cottrell,et al.  Learning Representations for Incomplete Time Series Clustering , 2021, AAAI.

[24]  Hyeran Byun,et al.  Learning Disentangled Representation for Fair Facial Attribute Classification via Fairness-aware Information Alignment , 2021, AAAI.

[25]  Ramit Sawhney,et al.  Stock Selection via Spatiotemporal Hypergraph Attention Network: A Learning to Rank Approach , 2021, AAAI.

[26]  Le Wu,et al.  Learning Fair Representations for Recommendation: A Graph-based Perspective , 2021, WWW.

[27]  Yingqiang Ge,et al.  User-oriented Fairness in Recommendation , 2021, WWW.

[28]  J. Bi,et al.  Discrete Graph Structure Learning for Forecasting Multiple Time Series , 2021, ICLR.

[29]  Hui Xiong,et al.  Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting , 2020, AAAI.

[30]  Jakub Marecek,et al.  Fairness in Forecasting and Learning Linear Dynamical Systems , 2020, AAAI.

[31]  Chaoyang He,et al.  AutoCTS: Automated Correlated Time Series Forecasting , 2021, Proc. VLDB Endow..

[32]  Kai Zheng,et al.  METRO: A Generic Graph Neural Network Framework for Multivariate Time Series Forecasting , 2021, Proc. VLDB Endow..

[33]  Qi Zhang,et al.  Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting , 2020, NeurIPS.

[34]  Hanghang Tong,et al.  InFoRM: Individual Fairness on Graph Mining , 2020, KDD.

[35]  Lina Yao,et al.  Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting , 2020, NeurIPS.

[36]  Shuyuan Xu,et al.  Fairness-Aware Explainable Recommendation over Knowledge Graphs , 2020, SIGIR.

[37]  Xiaojun Chang,et al.  Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks , 2020, KDD.

[38]  Krishna P. Gummadi,et al.  FairRec: Two-Sided Fairness for Personalized Recommendations in Two-Sided Platforms , 2020, WWW.

[39]  Lei Chen,et al.  Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting , 2020, AAAI.

[40]  Matt Fredrikson,et al.  Individual Fairness Revisited: Transferring Techniques from Adversarial Robustness , 2020, IJCAI.

[41]  Yuekai Sun,et al.  Training individually fair ML models with sensitive subspace robustness , 2019, ICLR.

[42]  Xi Xiao,et al.  Adversarial Sparse Transformer for Time Series Forecasting , 2020, NeurIPS.

[43]  Alessia Amelio,et al.  Time Series Vector Autoregression Prediction of the Ecological Footprint based on Energy Parameters , 2019, ArXiv.

[44]  Michael Bohlke-Schneider,et al.  High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processes , 2019, NeurIPS.

[45]  Roy Assaf,et al.  Explainable Deep Neural Networks for Multivariate Time Series Predictions , 2019, IJCAI.

[46]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[47]  Eamonn J. Keogh,et al.  The UCR time series archive , 2018, IEEE/CAA Journal of Automatica Sinica.

[48]  Hung-yi Lee,et al.  Temporal pattern attention for multivariate time series forecasting , 2018, Machine Learning.

[49]  Qianli Ma,et al.  Learning Representations for Time Series Clustering , 2019, NeurIPS.

[50]  Gunnar Rätsch,et al.  SOM-VAE: Interpretable Discrete Representation Learning on Time Series , 2019, ICLR.

[51]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[52]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[53]  Guokun Lai,et al.  Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks , 2017, SIGIR.