Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networks

Accurate and timely air quality and weather predictions are of great importance to urban governance and human livelihood. Though many efforts have been made for air quality or weather prediction, most of them simply employ one another as feature input, which ignores the inner-connection between two predictive tasks. On the one hand, the accurate prediction of one task can help improve another task’s performance. On the other hand, geospatially distributed air quality and weather monitoring stations provide additional hints for city-wide spatiotemporal dependency modeling. Inspired by the above two insights, in this paper, we propose the Multi-adversarial spatiotemporal recurrent Graph Neural Networks (MasterGNN) for joint air quality and weather predictions. Specifically, we first propose a heterogeneous recurrent graph neural network to model the spatiotemporal autocorrelation among air quality and weather monitoring stations. Then, we develop a multi-adversarial graph learning framework to against observation noise propagation introduced by spatiotemporal modeling. Moreover, we present an adaptive training strategy by formulating multi-adversarial learning as a multi-task learning problem. Finally, extensive experiments on two real-world datasets show that MasterGNN achieves the best performance compared with seven baselines on both air quality and weather prediction tasks.

[1]  Bin Wang,et al.  Deep Uncertainty Quantification: A Machine Learning Approach for Weather Forecasting , 2018, KDD.

[2]  Philip S. Yu,et al.  Deep Learning for Spatio-Temporal Data Mining: A Survey , 2019, IEEE Transactions on Knowledge and Data Engineering.

[3]  Hui Xiong,et al.  Hydra: A Personalized and Context-Aware Multi-Modal Transportation Recommendation System , 2019, KDD.

[4]  Trung Le,et al.  Dual Discriminator Generative Adversarial Nets , 2017, NIPS.

[5]  Yu Zheng,et al.  U-Air: when urban air quality inference meets big data , 2013, KDD.

[6]  Jianqiang Huang,et al.  AccuAir: Winning Solution to Air Quality Prediction for KDD Cup 2018 , 2019, KDD.

[7]  Xu Lai,et al.  Comparison between ARIMA and ANN Models Used in Short-Term Wind Speed Forecasting , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[8]  Lewis F. Richardson,et al.  Weather Prediction by Numerical Process , 1922 .

[9]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[10]  Hao Liu,et al.  Polestar: An Intelligent, Efficient and National-Wide Public Transportation Routing Engine , 2020, KDD.

[11]  C.,et al.  Analysis methods for numerical weather prediction , 2022 .

[12]  Hui Xiong,et al.  Days on Market: Measuring Liquidity in Real Estate Markets , 2016, KDD.

[13]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[14]  Yanchi Liu,et al.  Semi-Supervised Hierarchical Recurrent Graph Neural Network for City-Wide Parking Availability Prediction , 2019, AAAI.

[15]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[16]  Yu Zheng,et al.  GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction , 2018, IJCAI.

[17]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[18]  Hui Xiong,et al.  Multi-Modal Transportation Recommendation with Unified Route Representation Learning , 2020, Proc. VLDB Endow..

[19]  Dennis Y.C. Leung,et al.  On the prediction of air and pollutant exchange rates in street canyons of different aspect ratios using large-eddy simulation , 2005 .

[20]  Ioannis Mitliagkas,et al.  Multi-objective training of Generative Adversarial Networks with multiple discriminators , 2019, ICML.

[21]  R. Shanmugam Introduction to Time Series and Forecasting , 1997 .

[22]  S. Davis,et al.  Weakening aerosol direct radiative effects mitigate climate penalty on Chinese air quality , 2020, Nature Climate Change.

[23]  Stephan Günnemann,et al.  Adversarial Attacks on Neural Networks for Graph Data , 2018, KDD.

[24]  Ming Li,et al.  Forecasting Fine-Grained Air Quality Based on Big Data , 2015, KDD.

[25]  K. Pericleous,et al.  Modelling air quality in street canyons : a review , 2003 .

[26]  Hao Liu,et al.  Incorporating Multi-Source Urban Data for Personalized and Context-Aware Multi-Modal Transportation Recommendation , 2022, IEEE Transactions on Knowledge and Data Engineering.

[27]  Sridhar Mahadevan,et al.  Generative Multi-Adversarial Networks , 2016, ICLR.

[28]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[29]  Cyrus Shahabi,et al.  Exploiting spatiotemporal patterns for accurate air quality forecasting using deep learning , 2018, SIGSPATIAL/GIS.

[30]  Behnam Neyshabur,et al.  Stabilizing GAN Training with Multiple Random Projections , 2017, ArXiv.

[31]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[32]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[33]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[34]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[35]  D. Campbell-Lendrum,et al.  Climate change, air pollution and noncommunicable diseases , 2018, Bulletin of the World Health Organization.

[36]  Trung Le,et al.  MGAN: Training Generative Adversarial Nets with Multiple Generators , 2018, ICLR.

[37]  Xin Huang,et al.  Air Pollution and Weather Interaction in East Asia , 2017 .

[38]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[39]  Alexander Baklanov,et al.  From urban meteorology, climate and environment research to integrated city services , 2017 .

[40]  Yu Zheng,et al.  Deep Distributed Fusion Network for Air Quality Prediction , 2018, KDD.

[41]  Yanchi Liu,et al.  Semi-Supervised City-Wide Parking Availability Prediction via Hierarchical Recurrent Graph Neural Network , 2020, IEEE Transactions on Knowledge and Data Engineering.

[42]  J. Zhong,et al.  Weather Forecasting Using Ensemble of Spatial-Temporal Attention Network and Multi-Layer Perceptron , 2020, Asia-Pacific Journal of Atmospheric Sciences.

[43]  Tianrui Li,et al.  ST-MVL: Filling Missing Values in Geo-Sensory Time Series Data , 2016, IJCAI.

[44]  Linpeng Huang,et al.  A Neural Attention Model for Urban Air Quality Inference: Learning the Weights of Monitoring Stations , 2018, AAAI.