AutoSTL: Automated Spatio-Temporal Multi-Task Learning

Spatio-temporal prediction plays a critical role in smart city construction. Jointly modeling multiple spatio-temporal tasks can further promote an intelligent city life by integrating their inseparable relationship. However, existing studies fail to address this joint learning problem well, which generally solve tasks individually or a fixed task combination. The challenges lie in the tangled relation between different properties, the demand for supporting flexible combinations of tasks and the complex spatio-temporal dependency. To cope with the problems above, we propose an Automated Spatio-Temporal multi-task Learning (AutoSTL) method to handle multiple spatio-temporal tasks jointly. Firstly, we propose a scalable architecture consisting of advanced spatio-temporal operations to exploit the complicated dependency. Shared modules and feature fusion mechanism are incorporated to further capture the intrinsic relationship between tasks. Furthermore, our model automatically allocates the operations and fusion weight. Extensive experiments on benchmark datasets verified that our model achieves state-of-the-art performance. As we can know, AutoSTL is the first automated spatio-temporal multi-task learning method.

[1]  Ning Jia,et al.  Refined analysis and a hierarchical multi-task learning approach for loan fraud detection , 2022, Journal of Management Science and Engineering.

[2]  Changjie Fan,et al.  Multi-Dimensional Prediction of Guild Health in Online Games: A Stability-Aware Multi-Task Learning Approach , 2022, AAAI.

[3]  Jiliang Tang,et al.  Multi-Type Urban Crime Prediction , 2022, AAAI.

[4]  Jintao Ke,et al.  A Multi-Task Matrix Factorized Graph Neural Network for Co-Prediction of Zone-Based and OD-Based Ride-Hailing Demand , 2022, IEEE Transactions on Intelligent Transportation Systems.

[5]  Jiliang Tang,et al.  AutoLoss: Automated Loss Function Search in Recommendations , 2021, KDD.

[6]  Yong Yu,et al.  AutoSTG: Neural Architecture Search for Predictions of Spatio-Temporal Graph✱ , 2021, WWW.

[7]  Jiliang Tang,et al.  AutoDim: Field-aware Embedding Dimension Searchin Recommender Systems , 2021, WWW.

[8]  Qiang Cui,et al.  ST-PIL: Spatial-Temporal Periodic Interest Learning for Next Point-of-Interest Recommendation , 2021, CIKM.

[9]  J. Bi,et al.  Discrete Graph Structure Learning for Forecasting Multiple Time Series , 2021, ICLR.

[10]  Dejing Dou,et al.  Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networks , 2020, AAAI.

[11]  Yanjie Fu,et al.  Coupled Layer-wise Graph Convolution for Transportation Demand Prediction , 2020, AAAI.

[12]  Hui Xiong,et al.  Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting , 2020, AAAI.

[13]  Senzhang Wang,et al.  Multi-task Adversarial Spatial-Temporal Networks for Crowd Flow Prediction , 2020, CIKM.

[14]  Junning Liu,et al.  Progressive Layered Extraction (PLE): A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations , 2020, RecSys.

[15]  Fenghua Zhu,et al.  Taxi Demand Prediction Using Parallel Multi-Task Learning Model , 2020, IEEE Transactions on Intelligent Transportation Systems.

[16]  Xiaojun Chang,et al.  Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks , 2020, KDD.

[17]  Junbo Zhang,et al.  Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning , 2020, IEEE Transactions on Knowledge and Data Engineering.

[18]  Xike Xie,et al.  RiskOracle: A Minute-level Citywide Traffic Accident Forecasting Framework , 2020, AAAI.

[19]  Kai Zheng,et al.  Origin-Destination Matrix Prediction via Graph Convolution: a New Perspective of Passenger Demand Modeling , 2019, KDD.

[20]  Ning Feng,et al.  Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting , 2019, AAAI.

[21]  Wenhu Chen,et al.  Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting , 2019, NeurIPS.

[22]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[23]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[24]  Jiliang Tang,et al.  Modeling Temporal-Spatial Correlations for Crime Prediction , 2017, CIKM.

[25]  Jiliang Tang,et al.  Exploring Transfer Learning for Crime Prediction , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[26]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[27]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[28]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[29]  Guandong Xu,et al.  CoSoLoRec: Joint Factor Model with Content, Social, Location for Heterogeneous Point-of-Interest Recommendation , 2016, KSEM.

[30]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[31]  Hui Xiong,et al.  Taxi Driving Behavior Analysis in Latent Vehicle-to-Vehicle Networks: A Social Influence Perspective , 2016, KDD.

[32]  Li Pan,et al.  Predicting Short-Term Traffic Flow by Long Short-Term Memory Recurrent Neural Network , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[33]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[34]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[35]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[36]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[37]  Xu Wang,et al.  Inferring Intersection Traffic Patterns with Sparse Video Surveillance Information: An ST-GAN method , 2022, IEEE Transactions on Vehicular Technology.

[38]  Chaoyang He,et al.  AutoCTS: Automated Correlated Time Series Forecasting , 2021, Proc. VLDB Endow..

[39]  E. Gumbel Statistical Theory of Extreme Values and Some Practical Applications : A Series of Lectures , 1954 .