Building Transportation Foundation Model via Generative Graph Transformer

Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing prediction methods face challenges in terms of optimizing a single objective and understanding the complex composition of the transportation system. Moreover, they lack the ability to understand the macroscopic system and cannot efficiently utilize big data. In this paper, we propose a novel approach, Transportation Foundation Model (TFM), which integrates the principles of traffic simulation into traffic prediction. TFM uses graph structures and dynamic graph generation algorithms to capture the participatory behavior and interaction of transportation system actors. This data-driven and model-free simulation method addresses the challenges faced by traditional systems in terms of structural complexity and model accuracy and provides a foundation for solving complex transportation problems with real data. The proposed approach shows promising results in accurately predicting traffic outcomes in an urban transportation setting.

[1]  B. Lund,et al.  Chatting about ChatGPT: How May AI and GPT Impact Academia and Libraries? , 2023, SSRN Electronic Journal.

[2]  Weiwei Jiang.  Cellular traffic prediction with machine learning: A survey , 2022, Expert Syst. Appl..

[3]  A. Taherkordi,et al.  From statistical‐ to machine learning‐based network traffic prediction , 2021, Trans. Emerg. Telecommun. Technol..

[4]  Guojie Song,et al.  Spatial-Temporal Graph ODE Networks for Traffic Flow Forecasting , 2021, KDD.

[5]  Yulia R. Gel,et al.  Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecasting , 2021, ICML.

[6]  Zhifeng Bao,et al.  An Effective Joint Prediction Model for Travel Demands and Traffic Flows , 2021, 2021 IEEE 37th International Conference on Data Engineering (ICDE).

[7]  Wai Kin Victor Chan,et al.  Spatial‐temporal attention wavenet: A deep learning framework for traffic prediction considering spatial‐temporal dependencies , 2021, IET Intelligent Transport Systems.

[8]  Li Mengzhang,et al.  Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecasting , 2020, AAAI.

[9]  Lina Yao,et al.  Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting , 2020, NeurIPS.

[10]  Yubao Liu,et al.  LSGCN: Long Short-Term Traffic Prediction with Graph Convolutional Networks , 2020, IJCAI.

[11]  Jianya Gong,et al.  A hierarchical temporal attention-based LSTM encoder-decoder model for individual mobility prediction , 2020, Neurocomputing.

[12]  Youfang Lin,et al.  Spatial-Temporal Synchronous Graph Convolutional Networks: A New Framework for Spatial-Temporal Network Data Forecasting , 2020, AAAI.

[13]  Zhou Peng,et al.  MF-CNN: Traffic Flow Prediction Using Convolutional Neural Network and Multi-Features Fusion , 2019, IEICE Trans. Inf. Syst..

[14]  Ning Feng,et al.  Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting , 2019, AAAI.

[15]  Jing Jiang,et al.  Graph WaveNet for Deep Spatial-Temporal Graph Modeling , 2019, IJCAI.

[16]  Lina Yao,et al.  STG2Seq: Spatial-temporal Graph to Sequence Model for Multi-step Passenger Demand Forecasting , 2019, IJCAI.

[17]  João Gama,et al.  BRIGHT—Drift-Aware Demand Predictions for Taxi Networks , 2019, IEEE Transactions on Knowledge and Data Engineering.

[18]  Iz Beltagy,et al.  SciBERT: A Pretrained Language Model for Scientific Text , 2019, EMNLP.

[19]  Yun-Pang Flötteröd,et al.  Microscopic Traffic Simulation using SUMO , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[20]  Attila Matyas Nagy,et al.  Survey on traffic prediction in smart cities , 2018, Pervasive Mob. Comput..

[21]  Xianfeng Tang,et al.  Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction , 2018, AAAI.

[22]  Shuguang Cui,et al.  Spatio-Temporal Wireless Traffic Prediction With Recurrent Neural Network , 2018, IEEE Wireless Communications Letters.

[23]  Haoteng Yin,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[24]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[25]  Shui Yu,et al.  Network Traffic Prediction Based on Deep Belief Network in Wireless Mesh Backbone Networks , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[26]  Tianrui Li,et al.  Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks , 2017, Artif. Intell..

[27]  Li Li,et al.  Using LSTM and GRU neural network methods for traffic flow prediction , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[28]  Jinyoung Ahn,et al.  Highway traffic flow prediction using support vector regression and Bayesian classifier , 2016, 2016 International Conference on Big Data and Smart Computing (BigComp).

[29]  Jorge A. Laval,et al.  Stochastic Approximations for the Macroscopic Fundamental Diagram of Urban Networks , 2015 .

[30]  Jian Sun,et al.  A dynamic Bayesian network model for real-time crash prediction using traffic speed conditions data , 2015 .

[31]  Muhammad Tayyab Asif,et al.  Spatiotemporal Patterns in Large-Scale Traffic Speed Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[32]  Xuesong Zhou,et al.  Designing heterogeneous sensor networks for estimating and predicting path travel time dynamics: An information-theoretic modeling approach , 2013 .

[33]  Ming C. Lin,et al.  Interactive hybrid simulation of large-scale traffic , 2011, ACM Trans. Graph..

[34]  Sylvain Piechowiak,et al.  A behavioral multi-agent model for road traffic simulation , 2008, Eng. Appl. Artif. Intell..

[35]  K.P. Valavanis,et al.  Statistical profile generation for traffic monitoring using real-time UAV based video data , 2007, 2007 Mediterranean Conference on Control & Automation.

[36]  Jesús Félez,et al.  Real-Time Traffic Simulation With a Microscopic Model , 2006, IEEE Transactions on Intelligent Transportation Systems.

[37]  R. Jayakrishnan,et al.  A distributed, scalable, and synchronized framework for large-scale microscopic traffic simulation , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[38]  Kai Nagel,et al.  Towards truly agent-based traffic and mobility simulations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[39]  Nicolas Durand,et al.  Genetic algorithms applied to airport ground traffic optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[40]  M. Schreckenberg,et al.  Microscopic Simulation of Urban Traffic Based on Cellular Automata , 1997 .

[41]  M. Zuo,et al.  A sparse multivariate time series model-based fault detection method for gearboxes under variable speed condition , 2022, Mechanical Systems and Signal Processing.

[42]  Di Yang,et al.  Tra ffi c Flow Prediction Using Convolutional Neural Network and Multi-Features Fusion , 2019 .

[43]  Selvaraj Vasantha Kumar,et al.  Traffic Flow Prediction using Kalman Filtering Technique , 2017 .

[44]  Yunpeng Wang,et al.  A spatiotemporal correlative k-nearest neighbor model for short-term traffic multistep forecasting , 2016 .

[45]  Daniel Krajzewicz,et al.  Traffic Simulation for All: A Real World Traffic Scenario from the City of Bologna , 2015 .