STAN: Spatio-Temporal Attention Network for Pandemic Prediction Using Real World Evidence.

OBJECTIVE The COVID-19 pandemic has created many challenges that need immediate attention. Various epidemiological and deep learning models have been developed to predict the COVID-19 outbreak, but all have limitations that affect the accuracy and robustness of the predictions. Our method aims at addressing these limitations and making earlier and more accurate pandemic outbreak predictions by (1) using patients' EHR data from different counties and states that encode local disease status and medical resource utilization condition; (2) considering demographic similarity and geographical proximity between locations; and (3) integrating pandemic transmission dynamics into deep learning models. MATERIALS AND METHODS We proposed a spatio-temporal attention network (STAN) for pandemic prediction. It uses an attention-based graph convolutional network to capture geographical and temporal trends and predict the number of cases for a fixed number of days into the future. We also designed a physical law-based loss term for enhancing long-term prediction. STAN was tested using both massive real-world patient data and open source COVID-19 statistics provided by Johns Hopkins university across all U.S. counties. RESULTS STAN outperforms epidemiological modeling methods such as SIR and SEIR and deep learning models on both long-term and short-term predictions, achieving up to 87% lower mean squared error compared to the best baseline prediction model. CONCLUSIONS By using information from real-world patient data and geographical data, STAN can better capture the disease status and medical resource utilization information and thus provides more accurate pandemic modeling. With pandemic transmission law based regularization, STAN also achieves good long-term prediction performance.

[1]  Alper Tokgöz,et al.  A RNN based time series approach for forecasting turkish electricity load , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[2]  Gozde Unal,et al.  A RNN based time series approach for forecasting turkish electricity load , 2018 .

[3]  A. Lloyd,et al.  Nine challenges for deterministic epidemic models , 2014, Epidemics.

[4]  Jiangzhuo Chen,et al.  DEFSI: Deep Learning Based Epidemic Forecasting with Synthetic Information , 2019, AAAI.

[5]  S. Pei,et al.  Initial Simulation of SARS-CoV2 Spread and Intervention Effects in the Continental US , 2020, medRxiv.

[6]  Pierre Baldi,et al.  Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems. , 2019, Physical review letters.

[7]  Changxi Ma,et al.  Short-Term Traffic Flow Prediction Method for Urban Road Sections Based on Space–Time Analysis and GRU , 2019, IEEE Access.

[8]  Kimihito Ito,et al.  Can Machines Learn Respiratory Virus Epidemiology?: A Comparative Study of Likelihood-Free Methods for the Estimation of Epidemiological Dynamics , 2018, Front. Microbiol..

[9]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[10]  Wei Xu,et al.  Prediction of Chaotic Time Series of RBF Neural Network Based on Particle Swarm Optimization , 2014, ECC.

[11]  Liancheng Wang,et al.  Global Dynamics of an SEIR Epidemic Model with Vertical Transmission , 2001, SIAM J. Appl. Math..

[12]  Yan Liu,et al.  Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics , 2020, ICLR.

[13]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[14]  Peng Hong,et al.  Multi-step-prediction of chaotic time series based on co-evolutionary recurrent neural network , 2008 .

[15]  W. Liang,et al.  Modified SEIR and AI prediction of the epidemics trend of COVID-19 in China under public health interventions , 2020, Journal of thoracic disease.

[16]  E. Dong,et al.  An interactive web-based dashboard to track COVID-19 in real time , 2020, The Lancet Infectious Diseases.

[17]  Yan Liu,et al.  Differentiable Physics-informed Graph Networks , 2019, ArXiv.

[18]  Luyang Liu,et al.  Examining COVID-19 Forecasting using Spatio-Temporal Graph Neural Networks , 2020, ArXiv.

[19]  Huzefa Rangwala,et al.  Graph Message Passing with Cross-location Attentions for Long-term ILI Prediction , 2019, ArXiv.

[20]  Karthik Kashinath,et al.  Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems , 2019, J. Comput. Phys..

[21]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.