Neural Stochastic Differential Games for Time-series Analysis

Modeling spatiotemporal dynamics with neural differential equations has become a major line of research that opens new ways to handle various real-world scenarios ( e . g ., missing observations, irregular times, etc.). Despite such progress, most existing methods still face challenges in providing a general framework for analyzing time series. To tackle this, we adopt stochastic differential games to suggest a new philosophy of utilizing interacting collective intelligence in time series analysis. For the implementation, we develop the novel gradient descent-based algorithm called deep neural fictitious play to approximate the Nash equilibrium. We theoretically analyze the convergence result of the proposed algorithm and discuss the advantage of cooperative games in handling non-informative observation. Throughout the experiments on various datasets, we demonstrate the superiority of our framework over all the tested benchmarks in modeling time-series prediction by capitalizing on the advantages of applying cooperative games. An ablation study shows that neural agents of the proposed framework learn intrinsic temporal relevance to make accurate time-series predictions.

[1]  M. Schaar,et al.  Neural Laplace: Learning diverse classes of differential equations in the Laplace domain , 2022, ICML.

[2]  Maja R. Rudolph,et al.  Modeling Irregular Time Series with Continuous Recurrent Units , 2021, ICML.

[3]  Syama Sundar Rangapuram,et al.  Neural Flows: Efficient Alternative to Neural ODEs , 2021, NeurIPS.

[4]  Greg Mori,et al.  Continuous Latent Process Flows , 2021, NeurIPS.

[5]  Jianmin Wang,et al.  Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting , 2021, NeurIPS.

[6]  Ruimeng Hu,et al.  Signatured Deep Fictitious Play for Mean Field Games with Common Noise , 2021, ICML.

[7]  Hui Xiong,et al.  Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting , 2020, AAAI.

[8]  Abhishek Kumar,et al.  Score-Based Generative Modeling through Stochastic Differential Equations , 2020, ICLR.

[9]  Ricky T. Q. Chen,et al.  Neural Spatio-Temporal Point Processes , 2020, ICLR.

[10]  Terry Lyons,et al.  Neural Rough Differential Equations for Long Time Series , 2020, ICML.

[11]  Romuald Elie,et al.  Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications , 2020, NeurIPS.

[12]  Calypso Herrera,et al.  Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and Filtering , 2020, ICLR.

[13]  Terry Lyons,et al.  Neural Controlled Differential Equations for Irregular Time Series , 2020, NeurIPS.

[14]  Hongyuan Zha,et al.  Transformer Hawkes Process , 2020, ICML.

[15]  Lukasz Kaiser,et al.  Reformer: The Efficient Transformer , 2020, ICLR.

[16]  David Duvenaud,et al.  Scalable Gradients for Stochastic Differential Equations , 2020, AISTATS.

[17]  Jiequn Han,et al.  Deep Fictitious Play for Finding Markovian Nash Equilibrium in Multi-Agent Games , 2019, MSML.

[18]  Jiyu Chen,et al.  Informer: irregular traffic detection for containerized microservices RPC in the real world , 2019, SEC.

[19]  David Duvenaud,et al.  Residual Flows for Invertible Generative Modeling , 2019, NeurIPS.

[20]  Yee Whye Teh,et al.  Augmented Neural ODEs , 2019, NeurIPS.

[21]  Jason D. Lee,et al.  Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methods , 2019, NeurIPS.

[22]  Maojiao Ye,et al.  Nash equilibrium seeking for N-coalition noncooperative games , 2018, Autom..

[23]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[24]  Pete Warden,et al.  Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition , 2018, ArXiv.

[25]  François Delarue,et al.  Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games , 2018 .

[26]  Jing He,et al.  Cautionary tales on air-quality improvement in Beijing , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[27]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[28]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Jason Eisner,et al.  The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process , 2016, NIPS.

[30]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[31]  Shimon Whiteson,et al.  Learning to Communicate with Deep Multi-Agent Reinforcement Learning , 2016, NIPS.

[32]  R. Carmona Lectures on Bsdes, Stochastic Control, and Stochastic Differential Games with Financial Applications , 2016 .

[33]  Pierre Cardaliaguet,et al.  Learning in mean field games: The fictitious play , 2015, 1507.06280.

[34]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[35]  H. Pham Feynman-Kac Representation of Fully Nonlinear PDEs and Applications , 2014, 1409.0625.

[36]  Sean P. Meyn,et al.  Learning in Mean-Field Games , 2014, IEEE Transactions on Automatic Control.

[37]  A. Guillin,et al.  On the rate of convergence in Wasserstein distance of the empirical measure , 2013, 1312.2128.

[38]  G. Moody,et al.  Predicting in-hospital mortality of ICU patients: The PhysioNet/Computing in cardiology challenge 2012 , 2012, 2012 Computing in Cardiology.

[39]  L. A. Petrosi︠a︡n,et al.  Subgame Consistent Economic Optimization: An Advanced Cooperative Dynamic Game Analysis , 2011 .

[40]  Paul W. Goldberg,et al.  A Survey of PPAD-Completeness for Computing Nash Equilibria , 2011, ArXiv.

[41]  Tal Shima,et al.  Cooperative Differential Games Strategies for Active Aircraft Protection from a Homing Missile , 2010 .

[42]  Georges Zaccour,et al.  Dynamic Games in the Economics and Management of Pollution , 2009 .

[43]  Paul W. Goldberg,et al.  The complexity of computing a Nash equilibrium , 2006, STOC '06.

[44]  David W. K. Yeung,et al.  Cooperative Stochastic Differential Games , 2005 .

[45]  Y. Ogata Space-Time Point-Process Models for Earthquake Occurrences , 1998 .

[46]  Richard J. Sexton,et al.  The Formation of Cooperatives: A Game-Theoretic Approach with Implications for Cooperative Finance, Decision Making, and Stability , 1986 .

[47]  John M. Staatz,et al.  The cooperative as a coalition: A game-theoretic approach , 1983 .

[48]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[49]  Sung Woo Park,et al.  Neural Markov Controlled SDE: Stochastic Optimization for Continuous-Time Data , 2022, ICLR.

[50]  David Duvenaud,et al.  Latent Ordinary Differential Equations for Irregularly-Sampled Time Series , 2019, NeurIPS.

[51]  George Leitmann,et al.  Cooperative and Non-Cooperative Many Players Differential Games , 1974, International Centre for Mechanical Sciences.