Learning Dynamic Multimodal Implicit and Explicit Networks for Multiple Financial Tasks

Many financial forecasting deep learning works focus on the single task of predicting stock returns for trading with unimodal numerical inputs. Investment and risk management however involves multiple financial t asks - forecasts of expected returns, risks and correlations of multiple stocks in portfolios, as well as important events affecting different stocks - to support decision making. Moreover, stock returns are influenced by large volumes of non-stationary time-series information from a variety of modalities and the propagation of such information across inter-company relationship networks. Such networks could be explicit - observed co-occurrences in online news; or implicit -inferred from time-series information. Such networks are often dynamic, i.e. they evolve across time. Therefore, we propose the Dynamic Multimodal Multitask Implicit Explicit (DynMIX) network model, which pairs explicit and implicit networks across multiple modalities for a novel dynamic self-supervised learning approach to improve performance across multiple financial tasks. Our experiments show that DynMIX outperforms other state-of-the-art models on multiple forecasting tasks, and investment and risk management applications.

[1]  Yuan Tian,et al.  Stock Price Prediction Leveraging Reddit: The Role of Trust Filter and Sliding Window , 2021, 2021 IEEE International Conference on Big Data (Big Data).

[2]  Ee-Peng Lim,et al.  Learning knowledge-enriched company embeddings for investment management , 2021, ICAIF.

[3]  Dantong Yu,et al.  Attention Based Dynamic Graph Learning Framework for Asset Pricing , 2021, CIKM.

[4]  T. Xiong,et al.  Self-supervised Representation Learning on Dynamic Graphs , 2021, CIKM.

[5]  Huzefa Rangwala,et al.  Understanding Event Predictions via Contextualized Multilevel Feature Learning , 2021, CIKM.

[6]  Stephan Günnemann,et al.  A Study of Joint Graph Inference and Forecasting , 2021, ArXiv.

[7]  Geoffrey I. Webb,et al.  Monash Time Series Forecasting Archive , 2021, NeurIPS Datasets and Benchmarks.

[8]  Yann LeCun,et al.  VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning , 2021, ICLR.

[9]  Q. Zheng,et al.  T-EGAT: A Temporal Edge Enhanced Graph Attention Network for Tax Evasion Detection , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[10]  Kees Verstoep,et al.  Interpretable Multivariate Time Series Forecasting with Temporal Attention Convolutional Neural Networks , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[11]  Puneet Mathur,et al.  VolTAGE: Volatility Forecasting via Text-Audio Fusion with Graph Convolution Networks for Earnings Calls , 2020, EMNLP.

[12]  Roger Zimmermann,et al.  Multimodal Multi-Task Financial Risk Forecasting , 2020, ACM Multimedia.

[13]  Anuradha Bhamidipaty,et al.  A Transformer-based Framework for Multivariate Time Series Representation Learning , 2020, KDD.

[14]  Prasanna Balaprakash,et al.  Dynamic Graph Neural Network for Traffic Forecasting in Wide Area Networks , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[15]  Kaveh Hassani,et al.  Contrastive Multi-View Representation Learning on Graphs , 2020, ICML.

[16]  Xiaojun Chang,et al.  Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks , 2020, KDD.

[17]  Bryan Lim,et al.  Time-series forecasting with deep learning: a survey , 2020, Philosophical Transactions of the Royal Society A.

[18]  Barry Smyth,et al.  HTML: Hierarchical Transformer-based Multi-task Learning for Volatility Prediction , 2020, WWW.

[19]  Xue Ben,et al.  Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case , 2020, ArXiv.

[20]  Mingyuan Zhou,et al.  Variational Graph Recurrent Neural Networks , 2019, NeurIPS.

[21]  Sanjay Thakur,et al.  Time2Vec: Learning a Vector Representation of Time , 2019, ArXiv.

[22]  Nicolas Chapados,et al.  N-BEATS: Neural basis expansion analysis for interpretable time series forecasting , 2019, ICLR.

[23]  Ling Yang,et al.  DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series prediction , 2019, Expert Syst. Appl..

[24]  Charles E. Leisersen,et al.  EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs , 2019, AAAI.

[25]  Yuji Matsumoto,et al.  Wikipedia2Vec: An Efficient Toolkit for Learning and Visualizing the Embeddings of Words and Entities from Wikipedia , 2018, EMNLP.

[26]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[27]  Yiqun Liu,et al.  Temporal Relational Ranking for Stock Prediction , 2018, ACM Trans. Inf. Syst..

[28]  Yan Liu,et al.  DynGEM: Deep Embedding Method for Dynamic Graphs , 2018, ArXiv.

[29]  Haoteng Yin,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[30]  Fei Wang,et al.  Patient Subtyping via Time-Aware LSTM Networks , 2017, KDD.

[31]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Michael S. Gashler,et al.  Neural Decomposition of Time-Series Data for Effective Generalization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[35]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[36]  Timothy Perkins,et al.  Cultural Computing at Literature Scale: Encoding the Cultural Knowledge of Tens of Billions of Words of Academic Literature , 2014, D Lib Mag..

[37]  Hans-Peter Kriegel,et al.  A Three-Way Model for Collective Learning on Multi-Relational Data , 2011, ICML.

[38]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[39]  Neil D. Pearson,et al.  Value at Risk , 2000 .

[40]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[41]  Ee-Peng Lim,et al.  Guided Attention Multimodal Multitask Financial Forecasting with Inter-Company Relationships and Global and Local News , 2022, ACL.

[42]  Ramit Sawhney,et al.  FAST: Financial News and Tweet Based Time Aware Network for Stock Trading , 2021, EACL.

[43]  G. Hunanyan,et al.  Portfolio Selection , 2019, Finanzwirtschaft, Banken und Bankmanagement I Finance, Banks and Bank Management.

[44]  F. Fabozzi Robust Portfolio Optimization and Management , 2007 .