Baseline win rates for neural-network based trading algorithms

Neural networks and other machine-learning systems are used to create automatic financial forecasting and trading systems. To aid comparison of such systems, there is a need for reliable performance metrics. One such metric that may be considered is the win rate. We show how in certain circumstances the win-rate statistic can be very misleading, and to counter this, we propose and define baseline win rates for comparison. We develop empirical and closed-form models for such baselines and validate them against financial data and a neural forecaster.

[1]  Peter Tiño,et al.  Financial volatility trading using recurrent neural networks , 2001, IEEE Trans. Neural Networks.

[2]  M A H Dempster,et al.  An automated FX trading system using adaptive reinforcement learning , 2006, Expert Syst. Appl..

[3]  Lorenzo Bertolini,et al.  A Technical Trading Indicator Based on Dynamical Consistent Neural Networks , 2006, ICANN.

[4]  Jeffrey Pontiff,et al.  Does Academic Research Destroy Stock Return Predictability? , 2015 .

[5]  R. D. McLean,et al.  Does Academic Research Destroy Stock Return Predictability? , 2015 .

[6]  Yu-Yen Ou,et al.  Using Deep Learning Neural Networks and Candlestick Chart Representation to Predict Stock Market , 2019, ArXiv.

[7]  Marcos Lopez de Prado.  The 10 Reasons Most Machine Learning Funds Fail , 2018 .

[8]  Michael Fairbank,et al.  Convolutional neural networks applied to high-frequency market microstructure forecasting , 2017, 2017 9th Computer Science and Electronic Engineering (CEEC).

[9]  Kai Keng Ang,et al.  Stock Trading Using RSPOP: A Novel Rough Set-Based Neuro-Fuzzy Approach , 2006, IEEE Transactions on Neural Networks.

[10]  Edward P. K. Tsang,et al.  Backlash Agent: A trading strategy based on Directional Change , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[11]  Michael A. H. Dempster,et al.  Computational learning techniques for intraday FX trading using popular technical indicators , 2001, IEEE Trans. Neural Networks.

[12]  Tshilidzi Marwala,et al.  Common Mistakes when Applying Computational Intelligence and Machine Learning to Stock Market modelling , 2012, ArXiv.

[13]  Youyong Kong,et al.  Deep Direct Reinforcement Learning for Financial Signal Representation and Trading , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Sarunas Raudys,et al.  Portfolio of Automated Trading Systems: Complexity and Learning Set Size Issues , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Paulo J. L. Adeodato,et al.  Continuous Dynamical Combination of Short and Long-Term Forecasts for Nonstationary Time Series , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Matthew Saffell,et al.  Learning to trade via direct reinforcement , 2001, IEEE Trans. Neural Networks.

[17]  E. Prescott,et al.  Investment Under Uncertainty , 1971 .

[18]  Ammar Belatreche,et al.  Detecting Wash Trade in Financial Market Using Digraphs and Dynamic Programming , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Myungjoo Kang,et al.  Financial series prediction using Attention LSTM , 2019, ArXiv.