Artificial Higher Order Pipeline Recurrent Neural Networks for Financial Time Series Prediction

The research described in this chapter is concerned with the development of a novel artificial higher order neural networks architecture called the second-order pipeline recurrent neural network. The proposed artificial neural network consists of a linear and a nonlinear section, extracting relevant features from the input signal. The structuring unit of the proposed neural network is the second-order recurrent neural network. The architecture consists of a series of second-order recurrent neural networks, which are concatenated with each other. Simulation results in one-step ahead predictions of the foreign currency exchange rates demonstrate the superior performance of the proposed pipeline architecture as compared to other feed-forward and recurrent structures.

[1]  Michael C. Mozer,et al.  A Focused Backpropagation Algorithm for Temporal Pattern Recognition , 1989, Complex Syst..

[2]  Abir Jaafar Hussain,et al.  A Novel Recurrent Polynomial Neural Network for Financial Time Series Prediction , 2009 .

[3]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[4]  A. Hodgkin,et al.  Spontaneous voltage fluctuations in retinal cones and bipolar cells , 1975, Nature.

[5]  Massimiliano Versace,et al.  Predicting the exchange traded fund DIA with a combination of genetic algorithms and neural networks , 2004, Expert Syst. Appl..

[6]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[7]  E. Fama,et al.  Dividend yields and expected stock returns , 1988 .

[8]  Joydeep Ghosh,et al.  The pi-sigma network: an efficient higher-order neural network for pattern classification and function approximation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[9]  Po-Rong Chang,et al.  Optimal Nonlinear Adaptive Prediction and Modeling of MPEG Video in ATM Networks Using Pipelined Recurrent Neural Networks , 1997, IEEE J. Sel. Areas Commun..

[10]  Ming Zhang,et al.  Artificial Higher Order Neural Networks for Economics and Business , 2008 .

[11]  Mikel L. Forcada,et al.  Learning the Initial State of a Second-Order Recurrent Neural Network during Regular-Language Inference , 1995, Neural Computation.

[12]  Colin Giles,et al.  Learning, invariance, and generalization in high-order neural networks. , 1987, Applied optics.

[13]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[14]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[15]  Malik Magdon-Ismail,et al.  Financial markets: very noisy information processing , 1998 .

[16]  L Cao,et al.  FINANCIAL FORECASTING USING VECTOR MACHINES , 2001 .

[17]  G. A. Kohring,et al.  Neural networks with many-neuron interactions , 1990 .

[18]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[19]  Kin Keung Lai,et al.  Forecasting Foreign Exchange Rates With Artificial Neural Networks: A Review , 2004, Int. J. Inf. Technol. Decis. Mak..

[20]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[21]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[22]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[23]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[24]  An-Sing Chen,et al.  Performance evaluation of neural network architectures: the case of predicting foreign exchange correlations , 2005 .

[25]  Joydeep Ghosh,et al.  Efficient Higher-Order Neural Networks for Classification and Function Approximation , 1992, Int. J. Neural Syst..

[26]  David R. Selviah.  High Speed Optical Higher Order Neural Networks for Discovering Data Trends and Patterns in Very Large Databases , 2009, Database Technologies: Concepts, Methodologies, Tools, and Applications.

[27]  David A. Hsieh,et al.  Modeling Heteroscedasticity in Daily Foreign-Exchange Rates , 1989 .

[28]  M. C. Jensen.  Some Anomalous Evidence Regarding Market Efficiency , 1978 .

[29]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[30]  G. William Schwert,et al.  Asset returns and inflation , 1977 .

[31]  Joydeep Ghosh,et al.  Computationally efficient invariant pattern classification with higher-order pi-sigma networks , 1992 .

[32]  D. Peel,et al.  The time series behaviour of spot exchange rates in the German hyper-inflation period: (Was the process chaotic?) , 1995 .

[33]  J. Padmore,et al.  A threshold model for the French franc/deutschmark exchange rate , 1996 .

[34]  Mike K. P. So,et al.  Forecasting exchange rate volatility using autoregressive random variance model , 1999 .