Time Series Prediction Method Based on E-CRBM

To solve the problems of delayed prediction results and large prediction errors in one-dimensional time series prediction, a time series prediction method based on Error-Continuous Restricted Boltzmann Machines (E-CRBM) is proposed in this paper. This method constructs a deep conversion prediction framework, which is composed of two E-CRBMs and a neural network (NN). Firstly, the E-CRBM models of the original input sequence and the target prediction sequence are trained, respectively, to extract the time features of the two sequences. Then the NN model is used to connect and transform the time features. Secondly, the feature sequence H1 is extracted from the original input sequence of test data through E-CRBM1, which is used as input of NN to obtain feature transformation sequence H2. Finally, the target prediction sequence is obtained by reverse reconstruction of feature transformation sequence H2 through E-CRBM2. The E-CRBM in this paper introduces the residual sequence of NN feature transformation in the hidden layer of CRBM, which increases the robustness of CRBM and improves the overall prediction accuracy. The classical time series data (sunspot time series) and the actual operation data of reciprocating compressor are selected in the experiment. Compared with the traditional time series prediction method, the results verify the effectiveness of the proposed method in single-step prediction and multi-step prediction.

[1]  Chi-Man Vong,et al.  Predicting minority class for suspended particulate matters level by extreme learning machine , 2014, Neurocomputing.

[2]  Albert Sesé,et al.  Designing an artificial neural network for forecasting tourism time series , 2006 .

[3]  Shen Furao,et al.  Forecasting exchange rate using deep belief networks and conjugate gradient method , 2015, Neurocomputing.

[4]  Joao P. S. Catalao,et al.  Electricity price forecast using Combinatorial Neural Network trained by a new stochastic search method , 2015 .

[5]  Alan F. Murray,et al.  Adaptive Sensor Modelling and Classification using a Continuous Restricted Boltzmann Machine (CRBM) , 2007, ESANN.

[6]  Alan F. Murray,et al.  Continuous restricted Boltzmann machine with an implementable training algorithm , 2003 .

[7]  Chien-Chang Chou,et al.  A fuzzy neural network combined with technical indicators and its application to Baltic Dry Index forecasting , 2018, Journal of Marine Engineering & Technology.

[8]  Teik C. Lim,et al.  Evaluation of vehicle interior sound quality using a continuous restricted Boltzmann machine-based DBN , 2017 .

[9]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[10]  Gilbert T. Walker,et al.  On Periodicity in Series of Related Terms , 1931 .

[11]  Niu Rui-qing Wu Ting Peng Ling.  Time series analysis and support vector machine for landslide displacement prediction , 2013 .

[12]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[13]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[14]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[15]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[16]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[17]  Xinmin Song,et al.  Complex lithology prediction using probabilistic neural network improved by continuous restricted Boltzmann machine and particle swarm optimization , 2019, Journal of Petroleum Science and Engineering.

[18]  Daniel Stamate,et al.  A regime-switching recurrent neural network model applied to wind time series , 2019, Appl. Soft Comput..

[19]  B Zhou.  Financial time series forecasting based on wavelet and multi-dimensional Taylor network dynamics model , 2013 .

[20]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[21]  G. Caginalp,et al.  Statistical Inference and Modelling of Momentum in Stock Prices , 1995 .

[22]  Wei Wang,et al.  Time Series Prediction With Incomplete Dataset Based on Deep Bidirectional Echo State Network , 2019, IEEE Access.

[23]  G. Yule.  On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[24]  G. Box,et al.  The likelihood function of stationary autoregressive-moving average models , 1979 .

[25]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[26]  Yu Chong-chon.  Multivariate time series fuzzy clustering segmentation mining algorithm , 2014 .