Multivariate Chaotic Time Series Prediction: Broad Learning System Based on Sparse PCA

The sparse principle component analysis (SPCA) comprehensively considers the maximal variance of principal components and the sparseness of the load factor, thus making up for the defects of the traditional PCA. In this paper, we are committed to propose a novel approach based on broad learning system with sparse PCA named as SPCA-BLS for chaotic time series prediction. We also develop the incremental learning algorithms to rapidly rebuild the network without full retraining if the network is considered to be expanded. The core of the SPCA-BLS is that we achieved the dimensionality reduction and the features extraction of high-dimensional data and the dynamical reconstruction of the network without the entire retraining. The method has been simulated on an artificial and an actual data sets and the experimental results in regression accuracy confirm the characteristics and effectiveness of the SPCA-BLS.

[1]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Tie Qiu,et al.  Interval Type-2 Fuzzy Neural Networks for Chaotic Time Series Prediction: A Concise Overview , 2019, IEEE Transactions on Cybernetics.

[3]  Lingzhou Xue,et al.  A Selective Overview of Sparse Principal Component Analysis , 2018, Proceedings of the IEEE.

[4]  Enrico Zio,et al.  Two Machine Learning Approaches for Short-Term Wind Speed Time-Series Prediction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[6]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[7]  F. Takens Detecting strange attractors in turbulence , 1981 .

[8]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[9]  Yi Peng,et al.  Nonlinear manifold learning for early warnings in financial markets , 2017, Eur. J. Oper. Res..

[10]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[11]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[12]  Tie Qiu,et al.  Nonuniform State Space Reconstruction for Multivariate Chaotic Time Series , 2019, IEEE Transactions on Cybernetics.

[13]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[14]  I. Jolliffe,et al.  A Modified Principal Component Technique Based on the LASSO , 2003 .

[15]  Zhaohui Wu,et al.  Sparse Principal Component Analysis via Rotation and Truncation , 2014, IEEE Transactions on Neural Networks and Learning Systems.