Sunspot Time Series Prediction Using Parallel-Structure Fuzzy System

Sunspots are dark areas that grow and decay on the lowest level of the Sun that are visible from the Earth. Short-term predictions of solar activity are essential to help plan missions and to design satellites that will survive for their useful lifetimes. This paper presents a parallel-structure fuzzy system (PSFS) for prediction of sunspot number time series. The PSFS consists of a multiple number of component fuzzy systems connected in parallel. Each component fuzzy system in the PSFS predicts future data independently based on its past time series data with different embedding dimension and time delay. An embedding dimension determines the number of inputs of each component fuzzy system and a time delay decides the interval of inputs of the time series. According to the embedding dimension and the time delay, the component fuzzy system takes various input-output pairs. The PSFS determines the final predicted value as an average of all the outputs of the component fuzzy systems in order to reduce error accumulation effect.

[1]  H. Surmann,et al.  Self-Organizing and Genetic Algorithms for an Automatic Design of Fuzzy Control and Decision Systems , 1993 .

[2]  Agostino Di Ciaccio,et al.  Improving nonparametric regression methods by bagging and boosting , 2002 .

[3]  Yoshua Bengio,et al.  Boosting Neural Networks , 2000, Neural Computation.

[4]  Thomas G. Dietterich.  An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[5]  V. Rao Vemuri,et al.  Artificial Neural Networks - Forecasting Time Series , 1993 .

[6]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[7]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[8]  Padraig Cunningham,et al.  The NeuralBAG algorithm: optimizing generalization performance in bagged neural networks , 1999, ESANN.

[9]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  C. Hwang,et al.  A Combined Approach to Fuzzy Model Identification , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[11]  Harris Drucker,et al.  Improving Regressors using Boosting Techniques , 1997, ICML.

[12]  S. Kong,et al.  Time series prediction using the parallel-structure fuzzy system , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[13]  K. Nakayama,et al.  A Cascade Form Predictor of Neural and FIR Filters and Its Minimum Size Estimation Based on Nonlinearity Analysis of Time Series , 1998 .

[14]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[15]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[16]  Chee Peng Lim,et al.  Predicting drug dissolution profiles with an ensemble of boosted neural networks: a time series approach , 2003, IEEE Trans. Neural Networks.

[17]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[18]  Bernhard Sendhoff,et al.  An Extended Elman Net for Modeling Time Series , 1997, ICANN.

[19]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[20]  Toniann Pitassi,et al.  A Gradient-Based Boosting Algorithm for Regression Problems , 2000, NIPS.

[21]  R. Thompson,et al.  A technique for predicting the amplitude of the solar cycle , 1993 .

[22]  D. Lowe,et al.  Time series prediction by adaptive networks: a dynamical systems perspective , 1991 .

[23]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[24]  Lyle H. Ungar,et al.  A NEURAL NETWORK ARCHITECTURE THAT COMPUTES ITS OWN RELIABILITY , 1992 .

[25]  Ke-Jun Li,et al.  Solar activity in extended cycles , 2002 .

[26]  Ronald R. Yager,et al.  Essentials of fuzzy modeling and control , 1994 .

[27]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[28]  Jonas Sjöberg,et al.  Neural networks for modelling and control of dynamic systems, M. Nørgaard, O. Ravn, N. K. Poulsen and L. K. Hansen, Springer, London, 2000, xiv+246pp. , 2001 .

[29]  Fabio Roli,et al.  An approach to the automatic design of multiple classifier systems , 2001, Pattern Recognit. Lett..

[30]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[31]  M. Kim,et al.  Chaotic time series prediction using PSFS2 , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[32]  Michio Sugeno,et al.  Industrial Applications of Fuzzy Control , 1985 .

[33]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[34]  Robert N. Miller,et al.  Ensemble Generation for Models of Multimodal Systems , 2002 .

[35]  W. Hauptmann,et al.  A neural net topology for bidirectional fuzzy-neuro transformation , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[36]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[37]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[38]  Harris Drucker.  Fast Committee Machines for Regression and Classification , 1997, KDD.

[39]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[40]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[41]  Timothy Masters,et al.  Practical neural network recipes in C , 1993 .

[42]  Françoise Fessant,et al.  On the prediction of solar activity using different neural network models , 1996, Annales Geophysicae.

[43]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  R. Tong.  The evaluation of fuzzy models derived from experimental data , 1980 .

[45]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[46]  Michael J. Watts,et al.  FuNN/2 - A Fuzzy Neural Network Architecture for Adaptive Learning and Knowledge Acquisition , 1997, Inf. Sci..

[47]  David H. Hathaway,et al.  A synthesis of solar cycle prediction techniques , 1999 .

[48]  Witold Pedrycz,et al.  Distributed fuzzy system modeling , 1995, IEEE Trans. Syst. Man Cybern..

[49]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.