Potential of evolving AR and ARX models in signal recovering

Linear dynamic models, due to their agile structure, are capable to follow and predict fast variations of real-world systems. On the other hand, recovering outcome signals of real-world systems is a straightforward approach to predict them. In this paper, potential of some dynamic linear models—including autoregressive (AR), autoregressive with exogenous inputs (ARX) models and their extended adaptive and evolving versions–are studied in signal recovering. At first, a common signal is represented as summation of some basic temporal functions named TMs (TMs); then, capabilities of the considered models are explained and compared in generating signals with different combinations of TMs. The given explanations and results are supported by theorems, Corollaries, illustrative examples and a real-world example of signal recovering. It is demonstrated that adaptive and particularly evolving AR and ARX models are more capable in signal recovering than regular AR and ARX models. Also, it is proved that if exogenous inputs as incoming signals of an ARX model were not available, under some constraints, there is an AR model which can produce the output of the ARX model. This result is extended for adaptive and evolving AR and ARX models, too.

[1]  Igor Skrjanc,et al.  Identification of dynamical systems with a robust interval fuzzy model , 2005, Autom..

[2]  A. O. Odior,et al.  Application of neural network and fuzzy model to grinding process control , 2013, Evolving Systems.

[3]  R. Precup,et al.  Stability analysis method for fuzzy control systems dedicated controlling nonlinear processes , 2007 .

[4]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[5]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[6]  Endra Joelianto,et al.  ANFIS – Hybrid Reference Control for Improving Transient Response of Controlled Systems Using PID Controller , 2013 .

[7]  Plamen P. Angelov,et al.  On line learning fuzzy rule-based system structure from data streams , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[8]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[9]  Francis Eng Hock Tay,et al.  Modified support vector machines in financial time series forecasting , 2002, Neurocomputing.

[10]  Enrico Zio,et al.  Failure and reliability prediction by support vector machines regression of time series data , 2011, Reliab. Eng. Syst. Saf..

[11]  Terence C. Mills,et al.  Time series techniques for economists , 1990 .

[12]  Michael Unser,et al.  Consistent Sampling and Signal Recovery , 2007, IEEE Transactions on Signal Processing.

[13]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[14]  Katsuhiko Ogata,et al.  Discrete-time control systems (2nd ed.) , 1995 .

[15]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[16]  Diyar Akay,et al.  Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecasting , 2009, Expert Syst. Appl..

[17]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[18]  Babak Nadjar Araabi,et al.  Online extraction of main linear trends for nonlinear time-varying processes , 2013, Inf. Sci..

[19]  Juan Manuel Górriz,et al.  A new model for time-series forecasting using radial basis functions and exogenous data , 2004, Neural Computing & Applications.

[20]  Durdu Ömer Faruk A hybrid neural network and ARIMA model for water quality time series prediction , 2010, Eng. Appl. Artif. Intell..

[21]  Zhitao Huang,et al.  Improved blind-spreading sequence estimation algorithm for direct sequence spread spectrum signals , 2008 .

[22]  Babak Nadjar Araabi,et al.  Reducing the number of local linear models in neuro-fuzzy modeling: A split-and-merge clustering approach , 2011, Appl. Soft Comput..

[23]  Katsuhiko Ogata,et al.  Discrete-time control systems , 1987 .

[24]  Mehdi Khashei,et al.  A new hybrid artificial neural networks and fuzzy regression model for time series forecasting , 2008, Fuzzy Sets Syst..

[25]  Julio Ortega Lopera,et al.  Improved RAN sequential prediction using orthogonal techniques , 2001, Neurocomputing.

[26]  Babak Nadjar Araabi,et al.  Evolving Takagi-Sugeno fuzzy model based on switching to neighboring models , 2013, Appl. Soft Comput..

[27]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[28]  Paulo Jorge S. G. Ferreira,et al.  Incomplete sampling series and the recovery of missing samples from oversampled band-limited signals , 1992, IEEE Trans. Signal Process..

[29]  Q. M. Jonathan Wu,et al.  A fuzzy logic model based Markov random field for medical image segmentation , 2013, Evol. Syst..

[30]  Igor Skrjanc,et al.  Direct fuzzy model‐reference adaptive control , 2002, Int. J. Intell. Syst..

[31]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Ahmad Kalhor,et al.  A self tuning regulator for nonlinear time varying control systems based on evolving linear models , 2014, 2014 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[33]  Mohammad Ali Tinati,et al.  Adaptive efficient sparse estimator achieving oracle properties , 2013, IET Signal Process..

[34]  Gunawan Dewantoro,et al.  Fuzzy Sliding Mode Control for Enhancing Injection Velocity Performance in Injection Molding Machine , 2013 .

[35]  Stefan Preitl,et al.  Iterative Feedback Tuning in Fuzzy Control Systems. Theory and Applications , 2006 .

[36]  Babak Nadjar Araabi,et al.  An online predictor model as adaptive habitually linear and transiently nonlinear model , 2010, Evol. Syst..

[37]  Babak Nadjar Araabi,et al.  Predicting Chaotic Time Series Using Neural and Neurofuzzy Models: A Comparative Study , 2006, Neural Processing Letters.

[38]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[39]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[40]  Ahmad Kalhor,et al.  Online modeling of real-world time series through evolving AR models , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[41]  Tony White,et al.  The application of antigenic search techniques to time series forecasting , 2005, GECCO '05.