Nonlinear Prediction Based on Independent Component Analysis Mixture Modelling

This paper presents a new algorithm for nonlinear prediction based on independent component analysis mixture modelling (ICAMM). The data are considered from several mutually-exclusive classes which are generated by different ICA models. This strategy allows linear local projections that can be adapted to partial segments of a data set while maintaining generalization (capability for nonlinear modelling) given the mixture of several ICAs. The resulting algorithm is a general purpose technique that could be applied to time series prediction, to recover missing data in images, etc. The performance of the proposed method is demonstrated by simulations in comparison with several classical linear and nonlinear methods.

[1]  Addisson Salazar,et al.  On including sequential dependence in ICA mixture models , 2010, Signal Process..

[2]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[3]  Ying-wei Zhang,et al.  Complex process quality prediction using modified kernel partial least squares , 2010 .

[4]  R. S. Raghavan.  A model for spatially correlated radar clutter , 1991 .

[5]  Yen-Wei Chen,et al.  Independent component analysis-based prediction of O-Linked glycosylation sites in protein using multi-layered neural networks , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[6]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[7]  Addisson Salazar,et al.  A general procedure for learning mixtures of independent component analyzers , 2010, Pattern Recognit..

[8]  E. Oja,et al.  Independent Component Analysis , 2013 .

[9]  Addisson Salazar,et al.  ICA Mixtures Applied to Ultrasonic Nondestructive Classification of Archaeological Ceramics , 2010, EURASIP J. Adv. Signal Process..

[10]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  俊一 甘利,et al.  A. Hyvärinen, J. Karhunen and E. Oja, Independent Component Analysis, Jhon Wiley & Sons, 2001年，504ページ． （根本幾・川勝真喜訳：独立成分分析——信号解析の新しい世界，東京電機大学出版局，2005年，532ページ．） , 2010 .

[12]  Addisson Salazar,et al.  Learning material defect patterns by separating mixtures of independent component analyzers from NDT sonic signals , 2010 .

[13]  C.G. Puntonet,et al.  Time series prediction using ICA algorithms , 2003, Second IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2003. Proceedings.