Least-Mean-Square Training of Cluster-Weighted Modeling

Aside from the Expectation-Maximization (EM) algorithm, Least-Mean-Square (LMS) is devised to further train the model parameters as a complementary training algorithm for Cluster-Weighted Modeling (CWM). Due to different objective functions of EM and LMS, the training result of LMS can be used to reinitialize CWM's model parameters which provides an approach to mitigate local minimum problems.

[1]  N. Gershenfeld,et al.  Cluster-weighted modelling for time-series analysis , 1999, Nature.

[2]  Jiann-Ming Wu,et al.  Function approximation using generalized adalines , 2006, IEEE Transactions on Neural Networks.

[3]  Bruce R. Musicus,et al.  Cross Entropy Approximation of Structured Covariance Matrices , 2006, ArXiv.

[4]  Holger Kantz,et al.  Practical implementation of nonlinear time series methods: The TISEAN package. , 1998, Chaos.

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  Cheng-Yuan Liou,et al.  Self-organization using Potts models , 1996, Neural Networks.

[7]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[8]  Thomas G. Dietterich,et al.  Improving the Performance of Radial Basis Function Networks by Learning Center Locations , 1991, NIPS.

[9]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[10]  Jiann-Ming Wu,et al.  Independent component analysis using Potts models , 2001, IEEE Trans. Neural Networks.

[11]  Bruce R. Musicus,et al.  A separable cross-entropy approach to power spectral estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[12]  S. Greelish.  A basis for closed loop ROV control , 1999, Oceans '99. MTS/IEEE. Riding the Crest into the 21st Century. Conference and Exhibition. Conference Proceedings (IEEE Cat. No.99CH37008).

[13]  Cheng-Yuan Liou,et al.  The Determination of Modal Damping Ratios and Natural Frequencies from Bispectrum Modeling , 1987, OCEANS '87.

[14]  Danil V. Prokhorov,et al.  A new approach to cluster-weighted modeling , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[15]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[16]  R Morris,et al.  Computer security and the bell system. , 1977, Science.