Monotonic convergence of fixed-point algorithms for ICA

We re-examine a fixed-point algorithm proposed by Hyvarinen for independent component analysis, wherein local convergence is proved subject to an ideal signal model using a square invertible mixing matrix. Here, we derive step-size bounds which ensure monotonic convergence to a local extremum for any initial condition. Our analysis does not assume an ideal signal model but appeals rather to properties of the contrast function itself, and so applies even with noisy data and/or more sources than sensors. The results help alleviate the guesswork that often surrounds step-size selection when the observed signal does not fit an idealized model.

[1]  Phillip A. Regalia,et al.  Undermodeled equalization: a characterization of stationary points for a family of blind criteria , 1999, IEEE Trans. Signal Process..

[2]  P. Regalia,et al.  Tensor Approximation and Signal Processing Applications , 2005 .

[3]  P. Comon,et al.  Higher-order power method - application in independent component analysis , 1995 .

[4]  Philip Schniter,et al.  Blind equalization using the constant modulus criterion: a review , 1998, Proc. IEEE.

[5]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[6]  C. Richard Johnson,et al.  Bounds for the MSE performance of constant modulus estimators , 2000, IEEE Trans. Inf. Theory.

[7]  Ehud Weinstein,et al.  Super-exponential methods for blind deconvolution , 1993, IEEE Trans. Inf. Theory.

[8]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[9]  Lang Tong,et al.  Relationships Between the Constant Modulus and Wiener Receivers , 1998, IEEE Trans. Inf. Theory.

[10]  Phillip A. Regalia,et al.  A gradient search interpretation of the super-exponential algorithm , 2000, IEEE Trans. Inf. Theory.

[11]  Aapo Hyvärinen,et al.  Survey on Independent Component Analysis , 1999 .

[12]  Phillip A. Regalia,et al.  Properties of some blind equalization criteria in noisy multiuser environments , 2001, IEEE Trans. Signal Process..

[13]  Phillip A. Regalia,et al.  On the equivalence between the Godard and Shalvi-Weinstein schemes of blind equalization , 1999, Signal Process..

[14]  A. Benveniste,et al.  Robust identification of a nonminimum phase system: Blind adjustment of a linear equalizer in data communications , 1980 .