Real time input subset selection for linear time-variant MIMO systems

In this paper we propose an approach for multi-input multi-output (MIMO) system identification when the statistical relationship between input and output varies in input space as well as in time; i.e. nonstationary in space and time. An on-line variable selection algorithm, which has been recently developed for selecting a subset of input variables in real time by modifying least angle regression (LAR) with recursive estimators, is extensively applied to the linear time-variant MIMO systems. In our approach, a subset of input channels relevant with output is selected at every time instance based on the correlation between the filtering outcome of individual input channels and desired output. The on-line variable selection algorithm performs channel selection with weights using this real-time correlation. The proposed model is compared with a typical linear model in which only the least mean squares (LMS) is used to update system parameters. Tracking performances of these two models are demonstrated in a computer simulation and in a real-world application for tracking a linear relationship between neural firing rates of a primate and synchronously recorded hand kinematics. In both cases, our model demonstrates superior tracking performance.

[1]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[2]  J.C. Sanchez,et al.  Learning the contributions of the motor, premotor, and posterior parietal cortices for hand trajectory reconstruction in a brain machine interface , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[3]  Odile Macchi,et al.  Adaptive recovery of a chirped sinusoid in noise. I. Performance of the RLS algorithm , 1991, IEEE Trans. Signal Process..

[4]  Ali H. Sayed,et al.  Tracking of linear time-variant systems , 1995, Proceedings of MILCOM '95.

[5]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[6]  Deniz Erdogmus,et al.  Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[7]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[8]  Bhaskar D. Rao,et al.  Sparse channel estimation via matching pursuit with application to equalization , 2002, IEEE Trans. Commun..

[9]  William A. Gardner,et al.  Measures of tracking performance for the LMS algorithm , 1990, IEEE Trans. Acoust. Speech Signal Process..

[10]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[11]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[12]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[13]  Kiyoshi Nishiyama,et al.  An H/sub /spl infin// optimization and its fast algorithm for time-variant system identification , 2004, IEEE Transactions on Signal Processing.

[14]  Eweda Eweda,et al.  Comparison of RLS, LMS, and sign algorithms for tracking randomly time-varying channels , 1994, IEEE Trans. Signal Process..

[15]  Malik Beshir Malik,et al.  Applied Linear Regression , 2005, Technometrics.

[16]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[17]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .