Stochastic MV-PURE Estimator— Robust Reduced-Rank Estimator for Stochastic Linear Model

This paper proposes a novel linear estimator named stochastic MV-PURE estimator, developed for the stochastic linear model, and designed to provide improved performance over the linear minimum mean square error (MMSE) Wiener estimator in cases prevailing in practical, real-world settings, where at least some of the second-order statistics of the random vectors under consideration are only imperfectly known. The proposed estimator shares its main mathematical idea and terminology with the recently introduced minimum-variance pseudo-unbiased reduced-rank estimator (MV-PURE), developed for the linear regression model. The proposed stochastic MV-PURE estimator minimizes the mean square error (MSE) of its estimates subject to rank constraint and inducing minimum distortion to the target random vector. Therefore, the stochastic MV-PURE combines the techniques of the reduced rank Wiener filter (named in this paper RR-MMSE) and the distortionless-constrained estimator (named in this paper C-MMSE), in order to achieve greater robustness against noise or model errors than RR-MMSE and C-MMSE. Furthermore, to ensure that the stochastic MV-PURE estimator combines the reduced-rank and minimum-distortion approaches in the MSE-optimal way, we propose a rank selection criterion which minimizes the MSE of the estimates obtained by the stochastic MV-PURE. As a numerical example, we employ the stochastic MV-PURE, RR-MMSE, C-MMSE, and MMSE estimators as linear receivers in a MIMO wireless communication system. This example is chosen as a typical signal processing scenario, where the statistical information on the data, on which the estimates are built, is only imperfectly known. We verify that the stochastic MV-PURE achieves the lowest MSE and symbol error rate (SER) in such settings by employing the proposed rank selection criterion.

[1]  Louis L. Scharf,et al.  Data adaptive rank-shaping methods for solving least squares problems , 1995, IEEE Trans. Signal Process..

[2]  Upamanyu Madhow,et al.  MMSE interference suppression for direct-sequence spread-spectrum CDMA , 1994, IEEE Trans. Commun..

[3]  S.A. Kassam,et al.  Robust techniques for signal processing: A survey , 1985, Proceedings of the IEEE.

[4]  Mohammad Gharavi-Alkhansari,et al.  Minimum variance linear receivers for multiaccess MIMO wireless systems with space-time block coding , 2004, IEEE Transactions on Signal Processing.

[5]  Dale Borowiak,et al.  Linear Models, Least Squares and Alternatives , 2001, Technometrics.

[6]  Yue Rong,et al.  Robust linear receivers for multiaccess space-time block-coded MIMO systems: a probabilistically constrained approach , 2006, IEEE Journal on Selected Areas in Communications.

[7]  Yonina C. Eldar,et al.  A competitive minimax approach to robust estimation of random parameters , 2004, IEEE Transactions on Signal Processing.

[8]  R. Róbert Generalized Inverses (Theory and Applications. Second edition) by A. Ben-Israel and T.N.E. Neville (deceased) , 2005 .

[9]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[10]  Louis L. Scharf,et al.  The SVD and reduced rank signal processing , 1991, Signal Process..

[11]  L. Tee Wireless Communication Systems , 2007 .

[12]  Anders Høst-Madsen,et al.  Group-blind multiuser detection for uplink CDMA , 1999, IEEE J. Sel. Areas Commun..

[13]  Wanquan Liu,et al.  Generalized Karhunen-Loeve transform , 1998, IEEE Signal Process. Lett..

[14]  Wolfgang Utschick,et al.  Pilot-assisted channel estimation based on second-order statistics , 2005, IEEE Transactions on Signal Processing.

[15]  John K. Thomas,et al.  Wiener filters in canonical coordinates for transform coding, filtering, and quantizing , 1998, IEEE Trans. Signal Process..

[16]  D. Brillinger Time series - data analysis and theory , 1981, Classics in applied mathematics.

[17]  Petre Stoica,et al.  Maximum likelihood parameter and rank estimation in reduced-rank multivariate linear regressions , 1996, IEEE Trans. Signal Process..

[18]  Isao Yamada,et al.  MV-PURE Estimator: Minimum-Variance Pseudo-Unbiased Reduced-Rank Estimator for Linearly Constrained Ill-Conditioned Inverse Problems , 2008, IEEE Transactions on Signal Processing.

[19]  Umberto Spagnolini,et al.  Reduced-rank channel estimation for time-slotted mobile communication systems , 2005, IEEE Transactions on Signal Processing.

[20]  Aleksandar Dogandzic,et al.  Generalized multivariate analysis of variance - A unified framework for signal processing in correlated noise , 2003, IEEE Signal Process. Mag..

[21]  Yue Rong,et al.  Robust linear receivers for space-time block coded multiaccess MIMO systems with imperfect channel state information , 2005, IEEE Transactions on Signal Processing.

[22]  Petre Stoica,et al.  Optimal reduced-rank estimation and filtering , 2001, IEEE Trans. Signal Process..

[23]  Sun-Yuan Kung,et al.  Multilayer neural networks for reduced-rank approximation , 1994, IEEE Trans. Neural Networks.

[24]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[25]  Isao Yamada,et al.  Minimum-Variance Pseudo-Unbiased Low-Rank Estimator for Ill-Conditioned Inverse Problems , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[26]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[27]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[28]  Björn E. Ottersten,et al.  On the complexity of sphere decoding in digital communications , 2005, IEEE Transactions on Signal Processing.

[29]  Hongbin Li,et al.  Robust multiuser detection for multicarrier CDMA systems , 2006, IEEE Journal on Selected Areas in Communications.

[30]  Yingbo Hua,et al.  Generalized Karhunen-Loeve transform , 1998, IEEE Signal Processing Letters.

[31]  John S. Chipman,et al.  Linear restrictions, rank reduction, and biased estimation in linear regression , 1999 .

[32]  Bernard C. Picinbono,et al.  On circularity , 1994, IEEE Trans. Signal Process..

[33]  Isao Yamada,et al.  Multiaccess Interference Suppression in Orthogonal Space–Time Block Coded MIMO Systems by Adaptive Projected Subgradient Method , 2008, IEEE Transactions on Signal Processing.

[34]  David R. Brillinger,et al.  Time Series: Data Analysis and Theory. , 1982 .

[35]  Yukihiko Yamashita,et al.  Relative Karhunen-Loève transform , 1996, IEEE Trans. Signal Process..

[36]  Louis L. Scharf,et al.  Rank reduction for modeling stationary signals , 1987, IEEE Trans. Acoust. Speech Signal Process..

[37]  Alex B. Gershman,et al.  Space-time processing for MIMO communications , 2005 .

[38]  Shalabh,et al.  Linear Models and Generalizations: Least Squares and Alternatives , 2007 .

[39]  C. Windpassinger,et al.  Real versus complex-valued equalisation in V-BLAST systems , 2003 .

[40]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[41]  George V. Moustakides,et al.  On the relative error probabilities of linear multiuser detectors , 2001, IEEE Trans. Inf. Theory.

[42]  Rohit U. Nabar,et al.  Introduction to Space-Time Wireless Communications , 2003 .

[43]  P. K. Chaturvedi,et al.  Communication Systems , 2002, IFIP — The International Federation for Information Processing.