Performance Predictions for Parameter Estimators That Minimize Cost-Functions Using Wirtinger Calculus With Application to CM Blind Equalization

We present calculations of the first-order bias and first-order variance of parameters which are estimated batch-wise from the global minimum of a cost-function of complex-valued signals embedded in zero-mean Gaussian noise. The derivation involves the calculation of the multidimensional Taylor series of the non-analytic cost-function up to third order using the elegant Wirtinger calculus. Whereas closed-form expressions for the variance can be obtained straightforwardly from a second-order Taylor series, and have been presented in various other contexts, an exact expression for the bias cannot be derived, in general. In this paper, we propose approximate expressions for the first-order bias and confirm them in a comparison of results from extensive analytical calculations with results from Monte Carlo (MC) simulations for the statistical efficiency of a batch-processing blind equalizer using the constant-modulus (CM) criterion. We study the equalization of independent and identically distributed (i.i.d.) random symbols and obtain asymptotic (for large batch size) expressions for the averages of the bias and variance over zero-mean random (real-valued) signals of binary phase shift keying (BPSK), and (complex-valued) signals of M-ary PSK modulation (M >; 2) . Finally, we compare the statistical efficiency of the CM estimator with the one of the maximum likelihood (ML) blind estimation of the path parameters and equalized symbols with CM constraint.

[1]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[2]  Yonina C. Eldar,et al.  Rethinking Biased Estimation , 2008 .

[3]  Alfred O. Hero,et al.  Exploring estimator bias-variance tradeoffs using the uniform CR bound , 1996, IEEE Trans. Signal Process..

[4]  Julius O. Smith,et al.  Adaptive multipath delay estimation , 1985, IEEE Trans. Acoust. Speech Signal Process..

[5]  Hualiang Li,et al.  A Practical Formulation for Computation of Complex Gradients and its Application to Maximum Likelihood ICA , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  W. Wirtinger Zur formalen Theorie der Funktionen von mehr komplexen Veränderlichen , 1927 .

[7]  Anders Høst-Madsen On the existence of efficient estimators , 2000, IEEE Trans. Signal Process..

[8]  Arogyaswami Paulraj,et al.  A subspace approach to blind space-time signal processing for wireless communication systems , 1997, IEEE Trans. Signal Process..

[9]  Yingbo Hua,et al.  Fast maximum likelihood for blind identification of multiple FIR channels , 1996, IEEE Trans. Signal Process..

[10]  Petre Stoica,et al.  MUSIC, maximum likelihood and Cramer-Rao bound , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[11]  J. Treichler,et al.  A new approach to multipath correction of constant modulus signals , 1983 .

[12]  S.T. Smith Statistical Resolution Limits and the Complexified , 2005 .

[13]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[14]  H. V. Trees,et al.  Exploring Estimator BiasVariance Tradeoffs Using the Uniform CR Bound , 2007 .

[15]  John G. Proakis,et al.  Digital Communications , 1983 .

[16]  Philippe Forster,et al.  Unconditional Maximum Likelihood Performance at Finite Number of Samples and High Signal-to-Noise Ratio , 2007, IEEE Transactions on Signal Processing.

[17]  D.T.M. Slock,et al.  Asymptotic performance of ML methods for semi-blind channel estimation , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[18]  Yonina C. Eldar,et al.  Rethinking biased estimation [Lecture Notes] , 2008, IEEE Signal Processing Magazine.

[19]  W. Rummler,et al.  Multipath fading channel models for microwave digital radio , 1986, IEEE Communications Magazine.

[20]  Adriaan van den Bos,et al.  A Cramer-Rao lower bound for complex parameters , 1994, IEEE Trans. Signal Process..

[21]  Yoram Bresler,et al.  A compact Cramer-Rao bound expression for parametric estimation of superimposed signals , 1992, IEEE Trans. Signal Process..

[22]  James L. Massey,et al.  Proper complex random processes with applications to information theory , 1993, IEEE Trans. Inf. Theory.

[23]  S. Grob,et al.  Potential of the fixed frequency HF communication medium in the upgrading NATO Tactical Data Link 22 , 2006 .

[24]  R. Remmert,et al.  Theory of Complex Functions , 1990 .

[25]  Kenneth Kreutz-Delgado,et al.  Use of the Newton Method for Blind Adaptive Equalization Based on the Constant Modulus Algorithm , 2008, IEEE Transactions on Signal Processing.

[26]  Benjamin Friedlander,et al.  Maximum likelihood estimation, analysis, and applications of exponential polynomial signals , 1999, IEEE Trans. Signal Process..

[27]  S. T. Smith Statistical resolution limits and the complexified Crame/spl acute/r-Rao bound , 2005, IEEE Transactions on Signal Processing.

[28]  C. C. Watterson,et al.  Experimental Confirmation of an HF Channel Model , 1970 .

[29]  N. Makris,et al.  Necessary conditions for a maximum likelihood estimate to become asymptotically unbiased and attain the Cramer-Rao lower bound. Part I. General approach with an application to time-delay and Doppler shift estimation. , 2001, The Journal of the Acoustical Society of America.

[30]  Koichi Tsunekawa,et al.  Advanced LOS path-loss model in microcellular mobile communications , 2000, IEEE Trans. Veh. Technol..

[31]  H. Howard Fan,et al.  A Newton-like algorithm for complex variables with applications in blind equalization , 2000, IEEE Trans. Signal Process..

[32]  Yonina C. Eldar MSE Bounds With Affine Bias Dominating the CramÉr–Rao Bound , 2008, IEEE Transactions on Signal Processing.

[33]  D. Slock,et al.  Cramer-Rao bounds for semi-blind, blind and training sequence based channel estimation , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[34]  Philip Schniter,et al.  Blind equalization using the constant modulus criterion: a review , 1998, Proc. IEEE.

[35]  Visa Koivunen,et al.  Essential Statistics and Tools for Complex Random Variables , 2010, IEEE Transactions on Signal Processing.

[36]  A. Bos Complex gradient and Hessian , 1994 .

[37]  Dietrich Fr Complex Digital Networks: A Sensitivity Analysis Based on the Wirtinger Calculus , 1997 .

[38]  B. A. D. H. Brandwood A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[39]  Petre Stoica,et al.  On biased estimators and the unbiased Cramér-Rao lower bound , 1990, Signal Process..

[40]  Hualiang Li,et al.  Complex ICA Using Nonlinear Functions , 2008, IEEE Transactions on Signal Processing.