On the Distribution of Indefinite Quadratic Forms in Gaussian Random Variables

In this work, we propose a unified approach to evaluating the CDF and PDF of indefinite quadratic forms in Gaussian random variables. Such a quantity appears in many applications in communications, signal processing, information theory, and adaptive filtering. For example, this quantity appears in the mean-square-error (MSE) analysis of the normalized least-mean-square (NLMS) adaptive algorithm, and SINR associated with each beam in beam forming applications. The trick of the proposed approach is to replace inequalities that appear in the CDF calculation with unit step functions and to use complex integral representation of the the unit step function. Complex integration allows us then to evaluate the CDF in closed form for the zero mean case and as a single dimensional integral for the non-zero mean case. Utilizing the saddle point technique allows us to closely approximate such integrals in non zero mean case. We demonstrate how our approach can be extended to other scenarios such as the joint distribution of quadratic forms and ratios of such forms, and to characterize quadratic forms in isotropic distributed random variables. We also evaluate the outage probability in multiuser beamforming using our approach to provide an application of indefinite forms in communications.

[1]  Jungwoo Lee,et al.  SINR and Throughput Analysis for Random Beamforming Systems with Adaptive Modulation , 2013, IEEE Transactions on Wireless Communications.

[2]  Mohamed-Slim Alouini,et al.  Sum and difference of two squared correlated Nakagami variates in connection with the McKay distribution , 2004, IEEE Transactions on Communications.

[3]  L. L. Campbell,et al.  Tail probability of a noncentral indefinite gaussian quadratic form , 1994 .

[4]  K. Malakian,et al.  Distribution of general noncentral positive definite quadratic form in K-dimensions , 1989 .

[5]  Dan Raphaeli,et al.  Series expansions for the distribution of noncentral indefinite quadratic forms in complex normal variables , 1995, Eighteenth Convention of Electrical and Electronics Engineers in Israel.

[6]  N. Bershad.  Behavior of the ε-normalized LMS algorithm with Gaussian inputs , 1987, IEEE Trans. Acoust. Speech Signal Process..

[7]  Herbert Solomon,et al.  Distribution of Quadratic Forms and Some Applications , 1955 .

[8]  Dan Raphaeli,et al.  Noncoherent coded modulation , 1996, IEEE Trans. Commun..

[9]  Gonçalo N. Tavares,et al.  On the Statistics of the Sum of Squared Complex Gaussian Random Variables , 2007, IEEE Transactions on Communications.

[10]  Dariush Divsalar,et al.  The performance of trellis-coded MDPSK with multiple symbol detection , 1990, IEEE Trans. Commun..

[11]  C. G. Khatri,et al.  14 Quadratic forms in normal variables , 1980 .

[12]  J. Craig.  A new, simple and exact result for calculating the probability of error for two-dimensional signal constellations , 1991, MILCOM 91 - Conference record.

[13]  S. Orszag,et al.  Advanced Mathematical Methods For Scientists And Engineers , 1979 .

[14]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[15]  Shahram Shahbazpanahi,et al.  Optimal Distributed Beamforming for Two-Way Relay Networks , 2010, IEEE Transactions on Signal Processing.

[16]  A. M. Mathai.  Quadratic forms in random variables , 1992 .

[17]  J. Gurland,et al.  Distribution of Definite and of Indefinite Quadratic Forms , 1955 .

[18]  Moe Z. Win,et al.  On the capacity of spatially correlated MIMO Rayleigh-fading channels , 2003, IEEE Trans. Inf. Theory.

[19]  Y Y Wang.  A comparison of several variance component estimators. , 1967, Biometrika.

[20]  K. J. Ray Liu,et al.  Outage analysis and optimal power allocation for multinode relay networks , 2007, IEEE Signal Processing Letters.

[21]  H. Ruben,et al.  A New Result on the Distribution of Quadratic Forms , 1963 .

[22]  Babak Hassibi,et al.  On the capacity of MIMO broadcast channels with partial side information , 2005, IEEE Transactions on Information Theory.

[23]  Tareq Y. Al-Naffouri,et al.  Exact Performance Analysis of the $\epsilon$-NLMS Algorithm for Colored Circular Gaussian Inputs , 2010, IEEE Transactions on Signal Processing.

[24]  N. L. Johnson,et al.  SERIES REPRESENTATIONS OF DISTRIBUTIONS OF QUADRATIC FORMS IN NORMAL VARIABLES, I. CENTRAL CASE, , 1967 .

[25]  Babak Hassibi,et al.  Reduced feedback and random beamforming for OFDM MIMO broadcast channels , 2009, IEEE Transactions on Communications.

[26]  Albert Guillén i Fàbregas,et al.  Mismatched Decoding: Error Exponents, Second-Order Rates and Saddlepoint Approximations , 2013, IEEE Transactions on Information Theory.

[27]  Hongbin Li,et al.  Performance of differential modulation with wireless relays in Rayleigh fading channels , 2005, IEEE Communications Letters.

[28]  H. Ruben,et al.  Probability Content of Regions Under Spherical Normal Distributions, I , 1960 .

[29]  Mohamed-Slim Alouini,et al.  On the effect of correlated measurements on the performance of distributed estimation , 2013, 2013 IEEE International Conference on Communications (ICC).

[30]  Giuseppe Caire,et al.  Error probability analysis of bit-interleaved coded modulation , 2006, IEEE Transactions on Information Theory.

[31]  Nikos D. Sidiropoulos,et al.  Convex Optimization-Based Beamforming , 2010, IEEE Signal Processing Magazine.

[32]  G. Turin.  The characteristic function of Hermitian quadratic forms in complex normal variables , 1960 .

[33]  S. J. Press,et al.  LINEAR COMBINATIONS OF NON-CENTRAL CHI-SQUARE VARIATES' , 1966 .

[34]  Ulf Grenander,et al.  The Distribution of Quadratic Forms in Normal Variates: A Small Sample Theory with Applications to Spectral Analysis , 1959 .

[35]  L. L. Campbell,et al.  Trellis coded MDPSK in correlated and shadowed Rician fading channels , 1991 .

[36]  S. Simon,et al.  Eigenvalue density of correlated complex random Wishart matrices. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  John Robinson,et al.  THE DISTRIBUTION OF A GENERAL QUADRATIC FORM IN NORMAL VARIATES1 , 1965 .

[38]  Mohamed-Slim Alouini,et al.  On the difference of two chi-square variates with application to outage probability computation , 2001, IEEE Trans. Commun..

[39]  J. Imhof.  Computing the distribution of quadratic forms in normal variables , 1961 .

[40]  Patrick Marsh,et al.  SADDLEPOINT APPROXIMATIONS FOR NONCENTRAL QUADRATIC FORMS , 1998, Econometric Theory.

[41]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[42]  S. Rice.  Distribution of Quadratic Forms in Normal Random Variables—Evaluation by Numerical Integration , 1980 .

[43]  Thomas L. Marzetta,et al.  Multiple-antennas and isotropically random unitary inputs: The received signal density in closed form , 2002, IEEE Trans. Inf. Theory.

[44]  H. Robbins,et al.  Application of the Method of Mixtures to Quadratic Forms in Normal Variates , 1949 .

[45]  Serge B. Provost,et al.  The distribution function of a statistic for testing the equality of scale parameters in two gamma populations , 1989 .

[46]  Fortunato Santucci,et al.  On the cumulative distribution function of quadratic-form receivers over generalized fading channels with tone interference , 2009, IEEE Transactions on Communications.

[47]  A. A. Beex,et al.  Convergence behavior of affine projection algorithms , 2000, IEEE Trans. Signal Process..

[48]  B. K. Shah.  Distribution of Definite and of Indefinite Quadratic Forms from a Non- Central Normal Distribution , 1963 .

[49]  Herbert Robbins,et al.  The Distribution of a Definite Quadratic Form , 1948 .

[50]  Marvin K. Simon,et al.  Single integral representations of certain integer powers of the Gaussian Q-function and their application , 2002, IEEE Communications Letters.

[51]  Aris L. Moustakas,et al.  Random matrix theory of multi-antenna communications: the Ricean channel , 2005 .

[52]  Georgios Tziritas,et al.  On the distribution of positive-definite Gaussian quadratic forms , 1987, IEEE Trans. Inf. Theory.

[53]  Leszek Szczecinski,et al.  Calculating LLRs via Saddlepoint Approximation in Front-End MIMO Receivers , 2013, IEEE Trans. Commun..

[54]  Mounir Ghogho,et al.  Outage Probability Based Power Distribution Between Data and Artificial Noise for Physical Layer Security , 2012, IEEE Signal Processing Letters.

[55]  Mohamed-Slim Alouini,et al.  Digital Communication Over Fading Channels: A Unified Approach to Performance Analysis , 2000 .

[56]  Bhaskar D. Rao,et al.  Performance analysis and comparison of MRC and optimal combining in antenna array systems , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[57]  Gregory W. Wornell,et al.  An efficient protocol for realizing cooperative diversity in wireless networks , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[58]  Aris L. Moustakas,et al.  MIMO capacity through correlated channels in the presence of correlated interferers and noise: a (not so) large N analysis , 2003, IEEE Trans. Inf. Theory.

[59]  Shahram Shahbazpanahi,et al.  Two-way cooperative communications with statistical channel knowledge , 2013, Signal Process..

[60]  M. Schwartz,et al.  Communication Systems and Techniques , 1996, IEEE Communications Magazine.

[61]  T. Hayakawa,et al.  On the distribution of a quadratic form in a multivariate normal sample , 1966 .

[62]  M.-K. Liu,et al.  Saddle point bit error rate computations for optical communication systems incorporating equalizers , 1995, IEEE Trans. Commun..

[63]  Khaled H. Biyari,et al.  Statistical distributions of Hermitian quadratic forms in complex Gaussian variables , 1993, IEEE Trans. Inf. Theory.

[64]  Ronald W. Butler,et al.  Uniform saddlepoint approximations for ratios of quadratic forms , 2008, 0803.2132.

[65]  H. Li,et al.  Distribution of quadratic form in Gaussian mixture variables and an application in relay networks , 2005, IEEE 6th Workshop on Signal Processing Advances in Wireless Communications, 2005..