On the Distribution of Indefinite Quadratic Forms in Gaussian Random Variables

In this work, we propose a unified approach to evaluating the CDF and PDF of indefinite quadratic forms in Gaussian random variables. Such a quantity appears in many applications in communications, signal processing, information theory, and adaptive filtering. For example, this quantity appears in the mean-square-error (MSE) analysis of the normalized least-mean-square (NLMS) adaptive algorithm, and SINR associated with each beam in beam forming applications. The trick of the proposed approach is to replace inequalities that appear in the CDF calculation with unit step functions and to use complex integral representation of the the unit step function. Complex integration allows us then to evaluate the CDF in closed form for the zero mean case and as a single dimensional integral for the non-zero mean case. Utilizing the saddle point technique allows us to closely approximate such integrals in non zero mean case. We demonstrate how our approach can be extended to other scenarios such as the joint distribution of quadratic forms and ratios of such forms, and to characterize quadratic forms in isotropic distributed random variables. We also evaluate the outage probability in multiuser beamforming using our approach to provide an application of indefinite forms in communications.

[1]  Mohamed-Slim Alouini,et al.  Sum and difference of two squared correlated Nakagami variates in connection with the McKay distribution , 2004, IEEE Transactions on Communications.

[2]  H. Ruben,et al.  A New Result on the Distribution of Quadratic Forms , 1963 .

[3]  Timothy N. Davidson,et al.  Coordinate update algorithms for robust power loading for the MISO downlinkwith outage constraints and Gaussian uncertainties , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Tareq Y. Al-Naffouri,et al.  How Much Does Transmit Correlation Affect the Sum-Rate of MIMO Downlink Channels? , 2006, 2006 IEEE International Symposium on Information Theory.

[5]  A. M. Mathai Quadratic forms in random variables , 1992 .

[6]  John Robinson,et al.  THE DISTRIBUTION OF A GENERAL QUADRATIC FORM IN NORMAL VARIATES1 , 1965 .

[7]  J. Gurland,et al.  Distribution of Definite and of Indefinite Quadratic Forms , 1955 .

[8]  J. Craig A new, simple and exact result for calculating the probability of error for two-dimensional signal constellations , 1991, MILCOM 91 - Conference record.

[9]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[10]  Aris L. Moustakas,et al.  Random matrix theory of multi-antenna communications: the Ricean channel , 2005 .

[11]  Georgios Tziritas,et al.  On the distribution of positive-definite Gaussian quadratic forms , 1987, IEEE Trans. Inf. Theory.

[12]  Serge B. Provost,et al.  The distribution function of a statistic for testing the equality of scale parameters in two gamma populations , 1989 .

[13]  Fortunato Santucci,et al.  On the cumulative distribution function of quadratic-form receivers over generalized fading channels with tone interference , 2009, IEEE Transactions on Communications.

[14]  Babak Hassibi,et al.  Reduced feedback and random beamforming for OFDM MIMO broadcast channels , 2009, IEEE Transactions on Communications.

[15]  Albert Guillén i Fàbregas,et al.  Mismatched Decoding: Error Exponents, Second-Order Rates and Saddlepoint Approximations , 2013, IEEE Transactions on Information Theory.

[16]  A. A. Beex,et al.  Convergence behavior of affine projection algorithms , 2000, IEEE Trans. Signal Process..

[17]  B. K. Shah Distribution of Definite and of Indefinite Quadratic Forms from a Non- Central Normal Distribution , 1963 .

[18]  Herbert Robbins,et al.  The Distribution of a Definite Quadratic Form , 1948 .

[19]  Jungwoo Lee,et al.  SINR and Throughput Analysis for Random Beamforming Systems with Adaptive Modulation , 2013, IEEE Transactions on Wireless Communications.

[20]  L. L. Campbell,et al.  Tail probability of a noncentral indefinite gaussian quadratic form , 1994 .

[21]  Dan Raphaeli,et al.  Noncoherent coded modulation , 1996, IEEE Trans. Commun..

[22]  Y Y Wang A comparison of several variance component estimators. , 1967, Biometrika.

[23]  André I. Khuri,et al.  Quadratic Forms in Normal Variables , 2009 .

[24]  T Y Al Naffouri,et al.  TRANSIENT ANALYSIS OF DATANORMALIZED ADAPTIVE FILTERS , 2003 .

[25]  Tareq Y. Al-Naffouri,et al.  Exact Performance Analysis of the $\epsilon$-NLMS Algorithm for Colored Circular Gaussian Inputs , 2010, IEEE Transactions on Signal Processing.

[26]  N. L. Johnson,et al.  SERIES REPRESENTATIONS OF DISTRIBUTIONS OF QUADRATIC FORMS IN NORMAL VARIABLES, I. CENTRAL CASE, , 1967 .

[27]  Hongbin Li,et al.  Performance of differential modulation with wireless relays in Rayleigh fading channels , 2005, IEEE Communications Letters.

[28]  H. Li,et al.  Distribution of quadratic form in Gaussian mixture variables and an application in relay networks , 2005, IEEE 6th Workshop on Signal Processing Advances in Wireless Communications, 2005..

[29]  Tareq Y. Al-Naffouri,et al.  Transient analysis of data-normalized adaptive filters , 2003, IEEE Trans. Signal Process..

[30]  Shahram Shahbazpanahi,et al.  Two-way cooperative communications with statistical channel knowledge , 2013, Signal Process..

[31]  Dan Raphaeli Correction for "Distribution of Noncentral Indefinite Quadratic Forms in Complex Normal Variables" , 2006, IEEE Trans. Inf. Theory.

[32]  Patrick Marsh,et al.  SADDLEPOINT APPROXIMATIONS FOR NONCENTRAL QUADRATIC FORMS , 1998, Econometric Theory.

[33]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[34]  Hung T. Nguyen,et al.  Quadratic Forms in Normal Random Variables , 1989 .

[35]  Thomas L. Marzetta,et al.  Multiple-antennas and isotropically random unitary inputs: The received signal density in closed form , 2002, IEEE Trans. Inf. Theory.

[36]  S. Rice Distribution of Quadratic Forms in Normal Random Variables—Evaluation by Numerical Integration , 1980 .

[37]  Marvin K. Simon,et al.  Single integral representations of certain integer powers of the Gaussian Q-function and their application , 2002, IEEE Communications Letters.

[38]  G. Turin The characteristic function of Hermitian quadratic forms in complex normal variables , 1960 .

[39]  S. J. Press,et al.  LINEAR COMBINATIONS OF NON-CENTRAL CHI-SQUARE VARIATES' , 1966 .

[40]  Gregory W. Wornell,et al.  An efficient protocol for realizing cooperative diversity in wireless networks , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[41]  Kerstin Vogler,et al.  Table Of Integrals Series And Products , 2016 .

[42]  Aris L. Moustakas,et al.  MIMO capacity through correlated channels in the presence of correlated interferers and noise: a (not so) large N analysis , 2003, IEEE Trans. Inf. Theory.

[43]  H. Robbins,et al.  Application of the Method of Mixtures to Quadratic Forms in Normal Variates , 1949 .

[44]  Tareq Y. Al-Naffouri,et al.  How much does transmit correlation affect the sum-rate scaling of MIMO gaussian broadcast channels? , 2009, IEEE Transactions on Communications.

[45]  K. Malakian,et al.  Distribution of general noncentral positive definite quadratic form in K-dimensions , 1989 .

[46]  Mohamed-Slim Alouini,et al.  On the difference of two chi-square variates with application to outage probability computation , 2001, IEEE Trans. Commun..

[47]  J. Imhof Computing the distribution of quadratic forms in normal variables , 1961 .

[48]  M. Schwartz,et al.  Communication Systems and Techniques , 1996, IEEE Communications Magazine.

[49]  T. Hayakawa,et al.  On the distribution of a quadratic form in a multivariate normal sample , 1966 .

[50]  M.-K. Liu,et al.  Saddle point bit error rate computations for optical communication systems incorporating equalizers , 1995, IEEE Trans. Commun..

[51]  Khaled H. Biyari,et al.  Statistical distributions of Hermitian quadratic forms in complex Gaussian variables , 1993, IEEE Trans. Inf. Theory.

[52]  Ronald W. Butler,et al.  Uniform saddlepoint approximations for ratios of quadratic forms , 2008, 0803.2132.

[53]  Babak Hassibi,et al.  On the capacity of MIMO broadcast channel with partial side information , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[54]  Leszek Szczecinski,et al.  Calculating LLRs via saddlepoint approximation in front-end MIMO receivers , 2013, 2013 IEEE International Conference on Communications (ICC).

[55]  Mohamed-Slim Alouini,et al.  On the effect of correlated measurements on the performance of distributed estimation , 2013, 2013 IEEE International Conference on Communications (ICC).

[56]  Giuseppe Caire,et al.  Error probability analysis of bit-interleaved coded modulation , 2006, IEEE Transactions on Information Theory.

[57]  N. Bershad Behavior of the ε-normalized LMS algorithm with Gaussian inputs , 1987, IEEE Trans. Acoust. Speech Signal Process..

[58]  Herbert Solomon,et al.  Distribution of Quadratic Forms and Some Applications , 1955 .

[59]  Gonçalo N. Tavares,et al.  On the Statistics of the Sum of Squared Complex Gaussian Random Variables , 2007, IEEE Transactions on Communications.

[60]  Dariush Divsalar,et al.  The performance of trellis-coded MDPSK with multiple symbol detection , 1990, IEEE Trans. Commun..

[61]  Shahram Shahbazpanahi,et al.  Optimal Distributed Beamforming for Two-Way Relay Networks , 2010, IEEE Transactions on Signal Processing.

[62]  K. J. Ray Liu,et al.  Outage analysis and optimal power allocation for multinode relay networks , 2007, IEEE Signal Processing Letters.

[63]  Ulf Grenander,et al.  The Distribution of Quadratic Forms in Normal Variates: A Small Sample Theory with Applications to Spectral Analysis , 1959 .

[64]  L. L. Campbell,et al.  Trellis coded MDPSK in correlated and shadowed Rician fading channels , 1991 .

[65]  P. Zweifel Advanced Mathematical Methods for Scientists and Engineers , 1980 .

[66]  H. Ruben,et al.  Probability Content of Regions Under Spherical Normal Distributions, I , 1960 .

[67]  Mounir Ghogho,et al.  Outage Probability Based Power Distribution Between Data and Artificial Noise for Physical Layer Security , 2012, IEEE Signal Processing Letters.

[68]  Mohamed-Slim Alouini,et al.  Digital Communication Over Fading Channels: A Unified Approach to Performance Analysis , 2000 .

[69]  Bhaskar D. Rao,et al.  Performance analysis and comparison of MRC and optimal combining in antenna array systems , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[70]  Mats Bengtsson,et al.  Convex Optimization-based Beamforming : From Receive to Transmit and Network Designs , 2010 .

[71]  Moe Z. Win,et al.  On the capacity of spatially correlated MIMO Rayleigh-fading channels , 2003, IEEE Trans. Inf. Theory.