MIMO channel modeling and the principle of maximum entropy

We devise theoretical grounds for constructing channel models for multiple-input multiple-output (MIMO) systems based on information-theoretic tools. The paper provides a general method to derive a channel model which is consistent with one's state of knowledge. The framework we give here has already been fruitfully explored with success in the context of Bayesian spectrum analysis and parameter estimation. For each channel model, we conduct an asymptotic analysis (in the number of antennas) of the achievable transmission rate using tools from random matrix theory. A central limit theorem is provided on the asymptotic behavior of the mutual information and validated in the finite case by simulations. The results are useful both in terms of designing a system based on criteria such as quality of service and in optimizing transmissions in multiuser networks.

[1]  F. Hiai,et al.  The semicircle law, free random variables, and entropy , 2006 .

[2]  F. Palmieri,et al.  The role of entropy in wave propagation , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[3]  Reinaldo A. Valenzuela,et al.  Keyholes, correlations, and capacities of multielement transmit and receive antennas , 2002, IEEE Trans. Wirel. Commun..

[4]  Reinaldo A. Valenzuela,et al.  V-BLAST: an architecture for realizing very high data rates over the rich-scattering wireless channel , 1998, 1998 URSI International Symposium on Signals, Systems, and Electronics. Conference Proceedings (Cat. No.98EX167).

[5]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[6]  Akbar M. Sayeed,et al.  Deconstructing multiantenna fading channels , 2002, IEEE Trans. Signal Process..

[7]  D. Hampicke,et al.  Array measurement of the double-directional mobile radio channel , 2000, VTC2000-Spring. 2000 IEEE 51st Vehicular Technology Conference Proceedings (Cat. No.00CH37026).

[8]  J. Cadzow.  Maximum Entropy Spectral Analysis , 2006 .

[9]  Yingbin Liang,et al.  Capacity of noncoherent time-selective Rayleigh-fading channels , 2004, IEEE Transactions on Information Theory.

[10]  Ralf R. Müller,et al.  On the asymptotic eigenvalue distribution of concatenated vector-valued fading channels , 2002, IEEE Trans. Inf. Theory.

[11]  M. Debbah.  An information theoretic point of view to MIMO channel modelling , 2004, SympoTIC '04. Joint 1st Workshop on Mobile Future & Symposium on Trends In Communications (IEEE Cat. No.04EX877).

[12]  Philippe Loubaton,et al.  Asymptotic analysis of reduced rank Wiener filters , 2003, Proceedings 2003 IEEE Information Theory Workshop (Cat. No.03EX674).

[13]  E. Burke,et al.  Probability model for peak fluxes of solar proton events , 1998 .

[14]  David Tse.  Multiuser Receivers, Random Matrices and Free Probability , 1999 .

[15]  Anna Scaglione,et al.  Statistical analysis of the capacity of MIMO frequency selective Rayleigh fading channels with arbitrary number of inputs and outputs , 2002, Proceedings IEEE International Symposium on Information Theory,.

[16]  J. W. Silverstein,et al.  Large dimensional random matrix theory for signal detection and estimation in array processing , 1992, [1992] IEEE Sixth SP Workshop on Statistical Signal and Array Processing.

[17]  Walid Hachem,et al.  Simple polynomial detectors for CDMA downlink transmissions on frequency-selective channels , 2004, IEEE Transactions on Information Theory.

[18]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[19]  K. Adkins.  Theory of spin glasses , 1974 .

[20]  Ralf R. Müller,et al.  Design and analysis of low-complexity interference mitigation on vector channels , 2001, IEEE J. Sel. Areas Commun..

[21]  Shlomo Shamai,et al.  Spectral Efficiency of CDMA with Random Spreading , 1999, IEEE Trans. Inf. Theory.

[22]  Jean-Claude Belfiore,et al.  Constellations matched to the Rayleigh fading channel , 1996, IEEE Trans. Inf. Theory.

[23]  Thomas L. Marzetta,et al.  Capacity of a Mobile Multiple-Antenna Communication Link in Rayleigh Flat Fading , 1999, IEEE Trans. Inf. Theory.

[24]  J. W. Silverstein,et al.  No eigenvalues outside the support of the limiting spectral distribution of large-dimensional sample covariance matrices , 1998 .

[25]  H. Jeffreys,et al.  Theory of probability , 1896 .

[26]  Chen-Nee Chuah,et al.  Capacity scaling in MIMO Wireless systems under correlated fading , 2002, IEEE Trans. Inf. Theory.

[27]  G. L. Bretthorst.  AN INTRODUCTION TO MODEL SELECTION USING PROBABILITY THEORY AS LOGIC , 1996 .

[28]  Suhas N. Diggavi,et al.  Great expectations: the value of spatial diversity in wireless networks , 2004, Proceedings of the IEEE.

[29]  Shlomo Shamai,et al.  Fading Channels: Information-Theoretic and Communication Aspects , 1998, IEEE Trans. Inf. Theory.

[30]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[31]  Antonia Maria Tulino,et al.  Capacity of antenna arrays with space, polarization and pattern diversity , 2003, Proceedings 2003 IEEE Information Theory Workshop (Cat. No.03EX674).

[32]  Antonia Maria Tulino,et al.  Random Matrix Theory and Wireless Communications , 2004, Found. Trends Commun. Inf. Theory.

[33]  Thomas L. Marzetta,et al.  Multiple-antenna channel hardening and its implications for rate feedback and scheduling , 2004, IEEE Transactions on Information Theory.

[34]  B. Hughes,et al.  Gaussian approximations for the capacity of MIMO Rayleigh fading channels , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[35]  Shlomo Shamai,et al.  The impact of frequency-flat fading on the spectral efficiency of CDMA , 2001, IEEE Trans. Inf. Theory.

[36]  M. J. Gans,et al.  On Limits of Wireless Communications in a Fading Environment when Using Multiple Antennas , 1998, Wirel. Pers. Commun..

[37]  V. Girko,et al.  Theory of stochastic canonical equations , 2001 .

[38]  Brian W. Kernighan,et al.  WISE design of indoor wireless systems: practical computation and optimization , 1995 .

[39]  Joseph M. Kahn,et al.  Fading correlation and its effect on the capacity of multi-element antenna systems , 1998, ICUPC '98. IEEE 1998 International Conference on Universal Personal Communications. Conference Proceedings (Cat. No.98TH8384).

[40]  Anirvan M. Sengupta,et al.  Capacity of multivariate channels with multiplicative noise: I.Random matrix techniques and large-N expansions for full transfer matrices , 2000, physics/0010081.

[41]  Preben E. Mogensen,et al.  A stochastic MIMO radio channel model with experimental validation , 2002, IEEE J. Sel. Areas Commun..

[42]  J.-M. Chaufray,et al.  Asymptotic analysis of optimum and sub-optimum CDMA downlink MMSE receivers , 2002, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[43]  Mansoor Shafi,et al.  On a Gaussian approximation to the capacity of wireless MIMO systems , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[44]  Vi︠a︡cheslav Leonidovich Girko,et al.  Theory of random determinants , 1990 .

[45]  Robert W. Brodersen,et al.  Impact of scattering on the capacity, diversity, and propagation range of multiple-antenna channels , 2006, IEEE Transactions on Information Theory.

[46]  Joseph M. Kahn,et al.  Fading correlation and its effect on the capacity of multielement antenna systems , 2000, IEEE Trans. Commun..

[47]  David Tse,et al.  Resource pooling and effective bandwidths in CDMA networks with multiuser receivers and spatial diversity , 2001, IEEE Trans. Inf. Theory.

[48]  D. Voiculescu.  Limit laws for Random matrices and free products , 1991 .

[49]  David Tse,et al.  Linear multiuser receivers in random environments , 2000, IEEE Trans. Inf. Theory.

[50]  J. N. Kapur.  Maximum-entropy models in science and engineering , 1992 .

[51]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[52]  Helmut Bölcskei,et al.  MIMO wireless channels: capacity and performance prediction , 2000, Globecom '00 - IEEE. Global Telecommunications Conference. Conference Record (Cat. No.00CH37137).

[53]  Antonia Maria Tulino,et al.  Performance of space-time codes for a large number of antennas , 2002, IEEE Trans. Inf. Theory.

[54]  Nelson Costa,et al.  Multiple-input-multiple-output measurements and modeling in Manhattan , 2003, IEEE J. Sel. Areas Commun..

[55]  Reinaldo A. Valenzuela,et al.  Detection algorithm and initial laboratory results using V-BLAST space-time communication architecture , 1999 .

[56]  Aris L. Moustakas,et al.  MIMO capacity through correlated channels in the presence of correlated interferers and noise: a (not so) large N analysis , 2003, IEEE Trans. Inf. Theory.

[57]  Philippe Loubaton,et al.  Linear precoders for OFDM wireless communications with MMSE equalization: Facts and results , 2002, 2002 11th European Signal Processing Conference.

[58]  Laura Cottatellucci,et al.  Asymptotic design and analysis of multistage detectors with unequal powers , 2002, Proceedings of the IEEE Information Theory Workshop.

[59]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[60]  Dirk T. M. Slock,et al.  On MIMO capacity for various types of partial channel knowledge at the transmitter , 2003, Proceedings 2003 IEEE Information Theory Workshop (Cat. No.03EX674).

[61]  Georgios B. Giannakis,et al.  Outage mutual information of space-time MIMO channels , 2004, IEEE Transactions on Information Theory.

[62]  Jamie S. Evans,et al.  Large system performance of linear multiuser receivers in multipath fading channels , 2000, IEEE Trans. Inf. Theory.

[63]  Ralf R. Müller,et al.  A random matrix model of communication via antenna arrays , 2002, IEEE Trans. Inf. Theory.

[64]  Paul D. Alexander,et al.  Random Sequence Multisets for Synchronous Code-Division Multiple-Access Channels , 1998, IEEE Trans. Inf. Theory.

[65]  Z. Bai,et al.  CLT for linear spectral statistics of large dimensional sample covariance matrices with dependent data , 2017, Statistical Papers.

[66]  A. Zellner.  An Introduction to Bayesian Inference in Econometrics , 1971 .

[67]  Lizhong Zheng,et al.  Diversity and multiplexing: a fundamental tradeoff in multiple-antenna channels , 2003, IEEE Trans. Inf. Theory.

[68]  Antonia Maria Tulino,et al.  Asymptotic analysis of improved linear receivers for BPSK-CDMA subject to fading , 2001, IEEE J. Sel. Areas Commun..

[69]  A. Tulino,et al.  How far away is infinity? Using asymptotic analyses in multiple-antenna systems , 2002, IEEE Seventh International Symposium on Spread Spectrum Techniques and Applications,.

[70]  Marvin H. J. Guber.  Bayesian Spectrum Analysis and Parameter Estimation , 1988 .

[71]  Andrea J. Goldsmith,et al.  Capacity limits of MIMO channels , 2003, IEEE J. Sel. Areas Commun..

[72]  David Tse,et al.  Linear Multiuser Receivers: Effective Interference, Effective Bandwidth and User Capacity , 1999, IEEE Trans. Inf. Theory.

[73]  O. Johnson.  Free Random Variables , 2004 .

[74]  Ali Mohammad-Djafari,et al.  3 - Utilisation de l'entropie dans les problèmes de restauration et de reconstruction d'images , 1988 .

[75]  Ke Liu,et al.  Capacity scaling and spectral efficiency in wide-band correlated MIMO channels , 2003, IEEE Trans. Inf. Theory.

[76]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[77]  Philippe Loubaton,et al.  MMSE analysis of certain large isometric random precoded systems , 2003, IEEE Trans. Inf. Theory.

[78]  P. Biane.  FREE PROBABILITY FOR PROBABILISTS , 1998, math/9809193.

[79]  Emanuele Viterbo,et al.  Signal Space Diversity: A Power- and Bandwidth-Efficient Diversity Technique for the Rayleigh Fading Channel , 1998, IEEE Trans. Inf. Theory.

[80]  Babak Hassibi,et al.  How much training is needed in multiple-antenna wireless links? , 2003, IEEE Trans. Inf. Theory.

[81]  Dan Popescu,et al.  Information capacity of a random signature multiple-input multiple-output channel , 2000, IEEE Trans. Commun..

[82]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[83]  Helmut Bölcskei,et al.  Outdoor MIMO wireless channels: models and performance prediction , 2002, IEEE Trans. Commun..

[84]  Philippe Loubaton,et al.  Asymptotic analysis of optimum and sub-optimum CDMA MMSE receivers , 2002, Proceedings IEEE International Symposium on Information Theory,.

[85]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[86]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.