Pilot beam sequence design for channel estimation in millimeter-wave MIMO systems: A POMDP framework

In this paper, adaptive pilot beam sequence design for channel estimation in large millimeter-wave (mmWave) MIMO systems is considered. By exploiting the sparsity of mmWave MIMO channels with the virtual channel representation and imposing a Markovian random walk assumption on the physical movement of the line-of-sight (LOS) and reflection clusters, it is shown that the sparse channel estimation problem in large mmWave MIMO systems reduces to a sequential detection problem that finds the locations and values of the non-zero-valued bins in a two-dimensional rectangular grid, and the optimal adaptive pilot design problem can be cast into the framework of a partially observable Markov decision process (POMDP). Under the POMDP framework, an optimal adaptive pilot beam sequence design method is obtained to maximize the accumulated transmission data rate for a given period of time. Numerical results are provided to validate our pilot signal design method and they show that the proposed method yields good performance.

[1]  G. Monahan State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[2]  Akbar M. Sayeed,et al.  Deconstructing multiantenna fading channels , 2002, IEEE Trans. Signal Process..

[3]  Reid G. Simmons,et al.  Point-Based POMDP Algorithms: Improved Analysis and Implementation , 2005, UAI.

[4]  Robert W. Heath,et al.  Low complexity precoding for large millimeter wave MIMO systems , 2012, 2012 IEEE International Conference on Communications (ICC).

[5]  Michael L. Littman,et al.  Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes , 1997, UAI.

[6]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[7]  A.M. Sayeed,et al.  Maximizing MIMO Capacity in Sparse Multipath With Reconfigurable Antenna Arrays , 2007, IEEE Journal of Selected Topics in Signal Processing.

[8]  Franz Hlawatsch,et al.  Compressed sensing based estimation of doubly selective channels using a sparsity-optimized basis expansion , 2008, 2008 16th European Signal Processing Conference.

[9]  Robert D. Nowak,et al.  Compressed Channel Sensing: A New Approach to Estimating Sparse Multipath Channels , 2010, Proceedings of the IEEE.

[10]  Robert W. Heath,et al.  Hybrid precoding for millimeter wave cellular systems with partial channel knowledge , 2013, 2013 Information Theory and Applications Workshop (ITA).

[11]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[12]  Taejoon Kim,et al.  Millimeter wave MIMO channel tracking systems , 2014, 2014 IEEE Globecom Workshops (GC Wkshps).

[13]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[14]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[15]  Ieee Staff,et al.  2015 IEEE 16th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) , 2015 .

[16]  Robert W. Heath,et al.  Channel Estimation and Hybrid Precoding for Millimeter Wave Cellular Systems , 2014, IEEE Journal of Selected Topics in Signal Processing.