Optimal Solutions for Joint Beamforming and Antenna Selection: From Branch and Bound to Graph Neural Imitation Learning

This work revisits the joint beamforming (BF) and antenna selection (AS) problem, as well as its robust beamforming (RBF) version under imperfect channel state information (CSI). Such problems arise due to various reasons, e.g., the costly nature of the radio frequency (RF) chains and energy/resource-saving considerations. The joint (R)BF&AS problem is a mixed integer and nonlinear program, and thus finding optimal solutions is often costly. The vast majority of the prior works tackled these problems using techniques such as continuous approximations, greedy methods, and supervised machine learning—yet these approaches do not ensure optimality or even feasibility of the solutions. The main contribution of this work is threefold. First, an effective branch and bound (B&B) framework is proposed for the considered problem that guarantees global optimality by leveraging existing BF and RBF solvers. Second, to expedite the potentially costly B&B algorithm, a machine learning (ML)-based scheme is proposed to help skip intermediate states of the B&B search tree. The learning model features a graph neural network (GNN)-based design that is resilient to a commonly encountered challenge in wireless communications, namely, the change of problem size (e.g., the number of users) across the training and test stages. Third, comprehensive performance characterizations are presented, showing that the GNN-based method retains the global optimality of B&B with provably reduced complexity, under reasonable conditions. Numerical simulations also show that the ML-based acceleration can often achieve an order-of-magnitude speedup relative to B&B.

[1]  Symeon Chatzinotas,et al.  Analog Beamforming With Antenna Selection For Large-Scale Antenna Arrays , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Symeon Chatzinotas,et al.  Machine Learning-Enabled Joint Antenna Selection and Precoding Design: From Offline Complexity to Online Performance , 2021, IEEE Transactions on Wireless Communications.

[3]  Feifei Gao,et al.  Deep Learning based Antenna Selection and CSI Extrapolation in Massive MIMO Systems , 2021, 2021 IEEE/CIC International Conference on Communications in China (ICCC).

[4]  Christian Tjandraatmadja,et al.  Solving Mixed Integer Programs Using Neural Networks , 2020, ArXiv.

[5]  Taufik Abrão,et al.  Antenna Selection for Improving Energy Efficiency in XL-MIMO Systems , 2020, IEEE Transactions on Vehicular Technology.

[6]  Yimin D. Zhang,et al.  Antenna selection strategy for transmit beamforming-based joint radar-communication system , 2020, Digit. Signal Process..

[7]  Aritra Konar,et al.  Fast Algorithms for Joint Multicast Beamforming and Antenna Selection in Massive MIMO , 2020, IEEE Transactions on Signal Processing.

[8]  Lisandro Lovisolo,et al.  Antenna Selection in Massive MIMO Based on Greedy Algorithms , 2020, IEEE Transactions on Wireless Communications.

[9]  Stefanie Jegelka,et al.  Generalization and Representational Limits of Graph Neural Networks , 2020, ICML.

[10]  Ahmet M. Elbir,et al.  Joint Antenna Selection and Hybrid Beamformer Design Using Unquantized and Quantized Deep Learning Networks , 2019, IEEE Transactions on Wireless Communications.

[11]  Geoffrey Y. Li,et al.  Learning to Branch: Accelerating Resource Allocation in Wireless Networks , 2019, IEEE Transactions on Vehicular Technology.

[12]  Ya-Feng Liu,et al.  An Enhanced SDR Based Global Algorithm for Nonconvex Complex Quadratic Programs With Signal Processing Applications , 2019, IEEE Open Journal of Signal Processing.

[13]  Yuanming Shi,et al.  LORM: Learning to Optimize for Resource Management in Wireless Networks With Few Training Samples , 2018, IEEE Transactions on Wireless Communications.

[14]  Tuo Zhao,et al.  On Generalization Bounds of a Family of Recurrent Neural Networks , 2018, AISTATS.

[15]  Shengli Fu,et al.  Intelligent Massive MIMO Antenna Selection Using Monte Carlo Tree Search , 2019, IEEE Transactions on Signal Processing.

[16]  Andrea Lodi,et al.  Exact Combinatorial Optimization with Graph Convolutional Neural Networks , 2019, NeurIPS.

[17]  Hongwen Yang,et al.  Optimal Transmit Antenna Selection Algorithm in Massive MIMOME Channels , 2018, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[18]  Alon Gonen,et al.  Learning in Non-convex Games with an Optimization Oracle , 2018, COLT.

[19]  Marcel Nassar,et al.  Hierarchical Bipartite Graph Convolution Networks , 2018, ArXiv.

[20]  Bjorn Ottersten,et al.  Optimum and Suboptimum Transmit Beamforming , 2018, Handbook of Antennas in Wireless Communications.

[21]  Aritra Konar,et al.  A Simple and Effective Approach for Transmit Antenna Selection in Multiuser Massive MIMO Leveraging Submodularity , 2018, IEEE Transactions on Signal Processing.

[22]  Nikos D. Sidiropoulos,et al.  Learning-Based Antenna Selection for Multicasting , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[23]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[24]  Thomas Kaiser,et al.  Massive MIMO Antenna Selection: Switching Architectures, Capacity Bounds, and Optimal Antenna Selection Algorithms , 2018, IEEE Transactions on Signal Processing.

[25]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[26]  Matus Telgarsky,et al.  Spectrally-normalized margin bounds for neural networks , 2017, NIPS.

[27]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[28]  Ya-Feng Liu,et al.  An Efficient Global Algorithm for Single-Group Multicast Beamforming , 2017, IEEE Transactions on Signal Processing.

[29]  Anthony Man-Cho So,et al.  Unraveling the Rank-One Solution Mystery of Robust MISO Downlink Transmit Optimization: A Verifiable Sufficient Condition via a New Duality Result , 2016, IEEE Transactions on Signal Processing.

[30]  Mohammad-Hossein Golbon-Haghighi Beamforming in Wireless Networks , 2016 .

[31]  Jingon Joung,et al.  Machine Learning-Based Antenna Selection in Wireless Communications , 2016, IEEE Communications Letters.

[32]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[33]  Wei Jiang,et al.  Bidirectional branch and bound based antenna selection in massive MIMO systems , 2015, 2015 IEEE 26th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[34]  D. Bertsimas,et al.  Best Subset Selection via a Modern Optimization Lens , 2015, 1507.03133.

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  Nikos D. Sidiropoulos,et al.  Feasible Point Pursuit and Successive Approximation of Non-Convex QCQPs , 2014, IEEE Signal Processing Letters.

[37]  He He,et al.  Learning to Search in Branch and Bound Algorithms , 2014, NIPS.

[38]  Yan Shi,et al.  Globally optimal antenna selection and power allocation for energy efficiency maximization in downlink distributed antenna systems , 2014, 2014 IEEE Global Communications Conference.

[39]  Yuanming Shi,et al.  Group Sparse Beamforming for Green Cloud-RAN , 2013, IEEE Transactions on Wireless Communications.

[40]  Vincent K. N. Lau,et al.  Joint Power and Antenna Selection Optimization in Large Cloud Radio Access Networks , 2013, IEEE Transactions on Signal Processing.

[41]  Chong-Yung Chi,et al.  Outage Constrained Robust Transmit Optimization for Multiuser MISO Downlinks: Tractable Approximations by Conic Optimization , 2011, IEEE Transactions on Signal Processing.

[42]  Nikos D. Sidiropoulos,et al.  Joint Multicast Beamforming and Antenna Selection , 2013, IEEE Transactions on Signal Processing.

[43]  Leonard J. Cimini,et al.  Antenna Selection for Energy-Efficient MIMO Transmission , 2012, IEEE Wireless Communications Letters.

[44]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[45]  Chong-Yung Chi,et al.  Worst-case robust multiuser transmit beamforming using semidefinite relaxation: duality and implications , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[46]  Z. Luo,et al.  Robust SINR-constrained MISO downlink beamforming: when is semidefinite programming relaxation tight? , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Geoffrey J. Gordon,et al.  A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning , 2010, AISTATS.

[48]  Zhi-Quan Luo,et al.  Semidefinite Relaxation of Quadratic Optimization Problems , 2010, IEEE Signal Processing Magazine.

[49]  Nikos D. Sidiropoulos,et al.  Convex Optimization-Based Beamforming , 2010, IEEE Signal Processing Magazine.

[50]  Shi Liu,et al.  MMSE Based Greedy Antenna Selection Scheme for AF MIMO Relay Systems , 2010, IEEE Signal Processing Letters.

[51]  Ailsa H. Land,et al.  An Automatic Method of Solving Discrete Programming Problems , 1960 .

[52]  Malik Magdon-Ismail,et al.  On selecting a maximum volume sub-matrix of a matrix and related problems , 2009, Theor. Comput. Sci..

[53]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[54]  Stephen P. Boyd,et al.  Robust Beamforming via Worst-Case SINR Maximization , 2008, IEEE Transactions on Signal Processing.

[55]  Tung-Sang Ng,et al.  Robust Linear MIMO in the Downlink: A Worst-Case Optimization with Ellipsoidal Uncertainty Regions , 2008, EURASIP J. Adv. Signal Process..

[56]  Jeffrey G. Andrews,et al.  Efficient Transmit Antenna Selection for Multiuser MIMO Systems with Block Diagonalization , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[57]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[58]  Ali H. Sayed,et al.  Active Antenna Selection in Multiuser MIMO Communications , 2007, IEEE Transactions on Signal Processing.

[59]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[60]  Lin Dai,et al.  Optimal antenna selection based on capacity maximization for MIMO systems in correlated channels , 2006, IEEE Transactions on Communications.

[61]  Z. Luo,et al.  Transmit beamforming to multiple co-channel multicast groups , 2005, 1st IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005..

[62]  Moe Z. Win,et al.  Capacity of MIMO systems with antenna selection , 2001, IEEE Transactions on Wireless Communications.

[63]  Aria Nosratinia,et al.  Antenna selection in MIMO systems , 2004, IEEE Communications Magazine.

[64]  A.F. Molisch,et al.  MIMO systems with antenna selection , 2004, IEEE Microwave Magazine.

[65]  J. Clausen,et al.  Branch and Bound Algorithms-Principles and Examples , 2003 .

[66]  Stephen P. Boyd,et al.  Branch and Bound Methods , 1987 .

[67]  E. Visotsky,et al.  Optimum beamforming using transmit antenna arrays , 1999, 1999 IEEE 49th Vehicular Technology Conference (Cat. No.99CH36363).

[68]  Leandros Tassiulas,et al.  Transmit beamforming and power control for cellular wireless systems , 1998, IEEE J. Sel. Areas Commun..

[69]  D. Pollard Empirical Processes: Theory and Applications , 1990 .