Penalty Dual Decomposition Method for Nonsmooth Nonconvex Optimization—Part II: Applications

In Part I of this paper, we proposed and analyzed a novel algorithmic framework, termed penalty dual decomposition (PDD), for the minimization of a nonconvex nonsmooth objective function, subject to difficult coupling constraints. Part II of this paper is devoted to evaluation of the proposed methods in the following three timely applications, ranging from communication networks to data analytics: i) the max-min rate fair multicast beamforming problem; ii) the sum-rate maximization problem in multi-antenna relay broadcast networks; and iii) the volume-min based structured matrix factorization problem. By exploiting the structure of the aforementioned problems, we show that effective algorithms for all these problems can be devised under the PDD framework. Unlike the state-of-the-art algorithms, the PDD-based algorithms are proven to achieve convergence to stationary solutions of the aforementioned nonconvex problems. Numerical results validate the efficacy of the proposed schemes.

[1]  Mingyi Hong,et al.  Penalty Dual Decomposition Method For Nonsmooth Nonconvex Optimization , 2017, ArXiv.

[2]  Nikos D. Sidiropoulos,et al.  Power Spectra Separation via Structured Matrix Factorization , 2016, IEEE Transactions on Signal Processing.

[3]  Bo Yang,et al.  Robust Volume Minimization-Based Matrix Factorization for Remote Sensing and Document Clustering , 2016, IEEE Transactions on Signal Processing.

[4]  Wei Yu,et al.  Cross-Layer Design for Downlink Multihop Cloud Radio Access Networks With Network Coding , 2016, IEEE Transactions on Signal Processing.

[5]  Yunlong Cai,et al.  Energy Efficiency Optimization for MISO SWIPT Systems With Zero-Forcing Beamforming , 2016, IEEE Transactions on Signal Processing.

[6]  M. Rangaswamy,et al.  Joint Filter and Waveform Design for Radar STAP in Signal Dependent Interference , 2015, ArXiv.

[7]  Mehdi Korki,et al.  Dictionary Learning for Blind One Bit Compressed Sensing , 2015, IEEE Signal Processing Letters.

[8]  Sven Nordholm,et al.  MMSE-Based Transceiver Design Algorithms for Interference MIMO Relay Systems , 2015, IEEE Transactions on Wireless Communications.

[9]  Nikos D. Sidiropoulos,et al.  Blind Separation of Quasi-Stationary Sources: Exploiting Convex Geometry in Covariance Domain , 2015, IEEE Transactions on Signal Processing.

[10]  Anna Scaglione,et al.  A consensus-based decentralized algorithm for non-convex optimization with application to dictionary learning , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Xiaodong Wang,et al.  Energy Management and Cross Layer Optimization for Wireless Sensor Network Powered by Heterogeneous Energy Sources , 2014, IEEE Transactions on Wireless Communications.

[12]  Zhiqiang He,et al.  Multiuser Multihop MIMO Relay System Design Based on Mutual Information Maximization , 2014, IEEE Transactions on Signal Processing.

[13]  Lihua Xie,et al.  Enhancing Sparsity and Resolution via Reweighted Atomic Norm Minimization , 2014, IEEE Transactions on Signal Processing.

[14]  Yaming Wang,et al.  Distributed Optimal Rate–Reliability–Lifetime Tradeoff in Time-Varying Wireless Sensor Networks , 2014, IEEE Transactions on Wireless Communications.

[15]  Wei-Chiang Li,et al.  Identifiability of the Simplex Volume Minimization Criterion for Blind Hyperspectral Unmixing: The No-Pure-Pixel Case , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Augusto Aubry,et al.  A Doppler Robust Design of Transmit Sequence and Receive Filter in the Presence of Signal-Dependent Interference , 2014, IEEE Transactions on Signal Processing.

[17]  Xu Li,et al.  Min Flow Rate Maximization for Software Defined Radio Access Networks , 2013, IEEE Journal on Selected Areas in Communications.

[18]  Miguel Á. Carreira-Perpiñán,et al.  Projection onto the probability simplex: An efficient algorithm with a simple proof, and an application , 2013, ArXiv.

[19]  Nikos D. Sidiropoulos,et al.  Joint Multicast Beamforming and Antenna Selection , 2013, IEEE Transactions on Signal Processing.

[20]  Zhi-Quan Luo,et al.  Max-Min Fairness Linear Transceiver Design for a Multi-User MIMO Interference Channel , 2013, 2011 IEEE International Conference on Communications (ICC).

[21]  Anthony Man-Cho So,et al.  Beyond convex relaxation: A polynomial-time non-convex optimization approach to network localization , 2013, 2013 Proceedings IEEE INFOCOM.

[22]  Haibin Wan,et al.  Joint Source and Relay Design for MIMO Relaying Broadcast Channels , 2013, IEEE Communications Letters.

[23]  F. Gabin,et al.  Evolved multimedia broadcast/multicast service (eMBMS) in LTE-advanced: overview and Rel-11 enhancements , 2012, IEEE Communications Magazine.

[24]  Zhi-Quan Luo,et al.  SINR Constrained Beamforming for a MIMO Multi-User Downlink System: Algorithms and Convergence Analysis , 2012, IEEE Transactions on Signal Processing.

[25]  Muhammad R. A. Khandaker,et al.  Joint Transceiver Optimization for Multiuser MIMO Relay Communication Systems , 2012, IEEE Transactions on Signal Processing.

[26]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[27]  Xu Wang,et al.  On the Design of Constant Modulus Probing Signals for MIMO Radar , 2012, IEEE Transactions on Signal Processing.

[28]  Branka Vucetic,et al.  Transceiver Design for Multi-User Multi-Antenna Two-Way Relay Cellular Systems , 2012, IEEE Transactions on Communications.

[29]  Shi Jin,et al.  Maximin SNR Beamforming Strategies for Two-Way Relay Channels , 2012, IEEE Communications Letters.

[30]  Zhi-Quan Luo,et al.  Joint Base Station Clustering and Beamformer Design for Partial Coordinated Transmission in Heterogeneous Networks , 2012, IEEE Journal on Selected Areas in Communications.

[31]  R. Heath,et al.  Cooperative Algorithms for MIMO Amplify-and-Forward Relay Networks , 2011, IEEE Transactions on Signal Processing.

[32]  H. Vincent Poor,et al.  A General Robust Linear Transceiver Design for Multi-Hop Amplify-and-Forward MIMO Relaying Systems , 2011, IEEE Transactions on Signal Processing.

[33]  Z. Luo,et al.  An Iteratively Weighted MMSE Approach to Distributed Sum-Utility Maximization for a MIMO Interfering Broadcast Channel , 2011, IEEE Transactions on Signal Processing.

[34]  Antonio De Maio,et al.  A Doppler Robust Max-Min Approach to Radar Code Design , 2010, IEEE Transactions on Signal Processing.

[35]  Hongyang Chen,et al.  Distributed Wireless Sensor Network Localization Via Sequential Greedy Optimization Algorithm , 2010, IEEE Transactions on Signal Processing.

[36]  Christian Jutten,et al.  An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise , 2009, IEEE Transactions on Signal Processing.

[37]  Yang Yang,et al.  Relay technologies for WiMax and LTE-advanced mobile systems , 2009, IEEE Communications Magazine.

[38]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[39]  Ying-Chang Liang,et al.  Joint Beamforming and Power Control for Multiantenna Relay Broadcast Channel With QoS Constraints , 2009, IEEE Transactions on Signal Processing.

[40]  Chen He,et al.  A SDP Approach for Range-Free Localization in Wireless Sensor Networks , 2008, 2008 IEEE International Conference on Communications.

[41]  Z. Luo,et al.  Quality of Service and Max-Min Fair Transmit Beamforming to Multiple Cochannel Multicast Groups , 2008, IEEE Transactions on Signal Processing.

[42]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[43]  Stephen P. Boyd,et al.  Robust Fisher Discriminant Analysis , 2005, NIPS.

[44]  Christian Jutten,et al.  A general approach for mutual information minimization and its application to blind source separation , 2005, Signal Process..

[45]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[46]  G. Golub,et al.  A Hessenberg-Schur method for the problem AX + XB= C , 1979 .

[47]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[48]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .