Ergodic Stochastic Optimization Algorithms for Wireless Communication and Networking

Ergodic stochastic optimization (ESO) algorithms are proposed to solve resource allocation problems that involve a random state and where optimality criteria are expressed in terms of long term averages. A policy that observes the state and decides on a resource allocation is proposed and shown to almost surely satisfy problem constraints and optimality criteria. Salient features of ESO algorithms are that they do not require access to the state's probability distribution, that they can handle nonconvex constraints in the resource allocation variables, and that convergence to optimal operating points holds almost surely. The proposed algorithm is applied to determine operating points of an orthogonal frequency division multiplexing broadcast channel that maximize a given rate utility.

[1]  A. Robert Calderbank,et al.  Layering As Optimization Decomposition , 2006 .

[2]  Sanjay Shakkottai,et al.  Hop-by-Hop Congestion Control Over a Wireless Multi-Hop Network , 2004, IEEE/ACM Transactions on Networking.

[3]  Koushik Kar,et al.  Cross-layer rate optimization for proportional fairness in multihop wireless networks with random access , 2006, IEEE Journal on Selected Areas in Communications.

[4]  Xin Wang,et al.  Resource Allocation for Wireless Multiuser OFDM Networks , 2011, IEEE Transactions on Information Theory.

[5]  Ness B. Shroff,et al.  Opportunistic power scheduling for dynamic multi-server wireless systems , 2006, IEEE Transactions on Wireless Communications.

[6]  Leandros Tassiulas,et al.  On multicast beamforming for minimum outage , 2009, IEEE Transactions on Wireless Communications.

[7]  Eytan Modiano,et al.  Dynamic power allocation and routing for time varying wireless networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[8]  Nikos D. Sidiropoulos,et al.  Transmit beamforming for physical-layer multicasting , 2006, IEEE Transactions on Signal Processing.

[9]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[10]  Alexander Shapiro,et al.  Stochastic Approximation approach to Stochastic Programming , 2013 .

[11]  Alejandro Ribeiro,et al.  Separation Principles in Wireless Networking , 2010, IEEE Transactions on Information Theory.

[12]  Leandros Tassiulas,et al.  Resource Allocation and Cross-Layer Control in Wireless Networks , 2006, Found. Trends Netw..

[13]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[14]  Xuan Kong,et al.  Adaptive Signal Processing Algorithms: Stability and Performance , 1994 .

[15]  Alejandro Ribeiro,et al.  Adaptive distributed algorithms for optimal random access channels , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  R. Srikant,et al.  Joint congestion control, routing, and MAC for stability and fairness in wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[17]  Shuguang Cui,et al.  Optimal Linear Cooperation for Spectrum Sensing in Cognitive Radio Networks , 2008, IEEE Journal of Selected Topics in Signal Processing.

[18]  R. Srikant,et al.  A tutorial on cross-layer optimization in wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[19]  Alejandro Ribeiro.  Ergodic Stochastic Optimization Algorithms for Wireless Communication and Networking , 2010, IEEE Trans. Signal Process..

[20]  Boris Polyak,et al.  Acceleration of stochastic approximation by averaging , 1992 .

[21]  Michael Patriksson,et al.  Ergodic, primal convergence in dual subgradient schemes for convex programming , 1999, Mathematical programming.

[22]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[23]  Leandros Tassiulas,et al.  Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , 1992 .

[24]  Mung Chiang,et al.  Cross-Layer Congestion Control, Routing and Scheduling Design in Ad Hoc Wireless Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[25]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[26]  Georgios B. Giannakis,et al.  Distributed Scheduling and Resource Allocation for Cognitive OFDMA Radios , 2007, 2007 2nd International Conference on Cognitive Radio Oriented Wireless Networks and Communications.