Optimal Adaptive Modulation and Coding with Switching Costs

We present an optimal Adaptive Modulation and Coding (AMC) policy that minimizes the transmission latency and modulation/coding switching cost across a finite-state Markovian fading channel. We formulate the optimal tradeoff between the transmission latency and the modulation/coding switching cost as a stochastic shortest path Markov decision problem (MDP). By exploiting special structures of the formulated MDP and under certain sufficient conditions, we show that optimal modulation and coding selection policies are monotone in the state variables. These monotone optimal policies are computationally inexpensive to implement and are scalable in terms of channel and switching cost parameters. Numerical results confirm the monotonicity and threshold-based structure of the optimal MCS selection policies under the proposed sufficient conditions.

[1]  Andrea J. Goldsmith,et al.  Variable-rate variable-power MQAM for fading channels , 1997, IEEE Trans. Commun..

[2]  K. J. Ray Liu,et al.  Jointly optimized bit-rate/delay control policy for wireless packet networks with fading channels , 2002, IEEE Trans. Commun..

[3]  Vikram Krishnamurthy,et al.  Optimality of Monotone Policies for Transmission Control with Switching Costs , 2007, 2007 46th IEEE Conference on Decision and Control.

[4]  Saleem A. Kassam,et al.  Finite-state Markov model for Rayleigh fading channels , 1999, IEEE Trans. Commun..

[5]  Richard F. Serfozo,et al.  M/M/1 Queueing Decision Processes with Monotone Hysteretic Optimal Policies , 1984, Oper. Res..

[6]  Andrea J. Goldsmith,et al.  Adaptive turbo-coded modulation for flat-fading channels , 2003, IEEE Trans. Commun..

[7]  D. M. Topkis Supermodularity and Complementarity , 1998 .

[8]  Richard F. Serfozo,et al.  M/M/1 Queues with Switching Costs and Hysteretic Optimal Control , 1999, Oper. Res..

[9]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[10]  Henrik Holm,et al.  Optimal power control for discrete-rate link adaptation schemes with capacity-approaching coding , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[11]  James E. Smith,et al.  Structural Properties of Stochastic Dynamic Programs , 2002, Oper. Res..

[12]  Andrea J. Goldsmith,et al.  Adaptive coded modulation for fading channels , 1998, IEEE Trans. Commun..

[13]  C. Gollier The economics of risk and time , 2001 .

[14]  Vikram Krishnamurthy,et al.  MIMO Transmission Control in Fading Channels—A Constrained Markov Decision Process Formulation With Monotone Randomized Policies , 2007, IEEE Transactions on Signal Processing.

[15]  Dennis Goeckel,et al.  Adaptive coding for time-varying channels using outdated fading estimates , 1999, IEEE Trans. Commun..

[16]  Dimitri P. Bertsekas,et al.  Data networks (2nd ed.) , 1992 .

[17]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[18]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .