Layered Sequential Decision Policies for Cross-Layer Design of Wireless Ad-Hoc Networks

Efficient transmission control (e.g., power/rate control) in the physical layer, link scheduling in the link layer and routing in the network layer are critical design issues of wireless ad hoc networks. By considering both the quality-of-service and the utilization of resources under the temporally correlated uncertainties of the network conditions, a sequential decision framework is proposed for protocol design and layering. By observing that there are usually different performance concerns in the network layer versus lower layers, two correlated sequential decision models for the operations at different layers are proposed. With the decision model in the link and physical layers, scheduling and transmission control are jointly optimized. By adding a decision model in the network layer, the benefit of cross-layer information is quantified and the optimal routing/forwarding strategy is characterized. Practical algorithms based on the proposed decision models are also developed to achieve optimal/near-optimal performance.

[1]  Abhijeet Bhorkar,et al.  An adaptive opportunistic routing scheme for wireless ad-hoc networks , 2009, 2009 IEEE International Symposium on Information Theory.

[2]  A. Robert Calderbank,et al.  Layering As Optimization Decomposition , 2006 .

[3]  Ronald Prescott Loui,et al.  Optimal paths in graphs with stochastic or multidimensional weights , 1983, Commun. ACM.

[4]  Saleem A. Kassam,et al.  Finite-state Markov model for Rayleigh fading channels , 1999, IEEE Trans. Commun..

[5]  Samuli Aalto,et al.  Combining opportunistic and size-based scheduling in wireless systems , 2008, MSWiM '08.

[6]  Michail G. Lagoudakis,et al.  Least-Squares Policy Iteration , 2003, J. Mach. Learn. Res..

[7]  Ariel Orda,et al.  QoS routing in networks with inaccurate information: theory and algorithms , 1999, TNET.

[8]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[9]  Junshan Zhang,et al.  Traffic aided opportunistic scheduling for wireless networks: algorithms and performance bounds , 2004, Comput. Networks.

[10]  Marwan Krunz,et al.  Bandwidth-delay constrained path selection under inaccurate state information , 2003, TNET.

[11]  Andrea J. Goldsmith,et al.  Optimal power control and source-channel coding for delay constrained traffic over wireless channels , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[12]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[13]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[14]  J. W. Nieuwenhuis,et al.  Boekbespreking van D.P. Bertsekas (ed.), Dynamic programming and optimal control - volume 2 , 1999 .