Reduced dimension policy iteration for wireless network control via multiscale analysis

A novel framework for the analysis and optimization of wireless networks operations is proposed. The temporal evolution of the state of the network is modeled as the trajectory of the state of a Finite State Machine (FSM). The state space of the FSM and the statistics of state transition are represented as a directed graph. Graph reduction and transform techniques are proposed to reduce the dimension of the graph associated with the FSM and analyze the properties of functions defined on its state space. The proposed methodology is based on the intrinsic multi-dimensional/multi-scale structure of the state space of the FSM and enables the analysis and minimization of cost-to-go functions, i.e., functions measuring the expected long-term cost associated with a control strategy, on coarser versions of the original graph.

[1]  Joseph Mitola,et al.  Cognitive Radio An Integrated Agent Architecture for Software Defined Radio , 2000 .

[2]  Urbashi Mitra,et al.  Optimization of ARQ Protocols in Interference Networks with QoS Constraints , 2011, 2011 IEEE International Conference on Communications (ICC).

[3]  A. Girotra,et al.  Performance Analysis of the IEEE 802 . 11 Distributed Coordination Function , 2005 .

[4]  Mark Crovella,et al.  Graph wavelets for spatial traffic analysis , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[5]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[6]  Hongqiang Zhai,et al.  Performance analysis of IEEE 802.11 MAC protocols in wireless LANs , 2004, Wirel. Commun. Mob. Comput..

[7]  Sunil K. Narang,et al.  Multi-dimensional separable critically sampled wavelet filterbanks on arbitrary graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Ying-Chang Liang,et al.  Exploiting Multi-Antennas for Opportunistic Spectrum Sharing in Cognitive Radio Networks , 2007, IEEE Journal of Selected Topics in Signal Processing.

[9]  Michele Zorzi,et al.  On the use of renewal theory in the analysis of ARQ protocols , 1996, IEEE Trans. Commun..

[10]  Urbashi Mitra,et al.  Structure-based learning in wireless networks via sparse approximation , 2012, EURASIP J. Wirel. Commun. Netw..

[11]  Urbashi Mitra,et al.  Cognitive interference management in retransmission-based wireless networks , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  Eytan Modiano,et al.  Fairness and optimal stochastic control for heterogeneous networks , 2005, INFOCOM.

[13]  Sagar Naik,et al.  A node-cooperative ARQ scheme for wireless ad hoc networks , 2005, IEEE Transactions on Vehicular Technology.

[14]  Sunil K. Narang,et al.  Downsampling graphs using spectral theory , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[16]  Haitao Wu,et al.  Performance of reliable transport protocol over IEEE 802.11 wireless LAN: analysis and enhancement , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[17]  Keith W. Ross,et al.  Randomized and Past-Dependent Policies for Markov Decision Processes with Multiple Constraints , 1989, Oper. Res..