Optimal Expected Discounted Reward of a Wireless Network with Award and Cost

In this paper, we extend our previous optimization investigation on a single cell (IEEE Transactions on Wireless Communications, vol. 8, no. 2, pp. 1038-1044, 2009) to a whole network with multiple cells and further consider the call admission control (CAC) based on the total expected discounted reward. Here, the system will get the award for admitting a call, but will incur a cost for rejecting a call and incur a cost for holding a call. Call’s routing between cells in the network is characterized probabilistically. Under several realistic assumptions on network in general, we consider the reserved channel scheme in the literature and applied the theory of continuous time Markov decision process to derive the optimal policy. We figure out the optimal CAC policy of when to admit or reject an arrival call (either new call or handoff call) in order to achieve the maximum total expected discounted reward for the scheme. Our numerical analysis confirms the correctness of our result for this whole network investigation. The result of this paper could be applied in designing wireless networks for optimal performance, and be extended to the multiple classes of calls in the deign of future wireless mobile multimedia networking.