Marginal productivity index policies for scheduling multiclass wireless transmissions

We address the problem of dynamically scheduling wireless transmissions of multiple heterogeneous users in a centrally controlled single-hop mobile network, with the goal of designing well-grounded and tractable dynamic scheduling policies which come close to optimizing performance objectives of concern. We model the system as a discrete-time Markovian multiclass queue with random binary connectivities, where each class has a dedicated finite buffer. Different levels of tolerance to delay and loss of traffic classes are modeled via corresponding linear holding and/or rejection cost rates. We develop new dynamic index policies, prescribing to give higher service priority to connected classes with larger index values, where the index of a class measures the marginal productivity of work at its current state. Such marginal productivity index (MPI) policies furnish new, insightful structural results. Computational experiments are reported, showing that the proposed MPI policies are nearly optimal and outperform conventional policies across the instances considered

[1]  J.M. Schopf,et al.  Stochastic Scheduling , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[2]  José Niño-Mora,et al.  Dynamic allocation indices for restless projects and queueing admission control: a polyhedral approach , 2002, Math. Program..

[3]  J. Nino-Mora,et al.  Marginal productivity index policies for scheduling multiclass delay-/loss-sensitive traffic , 2005, Next Generation Internet Networks, 2005.

[4]  J. Nio-Mora Restless Bandit Marginal Productivity Indices, Diminishing Returns, and Optimal Control of Make-to-Order/Make-to-Stock M/G/1 Queues , 2006 .

[5]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .

[6]  P. Whittle Restless bandits: activity allocation in a changing world , 1988, Journal of Applied Probability.

[7]  Leandros Tassiulas,et al.  Dynamic server allocation to parallel queues with randomly varying connectivity , 1993, IEEE Trans. Inf. Theory.

[8]  J. Niño-Mora RESTLESS BANDITS, PARTIAL CONSERVATION LAWS AND INDEXABILITY , 2001 .

[9]  Demosthenis Teneketzis,et al.  ON THE OPTIMALITY OF AN INDEX RULE IN MULTICHANNEL ALLOCATION FOR SINGLE-HOP MOBILE NETWORKS WITH MULTIPLE SERVICE CLASSES , 2000 .

[10]  George Michailidis,et al.  ON PARALLEL QUEUING WITH RANDOM SERVER CONNECTIVITY AND ROUTING CONSTRAINTS , 2002, Probability in the Engineering and Informational Sciences.

[11]  José Niño-Mora,et al.  Restless Bandit Marginal Productivity Indices, Diminishing Returns, and Optimal Control of Make-to-Order/Make-to-Stock M/G/1 Queues , 2006, Math. Oper. Res..