Adaptive algorithms in distributed resource allocation

The allocation of scarce, reusable resources over time to interconnected tasks in uncertain and dynamic envi- ronments in order to optimize a performance measure is a general problem which arises in many real-world domains. The paper overviews several recent distrib- uted approaches to this problem and compares their properties, such as the guarantees of ¯nding a (near-) optimal solution, their robustness against di®erent dis- turbances or against imprecise, uncertain models, with a special emphasis on their adaptive capabilities. The paper argues that reinforcement learning based distrib- uted resource allocation systems represent one of the most promising approaches to these kinds of problems.