A Maximum Entropy Based Scalable Algorithm for Resource Allocation Problems

In this paper, we propose a scalable algorithm for solving resource allocation problems on large datasets. This class of problems is posed as a multi-objective optimization problem in a maximum entropy principle framework. This algorithm solves a multi-objective optimization problem that minimizes simultaneously the coverage cost and the computational cost by appropriate recursive prescription of smaller subsets required for a 'divide and conquer' strategy. It provides characterization of the inherent trade-off between reduction in computation time and the coverage cost. Simulations are presented that show significant improvements in the computational time required for solving the coverage problem while maintaining the coverage costs within pre- specified tolerance limits.

[1]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[2]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[3]  M. A. Dahleh,et al.  Constraints on locational optimization problems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[4]  R. Baierlein Probability Theory: The Logic of Science , 2004 .

[5]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[6]  P. Sharma,et al.  A scalable deterministic annealing algorithm for resource allocation problems , 2006, 2006 American Control Conference.

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Geoffrey C. Fox,et al.  Constrained Clustering as an Optimization Method , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Claude E. Shannon,et al.  The Mathematical Theory of Communication , 1950 .

[10]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[11]  P. Sharma,et al.  A deterministic annealing approach to combinatorial library design for drug discovery , 2005, Proceedings of the 2005, American Control Conference, 2005..

[12]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.