An outer-approximation algorithm for generalized maximum entropy sampling

This paper presents an outer-approximation algorithm to address a generalized maximum entropy sampling (GMES) problem that determines a set of measurement locations providing the largest entropy reduction. A new mixed- integer semidefinite program (MISDP) formulation is proposed to handle a GMES problem with a jointly Gaussian distribution over the search space. This formulation employs binary variables to indicate if the corresponding measurement location is selected, and exploits the linear equivalent form of a bilinear term involving binary variables to ensure convexity of the objective function and linearity of the constraint functions. An outer- approximation algorithm is developed for this formulation that obtains the optimal solution by solving a sequence of mixed-integer linear programs. Numerical experiments are presented to verify the solution optimality and the computational effectiveness of the proposed algorithm by comparing it with an existing branch-and-bound method that utilizes nonlinear programming relaxation. Sensor selection for best tracking of a moving target under a communication budget constraint is specifically considered to validate the superiority of the suggested algorithm in handling quadratic constraints.

[1]  Jon Lee,et al.  Solving maximum-entropy sampling problems using factored masks , 2007, Math. Program..

[2]  Jon Lee,et al.  Maximum-entropy remote sampling , 2001, Discret. Appl. Math..

[3]  Jon Lee,et al.  A linear integer programming bound for maximum-entropy sampling , 2003, Math. Program..

[4]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[5]  C. Guestrin,et al.  Near-optimal sensor placements: maximizing information while minimizing communication cost , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[6]  Gérard Cornuéjols,et al.  An algorithmic framework for convex mixed integer nonlinear programs , 2008, Discret. Optim..

[7]  Toby J. Mitchell,et al.  An algorithm for the construction of “ D -optimal” experimental designs , 2000 .

[8]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[9]  Jon Lee,et al.  New upper bounds for maximum-entropy sampling , 2000 .

[10]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[11]  Han-Lim Choi,et al.  A multi-UAV targeting algorithm for ensemble forecast improvement , 2007 .

[12]  G. Pottie,et al.  Entropy-based sensor selection heuristic for target localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[13]  A.S. Willsky,et al.  An approximate dynamic programming approach to a communication constrained sensor management problem , 2005, 2005 7th International Conference on Information Fusion.

[14]  Jeff T. Linderoth,et al.  FilMINT: An Outer-Approximation-Based Solver for Nonlinear Mixed Integer Programs , 2008 .

[15]  Jon Lee,et al.  Using continuous nonlinear relaxations to solve. constrained maximum-entropy sampling problems , 1999, Math. Program..

[16]  Maurice Queyranne,et al.  An Exact Algorithm for Maximum Entropy Sampling , 1995, Oper. Res..

[17]  Ignacio E. Grossmann,et al.  An outer-approximation algorithm for a class of mixed-integer nonlinear programs , 1987, Math. Program..

[18]  Andreas Krause,et al.  Near-optimal Nonmyopic Value of Information in Graphical Models , 2005, UAI.

[19]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[20]  Henry P. Wynn,et al.  Maximum entropy sampling , 1987 .

[21]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  F. J. Alonso,et al.  A state-space model approach to optimum spatial sampling design based on entropy , 1998, Environmental and Ecological Statistics.

[23]  Jon Lee Constrained Maximum-Entropy Sampling , 1998, Oper. Res..

[24]  Han-Lim Choi,et al.  Ensemble-Based Adaptive Targeting of Mobile Sensor Networks , 2007, 2007 American Control Conference.

[25]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[26]  P. I. Barton,et al.  Outer approximation algorithms for separable nonconvex mixed-integer nonlinear programs , 2004, Math. Program..

[27]  Sven Leyffer,et al.  Solving mixed integer nonlinear programs by outer approximation , 1994, Math. Program..