Heuristic Pattern Search for Bound Constrained Minimax Problems

This paper presents a pattern search algorithm and its hybridization with a random descent search for solving bound constrained minimax problems. The herein proposed heuristic pattern search method combines the Hooke and Jeeves (HJ) pattern and exploratory moves with a randomly generated approximate descent direction. Two versions of the heuristic algorithm have been applied to several benchmark minimax problems and compared with the original HJ pattern search algorithm.

[1]  Luigi Grippo,et al.  A smooth method for the finite minimax problem , 1993, Math. Program..

[2]  Marco Sciandrone,et al.  A Derivative-Free Algorithm for Linearly Constrained Finite Minimax Problems , 2006, SIAM J. Optim..

[3]  Song Xu,et al.  Smoothing Method for Minimax Problems , 2001, Comput. Optim. Appl..

[4]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[5]  Johannes O. Royset,et al.  Algorithms with Adaptive Smoothing for Finite Minimax Problems , 2003 .

[6]  Xiang Cai,et al.  An improved SQP algorithm for solving minimax problems , 2009, Appl. Math. Lett..

[7]  Masao Fukushima,et al.  Heuristic pattern search and its hybridization with simulated annealing for nonlinear global optimization , 2004, Optim. Methods Softw..

[8]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[9]  Michael N. Vrahatis,et al.  Particle swarm optimization for minimax problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[10]  Robert Michael Lewis,et al.  A Globally Convergent Augmented Lagrangian Pattern Search Algorithm for Optimization with General Constraints and Simple Bounds , 2002, SIAM J. Optim..

[11]  Michael N. Vrahatis,et al.  Optimal power allocation and joint source-channel coding for wireless DS-CDMA visual sensor networks using the Nash Bargaining Solution , 2005, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Michael N. Vrahatis,et al.  Memetic particle swarm optimization , 2007, Ann. Oper. Res..

[13]  Min-Jea Tahk,et al.  A hybrid optimization method of evolutionary and gradient search , 2007 .

[14]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[15]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[16]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[17]  Liu San-yang,et al.  A smoothing trust-region Newton-CG method for minimax problem , 2008 .

[18]  Robert Michael Lewis,et al.  Pattern Search Algorithms for Bound Constrained Minimization , 1999, SIAM J. Optim..