Technical Note - Trading Off Quick versus Slow Actions in Optimal Search

We consider the search for a target whose precise location is uncertain. The search region is divided into grid cells, and the searcher decides which cell to visit next and whether to search it quickly or slowly. A quick search of a cell containing the target may damage it, resulting in a failed search, or it may locate the target safely. If the target is not in the cell, the search continues over the remaining cells. If a slow search is performed on a cell, then the search ends in failure with a fixed probability regardless of whether or not the target is in that cell e.g., because of enemy fire while performing the slow search. If the slow search survives this failure possibility, then the search ends in success if the target is in that cell; otherwise, the search continues over the remaining cells. We seek to minimize the probability of the search ending in failure and consider two types of rules for visiting cells: the unconstrained search, in which the searcher may visit cells in any order, and the constrained search, in which the searcher may only visit adjacent cells e.g., up, down, left, or right of cells already visited. We prove that the optimal policy for the unconstrained search is to search quickly some initial set of cells with the lowest probabilities of containing the target before slowly searching the remaining cells in decreasing order of probabilities. For the special case in which a quick search on a cell containing the target damages it with certainty, the optimal policy is to search all cells slowly, in decreasing order of probabilities. We use the optimal solution of the unconstrained search in a branch-and-bound optimal solution algorithm for the constrained search. For larger instances, we evaluate heuristics and approximate dynamic programming approaches for finding good solutions.

[1]  James M. Dobbie,et al.  A Survey of Search Theory , 1968, Oper. Res..

[2]  Sheldon M. Ross,et al.  A Problem in Optimal Search and Stop , 1969, Oper. Res..

[3]  L. Stone Theory of Optimal Search , 1975 .

[4]  Ingo Wegener The Discrete Sequential Search Problem with Nonrandom Cost and Overlook Probabilities , 1980, Math. Oper. Res..

[5]  Ingo Wegener,et al.  Discrete Sequential Search with Positive Switch Cost , 1982, Math. Oper. Res..

[6]  Antony R. Unwin Search Theory and Applications , 1982 .

[7]  K E Trummel,et al.  Technical Note - The Complexity of the Optimal Searcher Path Problem , 1986, Oper. Res..

[8]  James N. Eagle,et al.  An Optimal Branch-and-Bound Procedure for the Constrained Path, Moving Target Search Problem , 1990, Oper. Res..

[9]  J. R. Weisinger,et al.  A survey of the search theory literature , 1991 .

[10]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[11]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[12]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[13]  Steve Alpern,et al.  Searching for an Agent Who May OR May Not Want to be Found , 2002, Oper. Res..

[14]  Benjamin Van Roy,et al.  The Linear Programming Approach to Approximate Dynamic Programming , 2003, Oper. Res..

[15]  Shmuel Gal,et al.  The theory of search games and rendezvous , 2002, International series in operations research and management science.

[16]  J. V. Howard,et al.  Rendezvous-Evasion Search in Two Boxes , 2005, Oper. Res..

[17]  Joel W. Burdick,et al.  A Decision-Making Framework for Control Strategies in Probabilistic Search , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[18]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[19]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[20]  Roberto Szechtman,et al.  Optimal discrete search with imperfect specificity , 2008, Math. Methods Oper. Res..

[21]  Hiroyuki Sato,et al.  Path optimization for the resource‐constrained searcher , 2010 .

[22]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[23]  Steve Alpern,et al.  Mining Coal or Finding Terrorists: The Expanding Search Paradigm , 2013, Oper. Res..

[24]  Matthew S. Maxwell,et al.  Tuning approximate dynamic programming policies for ambulance redeployment via direct search , 2013 .