A Decision-Making Framework for Control Strategies in Probabilistic Search

This paper presents the search problem formulated as a decision problem, where the searcher decides whether the target is present in the search region, and if so, where it is located. Such decision-based search tasks are relevant to many research areas, including mobile robot missions, visual search and attention, and event detection in sensor networks. The effect of control strategies in search problems on decision-making quantities, namely time-to-decision, is investigated in this work. We present a Bayesian framework in which the objective is to improve the decision, rather than the sensing, using different control policies. Furthermore, derivations of closed-form expressions governing the evolution of the belief function are also presented. As this framework enables the study and comparison of the role of control for decision-making applications, the derived theoretical results provide greater insight into the sequential processing of decisions. Numerical studies are presented to verify and demonstrate these results

[1]  B. O. Koopman,et al.  Search and its Optimization , 1979 .

[2]  L. Stone.  Theory of Optimal Search , 1975 .

[3]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[4]  A. Washburn.  Search for a Moving Target: Upper Bound on Detection Probability , 1978 .

[5]  K E Trummel,et al.  Technical Note - The Complexity of the Optimal Searcher Path Problem , 1986, Oper. Res..

[6]  Tomonari Furukawa,et al.  Multi-vehicle Bayesian Search for Multiple Lost Targets , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[7]  J Wolfowitz,et al.  Bayes Solutions of Sequential Decision Problems. , 1949, Proceedings of the National Academy of Sciences of the United States of America.

[8]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[9]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[10]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[11]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[12]  P. Hudson.  Search Games , 1982 .

[13]  Howie Choset,et al.  Path Planning for Robotic Demining: Robust Sensor-Based Coverage of Unstructured Environments and Probabilistic Methods , 2003, Int. J. Robotics Res..

[14]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.