Test sequencing algorithms with unreliable tests

In this paper, we consider imperfect test sequencing problems under a single fault assumption. This is a partially observed Markov decision problem (POMDP), a sequential multistage decision problem wherein a failure source must be identified using the results of imperfect tests at each stage. The optimal solution for this problem can be obtained by applying a continuous-state dynamic programming (DP) recursion. However, the DP recursion is computationally very expensive owing to the continuous nature of the state vector comprising the probabilities of faults. In order to alleviate this computational explosion, we present an efficient implementation of the DP recursion. We also consider various problems with special structure (parallel systems) and derive closed form solutions/index-rules without having to resort to DP. Finally, we present various top-down graph search algorithms for problems with no special structure, including multistep DP, multistep information heuristics, and certainty equivalence algorithms.

[1]  Krishna R. Pattipati,et al.  Optimal and near-optimal test sequencing algorithms with realistic test models , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Lawrence D. Stone,et al.  Optimal Search Using Uninterrupted Contact Investigation , 1971 .

[3]  G. Monahan State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[4]  Sidney I. Firstman,et al.  Optimum Search Routines for Automatic Fault Location , 1960 .

[5]  Keith P. Tognetti,et al.  Letter to the Editor - An Optimal Strategy for a Whereabouts Search , 1968, Oper. Res..

[6]  James M. Dobbie Some Search Problems with False Contacts , 1973, Oper. Res..

[7]  John Yen,et al.  Simplifying fuzzy rule-based models using orthogonal transformation methods , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[8]  J. Nachlas,et al.  Diagnostic-strategy selection for series systems , 1990 .

[9]  Lawrence D. Stone,et al.  Optimal Search in the Presence of Poisson-Distributed False Targets , 1972 .

[10]  K.R. Pattipati,et al.  Optimal Measurement Sequencing in M-Ary Hypothesis Testing Problems , 1992, 1992 American Control Conference.

[11]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[12]  Joseph B. Kadane,et al.  Optimal Whereabouts Search , 1971, Oper. Res..

[13]  Thomas B. Sheridan,et al.  On How Often the Supervisor Should Sample , 1970, IEEE Trans. Syst. Sci. Cybern..

[14]  Toshihide Ibaraki,et al.  Resource allocation problems - algorithmic approaches , 1988, MIT Press series in the foundations of computing.

[15]  R. Bellman Dynamic programming. , 1957, Science.

[16]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[17]  J. R. Weisinger,et al.  A survey of the search theory literature , 1991 .