Weak adaptive submodularity and group-based active diagnosis with applications to state estimation with persistent sensor faults

In this paper, we consider adaptive decision-making problems for stochastic state estimation with partial observations. First, we introduce the concept of weak adaptive submodularity, a generalization of adaptive submodularity, which has found great success in solving challenging adaptive state estimation problems. Then, for the problem of active diagnosis, i.e., discrete state estimation via active sensing, we show that an adaptive greedy policy has a near-optimal performance guarantee when the reward function possesses this property. We further show that the reward function for group-based active diagnosis, which arises in applications such as medical diagnosis and state estimation with persistent sensor faults, is also weakly adaptive submodular. Finally, in experiments of state estimation for an aircraft electrical system with persistent sensor faults, we observe that an adaptive greedy policy performs equally well as an exhaustive search.

[1]  Richard M. Murray,et al.  Dynamic state estimation in distributed aircraft electric control systems via adaptive submodularity , 2013, 52nd IEEE Conference on Decision and Control.

[2]  George J. Pappas,et al.  Sensor placement for optimal Kalman filtering: Fundamental limits, submodularity, and algorithms , 2015, 2016 American Control Conference (ACC).

[3]  Jason Stanley,et al.  A Rank-Based Approach to Active Diagnosis , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Michael I. Jordan,et al.  Variational methods and the QMR-DT database , 1998 .

[5]  C. Scott,et al.  Group-Based Active Query Selection for Rapid Diagnosis in Time-Critical Situations , 2012, IEEE Transactions on Information Theory.

[6]  Stéphane Lafortune,et al.  On an Optimization Problem in Sensor Selection* , 2002, Discret. Event Dyn. Syst..

[7]  Andreas Krause,et al.  Efficient Planning of Informative Paths for Multiple Robots , 2006, IJCAI.

[8]  Teresa M. Przytycka,et al.  On an Optimal Split Tree Problem , 1999, WADS.

[9]  John Lygeros,et al.  Optimal Sensor and Actuator Placement in Complex Dynamical Networks , 2013, ArXiv.

[10]  Abhimanyu Das,et al.  Submodular meets Spectral: Greedy Algorithms for Subset Selection, Sparse Approximation and Dictionary Selection , 2011, ICML.

[11]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[12]  Nugroho Iwan Santoso,et al.  Nuclear plant fault diagnosis using probabilistic reasoning , 1999, 1999 IEEE Power Engineering Society Summer Meeting. Conference Proceedings (Cat. No.99CH36364).

[13]  Alina Beygelzimer,et al.  Efficient Test Selection in Active Diagnosis via Entropy Approximation , 2005, UAI.

[14]  Andreas Krause,et al.  Near-Optimal Bayesian Active Learning with Noisy Observations , 2010, NIPS.

[15]  Andreas Krause,et al.  Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization , 2010, J. Artif. Intell. Res..