A 2-SPRT Based Approach to Multiple-Model Hypothesis Testing for Multi-Distribution Detection

This paper presents an approach to multiple-model hypothesis testing (MMHT) based on 2-SPRT (2-MMSRPT) for detecting unknown events that may have multiple possible distributions. The sequential probability ratio test (SPRT) based MMHT method (MMSPRT) is promising because of its efficiency and theoretical validity. However, it may suffer from SPRT's lack of an upper bound on its stopping time, especially in the mis-specified case. The proposed 2-MMSPRT algorithm not only copes with this problem, but also is in a setting that can provide efficient detection in the sense of minimizing the maximum expected sample size subject to error probability constraints. Specifically, we prove the theoretical validity of 2-SPRT for the problem of testing hypotheses with multivariate normal densities. Moreover, we present a technique of forced independence and identical distribution (i.i.d.) to map the non-i.i.d. likelihood ratio sequence to an i.i.d. one, which enables us to apply the SPRT and 2-SPRT effectively to the dynamic case (under the linear-Gaussian assumption) with a non-identical distribution. Also, 2-MMSPRT's detection efficiency under some assumptions/approximations is verified. Performance of 2-MMSPRT is evaluated for signal detection and model-set selection problems in several scenarios. Simulation results demonstrate the detection efficiency of the proposed 2-MMSPRT compared with the MMSPRT and some traditional tests.

[1]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[2]  Stefan Aachen,et al.  Signal Detection In Non Gaussian Noise , 2016 .

[3]  X. Rong Li,et al.  Multiple-model hypothesis testing based on 2-SPRT , 2015, 2015 American Control Conference (ACC).

[4]  B. O. Koopman.  On distributions admitting a sufficient statistic , 1936 .

[5]  P. Lachenbruch.  Mathematical Statistics, 2nd Edition , 1972 .

[6]  Fredrik Gustafsson,et al.  Adaptive filtering and change detection , 2000 .

[7]  X. Rong Li,et al.  Best Model Augmentation for Variable-Structure Multiple-Model Estimation , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[8]  R. F.,et al.  Mathematical Statistics , 1944, Nature.

[9]  Xuezhi Wang,et al.  Target tracking using energy based detections , 2007, 2007 10th International Conference on Information Fusion.

[10]  B. Hoadley.  Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed Case , 1971 .

[11]  Y. Baram,et al.  An information theoretic approach to dynamical systems modeling and identification , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[12]  A.R. Runnalls,et al.  Kullback-Leibler Approach to Gaussian Mixture Reduction , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[13]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[14]  Christ D. Richmond,et al.  Parameter Bounds on Estimation Accuracy Under Model Misspecification , 2015, IEEE Transactions on Signal Processing.

[15]  Nasir D. Memon,et al.  On sequential watermark detection , 2003, IEEE Trans. Signal Process..

[16]  Don H. Johnson,et al.  On the asymptotics of M-hypothesis Bayesian detection , 1997, IEEE Trans. Inf. Theory.

[17]  Xiaodong Wang,et al.  Minimax-Optimal Hypothesis Testing With Estimation-Dependent Costs , 2012, IEEE Transactions on Signal Processing.

[18]  Michael D. Huffman.  An Efficient Approximate Solution to the Kiefer-Weiss Problem , 1983 .

[19]  Paolo Braca,et al.  Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses , 2010, IEEE Transactions on Signal Processing.

[20]  X. Rong Li,et al.  Multiple-model estimation with variable structure- part VI: expected-mode augmentation , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[21]  X. Rong Li,et al.  Common fallacies in applying hypothesis testing , 2008, 2008 11th International Conference on Information Fusion.

[22]  J. Kiefer,et al.  Some Properties of Generalized Sequential Probability Ratio Tests , 1957 .

[23]  Alexander G. Tartakovsky.  Asymptotically optimal sequential tests for nonhomogeneous processes , 1998 .

[24]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[25]  Ronald H. Rnndles.  Nonparametric Statistical Inference (2nd ed.) , 1986 .

[26]  L. Weiss.  Testing one Simple Hypothesis Against Another , 1953 .

[27]  Lu Wang,et al.  Fault detection using sequential probability ratio test , 1999, IEEE Power Engineering Society. 1999 Winter Meeting (Cat. No.99CH36233).

[28]  X. Rong Li,et al.  Multiple-model detection of target maneuvers , 2005, SPIE Optics + Photonics.

[29]  Zhansheng Duan,et al.  Comprehensive evaluation of decision performance , 2008, 2008 11th International Conference on Information Fusion.

[30]  W. Hoeffding.  Lower Bounds for the Expected Sample Size and the Average Risk of a Sequential Procedure , 1960 .

[31]  V. Jilkov,et al.  Survey of maneuvering target tracking. Part V. Multiple-model methods , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[32]  Yu Liu,et al.  Sequential multiple-model detection of target maneuver termination , 2011, 14th International Conference on Information Fusion.

[33]  R. Bechhofer.  A Note on the Limiting Relative Efficiency of the Wald Sequential Probability Ratio Test , 1960 .

[34]  Rick S. Blum,et al.  The good, bad and ugly: distributed detection of a known signal in dependent Gaussian noise , 2000, IEEE Trans. Signal Process..

[35]  Yu Liu,et al.  Performance analysis of Wald's SPRT with independent but non-stationary log-likelihood ratios , 2011, 14th International Conference on Information Fusion.

[36]  Thomas Lumley,et al.  Kendall's advanced theory of statistics. Volume 2A: classical inference and the linear model. Alan Stuart, Keith Ord and Steven Arnold, Arnold, London, 1998, No. of pages: xiv+885. Price: £85.00. ISBN 0‐340‐66230‐1 , 2000 .

[37]  Inseok Hwang,et al.  Flight-Mode-Based Aircraft Conflict Detection Using a Residual-Mean Interacting Multiple Model Algorithm , 2003 .

[38]  G. Schwarz.  Asymptotic Shapes of Bayes Sequential Testing Regions , 1962 .

[39]  Murat Efe,et al.  The IMM Approach to the Fault Detection Problem , 1997 .

[40]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[41]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[42]  X. Rong Li,et al.  Multiple-Model Estimation with Variable Structure—Part II: Model-Set Adaptation , 2000 .

[43]  T. W. Anderson.  A MODIFICATION OF THE SEQUENTIAL PROBABILITY RATIO TEST TO REDUCE THE SAMPLE SIZE , 1960 .

[44]  T. Lai.  Pitman Efficiencies of Sequential Tests and Uniform Limit Theorems in Nonparametric Statistics , 1978 .

[45]  Fredrik Gustafsson,et al.  Adaptive Filtering and Change Detection: Gustafsson: Adaptive , 2001 .

[46]  G. Lorden.  2-SPRT'S and The Modified Kiefer-Weiss Problem of Minimizing an Expected Sample Size , 1976 .

[47]  T. Lai.  Optimal Stopping and Sequential Tests which Minimize the Maximum Expected Sample Size , 1973 .

[48]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[49]  Yaakov Bar-Shalom,et al.  Discrete-time point process filter for mode estimation , 1992 .

[50]  Calyampudi R. Rao.  Theory of Statistical Inference , 2008 .

[51]  Ananthram Swami,et al.  Optimal Index Policies for Anomaly Localization in Resource-Constrained Cyber Systems , 2014, IEEE Transactions on Signal Processing.

[52]  X. Rong Li,et al.  Multiple-model estimation with variable structure. II. Model-set adaptation , 2000, IEEE Trans. Autom. Control..

[53]  H. Vincent Poor,et al.  Asymptotic efficiencies of truncated sequential tests , 1982, IEEE Trans. Inf. Theory.

[54]  B. K. Ghosh,et al.  Handbook of sequential analysis , 1991 .

[55]  Sawasd Tantaratana,et al.  Relative efficiency of the sequential probability ratio test in signal detection , 1978, IEEE Trans. Inf. Theory.

[56]  A. W. Kemp,et al.  Kendall's Advanced Theory of Statistics. , 1994 .

[57]  L. Weiss.  On Sequential Tests Which Minimize the Maximum Expected Sample Size , 1962 .