Sequential Random Distortion Testing of Non-Stationary Processes

In this work, we propose a non-parametric sequential hypothesis test based on random distortion testing (RDT). RDT addresses the problem of testing whether or not a random signal, <inline-formula><tex-math notation="LaTeX">$\Xi$</tex-math></inline-formula>, observed in independent and identically distributed (i.i.d) additive noise deviates by more than a specified tolerance, <inline-formula><tex-math notation="LaTeX">$\tau$</tex-math></inline-formula>, from a fixed model, <inline-formula><tex-math notation="LaTeX">$\xi _0$</tex-math></inline-formula>. The test is non-parametric in the sense that the underlying signal distributions under each hypothesis are assumed to be unknown. The need to control the probabilities of false alarm (PFA) and missed detection (PMD), while reducing the number of samples required to make a decision, leads to a novel sequential algorithm, <italic>Seq</italic>RDT. We show that under mild assumptions on the signal, <italic>Seq</italic>RDT follows the properties desired by a sequential test. We introduce the concept of a buffer and derive bounds on PFA and PMD, from which we choose the buffer size. Simulations show that <italic>Seq</italic>RDT leads to faster decision-making on an average compared to its fixed-sample-size (FSS) counterpart, <italic>Block</italic>RDT. These simulations also show that the proposed algorithm is robust to model mismatches compared to the sequential probability ratio test (SPRT).

[1]  H Merabet,et al.  The design and analysis of sequential clinical trials , 2013 .

[2]  L. Shepp Probability Essentials , 2002 .

[3]  S. Geer,et al.  Statistics for big data: A perspective , 2018 .

[4]  Peter Bühlmann,et al.  Magging: Maximin Aggregation for Inhomogeneous Large-Scale Data , 2014, Proceedings of the IEEE.

[5]  P. D. T. O'Connor Understanding Statistical Process Control, D. J. Wheeler and D. S. Chambers, Addison-Wesley, 1990. Number of pages: 339 , 1990 .

[6]  T. Lai Asymptotic Optimality of Invariant Sequential Probability Ratio Tests , 1981 .

[7]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[8]  B. K. Ghosh,et al.  Handbook of sequential analysis , 1991 .

[9]  E. L’her,et al.  Automatic detection of AutoPEEP during controlled mechanical ventilation , 2012, Biomedical engineering online.

[10]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[11]  Vinod Sharma,et al.  Truncated Sequential Non-Parametric Hypothesis Testing Based on Random Distortion Testing , 2019, IEEE Transactions on Signal Processing.

[12]  Honghai Zhang,et al.  A Low-Complexity Sequential Spectrum Sensing Algorithm for Cognitive Radio , 2014, IEEE Journal on Selected Areas in Communications.

[13]  P. Spreij Probability and Measure , 1996 .

[14]  T. Lai SEQUENTIAL ANALYSIS: SOME CLASSICAL PROBLEMS AND NEW CHALLENGES , 2001 .

[15]  Shidong Zhou,et al.  On the Monotonicity, Log-Concavity, and Tight Bounds of the Generalized Marcum and Nuttall $Q$-Functions , 2010, IEEE Transactions on Information Theory.

[16]  T. Lai Likelihood Ratio Identities and Their Applications to Sequential Analysis , 2004 .

[17]  Z. Ying,et al.  Generalized Sequential Probability Ratio Test for Separate Families of Hypotheses , 2014, Sequential analysis.

[18]  Vinod Sharma,et al.  On Sequential Random Distortion Testing of Non-Stationary Processes , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Jerry D. Gibson,et al.  Introduction to Nonparametric Detection with Applications , 1995 .

[20]  Vinod Sharma,et al.  On Random Distortion Testing Based Sequential Non-Parametric Hypothesis Testing* , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[21]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[22]  Dominique Pastor,et al.  Random distortion testing with linear measurements , 2018, Signal Process..

[23]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[24]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[25]  Dominique Pastor,et al.  Robust statistical process control in Block-RDT framework , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Dominique Pastor,et al.  A sharp upper bound for the probability of error of the likelihood ratio test for detecting signals in white Gaussian noise , 2002, IEEE Trans. Inf. Theory.