Using cross-validation for model parameter selection of sequential probability ratio test

The sequential probability ratio test is widely used in in-situ monitoring, anomaly detection, and decision making for electronics, structures, and process controls. However, because model parameters for this method, such as the system disturbance magnitudes, and false and missed alarm probabilities, are selected by users primarily based on experience, the actual false and missed alarm probabilities are typically higher than the requirements of the users. This paper presents a systematic method to select model parameters for the sequential probability ratio test by using a cross-validation technique. The presented method can improve the accuracy of the sequential probability ratio test by reducing the false and missed alarm probabilities caused by improper model parameters. A case study of anomaly detection of resettable fuses is used to demonstrate the application of a cross validation method to select model parameters for the sequential probability ratio test.

[1]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[2]  C. P. Gupta,et al.  Nonlinear elliptic boundary value problems in Lp-spaces and sums of ranges of accretive operators , 1978 .

[3]  K. Gross,et al.  Sequential probability ratio test for nuclear plant component surveillance , 1991 .

[4]  Marion R. Reynolds,et al.  The SPRT control chart for the process mean with samples starting at fixed times , 2001 .

[5]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[6]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[7]  Rahul Sukthankar,et al.  Complete Cross-Validation for Nearest Neighbor Classifiers , 2000, ICML.

[8]  K. Worden,et al.  STATISTICAL DAMAGE CLASSIFICATION USING SEQUENTIAL PROBABILITY RATIO TESTS. , 2002 .

[9]  Bin Yao,et al.  A prognostics and health management roadmap for LED lighting system , 2014, 2014 10th International Conference on Reliability, Maintainability and Safety (ICRMS).

[10]  Gerhard Tutz,et al.  Feature Selection and Weighting by Nearest Neighbor Ensembles , 2009 .

[11]  Youn Min Chou,et al.  Transforming Non-Normal Data to Normality in Statistical Process Control , 1998 .

[12]  M. Stone,et al.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[13]  Michael G. Pecht,et al.  A prognostics and health management roadmap for information and electronics-rich systems , 2010, Microelectron. Reliab..

[14]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[15]  Marion R. Reynolds,et al.  The SPRT chart for monitoring a proportion , 1998 .

[16]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[17]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[18]  Zucchini,et al.  An Introduction to Model Selection. , 2000, Journal of mathematical psychology.

[19]  Adrian Miron.  A WAVELET APPROACH FOR DEVELOPMENT AND APPLICATION OF A STOCHASTIC PARAMETER SIMULATION SYSTEM , 2001 .

[20]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[21]  Kenny C. Gross,et al.  Early Detection of Signal and Process Anomalies in Enterprise Computing Systems , 2002, ICMLA.

[22]  B. Efron.  Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[23]  Kenny C. Gross,et al.  Proactive Fault Monitoring in Enterprise Servers , 2005, CDES.

[24]  M. Pecht,et al.  A Wireless Sensor System for Prognostics and Health Management , 2010, IEEE Sensors Journal.

[25]  Michael Pecht,et al.  Failure Precursors for Polymer Resettable Fuses , 2010, IEEE Transactions on Device and Materials Reliability.

[26]  Rudy Setiono,et al.  Feedforward Neural Network Construction Using Cross Validation , 2001, Neural Computation.

[27]  M. R. Reynolds,et al.  The SPRT chart for monitoring a proportion , 1998 .