Change Acceleration and Detection

A novel sequential change detection problem is proposed, in which the change should be not only detected but also accelerated. Specifically, it is assumed that the sequentially collected observations are responses to treatments selected in real time. The assigned treatments not only determine the pre-change and post-change distributions of the responses, but also influence when the change happens. The problem is to find a treatment assignment rule and a stopping rule that minimize the expected total number of observations subject to a user-specified bound on the false alarm probability. The optimal solution to this problem is obtained under a general Markovian change-point model. Moreover, an alternative procedure is proposed, whose applicability is not restricted to Markovian change-point models and whose design requires minimal computation. For a large class of change-point models, the proposed procedure is shown to achieve the optimal performance in an asymptotic sense. Finally, its performance is found in two simulation studies to be close to the optimal, uniformly with respect to the error probability.

[1]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[2]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[3]  Walter T. Federer,et al.  Sequential Design of Experiments , 1967 .

[4]  B. Bloom.  Learning for Mastery. Instruction and Curriculum. Regional Education Laboratory for the Carolinas and Virginia, Topical Papers and Reprints, Number 1. , 1968 .

[5]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[6]  G. Lorden.  On Excess Over the Boundary , 1970 .

[7]  G. Lorden.  PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[8]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal stopping rules , 1977 .

[9]  R. Keener.  Second Order Efficiency in the Sequential Design of Experiments , 1984 .

[10]  M. Pollak.  Optimal Detection of a Change in Distribution , 1985 .

[11]  Patchigolla Kiran Kumar,et al.  A Survey of Some Results in Stochastic Adaptive Control , 1985 .

[12]  M. Woodroofe.  Nonlinear Renewal Theory in Sequential Analysis , 1987 .

[13]  R. Durrett.  Probability: Theory and Examples , 1993 .

[14]  John N. Tsitsiklis,et al.  An Analysis of Stochastic Shortest Path Problems , 1991, Math. Oper. Res..

[15]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[16]  O. Kallenberg.  Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[17]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[18]  O. Hernández-Lerma,et al.  Discrete-time Markov control processes , 1999 .

[19]  S. Patek.  On partially observed stochastic shortest path problems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[20]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[21]  J. Templin,et al.  Measurement of psychological disorders using cognitive diagnosis models. , 2006, Psychological methods.

[22]  Stephen D. Patek,et al.  Partially Observed Stochastic Shortest Path Problems With Approximate Solution by Neurodynamic Programming , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  G. Moustakides.  SEQUENTIAL CHANGE DETECTION REVISITED , 2008, 0804.0741.

[24]  Stephanie T. Lanza,et al.  Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences , 2009 .

[25]  Jonathan Templin,et al.  Diagnostic Measurement: Theory, Methods, and Applications , 2010 .

[26]  Tara Javidi,et al.  Active Sequential Hypothesis Testing , 2012, ArXiv.

[27]  Taposh Banerjee,et al.  Quickest Change Detection , 2012, ArXiv.

[28]  C. Studer.  Incorporating Learning into the Cognitive Assessment Framework , 2012 .

[29]  George Atia,et al.  Controlled Sensing for Multihypothesis Testing , 2012, IEEE Transactions on Automatic Control.

[30]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[31]  Ryan S. Baker,et al.  Educational Data Mining and Learning Analytics , 2014 .

[32]  A. Cohen,et al.  A Latent Transition Analysis Model for Assessing Change in Cognitive Skills , 2016, Educational and psychological measurement.

[33]  Hua-Hua Chang,et al.  From smart testing to smart learning: how testing technology can assist the new generation of education , 2016 .

[34]  Jeff Douglas,et al.  Sequential detection of learning in cognitive diagnosis. , 2016, The British journal of mathematical and statistical psychology.

[35]  Alexander G. Tartakovsky,et al.  On Asymptotic Optimality in Sequential Changepoint Detection: Non-iid Case , 2015, IEEE Transactions on Information Theory.

[36]  Walter L. Leite,et al.  Assessing Change in Latent Skills Across Time With Longitudinal Cognitive Diagnosis Modeling: An Evaluation of Model Performance , 2017, Educational and psychological measurement.

[37]  Yan Yang,et al.  Tracking Skill Acquisition With Cognitive Diagnosis Models: A Higher-Order, Hidden Markov Model With Covariates , 2018 .

[38]  Steven Andrew Culpepper,et al.  A Hidden Markov Model for Learning Trajectories in Cognitive Diagnosis With Application to Spatial Rotation Skills , 2018, Applied psychological measurement.