Likelihood inference for a class of latent Markov models under linear hypotheses on the transition probabilities

Summary.  For a class of latent Markov models for discrete variables having a longitudinal structure, we introduce an approach for formulating and testing linear hypotheses on the transition probabilities of the latent process. For the maximum likelihood estimation of a latent Markov model under hypotheses of this type, we outline an EM algorithm that is based on well‐known recursions in the hidden Markov literature. We also show that, under certain assumptions, the asymptotic null distribution of the likelihood ratio statistic for testing a linear hypothesis on the transition probabilities of a latent Markov model, against a less stringent linear hypothesis on the transition probabilities of the same model, is of type. As a particular case, we derive the asymptotic distribution of the likelihood ratio statistic between a latent class model and its latent Markov version, which may be used to test the hypothesis of absence of transition between latent states. The approach is illustrated through a series of simulations and two applications, the first of which is based on educational testing data that have been collected within the National Assessment of Educational Progress 1996, and the second on data, concerning the use of marijuana, which have been collected within the National Youth Survey 1976–1980.

[1]  H. Chernoff On the Distribution of the Likelihood Ratio , 1954 .

[2]  R. McHugh Efficient estimation and local identification in latent class analysis , 1956 .

[3]  G. Rasch On General Laws and the Meaning of Measurement in Psychology , 1961 .

[4]  Paul F. Lazarsfeld,et al.  Latent Structure Analysis. , 1969 .

[5]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[6]  T. Rothenberg Identification in Parametric Models , 1971 .

[7]  L. A. Goodman Exploratory latent structure analysis using both identifiable and unidentifiable models , 1974 .

[8]  Otis Dudley Duncan,et al.  Panel Analysis: Latent Probability Models for Attitude and Behavior Processes. , 1975 .

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[11]  F. Krauss Latent Structure Analysis , 1980 .

[12]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[13]  Carsten Stig Poulsen,et al.  LATENT STRUCTURE ANALYSIS WITH CHOICE MODELING APPLICATIONS , 1983 .

[14]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[15]  A. Shapiro Asymptotic distribution of test statistics in the analysis of moment structures under inequality constraints , 1985 .

[16]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[17]  Carl P. M. Rijkes,et al.  Loglinear multidimensional IRT models for polytomously scored items , 1988 .

[18]  A. Shapiro Towards a unified theory of inequality constrained testing in multivariate analysis , 1988 .

[19]  F. V. D. Pol,et al.  MIXED MARKOV LATENT CLASS MODELS , 1990 .

[20]  C. S. Poulsen Mixed Markov and latent Markov modelling applied to brand choice behaviour , 1990 .

[21]  B. Lindsay,et al.  Semiparametric Estimation in the Rasch Model and Related Exponential Response Models, Including a Simple Latent Class Model for Item Analysis , 1991 .

[22]  Scott Menard,et al.  Multiple Problem Youth: Delinquency, Substance Use, and Mental Health Problems , 1991 .

[23]  Elsbeth Stern,et al.  State Mastery Learning: Dynamic Models for Longitudinal Data , 1994 .

[24]  J. Vermunt,et al.  Discrete-Time Discrete-State Latent Markov Models with Time-Constant and Time-Varying Covariates , 1999 .

[25]  Fumiko Samejima,et al.  EVALUATION OF MATHEMATICAL MODELS FOR ORDERED POLYCHOTOMOUS RESPONSES , 1996 .

[26]  S. P. Pederson,et al.  Hidden Markov and Other Models for Discrete-Valued Time Series , 1998 .

[27]  A. Forcina,et al.  A Unified Approach to Likelihood Inference on Stochastic Orderings in a Nonparametric Context , 1998 .

[28]  Keith Humphreys,et al.  The Latent Markov Chain with Multivariate Random Effects , 1998 .

[29]  R J Cook,et al.  Estimation of Operating Characteristics for Dependent Diagnostic Tests Based on Latent Markov Models , 2000, Biometrics.

[30]  F. Bartolucci,et al.  A likelihood ratio test for $MTP_2$ within binary variables , 2000 .

[31]  Elja Arjas,et al.  Transmission of Pneumococcal Carriage in Families: A Latent Markov Process Model for Binary Longitudinal Data , 2000 .

[32]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[33]  S. L. Scott Bayesian Methods for Hidden Markov Models , 2002 .

[34]  Rolf Langeheine,et al.  Applied Latent Class Analysis: Latent Markov Chains , 2002 .

[35]  Peter C. M. Molenaar,et al.  Fitting hidden Markov models to psychological data , 2002, Sci. Program..

[36]  D. Titterington,et al.  Parameter estimation for hidden Markov chains , 2002 .

[37]  J. Koval,et al.  Latent mixed Markov modelling of smoking transitions using Monte Carlo bootstrapping , 2003, Statistical methods in medical research.

[38]  Ab Mooijaart,et al.  Latent Markov Modelling of Recidivism Data , 2003 .

[39]  J. Hagenaars,et al.  Methods in Human Growth Research: Ordinal longitudinal data analysis , 2004 .

[40]  Ning-Zhong Shi,et al.  The restricted EM algorithm under inequality restrictions on the parameters , 2005 .

[41]  Francesco Bartolucci,et al.  Likelihood inference on the underlying structure of IRT models , 2005 .

[42]  Neil Henry Latent structure analysis , 1969 .

[43]  Deniz Senturk-Doganaksoy,et al.  Explanatory Item Response Models: A Generalized Linear and Nonlinear Approach , 2006, Technometrics.

[44]  Athanasios C. Micheas,et al.  Constrained Statistical Inference: Inequality, Order, and Shape Restrictions , 2006 .

[45]  Francesco Bartolucci,et al.  Maximum Likelihood Estimation of an Extended Latent Markov Model for Clustered Binary Panel Data , 2007, Comput. Stat. Data Anal..

[46]  Francesco Bartolucci,et al.  A latent Markov model for detecting patterns of criminal activity , 2007 .

[47]  H. Holzmann,et al.  Likelihood Ratio Testing for Hidden Markov Models Under Non‐standard Conditions , 2008 .

[48]  P. Deb Finite Mixture Models , 2008 .