Treatment Effects in Longitudinal Two-Method Measurement Planned Missingness Designs: An Application and Tutorial

Abstract Planned missing data designs allow researchers to have highly-powered studies by testing only a fraction of the traditional sample size. In two-method measurement planned missingness designs, researchers assess only part of the sample on a high-quality expensive measure, while the entire sample is given a more inexpensive, but biased measure. The present study focuses on a longitudinal application of the two-method planned missingness design. We provide evidence of the effectiveness of this design for fitting developmental data. Methodologically, we extend the framework for modeling an average treatment effect. Finally, we provide code and step-by-step instructions for how to analyze longitudinal, treatment effect data within these frameworks.

[1]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[2]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[3]  Mingyu Feng,et al.  Investigating Efficacy, Moderators and Mediators for an Online Mathematics Homework Intervention , 2020, Journal of Research on Educational Effectiveness.

[4]  Brenna K. Rivas,et al.  Intensive Intervention for Upper Elementary Students With Severe Reading Comprehension Difficulties , 2020, Journal of Research on Educational Effectiveness.

[5]  J. Squires,et al.  Revision of a parent-completed development screening tool: Ages and Stages Questionnaires. , 1997, Journal of pediatric psychology.

[6]  M. Eid,et al.  Modeling true intraindividual change: True change as a latent variable. , 1997 .

[7]  Mijke Rhemtulla,et al.  Planned Missing Data Designs for Developmental Researchers , 2013 .

[8]  Gregory R. Hancock,et al.  Planned Missing Data Designs in Educational Psychology Research , 2016 .

[9]  John W Graham,et al.  Planned missing data designs in psychological research. , 2006, Psychological methods.

[10]  J. Graham,et al.  Increasing the validity and efficiency of blood pressure estimates using ambulatory and clinic measurements and modern missing data methods. , 2012, American journal of hypertension.

[11]  J. Squires,et al.  The ASQ:SE user's guide: For the Ages & Stages Questionnaires: Social-emotional. , 2002 .

[12]  Patrick J Curran,et al.  Twelve Frequently Asked Questions About Growth Curve Modeling , 2010, Journal of cognition and development : official journal of the Cognitive Development Society.

[13]  John W. Graham.  Missing Data Theory , 2012 .

[14]  T. Little,et al.  Two-method planned missing designs for longitudinal research , 2014 .

[15]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[16]  R. Steyer.  Analyzing Individual and Average Causal Effects via Structural Equation Models , 2005 .

[17]  L. Titus,et al.  Two-method measurement for adolescent obesity epidemiology: reducing the bias in self-report of height and weight. , 2013, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[18]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[19]  D. R. Thomas,et al.  Difference Scores From the Point of View of Reliability and Repeated-Measures ANOVA , 2012 .

[20]  B. Shepherd,et al.  GUIDO IMBENS, DONALD RUBIN, Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. New York: Cambridge University Press. , 2016, Biometrics.

[21]  John W. Graham,et al.  Planned Missing Data Design 2: Two-Method Measurement , 2012 .

[22]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[23]  Jessica A. R. Logan,et al.  Print-Focused Read-Alouds in Early Childhood Special Education Programs , 2015 .

[24]  John O. Willis,et al.  Peabody Picture Vocabulary Test, Fourth Edition , 2014 .

[25]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[26]  P. Allison.  CHANGE SCORES AS DEPENDENT VARIABLES IN REGRESSION ANALYSIS , 1990 .

[27]  Mijke Rhemtulla,et al.  Planned Missing Data Designs for Research in Cognitive Development , 2012, Journal of cognition and development : official journal of the Cognitive Development Society.

[28]  Yaacov Petscher,et al.  A Simulation Study on the Performance of the Simple Difference and Covariance-Adjusted Scores in Randomized Experimental Designs. , 2011, Journal of educational measurement.

[29]  M. Masucci,et al.  The Effects of Two Mindset Interventions on Low-Income Students’ Academic and Psychological Outcomes , 2020 .

[30]  K. Bollen.  Latent variables in psychology and the social sciences. , 2002, Annual review of psychology.

[31]  Michael Puma,et al.  What to Do when Data Are Missing in Group Randomized Controlled Trials. NCEE 2009-0049. , 2009 .

[32]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[33]  T. Brown.  Confirmatory factor analysis for applied research, 2nd ed. , 2015 .

[34]  A. Satorra,et al.  Complex Sample Data in Structural Equation Modeling , 1995 .