Comparing Different Planned Missingness Designs in Longitudinal Studies

Planned Missingness (PM) designs, in which researchers deliberately collect only partial data, have enjoyed a recent growth in popularity. Among other benefits these designs have been proven capable of reducing the study costs and alleviating participant burden. Past research has shown that Split Form PM designs can be effective in simplifying complex surveys while Wave Missingness PM designs act similarly for Longitudinal studies. However, less work has been done to inform how to implement PM structures into studies which incorporate elements of both survey and longitudinal designs. Specifically, in studies where a questionnaire is given to participants at multiple measurement occasions the best way to design missingness is still unclear. To address this deficiency, data in this hybrid format was simulated under both Split Form and Wave Missingness PM structures. Multiple imputation techniques were applied to estimate a multilevel logistic model in each of the simulations. Estimated parameters were compared to the true values to see which PM design allowed us to best capture the true model. The results of this study indicate that, compared to the Split Form Design, the Wave Missingness design consistently performed less effectively in capturing the multilevel model. Thus, in the context of longitudinal surveys this study recommends the use of Split Form missingness designs, which performs well under a number of different conditions.

[1]  O. Harel,et al.  Designed missingness to better estimate efficacy of behavioral studies-application to suicide prevention trials , 2015 .

[2]  R. Carroll,et al.  The partial questionnaire design for case-control studies. , 1994, Statistics in medicine.

[3]  D P MacKinnon,et al.  Maximizing the Usefulness of Data Obtained with Planned Missing Value Patterns: An Application of Maximum Likelihood Procedures. , 1996, Multivariate behavioral research.

[4]  T. Little Longitudinal Structural Equation Modeling , 2013 .

[5]  Paul J. Silvia,et al.  Planned missing-data designs in experience-sampling research: Monte Carlo simulations of efficient designs for assessing within-person constructs , 2014, Behavior research methods.

[6]  Jennifer A. Pellowski,et al.  Alcohol-antiretroviral therapy interactive toxicity beliefs and daily medication adherence and alcohol use among people living with HIV , 2016, AIDS care.

[7]  S. Kalichman,et al.  Prevalence and clinical implications of interactive toxicity beliefs regarding mixing alcohol and antiretroviral therapies among people living with HIV/AIDS. , 2009, AIDS patient care and STDs.

[8]  T. Raghunathan,et al.  An Evaluation of Matrix Sampling Methods Using Data from the National Health and Nutrition Examination Survey , 2006 .

[9]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[10]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[11]  John J. McArdle,et al.  Expanding test–retest designs to include developmental time-lag components. , 1997 .

[12]  David M. Shoemaker,et al.  Principles and procedures of multiple matrix sampling. , 1973 .

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  Craig K. Enders,et al.  A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries , 2012 .

[15]  Ofer Harel,et al.  Inferences on missing information under multiple imputation and two-stage multiple imputation , 2007 .

[16]  Willem E. Saris,et al.  8. A New Approach to Evaluating the Quality of Measurement Instruments: The Split-Ballot MTMM Design , 2004 .

[17]  J. Graham,et al.  How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory , 2007, Prevention Science.

[18]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[19]  J. Schafer,et al.  A comparison of inclusive and restrictive strategies in modern missing data procedures. , 2001, Psychological methods.

[20]  Victoria Savalei,et al.  On the Asymptotic Relative Efficiency of Planned Missingness Designs , 2014, Psychometrika.

[21]  S. Kalichman,et al.  Alcohol and Adherence to Antiretroviral Medications: Interactive Toxicity Beliefs Among People Living With HIV , 2012, The Journal of the Association of Nurses in AIDS Care : JANAC.

[22]  John W Graham,et al.  Planned missing data designs in psychological research. , 2006, Psychological methods.

[23]  Fan Jia,et al.  Planned missing designs to optimize the efficiency of latent growth parameter estimates , 2014 .

[24]  Xiao-Hua Zhou,et al.  Multiple imputation: review of theory, implementation and software , 2007, Statistics in medicine.

[25]  Mijke Rhemtulla,et al.  Planned Missing Data Designs for Developmental Researchers , 2013 .

[26]  L. Zeger,et al.  Efficient Matrix Sampling Instruments for Correlated Latent Traits: Examples from the National Assessment of Educational Progress , 1997 .

[27]  John W. Graham,et al.  Planned missing-data designs in analysis of change. , 2001 .

[28]  Terry E. Duncan,et al.  An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Application, Second Edition , 1999 .

[29]  Kenneth A. Sirotnik,et al.  INCIDENCE SAMPLING: AN INTEGRATED THEORY FOR “MATRIX SAMPLING” , 1977 .

[30]  Gary King,et al.  Logistic Regression in Rare Events Data , 2001, Political Analysis.

[31]  D. Milton,et al.  Partial questionnaire designs, questionnaire non‐response, and attributable fraction: applications to adult onset asthma , 2006, Statistics in medicine.

[32]  Trivellore E. Raghunathan,et al.  Missing Data Analysis in Practice , 2015 .

[33]  Trivellore E. Raghunathan,et al.  A Split Questionnaire Survey Design , 1995 .