Reporting and handling missing values in clinical studies in intensive care units

IntroductionMissing values occur in nearly all clinical studies, despite the best efforts of the investigators, and cause frequently unrecognised biases. Our aims were (1) to assess the reporting and handling of missing values in the critical care literature; (2) to describe the impact of various techniques for handling missing values on the study results; (3) to provide guidance on the management of clinical study analysis in case of missing data.MethodsWe reviewed 44 published manuscripts in three critical care research journals. We used the Conflicus study database to illustrate how to handle missing values.ResultsAmong 44 published manuscripts, 16 (36.4 %) provided no information on whether missing data occurred, 6 (13.6 %) declared having no missing data, 20 (45.5 %) reported that missing values occurred but did not handle them and only 2 (4.5 %) used sophisticated missing data handling methods. In our example using the Conflicus study database, we evaluated correlations linking job strain intensity to the type and proportion of missing values. Overall, 8 % of data were missing; however, using only complete cases would have resulted in discarding 24 % of the questionnaires. A greater number and a higher percentage of missing values for a particular variable were significantly associated with a lower job strain score (indicating greater stress). Among respondents who fully completed the job strain questionnaire, the comparison of those whose questionnaires did and did not have missing values showed significant differences in terms of age, number of children and country of birth. We provided an algorithm to manage clinical studies analysis in case of missing data.ConclusionMissing data are common and generate interpretation biases. They should be reported routinely and taken into account when modelling data from clinical studies.

[1]  S J Pocock,et al.  Impact of missing data due to drop‐outs on estimators for rates of change in longitudinal studies: a simulation study , 2001, Statistics in medicine.

[2]  Roger A. Sugden,et al.  Multiple Imputation for Nonresponse in Surveys , 1988 .

[3]  C. Sprung,et al.  Prevalence and factors of intensive care unit conflicts: the conflicus study. , 2009, American journal of respiratory and critical care medicine.

[4]  A Ahlbom,et al.  Job decision latitude, job demands, and cardiovascular disease: a prospective study of Swedish men. , 1981, American journal of public health.

[5]  G. King,et al.  Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation , 2001, American Political Science Review.

[6]  R. Little,et al.  The prevention and treatment of missing data in clinical trials. , 2012, The New England journal of medicine.

[7]  A. Roman,et al.  New Concepts in the Invasive and Non Invasive Evaluation of Remodelling of the Right Ventricle and Pulmonary Vasculature in Pulmonary Arterial Hypertension , 2009, The open respiratory medicine journal.

[8]  Preston King,et al.  Worlds of Difference: European Discourses of Toleration, c. 1100–1550. By Cary J. Nederman. University Park: Pennsylvania State University Press, 2000. 157p. $40.00 cloth, $18.95 paper. , 2001, American Political Science Review.

[9]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[10]  M. Man-Son-Hing,et al.  Have last-observation-carried-forward analyses caused us to favour more toxic dementia therapies over less toxic alternatives? A systematic review , 2009, Open medicine : a peer-reviewed, independent, open-access journal.

[11]  Joseph G Ibrahim,et al.  Missing data in clinical studies: issues and methods. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  Andrew Gelman,et al.  Diagnostics for multivariate imputations , 2007 .

[13]  Douglas G Altman,et al.  Missing outcomes in randomized trials: addressing the dilemma , 2009, Open medicine : a peer-reviewed, independent, open-access journal.