Incidence of Missing Item Scores in Personality Measurement, and Simple Item-Score Imputation

The focus of this study was the incidence of different kinds of missing-data problems in personality research and the handling of these problems. Missing-data problems were reported in approximately half of more than 800 articles published in three leading personality journals. In these articles, unit nonresponse, attrition, and planned missingness were distinguished but missing item scores in trait measurement were reported most frequently. Listwise deletion was the most frequently used method for handling all missing-data problems. Listwise deletion is known to reduce the accuracy of parameter estimates and the power of statistical tests and often to produce biased statistical analysis results. This study proposes a simple alternative method for handling missing item scores, known as two-way imputation, which leaves the sample size intact and has been shown to produce almost unbiased results based on multi-item questionnaire data.

[1]  Robert J. Mislevy,et al.  INFERRING EXAMINEE ABILITY WHEN SOME ITEM RESPONSES ARE MISSING , 1988 .

[2]  J. Mcardle,et al.  Psychometric properties of the Hawaiian Culture Scale--Adolescent Version. , 2000, Psychological assessment.

[3]  Klaas Sijtsma,et al.  Multiple imputation for item scores when test data are factorially complex. , 2007, The British journal of mathematical and statistical psychology.

[4]  Russell V. Lenth,et al.  Statistical Analysis With Missing Data (2nd ed.) (Book) , 2004 .

[5]  J. Vermunt,et al.  9. Multiple Imputation of Incomplete Categorical Data Using Latent Class Analysis , 2008 .

[6]  Klaas Sijtsma,et al.  Investigation and Treatment of Missing Item Scores in Test and Questionnaire Data , 2003, Multivariate behavioral research.

[7]  Niels Keiding,et al.  Statistical Models Based on Counting Processes , 1993 .

[8]  Jeroen K. Vermunt,et al.  Two-way imputation: A Bayesian method for estimating missing scores in tests and questionnaires, and an accurate approximation , 2007, Comput. Stat. Data Anal..

[9]  Jae-On Kim,et al.  The Treatment of Missing Data in Multivariate Analysis , 1977 .

[10]  Yang C. Yuan,et al.  Multiple Imputation for Missing Data: Concepts and New Development , 2000 .

[11]  A. Dueck,et al.  Handling missing data. , 2005, Current problems in cancer.

[12]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[13]  Paul M. Salkovskis,et al.  The Validation of a New Obsessive-Compulsive Disorder Scale: The Obsessive-Compulsive Inventory , 1998 .

[14]  D. Watson,et al.  Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS). , 2007, Psychological assessment.

[15]  Mark Shevlin,et al.  Alternative factor models and factorial invariance of the GHQ-12: a large sample analysis using confirmatory factor analysis. , 2005, Psychological assessment.

[16]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[17]  N. Verhelst,et al.  Item calibration in incomplete testing designs , 2011 .

[18]  van der Ark,et al.  Multiple Imputation of Item Scores in Test and Questionnaire Data, and Influence on Psychometric Results , 2007, Multivariate behavioral research.

[19]  Joop J. Hox,et al.  The effects of response stimulating factors on response rates and data quality in mail surveys. A test of Dillman's Total design Method , 1988 .

[20]  John M. Abowd,et al.  Multiple Imputation , 2009, Encyclopedia of Database Systems.

[21]  Frederick L Coolidge,et al.  Psychometric Properties of the Beck Depression Inventory—II (BDI-II) Among Community-Dwelling Older Adults , 2008, Behavior modification.

[22]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[23]  D. Altman,et al.  Missing data , 2007, BMJ : British Medical Journal.

[24]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[25]  Stef van Buuren,et al.  Item Imputation Without Specifying Scale Structure , 2010 .

[26]  Aristide Saggino,et al.  Item factor analysis of the Italian version of the Myers-Briggs type indicator , 1995 .

[27]  Y. Haitovsky.  Missing Data in Regression Analysis , 1968 .

[28]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[29]  D. Dillman.  The Design and Administration of Mail Surveys , 1991 .

[30]  K Sijtsma,et al.  Influence of Imputation and EM Methods on Factor Analysis when Item Nonresponse in Questionnaire Data is Nonignorable , 2000, Multivariate behavioral research.

[31]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[32]  T. Rundmo,et al.  Personality, risky driving and accident involvement among Norwegian drivers , 2002 .

[33]  C. Morin,et al.  The Beck Anxiety Inventory: Psychometric Properties with Older Adults , 1999 .

[34]  The clinical assessment of depression. , 1981, British journal of clinical pharmacology.

[35]  D G Altman,et al.  Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines , 2004, British Journal of Cancer.

[36]  D. E. Green,et al.  Do we need positive illusions to carry out plans? Illusion: and instrumental coping , 2000 .

[37]  Robert M. Groves,et al.  Nonresponse in Household Interview Surveys: Groves/Nonresponse , 1998 .

[38]  S. Maxwell,et al.  Structural differences in parent and child reports of children's symptoms of depression and anxiety. , 2000, Psychological assessment.

[39]  Mark Huisman,et al.  Handling Missing Data by Re-approaching Non-respondents , 1998 .

[40]  R. R. Abidin.  Psychological Assessment Resources , 1995 .

[41]  L. Andries van der Ark,et al.  SPSS Syntax for Missing Value Imputation in Test and Questionnaire Data , 2005 .

[42]  van der Ark,et al.  Mokken Scale Analysis in R , 2007 .