Improving measurement invariance assessments in survey research with missing data by novel artificial neural networks

This study proposes the learning vector quantization estimated stratum weight (LVQ-ESW) method to interpolate missing group membership and weights in identifying the accuracy of measurement invariance (MI) in a stratified sampling survey. Survey data is rife with missing information, such as gender and race, which is critical for identifying MI, and in ensuring that conclusions from large-scale testing campaigns are accurate. In the current study, simulations were conducted to examine the accuracy and consistency of MI detection using multiple-group confirmatory factor analysis (MG-CFA) to compare different approaches for interpolating missing information. The results of the computerized simulations showed that the proposed method outperformed traditional methods, such as List-wise deletion, in terms of accurately and stably identifying MI. The implications for interpolating missing group membership and weights for survey research are discussed.

[1]  Phillip W. Braddy,et al.  Power and sensitivity of alternative fit indices in tests of measurement invariance. , 2008, The Journal of applied psychology.

[2]  Craig K. Enders,et al.  Using an EM Covariance Matrix to Estimate Structural Equation Models With Missing Data: Choosing an Adjusted Sample Size to Improve the Accuracy of Inferences , 2004 .

[3]  Adam W. Meade,et al.  A Monte-Carlo Study of Confirmatory Factor Analytic Tests of Measurement Equivalence/Invariance , 2004 .

[4]  Miin-Shen Yang,et al.  A fuzzy-soft learning vector quantization for control chart pattern recognition , 2002 .

[5]  Seref Sagiroglu,et al.  Neural network classification of defects in veneer boards , 2000 .

[6]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[7]  C.-T. Su,et al.  A Neural Network-Based Approach for Statistical Probability Distribution Recognition , 2006 .

[8]  Craig K. Enders,et al.  The Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models , 2001 .

[9]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[10]  Chih-Chien Yang,et al.  Supervised learning vector quantization for projecting missing weights of hierarchical neural networks , 2010 .

[11]  Daniel J Bauer,et al.  The role of nonlinear factor-to-indicator relationships in tests of measurement equivalence. , 2005, Psychological methods.

[12]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[13]  Clifford C. Clogg,et al.  Handbook of statistical modeling for the social and behavioral sciences , 1995 .

[14]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[15]  Holmes Finch,et al.  The MIMIC Model as a Method for Detecting DIF: Comparison With Mantel-Haenszel, SIBTEST, and the IRT Likelihood Ratio , 2005 .

[16]  Gulzar A. Khuwaja,et al.  Data Acquisition and Recognition of Fingerprints with LVQ , 2003, Int. J. Comput. Intell. Appl..

[17]  Sharon L. Lohr,et al.  Sampling: Design and Analysis , 1999 .

[18]  R. Millsap,et al.  Evaluating the impact of partial factorial invariance on selection in two populations. , 2004, Psychological methods.

[19]  Carol M. Woods.  Please Scroll down for Article Multivariate Behavioral Research Evaluation of Mimic-model Methods for Dif Testing with Comparison to Two- Group Analysis , 2022 .

[20]  Frans J. Oort,et al.  Simulation study of item bias detection with restricted factor analysis , 1998 .

[21]  Xueli An,et al.  A new T-S fuzzy-modeling approach to identify a boiler-turbine system , 2010, Expert Syst. Appl..

[22]  Fevzullah Temurtas,et al.  Chest diseases diagnosis using artificial neural networks , 2010, Expert Syst. Appl..

[23]  Xianyi Zeng,et al.  Nonwoven uniformity identification using wavelet texture analysis and LVQ neural network , 2010, Expert Syst. Appl..

[24]  H. White.  Some Asymptotic Results for Learning in Single Hidden-Layer Feedforward Network Models , 1989 .

[25]  Albert Satorra,et al.  A scaled difference chi-square test statistic for moment structure analysis , 1999 .

[26]  Francisco Herrera,et al.  A study on the use of statistical tests for experimentation with neural networks: Analysis of parametric test conditions and non-parametric tests , 2007, Expert Syst. Appl..

[27]  Barbara M Byrne,et al.  Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. , 2002, The Journal of applied psychology.