A Semi-Hierarchical Confirmatory Factor Model for Speeded Data

ABSTRACT This paper presents the semi-hierarchical model for confirmatory factor analysis of speeded data. The semi-hierarchical model is achieved by integrating information from the second level of the hierarchical structure of speeded data into the customary confirmatory factor model. The second level of speeded data originates from subsets of participants responding on the basis of different sources. In the semi-hierarchical model, the contributions of the latent variables are modified to reflect characteristics of these subsets. Furthermore, the results of a simulation study comparing the semi-hierarchical model adapted to speeded data and the customary confirmatory factor model are reported. Whereas all the models yielded good model fit according to RMSEA and SRMR, differences between the models were signified by CFI and TLI. The semi-hierarchical model led to the better model fit in data showing noticeable speededness.

[1]  E. S. Kim,et al.  Investigating Sources of Heterogeneity with Three-Step Multilevel Factor Mixture Modeling: Beyond Testing Measurement Invariance in Cross-National Studies , 2018, Structural Equation Modeling: A Multidisciplinary Journal.

[2]  S. Troche,et al.  Does the Effect of a Time Limit for Testing Impair Structural Investigations by Means of Confirmatory Factor Models? , 2019, Educational and psychological measurement.

[3]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[4]  S. Troche,et al.  Speed Effect Analysis Using the CFA Framework , 2019, Front. Psychol..

[5]  Investigating Experimental Effects Within the Framework of Structural Equation Modeling: An Example With Effects on Both Error Scores and Reaction Times , 2008 .

[6]  William G. Mollenkopf,et al.  An experimental study of the effects on item-analysis data of changing item placement and test time limit , 1950 .

[7]  Does Speededness in Collecting Reasoning Data Lead to a Speed Factor? , 2020 .

[8]  D. Campbell,et al.  The effect of ordinal position upon responses to items in a check list. , 1950 .

[9]  Rianne Janssen,et al.  Modeling Item-Position Effects Within an IRT Framework , 2012 .

[10]  J. Mcardle.  Latent variable modeling of differences and changes with longitudinal data. , 2009, Annual review of psychology.

[11]  A Comparison of Confirmatory Factor Analysis of Binary Data on the Basis of Tetrachoric Correlations and of Probability-Based Covariances: A Simulation Study , 2015 .

[12]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[13]  H. Fischer.  A History of the Central Limit Theorem , 2011 .

[14]  Roderick P. McDonald,et al.  DIFFICULTY FACTORS IN BINARY DATA , 1974 .

[15]  Paul De Boeck,et al.  How Much Power and Speed Is Measured in This Test? , 2013, Assessment.

[16]  T. C. Oshima.  The Effect of Speededness on Parameter Estimation in Item Response Theory , 1994 .

[17]  Johannes Hartig,et al.  A Confirmatory Analysis of Item Reliability Trends (CAIRT): Differentiating True Score and Error Variance in the Analysis of Item Context Effects , 2007, Multivariate behavioral research.

[18]  Y. Rosseel,et al.  Assessing Fit in Structural Equation Models: A Monte-Carlo Evaluation of RMSEA Versus SRMR Confidence Intervals and Tests of Close Fit , 2018 .

[19]  K. Schweizer,et al.  Do Adaptive Representations of the Item-Position Effect in APM Improve Model Fit? A Simulation Study , 2017, Educational and psychological measurement.

[20]  L. Poundie Burstein.  Chapter 4: The Analysis of Multilevel Data in Educational Research and Evaluation , 1980 .

[21]  J. Lucke.  The α and the ω of Congeneric Test Theory: An Extension of Reliability and Internal Consistency to Heterogeneous Tests , 2005 .

[22]  M. Davison,et al.  Spontaneous and imposed speed of cognitive test responses , 2017, The British journal of mathematical and statistical psychology.

[23]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[24]  J. H. Lozano.  Are impulsivity and intelligence truly related constructs? Evidence based on the fixed-links model , 2015 .

[25]  R. Mcdonald.  DIFFICULTY FACTORS AND NON-LINEAR FACTOR ANALYSIS. , 1965, The British journal of mathematical and statistical psychology.