Models for the Detection of Deviations from the Expected Processing Strategy in Completing the Items of Cognitive Measures

This paper presents confirmatory factor models with fixed factor loadings that enable the identification of deviations from the expected processing strategy. The instructions usually define the expected processing strategy to a considerable degree. Simplification is a deviation from instructions that is likely to occur in complex cognitive measures. Since simplification impairs the validity of the measure, its identification is important. Models representing simplicity and instruction-based processing strategies were considered in investigating the data of 345 participants obtained by a working memory measure in order to find out whether and how the use of these strategies influences model-data fit. As expected, the consideration of simplicity strategies improved the model-data fit achieved for the instruction-based strategy.

[1]  V. Savalei,et al.  Adjusting Incremental Fit Indices for Nonnormality , 2014, Multivariate behavioral research.

[2]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[3]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[4]  G. Enderlein.  Hawkins, D. M.: Identification of Outliers. Chapman and Hall, London – New York 1980, 188 S., £ 14, 50 , 1987 .

[5]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[6]  P. F. Jong,et al.  Attention and Intelligence: The Validity of the Star Counting Test. , 1995 .

[7]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[8]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[9]  A. C. Young,et al.  Factor Analysis of the Electrocardiogram: Test of Electrocardiographic Theory Normal Hearts , 1960, Circulation research.

[10]  A. Madansky.  Identification of Outliers , 1988 .

[11]  O. Hikosaka,et al.  Chunking during human visuomotor sequence learning , 2003, Experimental Brain Research.

[12]  Karl Schweizer.  Fixed-links models for investigating experimental effects combined with processing strategies in repeated measures designs: a cognitive task as example. , 2009, The British journal of mathematical and statistical psychology.

[13]  C. R. Rao,et al.  Some statistical methods for comparison of growth curves. , 1958 .

[14]  Henry L. Roediger,et al.  Research Methods in Psychology , 1985 .

[15]  J. Mcardle.  Latent variable modeling of differences and changes with longitudinal data. , 2009, Annual review of psychology.

[16]  Lawrence M. Rudner.  Biased Item Detection Techniques. , 1980 .

[17]  C. A. Baker,et al.  Differentiating Tower of Hanoi Performance: Interactive Effects of Psychopathic Tendencies, Impulsive Response Styles, and Modality , 2011, Applied neuropsychology.

[18]  J. Mcardle,et al.  Latent variable growth within behavior genetic models , 1986, Behavior genetics.

[19]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[20]  Lazar Stankov,et al.  Complexity, Metacognition, and Fluid Intelligence , 2000 .

[21]  K. Schweizer.  Investigating the relationship of working memory tasks and fluid intelligence tests by means of the fixed-links model in considering the impurity problem , 2007 .

[22]  Karl Schweizer,et al.  The Speed-Accuracy Transition Due to Task Complexity. , 1996 .

[23]  Richard P. Heitz,et al.  Complex working memory span tasks and higher-order cognition: A latent-variable analysis of the relationship between processing and storage , 2009, Memory.

[24]  K. Schweizer.  Scaling Variances of Latent Variables by Standardizing Loadings: Applications to Working Memory and the Position Effect , 2011, Multivariate behavioral research.

[25]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[26]  Patrick Perret,et al.  The influence of relational complexity and strategy selection on children's reasoning in the Latin Square Task , 2011 .

[27]  Sonya K. Sterba,et al.  Understanding Linkages Among Mixture Models , 2013, Multivariate behavioral research.

[28]  Akihito Kamata,et al.  An Introduction to Differential Item Functioning Analysis. , 2004 .

[29]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[30]  Ledyard R Tucker,et al.  Determination of parameters of a functional relation by factor analysis , 1958 .

[31]  The Fixed-Links Model in Combination With the Polynomial Function as a Tool for Investigating Choice Reaction Time Data , 2006 .

[32]  Elena G. Patsenko,et al.  How planful is routine behavior? A selective-attention model of performance in the Tower of Hanoi. , 2010, Journal of experimental psychology. General.

[33]  Michael Eid,et al.  Separating "Rotators" From "Nonrotators" in the Mental Rotations Test: A Multigroup Latent Class Analysis , 2006, Multivariate behavioral research.

[34]  Keith F Widaman,et al.  Investigating Factorial Invariance of Latent Variables Across Populations When Manifest Variables Are Missing Completely , 2013, Structural equation modeling : a multidisciplinary journal.

[35]  Dimitris Mavridis,et al.  Detecting Outliers in Factor Analysis Using the Forward Search Algorithm , 2008, Multivariate behavioral research.

[36]  L. A. Goodman.  Exploratory latent structure analysis using both identifiable and unidentifiable models , 1974 .

[37]  S. Reise,et al.  Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. , 1997 .

[38]  J. Tisak,et al.  Longitudinal Models of Reliability and Validity: A Latent Curve Approach , 1996 .

[39]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[40]  Alan D Baddeley,et al.  The complexities of complex span: explaining individual differences in working memory in children and adults. , 2003, Journal of experimental psychology. General.

[41]  K. Jöreskog.  Statistical analysis of sets of congeneric tests , 1971 .

[42]  Gregory R. Hancock,et al.  Latent Growth Modeling for Logistic Response Functions , 2009 .

[43]  Investigating Experimental Effects Within the Framework of Structural Equation Modeling: An Example With Effects on Both Error Scores and Reaction Times , 2008 .