Using Multilevel Mixture Models in Educational Research: An Illustration with Homework Research

Abstract The present study illustrates the utility of applying multilevel mixture models in educational research, using data on the homework behavior of 1,812 Swiss eighth-grade students in French as a second language. A previous person-centered study identified 5 homework learning types characterized by different patterns of high or low homework time and effort. Via multilevel latent profile analyses (MLPAs), the dependence of homework learning types on between-classroom differences was investigated. Based on the proportions of homework learning profiles across classrooms, 3 class-level profiles were identified: A “low time”, “high time” and an “average” profile. Predictors of the latent profiles at the student and class levels were assessed. The study offers insights into the advantages of multilevel mixture models for educational research.

[1]  Scott L. Thomas,et al.  Multilevel Mixture Models , 2015 .

[2]  Bengt Muthén,et al.  Multilevel Latent Class Analysis: An Application of Adolescent Smoking Typologies With Individual and Contextual Predictors , 2010, Structural equation modeling : a multidisciplinary journal.

[3]  S. Wormington,et al.  Profiles of Intrinsic and Extrinsic Motivations in Elementary School: A Longitudinal Analysis , 2014 .

[4]  Xitao Fan,et al.  Modeling Unobserved Heterogeneity Using Latent Profile Analysis: A Monte Carlo Simulation , 2013 .

[5]  Ulrich Trautwein,et al.  Please Scroll down for Article Structural Equation Modeling: a Multidisciplinary Journal Classical Latent Profile Analysis of Academic Self-concept Dimensions: Synergy of Person-and Variable-centered Approaches to Theoretical Models of Self-concept , 2022 .

[6]  Ulrich Trautwein,et al.  Between-teacher differences in homework assignments and the development of students' homework effort, homework emotions, and achievement. , 2009 .

[7]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[8]  Katherine E. Masyn,et al.  General Growth Mixture Analysis with Antecedents and Consequences of Change , 2010 .

[9]  W. Holmes Finch,et al.  Academic and social achievement goals and early adolescents' adjustment: A latent class approach , 2014 .

[10]  Markku Niemivirta,et al.  Achievement Goal Orientations and Subjective Well-Being: A Person-Centred Analysis. , 2008 .

[11]  Harris Cooper,et al.  Parent Involvement in Homework: A Research Synthesis , 2008 .

[12]  Fritz Drasgow,et al.  Multilevel Mixed-Measurement IRT Analysis: An Explication and Application to Self-Reported Emotions Across the World , 2011 .

[13]  Lisa Linnenbrink-Garcia,et al.  A New Look at Multiple Goal Pursuit: the Promise of a Person-Centered Approach , 2017 .

[14]  Richard P. Reed,et al.  Parental Involvement in Homework , 2001 .

[15]  Ulrich Trautwein,et al.  Quality of parental homework involvement: Predictors and reciprocal relations with academic functioning in the reading domain. , 2014 .

[16]  Jianzhong Xu,et al.  Predicting homework time management at the secondary school level: A multilevel analysis , 2010 .

[17]  Christophe Maïano,et al.  General Growth Mixture Analysis of Adolescents' Developmental Trajectories of Anxiety: The Impact of Untested Invariance Assumptions on Substantive Interpretations , 2011 .

[18]  Ulrich Trautwein,et al.  The Relationship Between Homework and Achievement—Still Much of a Mystery , 2003 .

[19]  Ulrich Trautwein,et al.  Chameleon effects in homework research: The homework-achievement association depends on the measures used and the level of analysis chosen , 2009 .

[20]  John P. Meyer,et al.  Multiple-Group Analysis of Similarity in Latent Profile Solutions , 2016 .

[21]  Jens B. Asendorpf,et al.  Person-Centered APProAChes to PersonAlity , 2015 .

[22]  Stephanie T. Lanza,et al.  Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences , 2009 .

[23]  Daniel J Bauer,et al.  The integration of continuous and discrete latent variable models: potential problems and promising opportunities. , 2004, Psychological methods.

[24]  Ulrich Trautwein,et al.  Predicting Homework Effort: Support for a Domain-Specific, Multilevel Homework Model. , 2006 .

[25]  Willem J. Heiser,et al.  Multilevel Latent Class Analysis for Large-Scale Educational Assessment Data: Exploring the Relation Between the Curriculum and Students’ Mathematical Strategies , 2016 .

[26]  J. Bempechat,et al.  The Motivational Benefits of Homework: A Social-Cognitive Perspective , 2004 .

[27]  José Carlos Núñez,et al.  Teachers’ Feedback on Homework, Homework-Related Behaviors, and Academic Achievement , 2015 .

[28]  Ulrich Trautwein,et al.  The Janus-faced nature of time spent on homework: Using latent profile analyses to predict academic achievement over a school year , 2015 .

[29]  Harris Cooper,et al.  Homework for All--in Moderation. , 2001 .

[30]  Jacquelynne S. Eccles,et al.  Development of Achievement Motivation and Engagement , 2015 .

[31]  W. Holmes Finch,et al.  Multilevel Latent Class Analysis: Parametric and Nonparametric Models , 2014 .

[32]  José Muñiz,et al.  Adolescents' Homework Performance in Mathematics and Science: Personal Factors and Teaching Practices , 2015 .

[33]  J. Vermunt,et al.  Latent class and finite mixture models for multilevel data sets , 2008, Statistical methods in medical research.

[34]  Daniel L. Oberski.  Beyond the number of classes: separating substantive from non-substantive dependence in latent class analysis , 2015, Advances in Data Analysis and Classification.

[35]  Gary Natriello,et al.  Performance Standards, Student Effort on Homework, and Academic Achievement. , 1986 .

[36]  Jianzhong Xu,et al.  Self-Regulation of Homework Behavior: Homework Management at the Secondary School Level , 2013 .

[37]  Mingyu Feng,et al.  Online Mathematics Homework Increases Student Achievement , 2016 .

[38]  Jianzhong Xu,et al.  A study of the validity and reliability of the Teacher Homework Involvement Scale: A psychometric evaluation , 2016 .

[39]  Tim Croudace,et al.  A comparison of approaches for assessing covariate effects in latent class analysis , 2015 .

[40]  Kaisa Aunola,et al.  Multilevel Latent Profile Analysis With Covariates , 2018 .

[41]  L. Corno,et al.  Looking at Homework Differently , 2000, The Elementary School Journal.

[42]  Jay Magidson,et al.  Technical Guide for Latent GOLD 5.1: Basic, Advanced, and Syntax 1 , 2016 .

[43]  Alexandre J. S. Morin,et al.  A Multifoci Person-Centered Perspective on Workplace Affective Commitment: A Latent Profile/Factor Mixture Analysis , 2011 .

[44]  Minjung Kim,et al.  Impact of an equality constraint on the class-specific residual variances in regression mixtures: A Monte Carlo simulation study , 2015, Behavior Research Methods.

[45]  Ulrich Trautwein,et al.  Effort on homework in grades 5-9: development, motivational antecedents, and the association with effort on classwork. , 2006, Child development.

[46]  Jeroen K. Vermunt,et al.  6. The Simultaneous Decision(s) about the Number of Lower- and Higher-Level Classes in Multilevel Latent Class Analysis , 2010 .

[47]  E. Pomerantz,et al.  The How, Whom, and Why of Parents’ Involvement in Children’s Academic Lives: More Is Not Always Better , 2007 .

[48]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[49]  José Carlos Núñez,et al.  Does homework design matter? The role of homework's purpose in student mathematics achievement , 2015 .

[50]  Ulrich Trautwein,et al.  A person-centered approach to homework behavior: Students’ characteristics predict their homework learning type , 2017 .

[51]  Minjung Kim,et al.  Using Multilevel Regression Mixture Models to Identify Level-1 Heterogeneity in Level-2 Effects , 2016, Structural equation modeling : a multidisciplinary journal.

[52]  Ulrich Trautwein,et al.  The homework–achievement relation reconsidered: Differentiating homework time, homework frequency, and homework effort , 2007 .

[53]  Ulrich Trautwein,et al.  The relationship between homework time and achievement is not universal: evidence from multilevel analyses in 40 countries , 2009 .

[54]  Angela D. Bryan,et al.  Confirmatory Latent Class Analysis , 2018 .

[55]  K. Bollen,et al.  Improper Solutions in Structural Equation Models , 2001 .

[56]  E. Gonida,et al.  Parental involvement in homework: relations with parent and student achievement-related motivational beliefs and achievement. , 2014, The British journal of educational psychology.

[57]  M. Kunter,et al.  Teachers' occupational well-being and quality of instruction: The important role of self-regulatory patterns , 2008 .

[58]  Ulrich Trautwein,et al.  The Role of Family Characteristics for Students' Academic Outcomes: A Person-Centered Approach. , 2018, Child development.

[59]  Willy Lens,et al.  Motivational Profiles from a Self-Determination Perspective: The Quality of Motivation Matters. , 2009 .

[60]  Jaehoon Lee,et al.  Ignoring Clustering in Confirmatory Factor Analysis: Some Consequences for Model Fit and Standardized Parameter Estimates , 2014, Multivariate behavioral research.

[61]  Ellen A. Skinner,et al.  Perceived control, effort, and academic performance: Interindividual, intraindividual, and multivariate time-series analyses. , 1993 .

[62]  Dena A. Pastor,et al.  A latent profile analysis of college students’ achievement goal orientation , 2007 .

[63]  W. Holmes Finch,et al.  Application of Multilevel Latent Class Analysis to Identify Achievement and Socio-Economic Typologies in the 20 Wealthiest Countries , 2013 .

[64]  Marcos Álvarez-Díaz,et al.  Students' Achievement and Homework Assignment Strategies , 2017, Front. Psychol..

[65]  John P. Meyer,et al.  A person‐centered approach to commitment research: Theory, research, and methodology , 2016 .

[66]  Jeroen K. Vermunt,et al.  7. Multilevel Latent Class Models , 2003 .

[67]  Pamela M. Warton,et al.  The Forgotten Voices in Homework: Views of Students , 2001 .