Modeling latent true scores to determine the utility of aggregate student perceptions as classroom indicators in HLM: The case of classroom goal structures

Abstract Measures of classroom climate such as classroom goal structures are often assessed through students’ perceptions; the aggregated means within classrooms are then sometimes labeled as “classroom characteristics.” The validity of these constructs is limited by the reliability of the measure at both the student and classroom level; yet, few studies accurately assess reliability when multilevel models are used. We demonstrate the use of a three-level hierarchical linear model to estimate latent true score measures of students’ perceptions of goal structures, appropriately adjusted for their nested structure. To investigate the distinctiveness of goal structures from teacher characteristics, we examined the inter-correlations among the student and classroom level variables, and predictors of each.

[1]  Margaret H. Gheen,et al.  Classroom goal structure and student disruptive behaviour. , 2002, The British journal of educational psychology.

[2]  Carole A. Ames,et al.  Achievement Goals in the Classroom: Students' Learning Strategies and Motivation Processes , 1988 .

[3]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[4]  J. Eccles,et al.  Adolescents' Perceptions of Middle School: Relation to Longitudinal Changes in Academic and Psychological Adjustment , 1998 .

[5]  H. Patrick.  RE-EXAMINING CLASSROOM MASTERY GOAL STRUCTURE , 2004 .

[6]  J. Eccles,et al.  INTERPERSONAL RELATIONS AND GROUP PROCESSES Teacher Expectations II: Construction and Reflection of Student Achievement , 2004 .

[7]  Eric M. Anderman,et al.  Motivation and Cheating During Early Adolescence , 1998 .

[8]  Eric M. Anderman,et al.  Motivation and strategy use in science: Individual differences and classroom effects , 1994 .

[9]  C. Midgley,et al.  Change in Teacher Efficacy and Student Self- and Task-Related Beliefs in Mathematics During the Transition to Junior High School , 1989 .

[10]  Sarah Lord,et al.  What Are We Doing to Early Adolescents? The Impact of Educational Contexts on Early Adolescents , 1991, American Journal of Education.

[11]  T. Murdock,et al.  Predictors of Cheating among Early Adolescents: Academic and Social Motivations. , 2001, Contemporary educational psychology.

[12]  T. Urdan.  Using Multiple Methods to Assess Students' Perceptions of Classroom Goal Structures , 2004 .

[13]  Diane M. Christophel,et al.  Students' perceptions of teacher behaviors as motivating and demotivating factors in college classes , 1992 .

[14]  Andrew J. Elliot,et al.  Perceptions of Classroom Environment, Achievement Goals, and Achievement Outcomes. , 2001 .

[15]  C. Dweck,et al.  Goals: an approach to motivation and achievement. , 1988, Journal of personality and social psychology.

[16]  Lynley H. Anderman.  Classroom goal orientation, school belonging and social goals as predictors of students' positive and negative affect following the transition to middle school. , 1999 .

[17]  E. Skinner,et al.  Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. , 1993 .

[18]  Eric M. Anderman,et al.  Learning to Value Mathematics and Reading: Relations to Mastery and Performance-Oriented Instructional Practices. , 2001, Contemporary educational psychology.

[19]  M. Maehr,et al.  Achievement Goals and Student Well-Being. , 1999, Contemporary educational psychology.

[20]  Eric M. Anderman,et al.  The classroom environment and students' reports of avoidance strategies in mathematics: A multimethod study. , 2002 .

[21]  Stuart A. Karabenick,et al.  Perceived Achievement Goal Structure and College Student Help Seeking. , 2004 .

[22]  Eric M. Anderman,et al.  The Role of Classroom Goal Structure in Students’ Use of Self-Handicapping Strategies , 1998 .

[23]  Carol Midgley,et al.  Perceptions of the school psychological environment and early adolescents' psychological and behavioral functioning in school: The mediating role of goals and belonging. , 1996 .

[24]  Stephen W. Raudenbush,et al.  1. Ecometrics: Toward a Science of Assessing Ecological Settings, with Application to the Systematic Social Observation of Neighborhoods , 1999 .

[25]  Lynley H. Anderman.  Academic and Social Perceptions as Predictors of Change in Middle School Students' Sense of School Belonging , 2003 .

[26]  Thomas M. Haladyna,et al.  Personal and environmental influences on students' beliefs about effective study strategies , 1990 .

[27]  Paul R. Pintrich,et al.  Motivating students, improving schools : the legacy of Carol Midgley , 2004 .

[28]  Stephen W. Raudenbush,et al.  A Multilevel, Multivariate Model for Studying School Climate With Estimation Via the EM Algorithm and Application to U.S. High-School Data , 1991 .

[29]  S. Raudenbush,et al.  Measurement and structural models for children's problem behaviors. , 2000, Psychological methods.

[30]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[31]  W. Hoy,et al.  Prospective Teachers' Sense of Efficacy and Beliefs About Control , 1990 .

[32]  C. Midgley,et al.  The relationship between perceptions of the classroom goal structure and early adolescents' affect in school: The mediating role of coping strategies , 1999 .

[33]  Myron H. Dembo,et al.  Teacher efficacy: A construct validation. , 1984 .

[34]  A. Ryan,et al.  Why do some students avoid asking for help? An examination of the interplay among students' academic efficacy, teachers' social–emotional role, and the classroom goal structure. , 1998 .

[35]  Carole A. Ames.  Classrooms: Goals, structures, and student motivation. , 1992 .

[36]  Eric M. Anderman,et al.  Differences between Elementary and Middle School Teachers and Students: A Goal Theory Approach , 1995 .

[37]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[38]  A. Young.  I think, therefore I'm motivated: The relations among cognitive strategy use, motivational orientation and classroom perceptions over time , 1997 .

[39]  C. Wolters.  Advancing Achievement Goal Theory: Using Goal Structures and Goal Orientations to Predict Students' Motivation, Cognition, and Achievement. , 2004 .