Examining school context and its influence on teachers: linking Talis 2013 with PISA 2012 student data

The Organisation for Economic Cooperation and Development (OECD) has linked data from the Teaching and Learning International Survey (TALIS) of teachers of 15-year-old students with school-level data from the Programme for International Student Assessment (PISA), a survey of 15-year-old students. The purpose of this study is to present an exploratory analysis of the combined TALIS-PISA data by examining the relationship of school-level student measures to teacher outcomes. In other words, this paper examines how student factors in a school may influence teachers’ work, their attitudes, and their perceived needs for support. Survey responses were collected from teachers and students in eight countries. Data from 26 610 teachers were combined with student measures, aggregated by school, from 103 077 students. Regression, hierarchical linear and multilevel models were used to analyse the data. Teacher outcomes that were modelled included professional development, collaboration, and self-efficacy. Student measures included attitudes about math and school, PISA math achievement, and Economic, Social and Cultural Status (ESCS). Interactions involving teacher measures such as gender and years of experience crossed with student outcomes were examined. Separate models for mathematics teachers were also explored. Findings varied dramatically across countries, and many significant differences were found between male and female teachers as well as between mathematics and all teachers. The paper concludes with practical implications of the research. L’Organisation de Cooperation et de Developpement Economiques (OCDE) a rapproche les donnees de l’Enquete internationale sur l'enseignement et l'apprentissage (TALIS), menee aupres d’enseignants ayant des eleves de 15 ans, de celles recueillies dans les etablissements aupres d’eleves âges de 15 ans dans le cadre du Programme international pour le suivi des acquis des eleves (PISA). Cette etude a pour but de presenter une analyse exploratoire des donnees combinees de TALIS-PISA en examinant le lien qui existe entre les reponses des eleves au niveau des etablissements et celles des enseignants. En d’autres termes, le present document examine comment les facteurs lies aux eleves dans un etablissement peuvent influencer la pratique professionnelle des enseignants, leurs attitudes et l’aide dont ils estiment avoir besoin. Les reponses aux enquetes ont ete recueillies aupres d’enseignants et d’eleves dans huit pays. Les donnees relatives a 26 610 enseignants ont ete associees aux reponses fournies par 103 077 eleves et regroupees par etablissement. Des modeles de regression, des modeles lineaires hierarchiques et des modeles multiniveaux ont ete utilises pour analyser les donnees. Parmi les indices des enseignants qui ont ete modelises figuraient le developpement professionnel, la collaboration et l’efficacite personnelle. Les indices des eleves portaient notamment sur les attitudes vis-a-vis des mathematiques et de l’ecole, les resultats PISA en mathematiques, et le statut economique, social et culturel (SESC). Ont egalement ete examinees les interactions entre les donnees relatives aux enseignants, comme le sexe et les annees d’experience, et les resultats des eleves. Des modeles distincts pour les professeurs de mathematiques ont egalement ete etudies. Les resultats etaient tres differents d’un pays a l’autre, et de nombreux ecarts importants ont ete observes entre les enseignants et les enseignantes mais aussi entre les professeurs de mathematiques et les autres. Pour conclure, le document expose les implications pratiques de ces travaux de recherche.

[1]  Philip D. Parker,et al.  Juxtaposing math self-efficacy and self-concept as predictors of long-term achievement outcomes , 2014 .

[2]  Teresa M. Petty,et al.  Relationships Between Student, Teacher, and School Characteristics and Mathematics Achievement , 2013 .

[3]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[4]  Peter A. Youngs,et al.  Teacher Characteristics and Student Achievement Gains: A Review , 2003 .

[5]  Deborah Holland,et al.  Motivation for Achievement: Possibilities for Teaching and Learning , 1999 .

[6]  Selcuk R. Sirin Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research , 2005 .

[7]  S. Nichols Teachers’ and Students’ Beliefs about Student Belonging in One Middle School , 2006, The Elementary School Journal.

[8]  K. Osterman Students' Need for Belonging in the School Community , 2000 .

[9]  D. Schanzenbach Does Class Size Matter , 2014 .

[10]  Esther López-Martín,et al.  Job satisfaction of secondary school teachers , 2015 .

[11]  Tracy A. Lavin,et al.  A Systematic Review and Meta-Analysis of the Cognitive Correlates of Bilingualism , 2010 .

[12]  J. Reeve A Self-determination Theory Perspective on Student Engagement , 2012 .

[13]  M. Bahr,et al.  Addressing the educational needs of boys , 2002 .

[14]  J. Oakes,et al.  Keeping Track: How Schools Structure Inequality. , 1986 .

[15]  E. Klieme,et al.  Teaching Practices and Pedagogical Innovations , 2012 .

[16]  L. Frehill,et al.  Professional women and minorities : a total human resources data compendium , 2008 .

[17]  Nancy I. Latham,et al.  Linking Preservice Teachers' Mathematics Self-Efficacy and Mathematics Teaching Efficacy to Their Mathematical Performance. , 2011 .

[18]  A. Berry The Relationship of Perceived Support to Satisfaction and Commitment for Special Education Teachers in Rural Areas , 2012 .

[19]  Lorna Earl,et al.  Toward an Evaluation Habit of Mind: Mapping the Journey. , 2005 .

[20]  Hsin-Yi Kung Perception or Confidence? Self-Concept, Self-Efficacy and Achievement in Mathematics: A Longitudinal Study , 2009 .

[21]  R. Chouinard,et al.  Teacher Beliefs as Predictors of Adolescents’ Cognitive Engagement and Achievement in Mathematics , 2012 .

[22]  Karen Akerhielm,et al.  Does class size matter , 1995 .

[23]  R. Weinstein,et al.  Teacher expectations, classroom context, and the achievement gap. , 2008, Journal of school psychology.

[24]  M. Chiu,et al.  The occupational commitment and intention to quit of practicing and pre-service teachers: Influence , 2011 .

[25]  C. Goldenberg,et al.  Teaching English Language Learners: What the Research Does - And Does Not - Say , 2008 .

[26]  C. Dweck,et al.  An Analysis of Learned Helplessness: Continuous Changes in Performance, Strategy, and Achievement Cognitions Following Failure. , 1978 .

[27]  J. Juvonen,et al.  The Role of Peer Relationships in Student Academic and Extracurricular Engagement , 2012 .

[28]  Philip G. Zimbardo,et al.  Prosocial Foundations of Children's Academic Achievement , 2000, Psychological science.

[29]  Ulrich Schiefele,et al.  Situational and individual interest. , 2009 .

[30]  Natasha M. Speer Connecting Beliefs and Practices: A Fine-Grained Analysis of a College Mathematics Teacher's Collections of Beliefs and Their Relationship to His Instructional Practices , 2008 .

[31]  E. Fruchart,et al.  Sources of stress, coping strategies, emotional experience: effects of the level of experience in primary school teachers in France , 2014 .

[32]  John Dunlosky,et al.  Improving Students’ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology , 2012 .

[33]  Susanna Loeb,et al.  School Size in Chicago Elementary Schools: Effects on Teachers' Attitudes and Students' Achievement , 2000 .

[34]  Peter Fredriksson,et al.  Long-Term Effects of Class Size , 2013, SSRN Electronic Journal.

[35]  Seth Brown,et al.  Middle School Mathematics Professional Development Impact Study Findings After the First Year of Implementation Executive Summary April 2010 , 2010 .

[36]  Raymond Miller,et al.  A Model of Future-Oriented Motivation and Self-Regulation , 2004 .

[37]  Angela L. Duckworth,et al.  Self-Discipline Outdoes IQ in Predicting Academic Performance of Adolescents , 2005, Psychological science.

[38]  A. Bandura The Explanatory and Predictive Scope of Self-Efficacy Theory , 1986 .

[39]  Adam Gamoran,et al.  Tracking and Inequality: New Directions for Research and Practice , 2009 .

[40]  B. Zimmerman,et al.  Handbook of Self-Regulation of Learning and Performance , 2011 .

[41]  A. Chudgar,et al.  The relationship between teacher gender and student achievement: evidence from five Indian states , 2008 .

[42]  Geoffrey D. Borman,et al.  Teacher Attrition and Retention: A Meta-Analytic and Narrative Review of the Research , 2008 .

[43]  E. Wegner,et al.  EDUCATIONAL PERFORMANCE AND ATTITUDES TOWARD SCHOOL AS RISK-PROTECTIVE FACTORS FOR VIOLENCE: A STUDY OF THE ASIAN/PACIFIC ISLANDER YOUTH VIOLENCE PREVENTION CENTER , 2010 .

[44]  A. Brown Non-Traditional Preservice Teachers and Their Mathematics Efficacy Beliefs , 2012 .

[45]  Josep Oriol Escardibul Ferrá,et al.  Teacher Gender and Student Performance In Mathematics. Evidence from Catalonia , 2013 .

[46]  M. Chiu,et al.  Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. , 2010 .

[47]  Caroline Guardino,et al.  Changing Behaviors by Changing the Classroom Environment , 2010 .

[48]  Megan Tschannen-Moran,et al.  The differential antecedents of self-efficacy beliefs of novice and experienced teachers. , 2007 .

[49]  T. Judge,et al.  The job satisfaction-job performance relationship: a qualitative and quantitative review. , 2001, Psychological bulletin.

[50]  Laura M. O’Dwyer,et al.  Impact of Online Professional Development or Teacher Quality and Student Achievement in Fifth Grade Mathematics , 2012 .

[51]  D. Stipek Context Matters , 2012, The Elementary School Journal.

[52]  Karen B. Givvin,et al.  Teachers' beliefs and practices related to mathematics instruction , 2001 .

[53]  Mathematics Teacher Change and Developments , 2002 .

[54]  Nancy E. Perry,et al.  Classrooms as Contexts for Motivating Learning , 2006 .

[55]  P. Tymms,et al.  Role models, school improvement and the ‘gender gap’—do men bring out the best in boys and women the best in girls?1 , 2008 .

[56]  E. Skaalvik,et al.  Dimensions of Teacher Self-Efficacy and Relations with Strain Factors, Perceived Collective Teacher Efficacy, and Teacher Burnout. , 2007 .

[57]  M. H. Shann Academics and a Culture of Caring: The Relationship Between School Achievement and Prosocial and Antisocial Behaviors in Four Urban Middle Schools , 1999 .

[58]  Yuanjie Cheng,et al.  Elementary resource room teachers' job stress and job satisfaction in Taoyuan County, Taiwan , 2010, Journal of intellectual & developmental disability.

[59]  Robert T. Jiménez,et al.  Developing Literacy in Second-Language Learners , 2009 .

[60]  George Philippou,et al.  ATTITUDES TOWARDS MATHEMATICS , SELF-EFFICACY AND ACHIEVEMENT IN PROBLEM - , 2003 .

[61]  E. Klieme,et al.  Teaching Practices and Pedagogical Innovations: Evidence from TALIS. , 2012 .

[62]  E. Bialystok Reshaping the mind: the benefits of bilingualism. , 2011, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[63]  M. Davidson,et al.  Creating Effective Teaching and Learning Environments: First Results from TALIS , 2009 .

[64]  Beatrice Ávalos Teacher professional development in Teaching and Teacher Education over ten years , 2011 .

[65]  Hywel R. Thomas,et al.  Teacher job satisfaction: lessons from the TSW Pathfinder Project , 2005 .

[66]  Colleen Vale Problem solving and modelling in mathematics : examples from industry and government services , 1989 .

[67]  K. Leithwood,et al.  A Review of Empirical Evidence About School Size Effects: A Policy Perspective , 2009 .

[68]  J. Gregson,et al.  Learning and Collaboration in Professional Development for Career and Technical Education Teachers: A Qualitative Multi-Case Study. , 2009 .

[69]  Angela L. Duckworth,et al.  Grit: perseverance and passion for long-term goals. , 2007, Journal of personality and social psychology.

[70]  J. Finn,et al.  Small Classes in the Early Grades, Academic Achievement, and Graduating From High School , 2005 .

[71]  Susan Moore Johnson,et al.  On Their Own and Presumed Expert: New Teachers’ Experience with Their Colleagues , 2007, Teachers College Record: The Voice of Scholarship in Education.

[72]  Ellen L. Usher,et al.  Exploring the validity of a teachers’ self-efficacy scale in five countries , 2009 .

[73]  Claudio Barbaranelli,et al.  TEACHERS' SELF-EFFICACY BELIEFS AS DETERMINANTS OF JOB SATISFACTION AND STUDENTS' ACADEMIC ACHIEVEMENT: A STUDY AT THE SCHOOL LEVEL , 2006 .

[74]  Jennifer King Rice,et al.  Teacher Quality: Understanding the Effectiveness of Teacher Attributes , 2003 .

[75]  Jeffrey H. D. Cornelius-White Learner-Centered Teacher-Student Relationships Are Effective: A Meta-Analysis , 2007 .

[76]  David W. Johnson,et al.  An Educational Psychology Success Story: Social Interdependence Theory and Cooperative Learning , 2009 .

[77]  Gilah C. Leder,et al.  Beliefs about mathematics and mathematics teaching , 2008 .

[78]  Margaret S. Smith,et al.  Transforming secondary mathematics teaching: increasing the cognitive demands of instructional tasks used in teachers' classrooms , 2009 .

[79]  A. Bandura Social cognitive theory: an agentic perspective. , 1999, Annual review of psychology.

[80]  A. Candeias,et al.  Student’ Attitudes Toward Learning and School – Study of Exploratory Models about the Effects of Socio-demographics and Personal Attributes , 2011 .

[81]  L. Darling-Hammond,et al.  Speaking of Salaries: What It Will Take to Get Qualified, Effective Teachers in All Communities. , 2011 .

[82]  A. Bandura Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[83]  Sian L. Beilock,et al.  Female teachers’ math anxiety affects girls’ math achievement , 2010, Proceedings of the National Academy of Sciences.

[84]  Preservice Elementary Teachers' Mathematics Content Knowledge and Teacher Efficacy , 2012 .

[85]  Elizabeth A. Davis,et al.  Fostering Second Graders' Scientific Explanations: A Beginning Elementary Teacher's Knowledge, Beliefs, and Practice , 2008 .

[86]  Robert J. Marzano,et al.  Classroom Instruction That Works , 2001 .

[87]  A. Loukas,et al.  Middle school student perceptions of school climate: Examining protective functions on subsequent adjustment problems. , 2007 .

[88]  G. Wiggan Race, School Achievement, and Educational Inequality: Toward a Student-Based Inquiry Perspective , 2007 .

[89]  James B. Schreiber Institutional and Student Factors and Their Influence on Advanced Mathematics Achievement , 2002 .

[90]  Claudio Barbaranelli,et al.  Efficacy beliefs as determinants of teachers' job satisfaction , 2003 .

[91]  W. Sedlacek Using Noncognitive Variables in Assessing Readiness for Higher Education , 2011 .

[92]  Megan Tschannen-Moran,et al.  Fostering Student Learning: The Relationship of Collective Teacher Efficacy and Student Achievement , 2004 .

[93]  Barbara A. Greene,et al.  Predicting high school students' cognitive engagement and achievement: Contributions of classroom perceptions and motivation , 2004 .

[94]  D. Shell,et al.  Beliefs and perceptions about the future: A measurement of future time perspective , 2008 .

[95]  D. P. Baker,et al.  Job Satisfaction among America's Teachers: Effects of Workplace Conditions, Background Characteristics, and Teacher Compensation. Statistical Analysis Report. , 1997 .

[96]  V. Widmer Managing disruptive behavior in the classroom , 2003 .

[97]  Michael D. Resnick Protecting Adolescents From Harm—Reply , 1998 .

[98]  Peter Kloosterman Beliefs and Achievement in Seventh-Grade Mathematics. , 1991 .

[99]  M. Hannula Attitude towards mathematics: emotions, expectations and values , 2002 .

[100]  G. Glass Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[101]  James A. Kulik,et al.  Effects of Frequent Classroom Testing. , 1991 .