Conceptualizing and exploring the quality of teaching using generic frameworks: A way forward

Abstract Empirical studies and meta-analyses conducted during the past 35 years led to the development of a number of theoretical frameworks of teacher effectiveness. In this paper, we aim to summarize the main characteristics of three dominant frameworks within the field of educational effectiveness and discuss both their conceptual differences and their similarities, as well as, the different observational instruments used by each one to capture instructional quality. Specifically, the three frameworks are: a) the dynamic model of educational effectiveness; b) the International System for Teacher Observation and Feedback (ISTOF); and c) the Three Basic Dimensions of Teaching Quality (TBD). These frameworks were also used to analyze three videolessons for comparing the quality of teaching through the lens of each respective framework. Based on the results of the three lesson analyses, possibilities for combining different generic frameworks of effective teaching to provide a more complete view of teaching quality are discussed.

[1]  Empirical Evidence of a Comprehensive Model of School Effectiveness: A Multilevel Study in Mathematics in the 1st Year of Junior General Education in The Netherlands , 2004 .

[2]  S. Taut,et al.  Observing instructional quality in the context of school evaluation , 2016 .

[3]  L. Kyriakides,et al.  Teacher Professional Development for Improving Quality of Teaching , 2012 .

[4]  B. Creemers,et al.  School-Level Conditions Affecting the Effectiveness of Instruction. , 1996 .

[5]  Alan H. Schoenfeld,et al.  Toward a theory of teaching-in-context , 1998 .

[6]  Sabine Gruehn,et al.  Unterricht und schulisches Lernen: Schüler als Quellen der Unterrichtsbeschreibung , 2000 .

[7]  Mareike Kunter,et al.  Das Modell der Unterrichtsqualität in COACTIV : Eine multikriteriale Analyse , 2011 .

[8]  Alexander Jordan,et al.  Der Mathematikunterricht der PISA-Schülerinnen und -Schüler , 2005 .

[9]  Charalambos Y. Charalambous,et al.  Integrating generic and content-specific teaching practices in exploring teaching quality in primary physical education , 2017 .

[10]  T. Seidel,et al.  Teaching Effectiveness Research in the Past Decade: The Role of Theory and Research Design in Disentangling Meta-Analysis Results , 2007 .

[11]  Mieke Brekelmans,et al.  Teaching for Active Learning , 2000 .

[12]  B. Joyce,et al.  Models of Teaching , 2024 .

[13]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[14]  Bert P. M. Creemers,et al.  The Effective Classroom , 1994 .

[15]  Daniel Muijs,et al.  Maximum impact evaluation: The impact of Teach First teachers in Schools , 2010 .

[16]  Frank Lipowsky,et al.  Teacher self-efficacy as a long-term predictor of instructional quality in the classroom , 2016 .

[17]  Carolyn M. Evertson,et al.  Synthesis of Research on Classroom Management. , 1981 .

[18]  W. Grift.  Quality of teaching in four european countries : a review of the literature and application of an assessment instrument , 2007 .

[19]  R. Janssen,et al.  The International System for Teacher Observation and Feedback questionnaire in the biology assessment– theory, evaluation, utility , 2012 .

[20]  L. Kyriakides,et al.  The impact of a dynamic approach to professional development on teacher instruction and student learning: results from an experimental study , 2011 .

[21]  D. Muijs,et al.  The international system for Teacher Observation and Feedback: Evolution of an international study of teacher effectiveness constructs 1 , 2006 .

[22]  L. Kyriakides,et al.  A Dynamic Integrated Approach to Teacher Professional Development: Impact and Sustainability of the Effects on Improving Teacher Behaviour and Student Outcomes. , 2013 .

[23]  Miriam Lotz.  Kognitive Aktivierung im Leseunterricht der Grundschule , 2016 .

[24]  James Ko.  Consistency and variation in classroom practice : a mixed-method investigation based on case studies of four EFL teachers of a disadvantaged secondary school in Hong Kong , 2010 .

[25]  Charalambos Y. Charalambous,et al.  Studying mathematics instruction through different lenses: setting the ground for understanding instructional quality more comprehensively , 2018 .

[26]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[27]  Dympna Devine,et al.  What is ‘good’ teaching? Teacher beliefs and practices about their teaching , 2013 .

[28]  Leonidas Kyriakides,et al.  Using educational effectiveness research to promote quality of teaching: the contribution of the dynamic model , 2018 .

[29]  M. Kunter,et al.  How teachers’ self-efficacy is related to instructional quality: A longitudinal analysis. , 2013 .

[30]  Fani Lauermann,et al.  Longitudinal relations between teaching-related motivations and student-reported teaching quality , 2017 .

[31]  B. Schmitz,et al.  Student and teacher ratings of instructional quality: Consistency of ratings over time, agreement, and predictive power. , 2016 .

[32]  L. Kyriakides,et al.  Quality and equity in education , 2020, Quality and Equity in Education.

[33]  D. Muijs,et al.  The international system for teacher observation and feedback: A theoretical framework for developing international instruments , 2010 .

[34]  L. Kyriakides,et al.  Short- and long-term effects of the home learning environment and teachers on student achievement in mathematics: a longitudinal study , 2020, School Effectiveness and School Improvement.

[35]  Robert C. Pianta,et al.  Classroom Assessment Scoring System™: Manual K-3. , 2008 .

[36]  Thilo Kleickmann,et al.  Blinde Flecken des Modells der drei Basisdimensionen von Unterrichtsqualität? Das Modell im Spiegel einer internationalen Synthese von Merkmalen der Unterrichtsqualität , 2020, Unterrichtswissenschaft.

[37]  J. Brophy.  Classroom Organization and Management , 1983, The Elementary School Journal.

[38]  Anna-Katharina Praetorius,et al.  Towards developing a theory of generic teaching quality: origin, current status, and necessary next steps regarding the three basic dimensions model , 2020 .

[39]  D. Muijs,et al.  State of the art – teacher effectiveness and professional learning , 2014 .

[40]  Katrin Rakoczy,et al.  Interplay of formative assessment and instructional quality—interactive effects on students’ mathematics achievement , 2018 .

[41]  David Reynolds,et al.  Comparing performance: a cross-national investigation into the teaching of mathematics in primary classrooms in England and China , 2015 .

[42]  J. Carroll.  A Model of School Learning , 1963, Teachers College Record: The Voice of Scholarship in Education.

[43]  M. Galton.  An ORACLE chronicle: A decade of classroom research , 1987 .

[44]  B. Creemers,et al.  The Effects of Two Intervention Programs on teaching Quality and Student Achievement , 2014 .

[45]  L. Kyriakides.  Testing the validity of the comprehensive model of educational effectiveness: a step towards the development of a dynamic model of effectiveness , 2008 .

[46]  L. Kyriakides,et al.  Using student ratings to measure quality of teaching in six European countries , 2014 .

[47]  J. Piaget,et al.  The equilibration of cognitive structures : the central problem of intellectual development , 1985 .

[48]  Eckhard Klieme,et al.  Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes , 2014 .

[49]  Gabriele Kaiser,et al.  Subject-specific characteristics of instructional quality in mathematics education , 2018 .

[50]  Elina Harjunen.  Patterns of control over the teaching–studying–learning process and classrooms as complex dynamic environments: a theoretical framework , 2012 .

[51]  L. Kyriakides,et al.  Teacher behaviour and student outcomes : Suggestions for research on teacher training and professional development , 2009 .

[52]  P. Sammons,et al.  Variations in effective classroom practices: confirmatory factor analysis Results from analysis of measures from the International System for Teacher Observation and Feedback (ISTOF) Scale and Quality and Teaching Lesson Observation Indicator (GRIFT) Scale , 2008 .

[53]  P. Sammons,et al.  Effective Classroom Practice: A Mixed Method Study of Influences and Outcomes. End of Award Report , 2008 .

[54]  E. Klieme,et al.  Generic dimensions of teaching quality: the German framework of Three Basic Dimensions , 2018, ZDM.

[55]  L. Kyriakides,et al.  Searching for the impact of teacher behavior on promoting students’ cognitive and metacognitive skills , 2020 .

[56]  L. Kyriakides,et al.  The effects of teacher factors on different outcomes: two studies testing the validity of the dynamic model , 2009 .

[57]  L. Kyriakides,et al.  Searching for stages of teacher's skills in assessment , 2014 .

[58]  L. Shepard.  Why We Need Better Assessments. , 1989 .

[59]  Eckhard Klieme,et al.  Unterrichtsqualität aus Schülerperspektive: Kulturspezifische Profile, regionale Unterschiede und Zusammenhänge mit Effekten von Unterricht , 2003 .

[60]  S. Krauss,et al.  Teachers’ Mathematical Knowledge, Cognitive Activation in the Classroom, and Student Progress , 2010 .

[61]  L. Kyriakides,et al.  The impact of effective teaching characteristics in promoting student achievement in Ghana , 2016 .

[62]  J. Scheerens.  The use of theory in school effectiveness research revisited , 2013 .

[63]  Teacher behavior and student outcomes: Results of a European study , 2014 .

[64]  Kurt Reusser,et al.  Quality of geometry instruction and its short-term impact on students' understanding of the Pythagorean Theorem , 2009 .

[65]  Eckhard Klieme,et al.  Empirische Unterrichtsforschung und Fachdidaktik. Outcome-orientierte Messung und Prozessqualität des Unterrichts , 2008 .

[66]  Robert E. Slavin,et al.  Ability Grouping and Student Achievement in Elementary Schools: A Best-Evidence Synthesis , 1986 .

[67]  Alison Kington,et al.  Effective Classroom Practice , 2014 .

[68]  Eckhard Klieme,et al.  Unterrichtsqualität auf der Basis hoch-inferenter Unterrichtsbeurteilungen. Ein Vergleich zwischen Deutschland und der deutschsprachigen Schweiz , 2003 .

[69]  Dennis M. McInerney,et al.  What do students say about their motivational goals?: Towards a more complex and dynamic perspective on student motivation , 2003 .

[70]  David Reynolds,et al.  School Effectiveness and Teacher Effectiveness in Mathematics: Some Preliminary Findings from the Evaluation of the Mathematics Enhancement Programme (Primary) , 2000 .

[71]  Margarita Christoforidou,et al.  Using the dynamic model to identify stage of teacher skills in assessment , 2014 .

[72]  Mieke Brekelmans,et al.  Interpersonal Teacher Behaviour and Student Outcomes , 2004 .

[73]  ‘It ain't (only) what you do, it's the way that you do it’: A mixed method approach to the study of inspiring teachers , 2018, Review of Education.

[74]  J. Brophy.  Teacher behavior and student achievement , 1984 .

[75]  D. Muijs,et al.  Assessing individual lessons using a generic teacher observation instrument: how useful is the International System for Teacher Observation and Feedback (ISTOF)? , 2018, ZDM.

[76]  P. Sammons,et al.  Inspiring teaching: learning from exemplary practitioners , 2016 .

[77]  C. Helm.  Zentrale Qualitätsdimensionen von Unterricht und ihre Effekte auf Schüleroutcomes im Fach Rechnungswesen , 2016 .

[78]  Jean Kerr Stenmark.  Mathematics Assessment: Myths, Models, Good Questions, and Practical Suggestions. , 1991 .

[79]  C. Teddlie,et al.  The International Handbook of School Effectiveness Research , 1999 .

[80]  D. Muijs,et al.  Teach First: Pedagogy and outcomes. The impact of an alternative certification programme , 2012 .

[81]  E. Brunner.  Qualität von Mathematikunterricht: Eine Frage der Perspektive , 2018 .

[82]  Pam Sammons,et al.  Using mixed methods to investigate school improvement and the role of leadership: An example of a longitudinal study in England , 2014 .

[83]  Brian J. Caldwell,et al.  The Self-managing School , 1988 .

[84]  H. Tillema,et al.  Dual roles – conflicting purposes: a comparative study on perceptions on assessment in mentoring relations during practicum , 2011 .

[85]  Charalambos Y. Charalambous,et al.  What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching , 2013 .

[86]  L. Kyriakides,et al.  Searching for stages of effective teaching: A study testing the validity of the dynamic model in Canada , 2013 .

[87]  Chin-Chung Tsai.  Relationships between student scientific epistemological beliefs and perceptions of constructivist learning environments , 2000 .

[88]  L. Kyriakides,et al.  Using a multidimensional approach to measure the impact of classroom-level factors upon student achievement: a study testing the validity of the dynamic model , 2008 .

[89]  L. Kyriakides,et al.  Improving Quality in Education: Dynamic Approaches to School Improvement , 2012 .

[90]  Eckhard Klieme,et al.  Mathematikunterricht in der Sekundarstufe I: "Aufgabenkultur" und Unterrichtsgestaltung , 2001 .

[91]  Bert P. M. Creemers,et al.  The Dynamics of Educational Effectiveness: A Contribution to Policy, Practice and Theory in Contemporary Schools , 2007 .