A classroom observation tool for scaffolding reading comprehension

An important goal of educational research is to find out which teaching practices are effective in promoting students' learning. In order to assess these practices, adequate observation instruments are needed. Existing observation schemes for language teaching are not suitable to gauge which teaching strategies scaffold EFL reading comprehension in particular and language learning in general. Therefore, we developed a new instrument: the English Reading Comprehension Observation Protocol. The focus of the instrument is on the role of the EFL teacher who helps students to move from learning to read to reading to learn in English. We conducted a generalizability study in order to establish the instrument's reliability. Twenty lessons taught by five experienced teachers were recorded and observed by five experienced teacher educators. The results of the generalizability study, in which we disentangled sources of variance, show that a large proportion of the variance can be attributed to differences between the teachers. This shows that the instrument has a high reliability and can help teachers identify their strengths and room for development. The instrument takes the form of a checklist and is easy to use for professional development purposes.

[1]  Lawrence Manion,et al.  Research Methods in Education, 7th Edition , 2011 .

[2]  Deirdre J. Derrick,et al.  Instrument Reporting Practices in Second Language Research. , 2016 .

[3]  Roy Lyster,et al.  Macroscopic and Microscopic Views of L2 Classrooms , 1997 .

[4]  D. Fasoglio,et al.  Handreiking schoolexamen moderne vreemde talen havo/vwo , 2007 .

[5]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[6]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[7]  Christine E. Nuttall,et al.  Teaching reading skills in a foreign language , 1982 .

[8]  M. Juan-Garau,et al.  Developing English learners' transcultural skills through content- and task-based lessons , 2015 .

[9]  Marjolijn H. Verspoor,et al.  The effects of English bilingual education in the Netherlands , 2015 .

[10]  Charalambos Y. Charalambous,et al.  When rater reliability is not enough: Teacher observation systems and a case for the G-study , 2012 .

[11]  William Grabe,et al.  Teaching and Researching Reading , 2019 .

[12]  William Grabe,et al.  Reading in a Second Language: Moving from Theory to Practice , 2008 .

[13]  Vera Busse,et al.  CLIL: Content and Language Integrated Learning , 2011 .

[14]  Lourdes Ortega,et al.  Synthesizing research on language learning and teaching , 2006 .

[15]  L. Cohen,et al.  Research Methods in Education , 1980 .

[16]  W. Grift.  Quality of teaching in four european countries : a review of the literature and application of an assessment instrument , 2007 .

[17]  Laura M. Desimone,et al.  Improving Impact Studies of Teachers’ Professional Development: Toward Better Conceptualizations and Measures , 2009 .

[18]  K. V. Gorp,et al.  Teachers, pupils and tasks: The genesis of dynamic learning opportunities , 2015 .

[19]  Richard J. Shavelson,et al.  Generalizability Theory: A Primer , 1991 .

[20]  Aída Walqui,et al.  Scaffolding Instruction for English Language Learners: A Conceptual Framework , 2006 .

[21]  Patsy M. Lightbown,et al.  Focus on Content Based Language Teaching , 2014 .

[22]  John T. Guthrie,et al.  Motivating Reading Comprehension: Concept-Oriented Reading Instruction , 2004 .

[23]  F. Genesee,et al.  A Conceptual Framework for the Integration of Language and Content in Second/Foreign Language Instruction , 1989 .

[24]  Michael H. Long,et al.  The Handbook of Language Teaching , 2011 .

[25]  Zoltán Dörnyei,et al.  Motivating Language Learners: A Classroom-Oriented Investigation of the Effects of Motivational Strategies on Student Motivation , 2008 .

[26]  T. Morton.  Reviewed of Christiane Dalton-Puffer. 2007. Discourse in Content and Language Integrated Learning (CLIL) Classrooms. Amsterdam: John Benjamins , 2009 .

[27]  R. Gallimore,et al.  Rousing Minds to Life: Teaching, Learning, and Schooling in Social Context , 1988 .

[28]  R. Lyster,et al.  CORRECTIVE FEEDBACK AND LEARNER UPTAKE , 1997, Studies in Second Language Acquisition.

[29]  Pauline Gibbons,et al.  Scaffolding language, scaffolding learning , 2002 .

[30]  Henderien Steenbeek,et al.  The dynamics of scaffolding , 2005 .

[31]  Deborah J. Short,et al.  Making Content Comprehensible for English Learners: The SIOP Model , 1999 .

[32]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[33]  Jack C. Richards,et al.  Approaches and Methods in Language Teaching , 2001 .

[34]  Tom Morton,et al.  The Roles of Language in CLIL , 2012 .

[35]  Leo van Lier,et al.  Scaffolding the Academic Success of Adolescent English Language Learners: A Pedagogy of Promise , 2010 .

[36]  M. Volman,et al.  Scaffolding in Teacher–Student Interaction: A Decade of Research , 2010 .

[37]  Yu A Anikina,et al.  An Observation Tool for Effective L2 Pedagogy in Content and Language Integrated Learning (CLIL) , 2007 .

[38]  Christiane Dalton-Puffer.  Discourse in Content and Language Integrated Learning Clil Classrooms , 2007 .

[39]  Ridwan Maulana,et al.  Teaching skills of student teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement , 2014 .

[40]  Alison Mackey,et al.  Research methods in second language acquisition : a practical guide , 2011 .

[41]  Joseph Foley.  Key concepts in ELT Scaffolding , 1994 .

[42]  Roy Lyster,et al.  Learning and Teaching Languages Through Content: A counterbalanced Approach , 2007 .

[43]  N. Spada,et al.  Differences in the Communicative Orientation of L2 Classrooms , 1985 .

[44]  W. Grift.  Reliability and validity in measuring the value added of schools , 2009 .

[45]  J. Norris,et al.  Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta‐analysis , 2000 .

[46]  N. Spada,et al.  Interactions between Type of Instruction and Type of Language Feature: A Meta-Analysis. , 2010 .