Using Video Clips of Mathematics Classroom Instruction as Item Prompts to Measure Teachers' Knowledge of Teaching Mathematics

Responding to the scarcity of suitable measures of teacher knowledge, this article reports on a novel assessment approach to measuring teacher knowledge of teaching mathematics. The new approach uses teachers' ability to analyze teaching as a proxy for their teaching knowledge. Video clips of classroom instruction, which respondents were asked to analyze in writing, were used as item prompts. Teacher responses were scored along four dimensions: mathematical content, student thinking, alternative teaching strategies, and overall quality of interpretation. A prototype assessment was developed and its reliability and validity were examined. Respondents' scores were found to be reliable. Positive, moderate correlations between teachers' scores on the video-analysis assessment, a criterion measure of mathematical content knowledge for teaching, and expert ratings provide initial evidence for the criterion-related validity of the video-analysis assessment. Results suggest that teachers' ability to analyze teaching might be reflective of their teaching knowledge.

[1]  R. Henson.  Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha , 2001 .

[2]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[3]  Brian Rowan,et al.  Using research on employees' performance to study the effects of teachers on students' achievement? , 1997 .

[4]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[5]  Stefinee Pinnegar,et al.  Processing and using information about students: A study of expert, novice, and postulant teachers☆ , 1987 .

[6]  D. Ball,et al.  Developing Measures of Teachers’ Mathematics Knowledge for Teaching , 2004, The Elementary school journal.

[7]  Bruce Thompson,et al.  Confidence intervals about score reliability coefficients, please: An EPM guidelines editorial. , 2001 .

[8]  S. Klein.  Standards for Teacher Tests , 1998 .

[9]  L. Shulman.  Knowledge and Teaching: Foundations of the New Reform , 1987 .

[10]  Bruce Thompson,et al.  Confidence Intervals for Effect Sizes , 2001 .

[11]  Marilyn Cochran-Smith,et al.  Relationships of Knowledge and Practice: Teacher Learning in Communities , 1999 .

[12]  J. Stone.  The Value-Added Achievement Gains of NBPTS-Certified Teachers in Tennessee: A Brief Report. , 2002 .

[13]  Hyman Bass,et al.  Interweaving content and pedagogy in teaching and learning to teach: Knowing and using mathematics. , 2000 .

[14]  Marilyn Cochran-Smith,et al.  Chapter 8: Relationships of Knowledge and Practice: Teacher Learning in Communities , 1999 .

[15]  Richard J. Shavelson,et al.  Generalizability Theory: A Primer , 1991 .

[16]  L. Shulman.  Those Who Understand: Knowledge Growth in Teaching , 1986 .

[17]  Chad D. Ellett,et al.  How Valid are the National Board of Professional Teaching Standards Assessments for Predicting the Quality of Actual Classroom Teaching and Learning? Results of Six Mini Case Studies , 2001 .

[18]  D. Berliner,et al.  Differences Among Teachers in a Task Characterized by Simultaneity, Multidimensional, and Immediacy , 1991 .

[19]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[20]  Heather C. Hill,et al.  Effects of Teachers’ Mathematical Knowledge for Teaching on Student Achievement , 2005 .

[21]  L. Bond.  Disparate Impact and Teacher Certification , 1998 .

[22]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[23]  Edward H. Haertel.  Chapter 1: New Forms of Teacher Assessment , 1991 .

[24]  Karen B. Givvin,et al.  Teaching Mathematics in Seven Countries: Results From the TIMSS 1999 Video Study , 2003 .

[25]  M. Manning,et al.  A Good Teacher in Every Classroom: Preparing the Highly Qualified Teachers Our Children Deserve , 2005 .

[26]  D. Berliner,et al.  Expert-Novice Differences in Perceiving and Processing Visual Classroom Information , 1988 .

[27]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[28]  R. Jaeger.  Evaluating the Psychometric Qualities of the National Board for Professional Teaching Standards' Assessments: A Methodological Accounting , 1998 .

[29]  D. Ball.  Bridging Practices , 2000 .

[30]  Edward H. Haertel.  New Forms of Teacher Assessment , 1991 .

[31]  Xiaohong Gao,et al.  Generalizability Analyses of Work Keys Listening and Writing Tests , 1995 .