Valid and Reliable Science Content Assessments for Science Teachers

Science teachers’ content knowledge is an important influence on student learning, highlighting an ongoing need for programs, and assessments of those programs, designed to support teacher learning of science. Valid and reliable assessments of teacher science knowledge are needed for direct measurement of this crucial variable. This paper describes multiple sources of validity and reliability (Cronbach’s alpha greater than 0.8) evidence for physical, life, and earth/space science assessments—part of the Diagnostic Teacher Assessments of Mathematics and Science (DTAMS) project. Validity was strengthened by systematic synthesis of relevant documents, extensive use of external reviewers, and field tests with 900 teachers during assessment development process. Subsequent results from 4,400 teachers, analyzed with Rasch IRT modeling techniques, offer construct and concurrent validity evidence.

[1]  Yew-Jin Lee,et al.  Teacher Knowledge of Biological Evolution from the Perspectives of Classical Test and Item Response Theory. , 1998 .

[2]  J. Shea.  National Science Education Standards , 1995 .

[3]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[4]  P. Preece.  Force and Motion: Pre-service and Practising Secondary Science Teachers' Language and Understanding , 1997 .

[5]  Abdullateef H. Haidar,et al.  Prospective chemistry teachers' conceptions of the conservation of matter and related concepts , 1997 .

[6]  L. Darling-Hammond.  How Teacher Education Matters , 2000 .

[7]  L. Shulman.  Those Who Understand: Knowledge Growth in Teaching , 1986 .

[8]  J. Lagowski.  National Science Education Standards , 1995 .

[9]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[10]  Onno De Jong,et al.  Problems in Teaching the Topic of Redox Reactions: Actions and Conceptions of Chemistry Teachers , 1995 .

[11]  T. Tretter,et al.  Identification of the Most Critical Content Knowledge Base for Middle School Science Teachers , 2008 .

[12]  R. Stiggins.  Student-centered classroom assessment , 1994 .

[13]  David C. Berliner,et al.  The Effectiveness of "Teach for America" and Other Under-certified Teachers , 2002 .

[14]  Shameem Nyla.  NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION , 2004 .

[15]  J. H. Driel,et al.  Developing science teachers' pedagogical content knowledge , 1998 .

[16]  Robert J. Marzano,et al.  Content Knowledge: A Compendium of Standards and Benchmarks for K-12 Education , 1997 .

[17]  Norman G. Lederman,et al.  Preservice biology teachers' knowledge structures as a function of professional teacher education: A year‐long assessment , 1993 .

[18]  D. Eignor.  The standards for educational and psychological testing. , 2013 .

[19]  M. Rutledge,et al.  The Development and Validation of the Measure of Acceptance of the Theory of Evolution Instrument , 1999 .

[20]  R. Trumper.  A survey of conceptions of energy of Israeli pre‐service high school biology teachers , 1997 .

[21]  How do intermediate and junior high school students conceptualize living and nonliving , 1981 .

[22]  Xiufeng Liu,et al.  Using and Developing Measurement Instruments in Science Education: A Rasch Modeling Approach , 2010 .

[23]  M. R. Espejo.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2004 .

[24]  John R. Staver,et al.  Using Rasch Theory to Guide the Practice of Survey Development and Survey Data Analysis in Science Education and to Inform Science Reform Efforts: An Exemplar Utilizing STEBI Self-Efficacy Data. , 2011 .

[25]  Vallerie L. Ruiz.  No Child Left Behind Act , 2010 .

[26]  Nancy L. Leech,et al.  The Meaning of Validity in the New Standards for Educational and Psychological Testing: , 2003 .

[27]  Kerry J. Gruber,et al.  Qualifications of the Public School Teacher Workforce: Prevalence of Out-of-Field Teaching, 1987-88 to 1999-2000. Statistical Analysis Report. , 2002 .

[28]  Pinchas Tamir,et al.  The relations between disciplinary and pedagogical knowledge and the length of teaching experience of biology and geography teachers , 1990 .

[29]  R. Henson.  Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha , 2001 .

[30]  W. McComas.  Benchmarks for Science Literacy , 2014 .