Validation of an Assessment Rubric via Controlled Modification of a Classroom Activity.

A rubric that embodies the key features of the process-oriented, guided-inquiry learning (POGIL) model was subjected to systematic study of validity and reliability. Nearly 60 college instructors used the rubric to evaluate four intentionally modified versions of an established POGIL activity. The modifications strengthened or weakened key characteristics of the activity. Results indicate that the rubric was sufficiently sensitive and reliable for distinguishing the structures of the four versions, even in the hands of those inexperienced with POGIL or the rubric, and that the evaluation was consistent with the design characteristics. The rubric should continue to be useful for reviewing existing classroom materials, for efficient authoring and revising of new materials, and for introducing others to POGIL pedagogy. This article also exemplifies a rigorous process by which a rubric may be evaluated.

[1]  Trevor R Anderson,et al.  Bridging the educational research‐teaching practice gap: Curriculum development, Part 1: Components of the curriculum and influences on the process of curriculum design , 2011, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[2]  A. Dunning,et al.  The use of scoring rubrics to determine clinical performance in the operating suite. , 2009, Nurse education today.

[3]  Melissa H. Dancy,et al.  Pedagogical practices and instructional change of physics faculty , 2010 .

[4]  H. Andrade,et al.  A review of rubric use in higher education , 2010 .

[5]  Karen Moni,et al.  Using student feedback to construct an assessment rubric for a concept map in physiology. , 2005, Advances in physiology education.

[6]  John C. Hafner,et al.  Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer‐group rating , 2003 .

[7]  Stacey Lowery Bretz,et al.  A rubric to characterize inquiry in the undergraduate chemistry laboratory , 2007 .

[8]  A. Hargreaves.  Extending educational change , 2005 .

[9]  M. Oliver-Hoyo.  Designing a Written Assignment To Promote the Use of Critical Thinking Skills in an Introductory Chemistry Course , 2003 .

[10]  Trish Stoddart,et al.  Concept maps as assessment in science inquiry learning - a report of methodology , 2000 .

[11]  James W. Stigler,et al.  Teachers’ Analyses of Classroom Video Predict Student Learning of Mathematics: Further Explorations of a Novel Measure of Teacher Knowledge , 2010 .

[12]  Richard S. Moog,et al.  Process Oriented Guided Inquiry Learning (POGIL) , 2008 .