What Does the Psychometrician's Classroom Look Like?: Reframing Assessment Concepts in the Context of Learning.

We question the utility of traditional conceptualizations of validity and reliability, developed in the context of large scale, external testing, and the psychology of individual differences, for the context of the classroom. We compare traditional views of validity and reliability to alternate frameworks that situate these constructs in teachers' work in classrooms. We describe how we used these frameworks to design an assessment course for preservice teachers, and present data that suggest students in the redesigned course not only saw the course as more valuable in their work as teachers, but developed deeper understandings of validity and reliability than did their counterparts in a traditional tests and measurement course. We close by discussing the implications of these data for the teaching of assessment, and for the use and interpretation of classroom assessment data for purposes of local and state accountability. More than ever before, pressure is being placed on teachers to create high quality assessments of their students' learning. Work is underway in Kentucky, New Mexico, Vermont, Washington, and in the eighteen states that are members of the New Standards Project (Resnick and Resnick, 1991) to explore the viability of classroom-based assessments, projects, and portfolios as sources of state or national accountability data about student learning. These initiatives emerge from a growing belief that the teacher can be one of the best sources of