Chapter 10: Socio-Cultural Aspects of Assessment

ion and memory skills, and the separability of social from cognitive skills and knowledge from action . . . performance in cognitive tasks is inseparable from values about appropriate social relationships in such situations" (pp. 58-59). Reliance on others for help in problem-solving situations varies according to the cultural setting. In traditional American and British school settings, relying on a companion for help in assessment is likely to be considered cheating, whereas in other settings in everyday situations not to use a companion's assistance may be regarded as inappropriate. Some researchers in the sociocultural perspective, which focuses on situated learning, suggest that assessment is not necessary, while others suggest that individuals must be assessed as part of a group. For example. Lave and Wenger (1991) argue that, in the apprenticeship system, testing is not necessary since increasing participation has its own use value; in settings such as schools, however, learning becomes commoditized, and exchange value, demonstrated through testing, replaces use value: Gipps: Socio-Cultural Aspects of Assessment 377 The commoditization of learning engenders a fundamental contradiction between the use and exchange values of the outcome of learning, which manifests itself in conflicts between learning to know and learning to display knowledge for evaluation. Testing in schools and trade schools (unnecessary in situations of apprenticeship learning) is perhaps the most pervasive and salient example of a way of establishing the exchange value of knowledge. Test taking then becomes a new parasitic practice, the goal of which is to increase the exchange value of learning independently of its use value, (p. 112) The requirement, in the sociocultural perspective, to assess the processes of learning and to assess learning in the social setting can be met in a number of ways. Portfolios can be used to reflect the processes of learning and their development over time. Portfolios, of course, take many forms: They may contain items selected at intervals by the teacher or "best" pieces of work chosen by the pupil; work in the portfolio may be assessed in a more or less standardized way (Koretz et al., 1993). To support the sociocultural model of learning, they need in some way to reflect or articulate the social setting in which the learning took place. Commentary by the teacher and the pupil can describe the social situation of learning. For example, student and teacher commentaries are part of the final portfolio in the PROPEL project (Wolf et al., 1991). These commentaries are focused on the process of learning and developing achievement, and they encourage reflection on the part of both pupil and teacher. The process, Wolf (1989) argues, is difficult because portfolios ' 'demand intimate and often frighteningly subjective talk with students" (p. 37). Pupils may be unwilling to engage in the intellectual process, while teachers may be unable to give up control of the discussion. But when it works, she argues, it is well worth the effort. Assessment within a social situation can be afforded by assessing students in collaborative group activities in which they contribute to a task and help others. "In such assessment, as in instruction using group approaches, the student can observe how others reason and can receive feedback on his or her own efforts. In this context, not only performance, but also the facility with which a student adapts to help and guidance, can be assessed" (Glaser & Silver, 1994, pp. 412-413). Such socially situated collaborative assessment also has the advantage of encouraging students to develop and question their definitions of competence. Brown and colleagues analyze collaborative assessment environments and compare them with collaborative teaching environments. In their view (Brown et al., 1992), the crucial difference between the two is that in the teaching environment aid is opportunistic, while in the assessment environment aid is in the form of "standardized hints." Lampert (1990) describes a project in the teaching of mathematics in which the roles and responsibilities of teachers and students within classroom discourse were altered. Sometimes the teacher consciously held back from commenting on answers given by students, and so the class developed discussion around the problems and tasks, made hypotheses about solutions, and took risks in the way that the mathematical community would. The teacher, standing back, refused to be the intellectual authority in the way that is normally the case in school mathematics. This approach to learning in a classroom community entails a 378 Review of Research in Education, 24 different view of assessment of pupil attainment, one based very much on understanding: The questions I expected them to answer went beyond simply determining whether they could get the solutions. I also expected them to answer questions about mathematical assumptions and the legitimacy of their strategies. Answers to problems were given by students, but I did not interpret them to be the primary indication of whether they knew mathematics, (p. 38) The emphasis was on the analysis of the students' language, their assertions, and their ability to demonstrate that their strategies were valid. In such a group/community learning situation, assessment may be focused as much on the group as on individuals: "By the end of the lesson, 14 of the 18 students present in the class had had something mathematically substantial to say about exponents" (p. 52). Cobb and Bowers (1998), too, talk about assessment (using the term evaluation) within the group. Within their cognitive and situated perspective on learning, performance is socially situated. Therefore, the teacher should evaluate the group's changing beliefs and reasoning, and the individual should be evaluated in relation to the group. The issue for Cobb and Bowers is how one views individuals whose (mathematical) reasoning is less effective than others in the group. They describe such students as those who have less sophisticated ways of participating in particular classroom practices. Since performance is socially situated, the performance resides not just in the student but in the relationship between the teacher and the individual. They treat academic success/failure as the exclusive property neither of individual students nor of the instruction they receive. They see it as a "relation" between individual students and the practices that they and the teacher construct. So, pupil assessment in this model focuses on the individual as part of the group, and the key issue becomes how or whether one interprets the evidence of performance of individuals. Assessment within the framework of sociocultural theory is seen as interactive, dynamic, and collaborative. Rather than an external and formalized activity, assessment is integral to the teaching process and embedded in the social and cultural life of the classroom. Such an approach is seen as constructive—because of its focus on assessing the process of learning, the attempt to elicit elaborated performance, and the emphasis on collaborative activity (whether the collaboration is with the teacher or a group of peers). Much of the work in this field is still at the level of research, however, and a number of issues remain to be clarified. For example, such assessment is often time consuming and demands particular skills of the teacher/assessor. The procedures, being unstandardized, do not meet traditional reliability criteria, and this has an impact on the purposes for which the assessment can or should be used. There are many issues to be resolved around the evaluation of individuals within group performance. A key issue, too, is the relationship between teacher/assessor and pupil. The Assessment Relationship In traditional assessment, the relationship between teacher and student is a hierarchical one. The teacher sets and defines the task and determines its evaluation. The student's role is to be the object of this activity and, through the Gipps: Socio-Cultυral Aspects of Assessment 379 completion of a range of tests, to be graded. However, if one uses an interpretive approach, there are other ways of seeing this relationship. In newer forms of assessment, such as negotiated assessment and self-assessment, the student has a role in discussing and negotiating the terms and outcomes of the assessment, although in reality such a practice may be rare. The thesis behind such a nontraditional approach (critical-theoretic in Habermas's framework) is that students need to become involved in the assessment process so that they are encouraged to monitor and reflect on their own performance in order to become self-monitoring and self-regulating learners (Broadfoot, 1996; Wittrock & Baker, 1991; Wolf et al., 1991). A key element of the interpretive paradigm is the need to understand a learner's response. In relation to informal assessment, this includes the learner's expectations, assumptions, and interpretations of the classroom culture, task demands, and criteria for success (Aikenhead, 1997). Sadler (1998), developing this line of argument further, points out that teachers commonly bring with them to the assessment setting a more elaborate and extensive knowledge base, a set of attitudes or dispositions toward teaching as an activity, skill in devising assessments, a deep knowledge of criteria and standards appropriate to the assess­ ment task, evaluative skills in making judgements about student performance, and expertise in framing feedback statements. Sadler argues that an appreciation of these resources and skills is important because eventually the teacher must share them with the student in order to pass them on. Ultimately the intention of most educational systems is to help students not only grow in knowledge and expertise, but also to become progressively independent of the teacher fo

[1]  T INGLES,et al.  An Experience in Learning , 1957, Nursing research.

[2]  M. James,et al.  Broadening the basis of assessment to prevent the narrowing of learning , 1998 .

[3]  Maxim J. Schlossberg,et al.  Educational Research, Methodology, and Measurement: An International Handbook. , 1990 .

[4]  P. Tunstall,et al.  Teacher Feedback to Young Children in Formative Assessment: a typology , 1996 .

[5]  Lawrence C. Stedman International Achievement Differences: An Assessment of a New Perspective , 1997 .

[6]  C. Gipps Beyond Testing: Towards a Theory of Educational Assessment , 1994 .

[7]  Benjamin Jowett,et al.  Report on the organisation of the permanent civil service : together with a letter from B. Jowett , 1854 .

[8]  B. Rogoff Apprenticeship in Thinking: Cognitive Development in Social Context , 1990 .

[9]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[10]  Dennie Palmer Wolf,et al.  Portfolio Assessment: Sampling Student Work. , 1989 .

[11]  R. Schiffer,et al.  INTRODUCTION , 1988, Neurology.

[12]  D. Pidgeon,et al.  Admission to Grammar Schools , 1958 .

[13]  J. Keeves National Examinations: Design, Procedures and Reporting , 1994 .

[14]  Phillip Brown,et al.  Education, globalisation and economic development , 1996 .

[15]  L. Resnick,et al.  Knowing, Learning, and Instruction , 2018 .

[16]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[17]  Denis Newman,et al.  The Construction Zone: Working for Cognitive Change in School , 1989 .

[18]  Barry Cooper,et al.  Anyone for Tennis? Social Class Differences in Children's Responses to National Curriculum Mathematics Testing , 1998 .

[19]  John Geanakoplos,et al.  Common Knowledge , 1992, TARK.

[20]  Wynne Harlen,et al.  Enhancing quality in assessment , 1995 .

[21]  Harry Torrance The Origins and Development of Mental Testing in England and the United States , 1981 .

[22]  P. Bourdieu,et al.  Reproduction in education, society and culture , 1970 .

[23]  P. Moss Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment , 1992 .

[24]  H. Goldstein Assessing Group Differences , 1993 .

[25]  Walter Doyle,et al.  Work in Mathematics Classes: The Context of Students' Thinking During Instruction , 1988 .

[26]  M. Greene Epistemology and Educational Research: The Influence of Recent Approaches to Knowledge , 1994 .

[27]  Phillip Brown,et al.  Education, Globalization and Economic Development , 1996 .

[28]  Magdalene Lampert,et al.  When the Problem Is Not the Question and the Solution Is Not the Answer: Mathematical Knowing and Teaching , 1990 .

[29]  Michael W. Apple,et al.  The Politics of Official Knowledge: Does a National Curriculum Make Sense? , 1993, Teachers College Record: The Voice of Scholarship in Education.

[30]  Carol S. Dweck,et al.  Motivational processes affecting learning. , 1986 .

[31]  L. Shepard Chapter 9: Evaluating Test Validity , 1993 .

[32]  R. Connell Schools And Social Justice , 1993 .

[33]  Robert Lyons,et al.  The Fractured Marketplace for Standardized Testing , 1993 .

[34]  Pamela A. Moss,et al.  Can There Be Validity Without Reliability? , 1994 .

[35]  Jerome S. Bruner,et al.  Making sense: The child's construction of the world , 1987 .

[36]  William R. Penuel,et al.  Vygotsky and identity formation: A sociocultural approach. , 1995 .

[37]  C. Tittle Validity: Whose Construction Is it in the Teaching and Learning Context? , 1989 .

[38]  K. Young The History of Mental Testing , 1924 .

[39]  Patricia Broadfoot,et al.  Education, Assessment, And Society , 1996 .

[40]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[41]  Eva L. Baker,et al.  Testing and Cognition , 1991 .

[42]  G. Bruce SECONDARY SCHOOL EXAMINATIONS , 1969 .

[43]  M. Neill,et al.  Some Prerequisites for the Establishment of Equitable, Inclusive Multicultural Assessment Systems , 1995 .

[44]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[45]  Ann L. Brown,et al.  Interactive Learning Environments: A New Look at Assessment and Instruction , 1992 .

[46]  J. Herman,et al.  American Students’ Perspectives on Alternative Assessment: do they know it's different? , 1997 .

[47]  B. Bernstein Theoretical Studies Towards a Sociology of Language , 1972 .

[48]  Robert L. Linn,et al.  Educational Assessment: Expanded Expectations and Challenges , 1993 .

[49]  E. Glasersfeld Learning as Constructive Activity , 1983 .

[50]  G. Neave Education and Social Policy: demise of an ethic or change of values? , 1988 .

[51]  D. Nuttall The validity of assessments , 1987 .

[52]  E. Erikson Identity, youth, and crisis , 1968 .

[53]  T. Husén,et al.  The Contribution of Formal Schooling to the Increase in Intellectual Capital , 1991 .

[54]  George Thomas White Patrick,et al.  What is the mind , 1929 .

[55]  P. David Pearson,et al.  Assessment and Diversity , 1994 .

[56]  J. Weiss The Golden Rule Bias Reduction Principle: A Practical Reform , 1987 .

[57]  Patti Lather,et al.  Critical frames in educational research: Feminist and post‐structural perspectives , 1992 .

[58]  L. Shepard Commentary: What Policy Makers Who Mandate Tests Should Know About the New Psychology of Intellectual Ability and Learning , 1992 .

[59]  Carole A. Ames Classrooms: Goals, structures, and student motivation. , 1992 .

[60]  I. Fras Identity: Youth and Crisis , 1968 .

[61]  Peter J. Denning,et al.  A nation at risk: the imperative for educational reform , 1983, CACM.

[62]  M. Meehan Culture Against Man , 1964 .

[63]  E. Glasersfeld Cognition, Construction of Knowledge, and Teaching , 1989 .

[64]  Darrell L. Fisher,et al.  Monitoring constructivist classroom learning environments , 1997 .

[65]  P. Cobb Where Is the Mind? Constructivist and Sociocultural Perspectives on Mathematical Development , 1994 .

[66]  J. Greeno On Claims That Answer the Wrong Questions , 1997 .

[67]  Elliot W. Eisner,et al.  Reshaping assessment in education: some criteria in search of practice , 1993 .

[68]  Alexandra K. Wigdor,et al.  Ability Testing: Uses, Consequences, and Controversies. Part II: Documentation Section. , 1982 .

[69]  Peter W. Airasian Measurement Driven Instruction: A Closer Look. , 1988 .

[70]  Alexandra K. Wigdor,et al.  Ability Testing: Uses, Consequences, and Controversies , 1982 .

[71]  C. Tittle Toward an educational psychology of assessment for teaching and learning: Theories, contexts, and validation arguments. , 1994 .

[72]  Terri Gullickson,et al.  A Fair Test? Assessment, Achievement and Equity. , 1996 .

[73]  L. Shepard Psychometricians’ Beliefs About Learning , 1991 .

[74]  M. O’Connor,et al.  Changing assessments : alternative views of aptitude, achievement and instruction , 1994 .

[75]  B. Bernstein Codes, modalities, and the process of cultural reproduction: A model , 1981, Language in Society.

[76]  H. Birx,et al.  The Mismeasure of Man , 1981 .

[77]  Harold J. Noah,et al.  Secondary School Examinations: International Perspectives on Policies and Practice , 1993 .

[78]  C. Dwyer Assessment and Classroom Learning: theory and practice , 1998 .

[79]  Howard Gardner,et al.  To Use Their Minds Well: Investigating New Forms of Student Assessment , 1991 .

[80]  S. Sharp,et al.  Ability, Merit, and Measurement: Mental Testing and English Education 1880-1940 , 1985 .

[81]  Caroline Gipps,et al.  Developments in Educational Assessment: what makes a good test? , 1994 .

[82]  Robert Glaser,et al.  Instructional technology and the measurement of learing outcomes: Some questions. , 1963 .

[83]  P. Broadfoot Assessment, Schools and Society , 1979 .

[84]  Robert Glaser,et al.  Assessment, Testing, and Instruction: Retrospect and Prospect. , 1994 .

[85]  J. Wertsch Voices of the Mind: A Sociocultural Approach to Mediated Action , 1992 .

[86]  Harry Torrance Formative Assessment: some theoretical problems and empirical questions , 1993 .

[87]  Tom Carney Fourth Generation Evaluation , 1991 .

[88]  R. Driver,et al.  Children's Ideas in Science , 1985 .

[89]  P. Cobb,et al.  Cognitive and Situated Learning Perspectives in Theory and Practice , 1999 .

[90]  A. Pollard Towards a Sociology of Learning in Primary Schools , 1990 .

[91]  D. Lohman Lessons from the History of Intelligence Testing. , 1997 .

[92]  P. Scott,et al.  Constructing Scientific Knowledge in the Classroom , 1994 .

[93]  Pamela A. Moss,et al.  Enlarging the Dialogue in Educational Measurement: Voices From Interpretive Research Traditions , 1996 .

[94]  D. Sadler Formative assessment and the design of instructional systems , 1989 .

[95]  David Belais Friedman,et al.  Discipline and Punishment , 1977 .

[96]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[97]  E. Baker,et al.  Diversity, Assessment, and Equity in Educational Reform , 1995 .

[98]  Alan G. Ryan Program Evaluation within the Paradigms , 1988 .