Evaluation and Assessment Needs of Computing Education in Primary Grades

Until recently, computer science (CS) has been predominantly taught at upper-secondary or tertiary levels. Lately, however, CS curricula have been introduced into school systems from the very first year of school. In this paper, we undertake a participatory research approach, using focus group discussions between a group of experts in the field of evaluation and assessment at the primary level (K-5). The group considered the evaluation and assessment measures they have used, what their current needs are and how the CS education community can move towards meeting those needs. We present the discussion results as a position paper, situated in the context of broader education research. The experts identified three key priorities for the education research community: creating a universal taxonomy of assessment in the primary grades (K-5), creating measurements of student progression and growth over time, and creating culturally relevant evaluations and assessments. Through identifying key priorities, this work provides direction for urgently needed resource development and research directions for K-5 evaluation and assessment.

[1]  M. Agar,et al.  Focus Groups and Ethnography , 1995 .

[2]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[3]  K. Wilson,et al.  The use of focus group discussion methodology: Insights from two decades of application in conservation , 2018 .

[4]  Renee P. Smith-Maddox,et al.  Defining Culture as a Dimension of Academic Achievement: Implications for Culturally Responsive Curriculum, Instruction, and Assessment. , 1998 .

[5]  Christopher Hoadley,et al.  The Role of Translanguaging in Computational Literacies: Documenting Middle School Bilinguals' Practices in Computer Science Integrated Units , 2019, SIGCSE.

[6]  Naftaly S. Glasman,et al.  Fear, the School Organization, and Teacher Evaluation , 2008 .

[7]  Roy D. Pea,et al.  Assessing computational learning in K-12 , 2014, ITiCSE '14.

[8]  Julius Sim,et al.  Focus group methodology: some ethical challenges , 2019, Quality & Quantity.

[9]  H. Timperley.  Teacher professional learning and development , 2007 .

[10]  C. Dianne Martin,et al.  Draw a computer scientist , 2004, ITiCSE-WGR '04.

[11]  Guy Claxton,et al.  PROGRESSION IN STUDENT CREATIVITY IN SCHOOL: FIRST STEPS TOWARDS NEW FORMS OF FORMATIVE ASSESSMENTS , 2013 .

[12]  Heather C. Hill,et al.  Learning from Teacher Observations: Challenges and Opportunities Posed by New Teacher Evaluation Systems. , 2013 .

[13]  Daniela Giordano,et al.  New Horizons in the Assessment of Computer Science at School and Beyond: Leveraging on the ViVA Platform , 2015, ITiCSE-WGR.

[14]  Vjollca Ahmedi,et al.  Teachers’ Attitudes and Practices Towards Formative Assessment in Primary Schools , 2019 .

[15]  Linda M. Seiter.  Using SOLO to Classify the Programming Responses of Primary Grade Students , 2015, SIGCSE.

[16]  Jason Alexander,et al.  Computer science unplugged: school students doing real computing without computers , 2009 .

[17]  Lesley Kay Rameka,et al.  Being Māori: culturally relevant assessment in early childhood education , 2011 .

[18]  Sue Sentance,et al.  A comparison of current trends within Computer Science teaching in school in Germany and the UK , 2013 .

[19]  Julia Vélez,et al.  Systematic Evaluation of UPR Libraries: Reaffirms Collaboration, Promotes Evaluation and Assessment Culture , 2009 .

[20]  Richard W. Morshead.  Taxonomy of Educational Objectives Handbook II: Affective Domain , 1965 .

[21]  Leigh Ann Delyser,et al.  Introducing Student Assessments with Evidence of Validity for NYC's CS4All , 2016, WiPSCE.

[22]  Natalja Menold,et al.  Methodological Aspects of Focus Groups in Health Research , 2016, Global qualitative nursing research.

[23]  David A. Squires,et al.  Curriculum Alignment Research Suggests That Alignment Can Improve Student Achievement , 2012 .

[24]  J. Bergold,et al.  Participatory Research Methods: A Methodological Approach in Motion , 2012 .

[25]  Linda Darling-Hammond,et al.  Evaluating Teacher Evaluation , 2012 .

[26]  Robert J. Marzano,et al.  Designing & assessing educational objectives : applying the new taxonomy , 2008 .

[27]  Robin Jones,et al.  Culturally Relevant Assessment of Indigenous Offenders: A Literature Review , 2002 .

[28]  J. Sarama,et al.  Early Childhood Mathematics Education Research: Learning Trajectories for Young Children , 2009 .

[29]  Susanne E. Hambrusch,et al.  Introducing computational thinking in education courses , 2011, SIGCSE.

[30]  Brian A. Jacob,et al.  Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education , 2008, Journal of Labor Economics.

[31]  V. Shute,et al.  Personal and Social-Contextual Factors in K–12 Academic Performance: An Integrative Perspective on Student Learning , 2010 .

[32]  Shuchi Grover,et al.  Measuring Student Learning in Introductory Block-Based Programming: Examining Misconceptions of Loops, Variables, and Boolean Logic , 2017, SIGCSE.

[33]  Karen Shakman,et al.  Logic Models for Program Design, Implementation, and Evaluation: Workshop Toolkit. REL 2015-057. , 2015 .

[34]  Michael S. Horn,et al.  Interactive Assessment Tools for Computational Thinking in High School STEM Classrooms , 2014, INTETAIN.

[35]  M. Nazaré,et al.  Supervision and Evaluation: Teachers' Perspectives , 2013 .

[36]  Dylan Wiliam,et al.  Studying changes in the practice of two teachers developing assessment for learning , 2005 .

[37]  J. Nagaoka,et al.  Teaching Adolescents To Become Learners The Role of Noncognitive Factors in Shaping School Performance: A Critical Literature Review , 2013 .

[38]  Rebecca Vivian,et al.  A survey of Australian teachers' self-efficacy and assessment approaches for the K-12 digital technologies curriculum , 2018, WiPSCE.

[39]  Gregorio Robles,et al.  Dr. Scratch: Automatic Analysis of Scratch Projects to Assess and Foster Computational Thinking , 2015 .

[40]  Sverre Tveit,et al.  Educational assessment in Norway , 2014 .

[41]  Roland Mittermeir,et al.  Computer science/informatics in secondary education , 2011, ITiCSE-WGR.

[42]  James E. Savage,et al.  Testing Minorities: Developing More Culturally Relevant Assessment Systems. , 1977 .

[43]  Hülya Yıldızlı,et al.  Classroom Assessment Practices of Teachers in Turkey , 2018, International Journal of Instruction.

[44]  J. Remillard.  Can Curriculum Materials Support Teachers' Learning? Two Fourth-Grade Teachers' Use of a New Mathematics Text , 2000, The Elementary School Journal.

[45]  Ulemu Luhanga,et al.  Teachers’ approaches to classroom assessment: a large-scale survey , 2016 .

[46]  Richard Lehrer,et al.  Tracing a Prospective Learning Progression for Developing Understanding of Evolution , 2005 .

[47]  Brandon R. Rodriguez,et al.  Assessing computational thinking in Computer Science Unplugged activities , 2016 .

[48]  Francesco Maiorana,et al.  An International Study Piloting the MEasuring TeacheR Enacted Computing Curriculum (METRECC) Instrument , 2019, ITiCSE-WGR.

[49]  Linda M. Seiter,et al.  Modeling the learning progressions of computational thinking of primary grade students , 2013, ICER.

[50]  B. Ireland.  National Council for Curriculum and Assessment , 2005 .