The Role of Evidence Centered Design and Participatory Design in a Playful Assessment for Computational Thinking About Data

The K-12 CS Framework provides guidance on what concepts and practices students are expected to know and demonstrate within different grade bands. For these guidelines to be useful in CS education, a critical next step is to translate the guidelines to explicit learning targets and design aligned instructional tools and assessments. Our research and development goal in this paper is to design a playful, curriculum-neutral assessment aligned with the 'Data and Analysis' concept (grades 6-8) from the CS framework. Using Evidence Centered Design and Participatory Design, we present a set of assessment guidelines for assessing data and analysis, as well as a set of design considerations for integrating data and analysis across middle school curricula in CS and non-CS contexts. We outline these contributions, describe how they were applied to the development of a game-based formative assessment for data and analysis, and present preliminary findings on student understanding and challenges inferred from student gameplay.

[1]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[2]  Leigh Ann Delyser,et al.  Concepts and Practices: Designing and Developing A Modern K-12 CS Framework , 2017, SIGCSE.

[3]  Robert J. Mislevy,et al.  Implications of Evidence‐Centered Design for Educational Testing , 2007 .

[4]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[5]  Edith S. Gummer,et al.  A Systemic View of Implementing Data Literacy in Educator Preparation , 2013 .

[6]  Michael S. Horn,et al.  Computational Thinking in Constructionist Video Games , 2016, Int. J. Game Based Learn..

[7]  Matthew Berland,et al.  Making, Tinkering, and Computational Literacy , 2016 .

[8]  Michael S. Horn,et al.  Interactive Assessment Tools for Computational Thinking in High School STEM Classrooms , 2014, INTETAIN.

[9]  Jason C. Yip,et al.  Participatory Design for Learning : Perspectives from Practice and Research , 2017 .

[10]  Uri Wilensky,et al.  Designing Educational Video Games to Be Objects-to-Think-With , 2018, Journal of the Learning Sciences.

[11]  Saul Greenberg,et al.  Working Through Task-Centered System Design , 2003 .

[12]  Jason C. Yip,et al.  Participatory Design for Learning , 2017 .

[13]  Betsy DiSalvo,et al.  Designing for Democracy in Education: Participatory Design and the Learning Sciences , 2014, ICLS.

[14]  Larry Cuban How Teachers Taught: Constancy and Change in American Classrooms, 1890-1990 , 1984 .

[15]  Dan Laughey Music and Youth Culture , 2006 .

[16]  Robert J. Mislevy,et al.  Validity by Design , 2007 .

[17]  Joanna Goode,et al.  Beyond curriculum: the exploring computer science program , 2012, INROADS.

[18]  Taylor Martin,et al.  Using Learning Analytics to Understand the Learning Pathways of Novice Programmers , 2013 .

[19]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .