Gathering Requirements for Teacher Tools: Strategies for Empowering Teachers Through Co-Design

Technology can enhance teachers’ practice in multiple ways. It can help them better understand patterns in their students’ thinking, manage class progress at individual and group levels, and obtain evidence to inform modifications to curriculum and instruction. Such technology is most effective when it is aligned with teachers’ goals and expectations. Participatory methods, which involve teachers closely in the design process, are widely recommended for establishing accurate design requirements that address users’ needs. By collaborating with researchers, teachers can contribute their professional expertise to shape the tools of their practice, and ultimately ensure their sustained use. However, there is little guidance available for maintaining effective teacher–researcher design partnerships. We describe four strategies for engaging teachers in designing tools intended to support and enhance their practice within a web-based science learning environment: discussing physical artifacts, reacting to scenarios, customizing prototypes, and writing user stories. Using design artifacts and documents of teachers’ reflections, we illustrate how we applied these techniques over 5 years of annual professional development workshops, and examine their affordances for eliciting teachers’ ideas. We reflect on how these approaches have helped inform technology refinements and innovations. We moreover discuss the further benefits these strategies have had in encouraging teachers to reflect on their own practice and on the roles of technology in supporting it; and in allowing researchers to gain a deeper understanding of the relationship between technology, teaching, and design.

[1]  Frank Maurer,et al.  User-Centered Design and Agile Methods: A Systematic Review , 2011, 2011 AGILE Conference.

[2]  Kaj Grønbæk,et al.  Toward a cooperative experimental system development approach , 1997 .

[3]  Samuel J. Severance,et al.  Designing a Deeply Digital Science Curriculum: Supporting Teacher Learning and Implementation with Organizing Technologies , 2016 .

[4]  Dan Saffer,et al.  Designing for Interaction: Creating Innovative Applications and Devices , 2009 .

[5]  John M. Carroll,et al.  Five reasons for scenario-based design , 2000, Interact. Comput..

[6]  Khalid Bingimlas Barriers to the Successful Integration of ICT in Teaching and Learning Environments: A Review of the Literature , 2009 .

[7]  Camillia Matuk,et al.  The idea manager: A tool to scaffold students in documenting, sorting, and distinguishing ideas during science inquiry , 2012 .

[8]  John J. Rheinfrank,et al.  Design for Usability: Crafting a Strategy for the Design of a New Generation of Xerox Copiers , 1992, Usability - Turning Technologies into Tools.

[9]  P. Luff,et al.  Tasks and social interaction: the relevance of naturalistic analyses of conduct for requirements engineering , 1993, [1993] Proceedings of the IEEE International Symposium on Requirements Engineering.

[10]  Fred Paas,et al.  Exploring teachers' instructional design practices from a systems design perspective , 2002 .

[11]  Jeremy Roschelle,et al.  Co-design of Innovations with Teachers: Definition and Dynamics , 2006, ICLS.

[12]  Eleni A. Kyza,et al.  Investigating the Mutual Adaptation Process in Teachers' Design of Technology-Infused Curricula , 2000 .

[13]  William R. Penuel,et al.  The Connected School: Technology and Learning in High School , 2001 .

[14]  Michele W. Spitulnik,et al.  Teacher Use of Evidence to Customize Inquiry Science Instruction. , 2010 .

[15]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[16]  Pedro A. Szekely User Interface Prototyping: Tools and Techniques , 1994, ICSE Workshop on SE-HCI.

[17]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[18]  T. Seidel,et al.  Participatory design of learning environments: integrating perspectives of students, teachers, and designers , 2014 .

[19]  Joke Voogt,et al.  Understanding decision making in teachers’ curriculum design approaches , 2014, Educational Technology Research and Development.

[20]  Batya Friedman,et al.  Human values and the design of computer technology , 1997 .

[21]  Tom Rodden,et al.  Informing the Development of Calendar Systems for Domestic Use , 2003, ECSCW.

[22]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[23]  S. Barab,et al.  Building sustainable science curriculum: Acknowledging and accommodating local adaptation , 2003 .

[24]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[25]  Carol S. Lidz,et al.  Dynamic assessment: An interactional approach to evaluating learning potential. , 1987 .

[26]  Anna N. Rafferty,et al.  Promoting Student Learning through Automated Formative Guidance on Chemistry Drawings , 2014, ICLS.

[27]  Libby Gerard,et al.  How Do Openers Contribute to Student Learning , 2012 .

[28]  Amedeo Giorgi,et al.  An Application of Phenomenological Method in Psychology , 1975 .

[29]  A. Huberman,et al.  Qualitative Data Analysis: A Methods Sourcebook , 1994 .

[30]  Georges Van der Perre,et al.  Innovating Education Through the Use of New Technologies: Reflections from the Field (Part 1) , 1997 .

[31]  A. Cook‐Sather Multiplying perspectives and improving practice: what can happen when undergraduate students collaborate with college faculty to explore teaching and learning , 2014 .

[32]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[33]  John Bowers,et al.  Talking through design: requirements and resistance in cooperative prototyping , 1994, CHI '94.

[34]  P. Black,et al.  Inside the Black Box: Raising Standards Through Classroom Assessment Formative assessment is an essential component of classroom work and can raise student achievement. , 2010 .

[35]  Brendan Walker,et al.  Cultural probes and the value of uncertainty , 2004, INTR.

[36]  Eva Brandt,et al.  Designing exploratory design games: a framework for participation in Participatory Design? , 2006, PDC '06.

[37]  Linda A. Macaulay Requirements capture as a cooperative activity , 1993, [1993] Proceedings of the IEEE International Symposium on Requirements Engineering.

[38]  James D. Slotta,et al.  Teachers as participatory designers: two case studies with technology-enhanced learning environments , 2015 .

[39]  Alan Borning,et al.  Value Sensitive Design: Theory and Methods , 2002 .

[40]  Erik Stolterman,et al.  The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas , 2008, TCHI.

[41]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[42]  Ron Owston,et al.  Contextual factors that sustain innovative pedagogical practice using technology: an international study , 2007 .

[43]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[44]  Camillia Matuk,et al.  Technology to support teachers using evidence from student work to customize technology-enhanced inquiry units , 2015, Instructional Science.

[45]  Randall H. Trigg,et al.  Open-Ended Interaction in Coorperative Prototyping: A Video-Based Analysis , 1991, Scand. J. Inf. Syst..

[46]  Michael J. Muller,et al.  Taxonomy of PD Practices: A Brief Practitioner's Guide , 1993, Commun. ACM.

[47]  Rivka Oxman,et al.  Precedents in design: a computational model for the organization of precedent knowledge , 1994 .

[48]  James M. Bieman,et al.  Rapid Prototyping: Lessons Learned , 1995, IEEE Softw..

[49]  A. Lancaster,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2004, IEEE Transactions on Professional Communication.

[50]  James D. Slotta,et al.  Co-designing curricula to promote collaborative knowledge construction in secondary school science , 2009, CSCL.

[51]  Pelle Ehn,et al.  Scandinavian Design: On Participation and Skill , 1992, Usability - Turning Technologies into Tools.

[52]  Linda S. Lotto Qualitative Data Analysis: A Sourcebook of New Methods , 1986 .

[53]  B. Lawson Schemata, gambits and precedent: some factors in design expertise , 2004 .

[54]  Mary Beth Rosson,et al.  Scenario-based design , 2002 .

[55]  W. Penuel,et al.  Organizing Research and Development at the Intersection of Learning, Implementation, and Design , 2011 .

[56]  Daniel C. Edelson Design Research: What We Learn When We Engage in Design , 2002 .

[57]  Hilary Johnson,et al.  Structured approaches to participatory design for children: can targeting the needs of children with autism provide benefits for a broader child population? , 2014 .

[58]  Mike Cohn,et al.  User Stories Applied: For Agile Software Development , 2004 .

[59]  Preben Mogensen,et al.  Towards a Provotyping Approach in Systems Development , 1992, Scand. J. Inf. Syst..

[60]  Elizabeth Boling,et al.  The Need for Design Cases: Disseminating Design Knowledge , 2010 .

[61]  Masaki Suwa,et al.  Unexpected discoveries and S-invention of design requirements , 2000 .

[62]  Yael Kali,et al.  Teachers as designers of technology enhanced learning , 2015, Instructional Science.

[63]  J. Charteris,et al.  Teacher agency and dialogic feedback: Using classroom data for practitioner inquiry , 2015 .

[64]  Susanne Bødker,et al.  Scenarios in user-centred design-setting the stage for reflection and action , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[65]  Jeremy Roschelle,et al.  Designing Formative Assessment Software with Teachers: an Analysis of the Co-Design Process , 2007, Res. Pract. Technol. Enhanc. Learn..

[66]  Kennon M. Smith,et al.  Producing the Rigorous Design Case , 2018, International Journal of Designs for Learning.

[67]  Finn Kensing,et al.  Participatory Design: Issues and Concerns , 2004, Computer Supported Cooperative Work (CSCW).

[68]  E. Soloway,et al.  Creating Usable Innovations in Systemic Reform: Scaling Up Technology-Embedded Project-Based Science in Urban Schools , 2000 .

[69]  Alison A. Carr,et al.  User-design in the creation of human learning systems , 1997 .

[70]  Marcia C. Linn,et al.  WISE Science: Web-Based Inquiry in the Classroom , 2009 .

[71]  Susan K. Lippert,et al.  Utilization of information technology: examining cognitive and experiential factors of post-adoption behavior , 2005, IEEE Transactions on Engineering Management.

[72]  Camillia Matuk,et al.  The WISE Idea Manager: A tool to scaffold the collaborative construction of evidence-based explanations from dynamic scientific visualizations , 2011 .

[73]  Mark Guzdial,et al.  Learner-centered design: the challenge for HCI in the 21st century , 1994, INTR.

[74]  Gert Biesta,et al.  How is agency possible? Towards an ecological understanding of agency-as-achievement , 2006 .

[75]  Miriam Ben-Peretz,et al.  The Teacher-Curriculum Encounter , 1990 .

[76]  Susanne Bødker,et al.  The AT-project: practical research in cooperative design , 1993 .

[77]  P. Kirschner,et al.  Do Learners Really Know Best? Urban Legends in Education , 2013 .

[78]  William W. Gaver,et al.  Projected realities: conceptual design for cultural effect , 1999, CHI '99.

[79]  Morten Kyng,et al.  Cardboard Computers: Mocking-it-up or Hands-on the Future , 1992 .

[80]  Heinz Ulrich Hoppe,et al.  Classroom orchestration: Synthesis , 2013, Comput. Educ..

[81]  Camillia Matuk,et al.  Exploring A Digital Tool for Exchanging Ideas During Science Inquiry , 2014, ICLS.

[82]  Camillia Matuk,et al.  Using the Idea Manager to Promote Coherent Understanding of Inquiry Investigations , 2012, ICLS.

[83]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[84]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[85]  Gert Biesta,et al.  Education, Accountability, and the Ethical Demand: Can the Democratic Potential of Accountability Be Regained? , 2004 .

[86]  Steve Murphy,et al.  Lessons Learned from Using Personas and Scenarios for Requirements Specification of Next-Generation Industrial Robots , 2011, HCI.

[87]  Steven D. Tripp,et al.  Rapid prototyping: An alternative instructional design strategy , 1990 .

[88]  Lene Nielsen,et al.  Engaging Personas and Narrative Scenarios , 2004 .

[89]  Andy Crabtree,et al.  Design in the absence of practice: breaching experiments , 2004, DIS '04.

[90]  Masaki Suwa,et al.  What do architects and students perceive in their design sketches? A protocol analysis , 1997 .