Co-design for a Competency Self-assessment Chatbot and Survey in Science Education

This paper describes a co-design process for a formative assessment tool in the area of core competencies such as creativity, communication, collaboration, and critical thinking. This process has been carried out in the context of non-formal science education institutions in 19 countries in Europe and the Middle East. The results of the co-design have been influential in the design of a formative assessment chatbot and survey that supports learner competency and self-regulation. We also discuss some preliminary results from the use of the tool and introduce additional considerations with regard to inclusion, technical aspects, and ethics, towards a set of best practices in this area.

[1]  Gnanathusharan Rajendran,et al.  Computer mediated interaction in Asperger's syndrome: the Bubble Dialogue program , 2000, Comput. Educ..

[2]  Stephen Crown,et al.  Ann G. Neering: Interactive Chatbot To Motivate And Engage Engineering Students , 2010 .

[3]  Elliot Soloway,et al.  Deconstructing and reconstructing: Transforming primary science learning via a mobilized curriculum , 2010, Comput. Educ..

[4]  Bena Kallick,et al.  Assessment Strategies for Self-Directed Learning , 2003 .

[5]  Maria Koutsombogera,et al.  Introduction: User Experience in and for Learning , 2018, Designing for the User Experience in Learning Systems.

[6]  Bo Westerlund,et al.  Experiencing, Exploring and Experimenting in and with Co-Design Spaces , 2011, Nordes 2011: Making Design Matter.

[7]  L. Suchman,et al.  Reconstructing Technologies as Social Practice , 1999 .

[8]  Matthias Söllner,et al.  Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis , 2018, Academy of Management Proceedings.

[9]  Allison Druin,et al.  Embedding Participatory Design into Designs for Learning: An Untapped Interdisciplinary Resource? , 2013, CSCL.

[10]  Elizabeth B.-N. Sanders,et al.  From user-centered to participatory design approaches , 2002 .

[11]  Jeremy Roschelle,et al.  Designing Formative Assessment Software with Teachers: an Analysis of the Co-Design Process , 2007, Res. Pract. Technol. Enhanc. Learn..

[12]  P BighamJeffrey,et al.  Inspiring blind high school students to pursue computer science with instant messaging chatbots , 2008 .

[13]  Bertram C. Bruce.  Technology as Social Practice , 1996 .

[14]  Ernesto Panadero,et al.  Self-assessment: Theoretical and Practical Connotations. When it Happens, How is it Acquired and what to do to Develop it in our Students , 2013 .

[15]  Ian O'Keeffe,et al.  A Universally Accessible Self-assessment Gamified Framework and Software Application to Capture 21st Century Skills , 2018, Designing for the User Experience in Learning Systems.

[16]  M. Warschauer,et al.  Technology and Equity in Schooling: Deconstructing the Digital Divide , 2004 .

[17]  Richard E. Ladner,et al.  Inspiring blind high school students to pursue computer science with instant messaging chatbots , 2008, SIGCSE '08.

[18]  Teemu Leinonen,et al.  Software as hypothesis: research-based design methodology , 2008, PDC.

[19]  Marcelo Milrad,et al.  Integrating Co-design Practices into the Development of Mobile Science Collaboratories , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[20]  Guillem Garcia Brustenga,et al.  Briefing paper: chatbots in education , 2018 .

[21]  Manfred Tscheligi,et al.  SIG: Chatbots for Social Good , 2018, CHI Extended Abstracts.

[22]  Rupert Wegerif,et al.  The role of educational software as a support for teaching and learning conversations , 2004, Comput. Educ..

[23]  Annika Silvervarg,et al.  Steps towards a Challenging Teachable Agent , 2014, IVA.