Auto-Sending Messages in an Intelligent Orchestration System: A Pilot Study

FACT (Formative Assessment with Computational Technology) is an intelligent orchestration system. That is, because it helps the teacher manage the workflow of a complicated set of activities in the classroom, it is an orchestration system. Because it conducts tasks-specific and domain-specific analyses of the students’ mathematical products and their group interactions, it is more intelligent than other orchestration systems. From analyzing videos of our iterative development trials, we realized that too many students needed help simultaneously, but the teacher could only visit one group at a time. Thus, we modified FACT to send a few messages to the students directly instead of sending all its advice to the teacher. This paper reports a successful pilot test of auto-sending.

[1]  Saskia Bakker,et al.  Lernanto: Using an Ambient Display During Differentiated Instruction , 2016, CHI Extended Abstracts.

[2]  Thanasis Hadzilacos,et al.  FROG: rapid prototyping of collaborative learning scenarios , 2017 .

[3]  Davinia Hernández Leo,et al.  Technology-Supported Orchestration Matters: Outperforming Paper-Based Scripting in a Jigsaw Classroom , 2014, IEEE Transactions on Learning Technologies.

[4]  Judy Kay,et al.  MTFeedback: Providing Notifications to Enhance Teacher Awareness of Small Group Work in the Classroom , 2015, IEEE Transactions on Learning Technologies.

[5]  Vincent Aleven,et al.  Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms , 2018, AIED.

[6]  Alan H. Schoenfeld,et al.  How can fact encourage collaboration and selfcorrection , 2018 .

[7]  Kurt VanLehn,et al.  Using the Tablet Gestures and Speech of Pairs of Students to Classify Their Collaboration , 2018, IEEE Transactions on Learning Technologies.

[8]  Kurt VanLehn,et al.  Can an orchestration system increase collaborative, productive struggle in teaching-by-eliciting classrooms? , 2019, Interact. Learn. Environ..

[9]  Pierre Dillenbourg,et al.  Technology for Classroom Orchestration , 2010 .

[10]  Kurt VanLehn,et al.  A Preliminary Evaluation of the Usability of an AI-Infused Orchestration System , 2018, AIED.

[11]  Emma Mercier,et al.  Multi-touch tables and collaborative learning , 2012, Br. J. Educ. Technol..

[12]  Pierre Dillenbourg,et al.  An Ambient Awareness Tool for Supporting Supervised Collaborative Problem Solving , 2012, IEEE Transactions on Learning Technologies.

[13]  Mahmoud Abdulwahed,et al.  Orchestrating technology enhanced learning: a literature review and a conceptual framework , 2011 .

[14]  Judy Kay,et al.  TSCL: A conceptual model to inform understanding of collaborative learning processes at interactive tabletops , 2015, Int. J. Hum. Comput. Stud..

[15]  Kurt VanLehn,et al.  Some less obvious features of classroom orchestration systems , 2016 .

[16]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[17]  Thanasis Hadzilacos,et al.  Orchestration Graphs: Enabling Rich Social Pedagogical Scenarios in MOOCs , 2017, L@S.

[18]  Yannis A. Dimitriadis,et al.  Supporting orchestration of CSCL scenarios in web-based Distributed Learning Environments , 2014, Comput. Educ..

[19]  Kurt VanLehn,et al.  The Effect of Digital Versus Traditional Orchestration on Collaboration in Small Groups , 2018, AIED.

[20]  Chee-Kit Looi,et al.  Group Scribbles to Support Knowledge Building in Jigsaw Method , 2008, IEEE Transactions on Learning Technologies.

[21]  Emma Mary Mercier,et al.  Teacher orchestration and student learning during mathematics activities in a smart classroom , 2016 .

[22]  Inge Molenaar,et al.  The effects of a learning analytics empowered technology on students' arithmetic skill development , 2017, LAK.

[23]  Lenh Hung Son Do.  Supporting Reflection and Classroom Orchestration with Tangible Tabletops , 2012 .

[24]  Inge Molenaar,et al.  Teacher Dashboards in Practice: Usage and Impact , 2017, EC-TEL.

[25]  Matthew Berland,et al.  AMOEBA: Designing for collaboration in computer science classrooms through live learning analytics , 2015, International Journal of Computer-Supported Collaborative Learning.

[26]  Joan L. Herman,et al.  The Implementation and Effects of the Mathematics Design Collaborative (MDC): Early Findings from Kentucky Ninth-Grade Algebra 1 Courses. CRESST Report 845. , 2015 .