Maestro: Designing a System for Real-Time Orchestration of 3D Modeling Workshops

Instructors of 3D design workshops for children face many challenges, including maintaining awareness of students' progress, helping students who need additional attention, and creating a fun experience while still achieving learning goals. To help address these challenges, we developed Maestro, a workshop orchestration system that visualizes students' progress, automatically detects and draws attention to common challenges faced by students, and provides mechanisms to address common student challenges as they occur. We present the design of Maestro, and the results of a case-study evaluation with an experienced facilitator and 13 children. The facilitator appreciated Maestro's real-time indications of which students were successfully following her tutorial demonstration, and recognized the system's potential to "extend her reach" while helping struggling students. Participant interaction data from the study provided support for our follow-along detection algorithm, and the capability to remind students to use 3D navigation.

[1]  K. Topping The effectiveness of peer tutoring in further and higher education: A typology and review of the literature , 1996 .

[2]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[3]  Tovi Grossman,et al.  Chronicle: capture, exploration, and playback of document workflow histories , 2010, UIST.

[4]  Francis K. H. Quek,et al.  Making the Maker: A Means-to-an-Ends approach to nurturing the Maker mindset in elementary-aged children , 2015, Int. J. Child Comput. Interact..

[5]  Neil T. Heffernan,et al.  Increasing Parent Engagement in Student Learning Using an Intelligent Tutoring System , 2011 .

[6]  Juan-Diego Zapata-Rivera,et al.  Keeping your audience in mind: applying audience analysis to the design of interactive score reports , 2014 .

[7]  Janet C. Read,et al.  Exploring children's designs for maker technologies , 2015, IDC.

[8]  Tovi Grossman,et al.  CADament: a gamified multiplayer software tutorial system , 2014, CHI.

[9]  Susan Wiedenbeck,et al.  Children as webmakers: designing a web editor for beginners , 2013, IDC.

[10]  Leonel Morales Diaz,et al.  Profiling styles of use in Alice: Identifying patterns of use by observing participants in workshops with Alice , 2015, 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond).

[11]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[12]  Tovi Grossman,et al.  Community enhanced tutorials: improving tutorials with multiple demonstrations , 2013, CHI.

[13]  Ryan Shaun Joazeiro de Baker,et al.  Towards Automatically Detecting Whether Student Learning is Shallow , 2012, International Journal of Artificial Intelligence in Education.

[14]  BakerRyan S. J. d.,et al.  Better to be frustrated than bored , 2010 .

[15]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[16]  Peter Brusilovsky,et al.  An Intelligent Interface for Learning Content: Combining an Open Learner Model and Social Comparison to Support Self-Regulated Learning and Engagement , 2016, IUI.

[17]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[18]  Yasmin B. Kafai,et al.  Making physical and digital games with e-textiles: a workshop for youth making responsive wearable games and controllers , 2015, IDC.

[19]  Adam Fourney,et al.  InterTwine: creating interapplication information scent to support coordinated use of software , 2014, UIST.

[20]  Tovi Grossman,et al.  Investigating How Online Help and Learning Resources Support Children's Use of 3D Design Software , 2018, CHI.

[21]  Konstantin Aal,et al.  3D Printing with Marginalized Children - An Exploration in a Palestinian Refugee Camp , 2015, ECSCW.

[22]  Philip J. Guo Codeopticon: Real-Time, One-To-Many Human Tutoring for Computer Programming , 2015, UIST.

[23]  William Billingsley,et al.  Indirect Interaction: A Computing Lecture for Five to Seven Year-Olds , 2016, Conference on Designing Interactive Systems.

[24]  Ryan Shaun Joazeiro de Baker,et al.  Stupid Tutoring Systems, Intelligent Humans , 2016, International Journal of Artificial Intelligence in Education.

[25]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[26]  Tessa A. Lau,et al.  Programming by demonstration: an inductive learning formulation , 1998, IUI '99.

[27]  B. K. Tripathy,et al.  Reinforcement learning approach towards effective content recommendation in MOOC environments , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[28]  Judy Kay,et al.  Learner Know Thyself: Student Models to Give Learner Control and Responsibility , 1997 .

[29]  Jack Mostow,et al.  How Who Should Practice: Using Learning Decomposition to Evaluate the Efficacy of Different Types of Practice for Different Types of Students , 2008, Intelligent Tutoring Systems.

[30]  Robin Jeffries,et al.  Undo and erase events as indicators of usability problems , 2009, CHI.

[31]  Zeny F. Mateo CREATING ACTIVE LEARNING IN A LARGE INTRODUCTORY STATISTICS CLASS USING CLICKER TECHNOLOGY , 2010 .

[32]  Berry Eggen,et al.  FireFlies2: Interactive Tangible Pixels to enable Distributed Cognition in Classroom Technologies , 2017, ISS.

[33]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[34]  Nathaniel Hudson,et al.  Understanding Newcomers to 3D Printing: Motivations, Workflows, and Barriers of Casual Makers , 2016, CHI.

[35]  Mira Dontcheva,et al.  Pause-and-play: automatically linking screencast video tutorials with applications , 2011, UIST.

[36]  Li-Yi Wei,et al.  History assisted view authoring for 3D models , 2014, CHI.

[37]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[38]  Chee-Kit Looi,et al.  Collaborative activities enabled by GroupScribbles (GS): An exploratory study of learning effectiveness , 2010, Comput. Educ..

[39]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..