Adaptive Feedback Based on Student Emotion in a System for Programming Practice

We developed a system for programming practice that provides adaptive feedback based on the presence of confusion on the student. The system provides two types of adaptive feedback. First, it can control the complexity of the exercises presented to the student. Second, it can offer guides for the exercises when needed. These feedback are based on the presence of confusion, which is detected based on the student’s compilations, typing activity, and facial expressions using a hidden Markov model trained on data collected from introductory programming course students. In this paper we discuss the system, the approach for detecting confusion, and the types of adaptive feedback displayed. We tested our system on Japanese university students and discuss the results and their feedback. This study can lay the foundation for the development of intelligent programming tutors that can generate personalized learning content based on the state of the individual learner.

[1]  Randy Pausch,et al.  Alice: a 3-D tool for introductory programming concepts , 2000 .

[2]  Johan Jeuring,et al.  Strategy-based feedback in a programming tutor , 2014, CSERC.

[3]  Andrew C. Myers,et al.  Teaching Programming with Gamified Semantics , 2017, CHI.

[4]  Kristy Elizabeth Boyer,et al.  Automatically Recognizing Facial Indicators of Frustration: A Learning-centric Analysis , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[5]  Brad A. Myers,et al.  Taxonomies of visual programming and program visualization , 1990, J. Vis. Lang. Comput..

[6]  Johan Jeuring,et al.  Ask-Elle: an Adaptable Programming Tutor for Haskell Giving Automated Feedback , 2017, International Journal of Artificial Intelligence in Education.

[7]  Nguyen-Thinh Le,et al.  A Classification of Adaptive Feedback in Educational Systems for Programming , 2016, Syst..

[8]  Kirsti Ala-Mutka,et al.  A study of the difficulties of novice programmers , 2005, ITiCSE '05.

[9]  Kristy Elizabeth Boyer,et al.  Predicting Facial Indicators of Confusion with Hidden Markov Models , 2011, ACII.

[10]  Eric Rosenbaum,et al.  Scratch: programming for all , 2009, Commun. ACM.

[11]  Fred Paas,et al.  Personalised adaptive task selection in air traffic control: Effects on training efficiency and transfer , 2006 .

[12]  Beverly Park Woolf,et al.  Affect-aware tutors: recognising and responding to student affect , 2009, Int. J. Learn. Technol..

[13]  Kaoru Sumi,et al.  Analyzing Facial Expressions and Hand Gestures in Filipino Students' Programming Sessions , 2017, 2017 International Conference on Culture and Computing (Culture and Computing).

[14]  K. Fulton.  Upside down and inside out: Flip Your Classroom to Improve Student Learning. , 2012 .

[15]  Rui Dias,et al.  Using lab exams to ensure programming practice in an introductory programming course , 2003 .

[16]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[17]  Sidney K. D'Mello,et al.  What Emotions Do Novices Experience during Their First Computer Programming Learning Session? , 2013, AIED.

[18]  Ryan Shaun Joazeiro de Baker,et al.  Affective and behavioral predictors of novice programmer achievement , 2009, ITiCSE.

[19]  Nik Thompson,et al.  Genetics with Jean: the design, development and evaluation of an affective tutoring system , 2017 .

[20]  Ryan Shaun Joazeiro de Baker,et al.  Exploring the Relationship between Novice Programmer Confusion and Achievement , 2011, ACII.

[21]  Claude Frasson,et al.  Managing Learner's Affective States in Intelligent Tutoring Systems , 2010, Advances in Intelligent Tutoring Systems.

[22]  Kenneth R. Koedinger,et al.  Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor , 2017, International Journal of Artificial Intelligence in Education.

[23]  A. Graesser,et al.  A Motivationally Supportive Affect-Sensitive AutoTutor , 2011 .

[24]  Judith Masthoff,et al.  Conceptualizing a Framework for Adaptive Exercise Selection with Personality as a Major Learner Characteristic , 2017, UMAP.

[25]  Erica Melis,et al.  Global Feedback in ActiveMath. , 2005 .

[26]  Kristy Elizabeth Boyer,et al.  Embodied Affect in Tutorial Dialogue: Student Gesture and Posture , 2013, AIED.

[27]  Ramón Zataraín-Cabada,et al.  An Affective Learning Environment for Java , 2015, 2015 IEEE 15th International Conference on Advanced Learning Technologies.

[28]  J. Piaget,et al.  The Origins of Intelligence in Children , 1971 .

[29]  Ian Douglas Sanders,et al.  Introducing Code Adviser: A DFA-driven Electronic Programming Tutor , 2015, CIAA.