The Affective Experience of Novice Computer Programmers

Novice students (N = 99) participated in a lab study in which they learned the fundamentals of computer programming in Python using a self-paced computerized learning environment involving a 25-min scaffolded learning phase and a 10-min unscaffolded fadeout phase. Students provided affect judgments at approximately 100 points (every 15 s) over the course of viewing videos of their faces and computer screens recorded during the learning session. The results indicated that engagement, confusion, frustration, boredom, and curiosity were the most frequent affective states, while anxiety, happiness, anger, surprise, disgust, sadness, and fear were rare. Confusion + frustration and curiosity + engagement were identified as two frequently co-occurring pairs of affective states. An analysis of affect dynamics indicated that there were reciprocal transitions between engagement and confusion, confusion and frustration, and one way transitions between frustration and boredom and boredom and engagement. Considering interaction events in tandem with affect revealed that constructing code was the central activity that preceded and followed each affective state. Further, confusion and frustration followed errors and preceded hint usage, while curiosity and engagement followed reading or coding. An analysis of affect-learning relationships after partialling out control variables (e.g., scholastic aptitude, hint usage) indicated that boredom (r = −.149) and frustration (r = −.218) were negative correlated with learning while transitions between confusion → frustration (r = .103), frustration → confusion (r = .105), and boredom → engagement (r = .282) were positively correlated with learning. Implications of the results to theory on affect incidence and dynamics and on the design of affect-aware learning environments are discussed.

[1]  Jaideep Srivastava,et al.  Selecting the right interestingness measure for association patterns , 2002, KDD.

[2]  Winslow Burleson,et al.  Affective agents: Sustaining motivation to learn through failure and state of "stuck" , 2004 .

[3]  Sidney K. D'Mello,et al.  Sequential Patterns of Affective States of Novice Programmers , 2013, AIED Workshops.

[4]  Arthur C. Graesser,et al.  Feeling, Thinking, and Computing with Affect-Aware Learning Technologies , 2015 .

[5]  Victor C. S. Lee,et al.  Learning motivation in e-learning facilitated computer programming courses , 2010, Comput. Educ..

[6]  Peter Brusilovsky,et al.  Exploring Problem Solving Paths in a Java Programming Course , 2014, PPIG.

[7]  R. Baker,et al.  I Feel Your Pain : A Selective Review of Affect-Sensitive Instructional Strategies , 2014 .

[8]  Robert M. Gonyea,et al.  Accuracy of Self-reported SAT and ACT Test Scores: Implications for Research , 2010 .

[9]  Bradford W. Mott,et al.  Adaptive Scaffolding in an Intelligent Game-Based Learning Environment for Computer Science , 2014 .

[10]  Ryan Shaun Joazeiro de Baker,et al.  Affective and behavioral predictors of novice programmer achievement , 2009, ITiCSE.

[11]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[12]  A. Graesser,et al.  Monitoring Affective Trajectories during Complex Learning , 2007 .

[13]  Arthur C. Graesser,et al.  Emote aloud during learning with AutoTutor: Applying the Facial Action Coding System to cognitive–affective states during learning , 2008 .

[14]  Ryan Shaun Joazeiro de Baker,et al.  Coarse-grained detection of student frustration in an introductory programming course , 2009, ICER '09.

[15]  A. Graesser,et al.  Dynamics of affective states during complex learning , 2012 .

[16]  S. D’Mello A selective meta-analysis on the relative incidence of discrete affective states during learning with technology , 2013 .

[17]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[18]  Scotty D. Craig,et al.  Affect and learning: An exploratory look into the role of affect in learning with AutoTutor , 2004 .

[19]  Carol Ann Alspaugh Identification of Some Components of Computer Programming Aptitude. , 1972 .

[20]  Robert M. Hierons,et al.  Mood independent programming , 2007, ECCE '07.

[21]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[22]  Amy M. Witherspoon,et al.  Detection of Emotions during Learning with AutoTutor , 2006 .

[23]  David S. Janzen,et al.  Improving first-year success and retention through interest-based CS0 courses , 2012, SIGCSE '12.

[24]  Reed W. Larson,et al.  Boredom in the Middle School Years: Blaming Schools versus Blaming Students , 1991, American Journal of Education.

[25]  Valerie J. Shute,et al.  Modeling Individual Differences in Programming Skill Acquisition , 1990 .

[26]  Kristy Elizabeth Boyer,et al.  Multimodal analysis of the implicit affective channel in computer-mediated textual communication , 2012, ICMI '12.

[27]  Sidney K. D'Mello,et al.  Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies , 2012, ICMI '12.

[28]  Arthur C. Graesser,et al.  Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features , 2010, User Modeling and User-Adapted Interaction.

[29]  A. Graesser,et al.  Confusion can be beneficial for learning. , 2014 .

[30]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[31]  Cristina Conati,et al.  Knowledge Elicitation Methods for Affect Modelling in Education , 2013, Int. J. Artif. Intell. Educ..

[32]  James C. Lester,et al.  Affective Transitions in Narrative-Centered Learning Environments , 2008, J. Educ. Technol. Soc..

[33]  Matthew C. Jadud A First Look at Novice Compilation Behaviour Using BlueJ , 2005, Comput. Sci. Educ..

[34]  P. Ekman,et al.  Coherence between expressive and experiential systems in emotion , 1994 .

[35]  Ryan S. Baker,et al.  Monitoring Novice Programmer Affect and Behaviors to Identify Learning Bottlenecks , 2009 .

[36]  Sidney K. D'Mello,et al.  What Emotions Do Novices Experience during Their First Computer Programming Learning Session? , 2013, AIED.

[37]  Sidney K. D'Mello,et al.  Antecedent-Consequent Relationships and Cyclical Patterns between Affective States and Problem Solving Outcomes , 2009, AIED.

[38]  Ryan Shaun Joazeiro de Baker,et al.  The Dynamics of Affective Transitions in Simulation Problem-Solving Environments , 2007, ACII.

[39]  Jason M. Harley,et al.  Measuring Learners' Co-Occurring Emotional Responses during Their Interaction with a Pedagogical Agent in MetaTutor , 2012, ITS.

[40]  Ryan Shaun Joazeiro de Baker,et al.  Exploring the Relationship between Novice Programmer Confusion and Achievement , 2011, ACII.

[41]  K. VanLehn,et al.  Why Do Only Some Events Cause Learning During Human Tutoring? , 2003 .

[42]  Pieter J. Blignaut,et al.  The influence of temperament style on a student's choice of and performance in a computer programming course , 2008, Comput. Hum. Behav..

[43]  Ryan Shaun Joazeiro de Baker,et al.  Accuracy vs. Availability Heuristic in Multimodal Affect Detection in the Wild , 2015, ICMI.

[44]  Sidney D'Mello,et al.  Confusion and its dynamics during device comprehension with breakdown scenarios. , 2014, Acta psychologica.