Unproductive Help-seeking in Programming: What it is and How to Address it

While programming, novices often lack the ability to effectively seek help, such as when to ask for a hint or feedback. Students may avoid help when they need it, or abuse help to avoid putting in effort, and both behaviors can impede learning. In this paper we present two main contributions. First, we investigated log data from students working in a programming environment that offers automated hints, and we propose a taxonomy of unproductive help-seeking behaviors in programming. Second, we used these findings to design a novel user interface for hints that subtly encourages students to seek help with the right frequency, estimated with a data-driven algorithm. We conducted a pilot study to evaluate our data-driven (DD) hint display, compared to a traditional interface, where students request hints on-demand as desired. We found students with the DD display were less than half as likely to engage in unproductive help-seeking, and we found suggestive evidence that this may improve their learning.

[1]  M. Puustinen Help-seeking behavior in a problem-solving situation: Development of self-regulation , 1998 .

[2]  Joseph Jay Williams,et al.  The Impact of Adding Textual Explanations to Next-step Hints in a Novice Programming Environment , 2019, ITiCSE.

[3]  Neil T. Heffernan,et al.  Hints: Is It Better to Give or Wait to Be Asked? , 2010, Intelligent Tutoring Systems.

[4]  JeuringJohan,et al.  University students' achievement goals and help-seeking strategies in an intelligent tutoring system , 2014 .

[5]  Kurt VanLehn,et al.  A Comparison of Decision-Theoretic, Fixed-Policy and Random Tutorial Action Selection , 2006, Intelligent Tutoring Systems.

[6]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[7]  Joseph Jay Williams,et al.  An Evaluation of the Impact of Automated Programming Hints on Performance and Learning , 2019, ICER.

[8]  Piroska Biro,et al.  Deep and surface metacognitive processes in non-traditional programming tasks , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[9]  R. Newman Adaptive help seeking: A strategy of self-regulated learning. , 1994 .

[10]  VanlehnKurt,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005 .

[11]  Brett A. Becker,et al.  Effective compiler error message enhancement for novice programming students , 2016, Comput. Sci. Educ..

[12]  Kurt VanLehn,et al.  Effects of Dissuading Unnecessary Help Requests While Providing Proactive Help , 2005, AIED.

[13]  Ryan Shaun Joazeiro de Baker,et al.  Towards Predicting Future Transfer of Learning , 2011, AIED.

[14]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[15]  Brad A. Myers,et al.  Six Learning Barriers in End-User Programming Systems , 2004, 2004 IEEE Symposium on Visual Languages - Human Centric Computing.

[16]  Kenneth R. Koedinger,et al.  Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor , 2015, International Journal of Artificial Intelligence in Education.

[17]  Kirsten Berthold,et al.  Learning from worked-out examples , 2006 .

[18]  Antonija Mitrovic,et al.  The effect of positive feedback in a constraint-based intelligent tutoring system , 2013, Comput. Educ..

[19]  S. Gall Help-seeking: An understudied problem-solving skill in children☆ , 1981 .

[20]  John R. Anderson,et al.  Locus of feedback control in computer-based tutoring: impact on learning rate, achievement and attitudes , 2001, CHI.

[21]  Thomas W. Price,et al.  iSnap: Towards Intelligent Tutoring in Novice Programming Environments , 2017, SIGCSE.

[22]  Thomas W. Price,et al.  Factors Influencing Students' Help-Seeking Behavior while Programming with Human and Computer Tutors , 2017, ICER.

[23]  Vincent Aleven,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006, Int. J. Artif. Intell. Educ..

[24]  Davide Fossati,et al.  Data D riven A utomatic F eedback G eneration in the iList I ntelligent T utoring S ystem , 2014 .

[25]  Kazuhisa Miwa,et al.  Stoic Behavior in Hint Seeking when Learning using an Intelligent Tutoring System , 2013, CogSci.

[26]  AlevenVincent,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006 .

[27]  David E. Johnson ITCH: Individual Testing of Computer Homework for Scratch Assignments , 2016, SIGCSE.

[28]  Johan Jeuring,et al.  University students' achievement goals and help-seeking strategies in an intelligent tutoring system , 2014, Comput. Educ..

[29]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[30]  Nicholas Lytle,et al.  Crescendo: Engaging Students to Self-Paced Programming Practices , 2020, SIGCSE.

[31]  Vincent Aleven,et al.  Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems , 2016, International Journal of Artificial Intelligence in Education.

[32]  Cristina Conati,et al.  Providing Adaptive Support in an Interactive Simulation for Learning: An Experimental Evaluation , 2015, CHI.

[33]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[34]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[35]  Davide Fossati,et al.  Beyond the code-and-count analysis of tutoring dialogues , 2007, AIED.

[36]  A. Renkl Worked-out examples: instructional explanations support learning by self- explanations , 2002 .

[37]  Daniel D. Garcia,et al.  The beauty and joy of computing , 2015, Inroads.

[38]  Vincent Aleven,et al.  On the Benefits of Seeking (and Avoiding) Help in Online Problem-Solving Environments , 2014, Journal of the Learning Sciences.

[39]  M. Thurlings,et al.  Understanding feedback: A learning theory perspective , 2013 .

[40]  K. Koedinger,et al.  Investigations into Help Seeking and Learning with a Cognitive Tutor , 2001 .

[41]  Mitchell J. Nathan,et al.  Expert Blind Spot : When Content Knowledge Eclipses Pedagogical Content Knowledge , 2001 .

[42]  Thomas W. Price,et al.  Defining Tinkering Behavior in Open-ended Block-based Programming Assignments , 2019, SIGCSE.

[43]  Ronan G. Reilly,et al.  Examining the role of self-regulated learning on introductory programming performance , 2005, ICER '05.