Factors Influencing Students' Help-Seeking Behavior while Programming with Human and Computer Tutors

When novice students encounter difficulty when learning to program, some can seek help from instructors or teaching assistants. This one-on-one tutoring is highly effective at fostering learning, but busy instructors and large class sizes can make expert help a scarce resource. Increasingly, programming environments attempt to imitate this human support by providing students with hints and feedback. In order to design effective, computer-based help, it is important to understand how and why students seek and avoid help when programming, and how this process differs when the help is provided by a human or a computer. We explore these questions through a qualitative analysis of 15 students' interviews, in which they reflect on solving two programming problems with human and computer help. We discuss implications for help design and present hypotheses on students' help-seeking behavior.

[1]  Sue Fitzgerald,et al.  Strategies that students use to trace code: an analysis based in grounded theory , 2005, ICER '05.

[2]  D. Wood,et al.  Help seeking, learning and contingent tutoring , 1999, Comput. Educ..

[3]  Andrew Luxton-Reilly,et al.  Enhancing syntax error messages appears ineffectual , 2014, ITiCSE '14.

[4]  Thomas W. Price,et al.  Generating Data-driven Hints for Open-ended Programming , 2016, EDM.

[5]  Colleen M. Lewis,et al.  Deciding to major in computer science: a grounded theory of students' self-assessment of ability , 2011, ICER.

[6]  Julien Mercier,et al.  The structure of the help-seeking process in collaboratively using a computer coach in problem-based learning , 2008, Comput. Educ..

[7]  Beth Simon,et al.  CS majors' self-efficacy perceptions in CS1: results in light of social cognitive theory , 2011, ICER.

[8]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[9]  Hans van der Meij,et al.  Constraints on Question Asking in Classrooms. , 1988 .

[10]  Stuart A. Karabenick,et al.  Perceived Achievement Goal Structure and College Student Help Seeking. , 2004 .

[11]  R. Butler Determinants of help seeking : Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context , 1998 .

[12]  A. Strauss,et al.  Grounded theory , 2017 .

[13]  Brad A. Myers,et al.  Designing the whyline: a debugging interface for asking questions about program behavior , 2004, CHI.

[14]  P. Pintrich,et al.  "Should I ask for help?" The role of motivation and attitudes in adolescents' help seeking in math class. , 1997 .

[15]  Thomas W. Price,et al.  Hint Generation Under Uncertainty: The Effect of Hint Quality on Help-Seeking Behavior , 2017, AIED.

[16]  Carol Midgley,et al.  Avoiding Seeking Help in the Classroom: Who and Why? , 2001 .

[17]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[18]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[19]  Johan Jeuring,et al.  Ask-Elle: an Adaptable Programming Tutor for Haskell Giving Automated Feedback , 2017, International Journal of Artificial Intelligence in Education.

[20]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[21]  Lauri Malmi,et al.  A Review of Generic Program Visualization Systems for Introductory Programming Education , 2013, TOCE.

[22]  Kenneth R. Koedinger,et al.  Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor , 2015, International Journal of Artificial Intelligence in Education.

[23]  Vincent Aleven,et al.  Help Helps, But Only So Much: Research on Help Seeking with Intelligent Tutoring Systems , 2016, International Journal of Artificial Intelligence in Education.

[24]  Vincent Aleven,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006, Int. J. Artif. Intell. Educ..

[25]  D. Wood Scaffolding, contingent tutoring and computer-supported learning , 2001 .

[26]  Tiffany Barnes,et al.  Preface for the Special Issue on AI-Supported Education in Computer Science , 2017, International Journal of Artificial Intelligence in Education.

[27]  Vincent Aleven,et al.  The Help Tutor: Does Metacognitive Feedback Improve Students' Help-Seeking Actions, Skills and Learning? , 2006, Intelligent Tutoring Systems.

[28]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[29]  Briana B. Morrison Computer Science Is Different!: Educational Psychology Experiments Do Not Reliably Replicate in Programming Domain , 2015, ICER.

[30]  Johan Jeuring,et al.  University students' achievement goals and help-seeking strategies in an intelligent tutoring system , 2014, Comput. Educ..

[31]  Mark Guzdial,et al.  Subgoals, Context, and Worked Examples in Learning Computing Problem Solving , 2015, ICER.

[32]  Colleen M. Lewis,et al.  "I Don't Code All Day": Fitting in Computer Science When the Stereotypes Don't Fit , 2016, ICER.

[33]  Daniel D. Garcia,et al.  The beauty and joy of computing , 2015, Inroads.

[34]  Albert T. Corbett,et al.  Cognitive Computer Tutors: Solving the Two-Sigma Problem , 2001, User Modeling.

[35]  K. Charmaz,et al.  Qualitative interviewing and grounded theory analysis , 2012 .

[36]  S. Gall Help-seeking: An understudied problem-solving skill in children☆ , 1981 .

[37]  John R. Anderson,et al.  Locus of feedback control in computer-based tutoring: impact on learning rate, achievement and attitudes , 2001, CHI.

[38]  Sally Fincher,et al.  Where students go for knowledge and what they find there , 2013, ICER '13.

[39]  Beth Simon,et al.  Building theory about computing education phenomena: a discussion of grounded theory , 2010, Koli Calling.

[40]  Thomas W. Price,et al.  iSnap: Towards Intelligent Tutoring in Novice Programming Environments , 2017, SIGCSE.

[41]  James A. Holstein,et al.  The SAGE Handbook of Interview Research: The Complexity of the Craft , 2012 .

[42]  R. Newman Adaptive help seeking: A strategy of self-regulated learning. , 1994 .

[43]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[44]  E. Stahl,et al.  Help-seeking in Interactive Learning Environments: Effectiveness of Help and Learner-related Factors in a Dyadic Setting , 2004, ICLS.

[45]  B. Zimmerman,et al.  Self-regulation of learning and performance: Issues and educational applications. , 1994 .

[46]  Christina Goulding,et al.  Grounded theory , 2015 .

[47]  Vincent Aleven,et al.  Limitations of Student Control: Do Students Know When They Need Help? , 2000, Intelligent Tutoring Systems.

[48]  Rose Luckin,et al.  Ecolab: the development and evaluation of a Vygotskian design framework , 1999 .

[49]  Beth Simon,et al.  Experiencing programming assignments in CS1: the emotional toll , 2010, ICER '10.