Investigating Students’ Preexisting Debugging Traits: A Real World Escape Room Study

Being able to find and fix errors is an essential skill in computer programming. Nevertheless, debugging poses a major hurdle in the K12 classroom, as students are often rather helpless and rely on the teacher hurrying from one student-PC to the other. Overall, there is a lack of respective concepts and materials for the classroom as well as research on how to teach debugging. According to the constructivist learning theory, teaching and developing concepts and materials for the classroom must take learners’ preexisting experience into account to be effective. In their daily lives, students are confronted with errors long before they build programming experience: Whether there is a problem with “the internet” or with their bicycle, they are troubleshooting and locating and fixing errors. Debugging is a special case of general troubleshooting and shares common characteristics, such as the overall process or particular strategies. Thus, the aim of this study is to investigate students’ preexisting debugging traits. To this end, we developed a real-world escape room consisting of debugging-related troubleshooting exercises. This allows us to observe students’ troubleshooting behavior in a natural environment. Building upon this, we employed the escape room approach with around 150 high school students and analyzed the resulting video data. Based on the data we identify preexisting debugging traits such as students struggling to generate hypotheses or to undo changes. Furthermore, they are not able to effectively test a system and struggle with cognitive load in topographic search. Therefore, our study firstly contributes to understanding and explaining the behavior of novice debuggers. The second contribution is an innovative methodology to analyze preexisting debugging traits.

[1]  McCoy Sharon Carver,et al.  Improving children's debugging skills , 1987 .

[2]  Beth Simon,et al.  Experiencing programming assignments in CS1: the emotional toll , 2010, ICER '10.

[3]  Robert Charles Metzger Debugging by Thinking: A Multidisciplinary Approach , 2003 .

[4]  LahtinenEssi,et al.  A study of the difficulties of novice programmers , 2005 .

[5]  Ewan D. Tempero,et al.  Towards a Framework for Teaching Debugging , 2019, ACE '19.

[6]  S. Elo,et al.  Qualitative Content Analysis , 2014 .

[7]  D. C. Phillips The Good, the Bad, and the Ugly: The Many Faces of Constructivism , 1995 .

[8]  L. Gugerty,et al.  Debugging by skilled and novice programmers , 1986, CHI '86.

[9]  Andreas Zeller,et al.  Why Programs Fail: A Guide to Systematic Debugging , 2005 .

[10]  Alexander Hacke,et al.  Computer Science Problem Solving in the Escape Game "Room-X" , 2019, ISSEP.

[11]  John R. Anderson,et al.  Debugging: An Analysis of Bug-Location Strategies , 1987, Hum. Comput. Interact..

[12]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[13]  Robert McCartney,et al.  Commonsense computing (episode 3): concurrency and concert tickets , 2007, ICER '07.

[14]  Robert Hirschfeld,et al.  Studying the advancement in debugging practice of professional software developers , 2014, 2014 IEEE International Symposium on Software Reliability Engineering Workshops.

[15]  Renee Hobbs,et al.  Conditions of Learning in Novice Programmers , 1986 .

[16]  Lance A. Miller,et al.  Natural Language Programming: Styles, Strategies, and Contrasts , 1981, IBM Syst. J..

[17]  C. Borrego,et al.  Room escape at class: Escape games activities to facilitate the motivation and learning in computer science , 2017 .

[18]  Yifat Ben-David Kolikant Gardeners and Cinema Tickets: High School Students' Preconceptions of Concurrency , 2001, Comput. Sci. Educ..

[19]  Jonna Järveläinen,et al.  Escape Room as Game-Based Learning Process: Causation - Effectuation Perspective , 2019, HICSS.

[20]  Ralf Romeike,et al.  Current Status and Perspectives of Debugging in the K12 Classroom: A Qualitative Study , 2019, 2019 IEEE Global Engineering Education Conference (EDUCON).

[21]  Cheri Friedrich,et al.  Escaping the professional silo: an escape room implemented in an interprofessional education curriculum , 2018, Journal of interprofessional care.

[22]  Jan Maarten Schraagen,et al.  Cognitive Task Analysis and Innovation of Training: The Case of Structured Troubleshooting , 2000, Hum. Factors.

[23]  Susan R. Bereiter,et al.  A field-based study of troubleshooting in computer-controlled manufacturing systems , 1989, IEEE Trans. Syst. Man Cybern..

[24]  Scott Nicholson,et al.  Creating Engaging Escape Rooms for the Classroom , 2018 .

[25]  William B. Rouse,et al.  Review and Evaluation of Empirical Research in Troubleshooting , 1985 .

[26]  Elliot Soloway,et al.  Empirical Studies of Programmers: Second Workshop , 1991 .

[27]  Carman Neustaedter,et al.  Collaboration, Awareness, and Communication in Real-Life Escape Rooms , 2017, Conference on Designing Interactive Systems.

[28]  Deborah A. Fields,et al.  Deconstruction Kits for Learning: Students' Collaborative Debugging of Electronic Textile Designs , 2016, FabLearn.

[29]  Robert McCartney,et al.  Common sense computing (episode 4): debugging , 2008, Comput. Sci. Educ..

[30]  Andreas Zeller CHAPTER 6 – Scientific Debugging , 2009 .

[31]  Robert McCartney,et al.  Commonsense computing (episode 6): logic is harder than pie , 2010, Koli Calling.

[32]  Barbara Ericson,et al.  Using Tracing and Sketching to Solve Programming Problems: Replicating and Extending an Analysis of What Students Draw , 2017, ICER.

[33]  Patrick Williams Using escape room-like puzzles to teach undergraduate students effective and efficient group process skills , 2018, 2018 IEEE Integrated STEM Education Conference (ISEC).

[34]  Elliot Soloway,et al.  Preprogramming Knowledge: A Major Source of Misconceptions in Novice Programmers , 1985, Hum. Comput. Interact..

[35]  David H. Jonassen,et al.  Learning to Troubleshoot: A New Theory-Based Design Architecture , 2006 .

[36]  Jeanne E. Frenzel,et al.  Educational Gaming for Pharmacy Students – Design and Evaluation of a Diabetes-themed Escape Room , 2017, American Journal of Pharmaceutical Education.

[37]  Sue Fitzgerald,et al.  Debugging From the Student Perspective , 2010, IEEE Transactions on Education.

[38]  Roger W. Schvaneveldt,et al.  Programmer-nonprogrammer differences in specifying procedures to people and computers , 1987, J. Syst. Softw..

[39]  Kirsti Ala-Mutka,et al.  A study of the difficulties of novice programmers , 2005, ITiCSE '05.

[40]  Robert McCartney,et al.  Commonsense computing: what students know before we teach (episode 1: sorting) , 2006, ICER '06.

[41]  Alpár István Vita Vörös,et al.  Physics escape room as an educational tool , 2017 .

[42]  Françoise Détienne,et al.  An Empirically-Derived Control Structure for the Process of Program Understanding , 1990, Int. J. Man Mach. Stud..

[43]  J. Paul Gibson,et al.  Software engineering as a model of understanding for learning and problem solving , 2005, ICER '05.

[44]  ChanMin Kim,et al.  Debugging during block-based programming , 2018 .

[45]  Susanne E. Hambrusch,et al.  Introducing computational thinking in education courses , 2011, SIGCSE.

[46]  Philipp Mayring,et al.  Combination and Integration of Qualitative and Quantitative Analysis , 2001 .

[47]  Gary Lewandowski,et al.  Debugging: the good, the bad, and the quirky -- a qualitative analysis of novices' strategies , 2008, SIGCSE '08.

[48]  Mark Guzdial,et al.  Learner-Centered Design of Computing Education: Research on Computing for Everyone , 2015, Synthesis Lectures on Human-Centered Informatics.