Interactions of Individual and Pair Programmers with an Intelligent Tutoring System for Computer Science

Pair programming is a practice where two coders work side by side at one computer. The practice has been linked to many benefits including increased student engagement, satisfaction, and course grades. We present a quantitative study comparing the fine-grained interactions of individual programmers versus pair programmers as they work to solve coding problems using an Intelligent Tutoring System. We collected data from over 115 students resulting in more than 53,000 log events. We discovered that while both individual and pair programmers had equivalent learning gains, pair programmers took significantly less time on most problems, consulted fewer examples, coded more efficiently, and showed more signs of engagement. Individuals adapted to problems requiring new and compounded concepts at a rate similar to pair programmers.

[1]  Vincent Aleven,et al.  Using an Intelligent Tutoring System to Support Collaborative as well as Individual Learning , 2014, Intelligent Tutoring Systems.

[2]  Davide Fossati,et al.  Collab-ChiQat: A Collaborative Remaking of a Computer Science Intelligent Tutoring System , 2016, CSCW '16 Companion.

[3]  Davide Fossati,et al.  A Scalable Intelligent Tutoring System Framework for Computer Science Education , 2015, CSEDU.

[4]  Emilia Mendes,et al.  Empirical Studies of Pair Programming for CS/SE Teaching in Higher Education: A Systematic Literature Review , 2011, IEEE Transactions on Software Engineering.

[5]  Raúl Antonio Aguilar Vera,et al.  Pair versus Solo Programming - An Experience Report from a Course on Design of Experiments in Software Engineering , 2013, ArXiv.

[6]  Arnold N. Pears,et al.  Enhancing student engagement in an introductory programming course , 2010, 2010 IEEE Frontiers in Education Conference (FIE).

[7]  Rachel Harsley.  Learning Together: Expanding the One-To-One ITS Model for Computer Science Education , 2015, ICER.

[8]  Davide Fossati.  Data driven automatic feedback generation in the iList intelligent tutoring system , 2014 .

[9]  Phil Maguire,et al.  Enhancing collaborative learning using pair programming: Who benefits? , 2014 .

[10]  Mark Guzdial,et al.  Success in introductory programming: what works? , 2013, CACM.

[11]  Jo Erskine Hannay,et al.  Personality and the nature of collaboration in pair programming , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[12]  SimonBeth,et al.  Success in introductory programming , 2013 .

[13]  Roger Y. Lee,et al.  Evaluating the Usefulness of Pair Programming in a Classroom Setting , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[14]  Charles E. McDowell,et al.  Pair programming improves student retention, confidence, and program quality , 2006, CACM.

[15]  Laurie A. Williams,et al.  All I really need to know about pair programming I learned in kindergarten , 2000, Commun. ACM.

[16]  References , 1971 .

[17]  Davide Fossati,et al.  Integrating Support for Collaboration in a Computer Science Intelligent Tutoring System , 2016, ITS.

[18]  Ronald Jensen.  A pair programming experience , 2003 .

[19]  Beth Simon,et al.  Retaining nearly one-third more majors with a trio of instructional best practices in CS1 , 2013, SIGCSE '13.

[20]  Davide Fossati,et al.  The Role of Positive Feedback in Intelligent Tutoring Systems , 2008, ACL.

[21]  Laurie A. Williams,et al.  Strengthening the Case for Pair Programming , 2000, IEEE Softw..

[22]  Laurie A. Williams,et al.  In support of student pair-programming , 2001, SIGCSE '01.

[23]  W. Chigona,et al.  Pair programming for information systems students new to programming: Students’ experiences and teachers’ challenges , 2008, PICMET '08 - 2008 Portland International Conference on Management of Engineering & Technology.

[24]  Anastasios Karakostas,et al.  Adaptive and Intelligent Systems for Collaborative Learning Support: A Review of the Field , 2011, IEEE Transactions on Learning Technologies.

[25]  Kristy Elizabeth Boyer,et al.  Discovering Individual and Collaborative Problem-Solving Modes with Hidden Markov Models , 2015, AIED.

[26]  Kenneth R. Koedinger,et al.  Integrating Collaboration and Intelligent Tutoring Data in the Evaluation of a Reciprocal Peer Tutoring Environment , 2009, Res. Pract. Technol. Enhanc. Learn..