Gaze collaboration patterns of successful and unsuccessful programming pairs using cross-recurrence quantification analysis

A dual eye tracking experiment was performed on pairs of novice programmers as they traced and debugged fragments of code. These programming pairs were categorized into successful and unsuccessful pairs based on their debugging scores. Cross-recurrence quantification analysis (CRQA), an analysis using cross-recurrence plots (CRP), was used to determine whether there are significant differences in the gaze collaboration patterns between these pair categories. Results showed that successful and unsuccessful pairs can be characterized distinctively based on their CRPs and CRQA metrics. This study also attempted to interpret the CRQA metrics in relation to how the pairs collaborated in order to provide a somewhat clear picture of their relevance and meaning. The analysis results could serve as a precursor in helping us understand what makes a programming pair more successful over other pairs and what behaviors exhibited by unsuccessful pairs that should be avoided.

[1]  Susan Wiedenbeck,et al.  Development and Validation of Scores on a Computer Programming Self-Efficacy Scale and Group Analyses of Novice Programmer Self-Efficacy , 1998 .

[2]  V. I. Levenshtein,et al.  Bounds for deletion/insertion correcting codes , 2002, Proceedings IEEE International Symposium on Information Theory,.

[3]  E. Bradley,et al.  Recurrence plots of experimental data: To embed or not to embed? , 1998, Chaos.

[4]  Telle Hailikari,et al.  The relevance of prior knowledge in learning and instructional design. , 2008, American journal of pharmaceutical education.

[5]  Patrick Jermann,et al.  Collaborative Gaze Footprints: Correlates of Interaction Quality , 2011, CSCL.

[6]  Sean Andrist,et al.  Look together: analyzing gaze coordination with epistemic network analysis , 2015, Front. Psychol..

[7]  Vincent Aleven,et al.  Exploring Causality Within Collaborative Problem Solving Using Eye-Tracking , 2018, EC-TEL.

[8]  Ma. Mercedes T. Rodrigo,et al.  Assessing the Collaboration Quality in the Pair Program Tracing and Debugging Eye-Tracking Experiment , 2017, AIED.

[9]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[10]  A. Giuliani,et al.  Detecting deterministic signals in exceptionally noisy environments using cross-recurrence quantification , 1998 .

[11]  Vincent Aleven,et al.  Dual Eye Tracking as a Tool to Assess Collaboration , 2015, AIED Workshops.

[12]  Ma. Mercedes T. Rodrigo,et al.  Do friends collaborate and perform better?: A pair program tracing and debugging eye-tracking experiment , 2018 .

[13]  Tore Dybå,et al.  The effectiveness of pair programming: A meta-analysis , 2009, Inf. Softw. Technol..

[14]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[15]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[16]  Sue Fitzgerald,et al.  Pair debugging: a transactive discourse analysis , 2010, ICER '10.

[17]  Markku Tukiainen,et al.  A method to study visual attention aspects of collaboration: eye-tracking pair programmers simultaneously , 2008, ETRA.

[18]  Norbert Marwan,et al.  Selection of recurrence threshold for signal detection , 2008 .

[19]  Ma. Mercedes T. Rodrigo,et al.  Impact of Pair Programming Dynamics and Profiles to Pair Success , 2018 .

[20]  Bertrand Schneider,et al.  Real-time mutual gaze perception enhances collaborative learning and collaboration quality , 2013, International Journal of Computer-Supported Collaborative Learning.

[21]  L. Schilbach.  Eye to eye, face to face and brain to brain: novel approaches to study the behavioral dynamics and neural mechanisms of social interactions , 2015, Current Opinion in Behavioral Sciences.

[22]  Ma. Mercedes T. Rodrigo,et al.  Exploring lag times in a pair tracing and debugging eye-tracking experiment , 2017 .

[23]  Pierre Dillenbourg,et al.  This is it ! : Indicating and looking in collaborative work at distance , 2010 .

[24]  M. Stella Atkins,et al.  Revealing team cognition from dual eye-tracking in the surgical setting , 2016, ETRA.

[25]  Daniel C. Richardson,et al.  Looking To Understand: The Coupling Between Speakers' and Listeners' Eye Movements and Its Relationship to Discourse Comprehension , 2005, Cogn. Sci..

[26]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[27]  K Naoko,et al.  Gaze matching of referring expressions in collaborative problem solving-Analysis based on the attributes of referring expressions - , 2011 .

[28]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.