Gaze insights into debugging behavior using learner-centred analysis

The presented study tries to tackle an intriguing question of how user-generated data from current technologies can be used to reinforce learners' reflections, improve teaching practices, and close the learning analytics loop. In particular, the aim of the study is to utilize users' gaze to examine the role of a mirroring tool (i.e. Exercise View in Eclipse) in orchestrating basic behavioral regulation of participants engaged in a debugging task. The results demonstrated that students who processed the information presented in the Exercise View and acted upon it, improved their performance and achieved higher level of success than those who failed to do it. The findings shed a light how to capture what constitute relevant data within a particular context using gaze patterns, that could guide collection of essential learner-centred analytics for the purpose of designing usable and modular learning environments based on data-driven approaches.

[1]  Pablo Romero,et al.  Visual Attention and Representation Switching During Java Program Debugging: A Study Using the Restricted Focus Viewer , 2002, Diagrams.

[2]  Gary Jones.  Testing two cognitive theories of insight. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Joel B. Richman,et al.  Best practices for eye tracking of television and video user experiences , 2008, UXTV '08.

[4]  Patrick Jermann,et al.  Gaze Evidence for Different Activities in Program Understanding , 2012, PPIG.

[5]  Carl Gutwin,et al.  The effects of workspace awareness support on the usability of real-time distributed groupware , 1999, TCHI.

[6]  M. L. Mele,et al.  A psychotechnological review on eye-tracking systems: towards user experience , 2012, Disability and rehabilitation. Assistive technology.

[7]  Theocharis Kyriacou,et al.  Learner Analytics; The Need for User-Centred Design in Learning Analytics , 2016, EAI Endorsed Trans. Ambient Syst..

[8]  Markku Tukiainen,et al.  Temporal eye-tracking data: evolution of debugging strategies with multiple representations , 2008, ETRA.

[9]  Roman Bednarik,et al.  Expertise-dependent visual attention strategies develop over time during debugging with multiple code representations , 2012, Int. J. Hum. Comput. Stud..

[10]  George Siemens,et al.  Learning analytics: envisioning a research discipline and a domain of practice , 2012, LAK.

[11]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[12]  Enric Mor,et al.  User-centered design gymkhana , 2007, CHI Extended Abstracts.

[13]  Katerina Tzafilkou,et al.  Diagnosing user perception and acceptance using eye tracking in web-based end-user development , 2017, Comput. Hum. Behav..

[14]  Erik Duval,et al.  Learning dashboards: an overview and future research opportunities , 2013, Personal and Ubiquitous Computing.

[15]  Muriel Garreta Domingo,et al.  User Centered Desing in E-Learning Environments : from Usability to Learner Experience , 2007 .

[16]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[17]  Jonathan I. Maletic,et al.  An Eye Tracking Study on camelCase and under_score Identifier Styles , 2010, 2010 IEEE 18th International Conference on Program Comprehension.

[18]  Shane Dawson,et al.  Learning designs and learning analytics , 2011, LAK.

[19]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[20]  Alyssa Friend Wise,et al.  Designing pedagogical interventions to support student use of learning analytics , 2014, LAK.

[21]  N. Hari Narayanan,et al.  Mental imagery in problem solving: an eye tracking study , 2004, ETRA.

[22]  Alastair G Gale,et al.  Inspection Times and the Selection Task: What do Eye-Movements Reveal about Relevance Effects? , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[23]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[24]  H. Simon,et al.  Perception in chess , 1973 .

[25]  Michail N. Giannakos,et al.  Learning Analytics for Learning Design: Towards Evidence-Driven Decisions to Enhance Learning , 2017, EC-TEL.

[26]  Aga Bojko,et al.  Eye Tracking the User Experience: A Practical Guide to Research , 2013 .

[27]  Pablo Romero,et al.  Debugging strategies and tactics in a multi-representation software environment , 2007, Int. J. Hum. Comput. Stud..

[28]  Moshe Eizenman,et al.  An on-road assessment of cognitive distraction: impacts on drivers' visual behavior and braking performance. , 2007, Accident; analysis and prevention.

[29]  Roger Dawkins,et al.  Content strategy : a lesson from the industry for university learning analytics , 2016 .

[30]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[31]  Judy Kay,et al.  The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings , 2015, LAK.

[32]  Kristine Lund,et al.  Multidisciplinarity vs. Multivocality, the case of "learning analytics" , 2013, LAK '13.

[33]  Jonathan I. Maletic,et al.  An eye-tracking study on the role of scan time in finding source code defects , 2012, ETRA.

[34]  Markku Tukiainen,et al.  Visual attention tracking during program debugging , 2004, NordiCHI '04.

[35]  Azizah Jaafar,et al.  Evaluation of User Interface Design for Leaning Management System (LMS): Investigating Student's Eye Tracking Pattern and Experiences , 2012 .

[36]  Markku Tukiainen,et al.  Visual attention and representation switching in Java program debugging: a study using eye movement tracking , 2004, PPIG.

[37]  E. Tabor.  Handbook of Self-Regulation: Research, Theory, and Applications , 2006 .

[38]  Thorsten Joachims,et al.  Eye-tracking analysis of user behavior in WWW search , 2004, SIGIR '04.

[39]  Benjamin Rahm,et al.  Eye movements and visuospatial problem solving: identifying separable phases of complex cognition. , 2009, Psychophysiology.

[40]  Susan Brennan,et al.  Another person's eye gaze as a cue in solving programming problems , 2004, ICMI '04.

[41]  William Garrard,et al.  An examination of eyetracking artifacts related to website design for individuals with cognitive disability , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[42]  Pablo Romero,et al.  Visual attention and representation switching during Java program debugging: A study using the Restricted Focus Viewer. Diagrammatic representation and inference , 2002 .