Another person's eye gaze as a cue in solving programming problems

Expertise in computer programming can often be difficult to transfer verbally. Moreover, technical training and communication occur more and more between people who are located at a distance. We tested the hypothesis that seeing one person's visual focus of attention (represented as an eyegaze cursor) while debugging software (displayed as text on a screen) can be helpful to another person doing the same task. In an experiment, a group of professional programmers searched for bugs in small Java programs while wearing an unobtrusive head-mounted eye tracker. Later, a second set of programmers searched for bugs in the same programs. For half of the bugs, the second set of programmers first viewed a recording of an eyegaze cursor from one of the first programmers displayed over the (indistinct) screen of code, and for the other half they did not. The second set of programmers found the bugs more quickly after viewing the eye gaze of the first programmers, suggesting that another person's eye gaze, produced instrumentally (as opposed to intentionally, like pointing with a mouse), can be a useful cue in problem solving. This finding supports the potential of eye gaze as a valuable cue for collaborative interaction in a visuo-spatial task conducted at a distance.

[1]  Elliot Soloway,et al.  Where the bugs are , 1985, CHI '85.

[2]  L. Gugerty,et al.  Debugging by skilled and novice programmers , 1986, CHI '86.

[3]  Elliot Soloway,et al.  Novice mistakes: are the folk wisdoms correct? , 1986, CACM.

[4]  J. C. Spohrer,et al.  Alternatives to construct-based programming misconceptions , 1986, CHI '86.

[5]  Laurent Karsenty,et al.  Cooperative Work and Shared Visual Context: An Empirical Study of Comprehension Problems in Side-by-Side and Remote Help Dialogues , 1999, Hum. Comput. Interact..

[6]  Allan Kuchinsky,et al.  Turning away from talking heads: the use of video-as-data in neurosurgery , 1993, INTERCHI.

[7]  Carl Gutwin,et al.  Supporting awareness of others in groupware , 1996, CHI Conference Companion.

[8]  Jonathan Grudin,et al.  Integration of Inter-Personal Space and Shared Workspace: ClearBoard Design and Experiments , 1992, CSCW.

[9]  Mark Weiser,et al.  Programmers use slices when debugging , 1982, CACM.

[10]  Steve Whittaker,et al.  Shared Workspaces: How Do They Work and When Are They Useful? , 1993, Int. J. Man Mach. Stud..

[11]  Jean Scholtz,et al.  Mental representations of programs by novices and experts , 1993, INTERCHI.

[12]  Scott P. Robertson,et al.  Expert problem solving strategies for program comprehension , 1991, CHI.

[13]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  S. Brennan Centering Attention in Discourse. , 1995 .

[15]  Robert J. K. Jacob,et al.  Eye tracking in advanced interface design , 1995 .

[16]  Susan Wiedenbeck,et al.  An empirical study of novice program comprehension in the imperative and object-oriented styles , 1997, ESP '97.

[17]  Kate Ehrlich,et al.  Tapping into tacit programming knowledge , 1982, CHI '82.

[18]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[19]  S. Brennan Seeking and providing evidence for mutual understanding , 1990 .

[20]  Steve Benford,et al.  Fragmented interaction: establishing mutual orientation in virtual environments , 1998, CSCW '98.

[21]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[22]  S. Brennan 4 How Conversation Is Shaped by Visual and Spoken Evidence , 2005 .

[23]  Abigail Sellen,et al.  Remote Conversations: The Effects of Mediating Talk With Technology , 1995, Hum. Comput. Interact..

[24]  John C. Tang,et al.  Piazza: a desktop environment supporting impromptu and planned interactions , 1996, CSCW '96.

[25]  Austin Henderson,et al.  Your place or mine? Learning from long-term use of Audio-Video communication , 1996, Computer Supported Cooperative Work (CSCW).

[26]  Steve Whittaker,et al.  Rethinking video as a technology for interpersonal communications: theory and design implications , 1995, Int. J. Hum. Comput. Stud..

[27]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[28]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[29]  Robert E. Kraut,et al.  --Understanding Effects of Proximity on Collaboration : Implications for Technologies to Support Remote Collaborative Work , 2001 .

[30]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[31]  Woodrow Barfield,et al.  Virtual environments and advanced interface design , 1995 .

[32]  Gwyneth Doherty-Sneddon,et al.  Face-to-face and video mediated communication: a comparison of dialogue structure and task performance , 1997 .