Eye-hand coordination strategies during active video game playing: An eye-tracking study

All participants used multiple eye-hand strategies while playing digital games.Different active video games induced different latencies and gaze points.Children had different latencies and fixation than adults during game playing.Eye-tracking technology may explore eye-hand coordination in game-based learning. The purpose of this exploratory study was to examine the eye-hand coordination patterns while playing two virtual-reality active video games in healthy children and adults. Eleven children (mean age 8.09years) and ten adults participated in the study. Each participant played two digital games, Slap Stream and Kung Foo, from EyeToy Play software. Eye movements were recorded using Mobile Eye eyetracker. Eye-hand coordination strategies and the time when virtual object appeared, the gaze shifted to the object, the reach started, the gaze shifted away, and the reach ended were coded from the video. The latencies between these events were computed and compared between adults and children and between games. The fixation duration, number of fixations, and number of gaze points were also computed for each game's areas of interests. Results showed that (1) all participants used multiple eye-hand strategies while playing active video games with some strategies more than others; (2) the Kung Foo game (with one target appearing on the screen) and the Slap Stream game (with potentially multiple targets appearing on the screen) induced different latencies and gaze points between children and adults; and (3) children had longer latencies and shorter fixation durations than adults. The study thus provides in-depth understanding of different patterns of eye-hand coordination in relations to active video game playing. The significant differences in coordinative control strategies found between adults and children as well as between game types provide a basis for further research in both child development and game-based learning fields.

[1]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[2]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[3]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, ETRA.

[4]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[5]  R. Johansson,et al.  Gaze behavior when learning to link sequential action phases in a manual task. , 2014, Journal of vision.

[6]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[7]  F. Paas,et al.  Attention guidance in learning from a complex animation: Seeing is understanding? , 2010 .

[8]  Meng-Jung Tsai,et al.  The Model of Strategic e-Learning: Understanding and Evaluating Student e-Learning from Metacognitive Perspectives , 2009, J. Educ. Technol. Soc..

[9]  Trish Gorely,et al.  A descriptive epidemiology of screen-based media use in youth: a review and critique. , 2006, Journal of adolescence.

[10]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[11]  Rebecca M Foerster,et al.  Saccadic eye movements in a high-speed bimanual stacking task: changes of attentional control during learning and automatization. , 2011, Journal of vision.

[12]  Han-Chin Liu,et al.  Using eye-tracking technology to investigate the redundant effect of multimedia web pages on viewers' cognitive processes , 2011, Comput. Hum. Behav..

[13]  Chris R Sims,et al.  Adaptive Allocation of Vision under Competing Task Demands , 2011, The Journal of Neuroscience.

[14]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, ACE '06.

[15]  Hsin Ning Jessie Ho,et al.  PRIOR KNOWLEDGE AND ONLINE INQUIRY-BASED SCIENCE READING: EVIDENCE FROM EYE TRACKING , 2014 .

[16]  Jason Bell,et al.  Contour inflections are adaptable features. , 2014, Journal of vision.

[17]  K. Velanova,et al.  Development of eye-movement control , 2008, Brain and Cognition.

[18]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[19]  Sjoerd Stuit,et al.  Suppressed images selectively affect perceptual dominance in binocular rivalry , 2011 .

[20]  Katharina Scheiter,et al.  Eye tracking as a tool to study and enhance multimedia learning , 2010 .

[21]  Harumi Kobayashi,et al.  Eye-hand Coordination in Development of a Natural Task: Making ten cups of coffee , 2006 .

[22]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[23]  Mark R. Wilson,et al.  Psychomotor control in a virtual laparoscopic surgery training environment: gaze control parameters differentiate novices from experts , 2010, Surgical Endoscopy.

[24]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[25]  Qing Yang,et al.  The latency of saccades, vergence, and combined eye movements in children and in adults. , 2002, Investigative ophthalmology & visual science.

[26]  Huei-Tse Hou,et al.  Visual attention for solving multiple-choice science problem: An eye-tracking analysis , 2012, Comput. Educ..

[27]  Mary Hegarty,et al.  Effects of knowledge and display design on comprehension of complex graphics , 2010 .

[28]  M. Hayhoe,et al.  Look-ahead fixations: anticipatory eye movements in natural tasks , 2007, Experimental Brain Research.

[29]  Joe Causer,et al.  Quiet eye training improves surgical knot tying more than traditional technical training: a randomized controlled study. , 2014, American journal of surgery.

[30]  O. R. Anderson,et al.  Neuroscience Perspectives for Science and Mathematics Learning in Technology-Enhanced Learning Environments , 2014 .

[31]  Silvia Wen-Yu Lee,et al.  A review of using eye-tracking technology in exploring learning from 2000 to 2012 , 2013 .

[32]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.