Mobile gaze tracking system for outdoor walking behavioral studies

Most gaze tracking techniques estimate gaze points on screens, on scene images, or in confined spaces. Tracking of gaze in open-world coordinates, especially in walking situations, has rarely been addressed. We use a head-mounted eye tracker combined with two inertial measurement units (IMU) to track gaze orientation relative to the heading direction in outdoor walking. Head movements relative to the body are measured by the difference in output between the IMUs on the head and body trunk. The use of the IMU pair reduces the impact of environmental interference on each sensor. The system was tested in busy urban areas and allowed drift compensation for long (up to 18 min) gaze recording. Comparison with ground truth revealed an average error of 3.3° while walking straight segments. The range of gaze scanning in walking is frequently larger than the estimation error by about one order of magnitude. Our proposed method was also tested with real cases of natural walking and it was found to be suitable for the evaluation of gaze behaviors in outdoor environments.

[1]  Chern-Sheng Lin,et al.  An eye-tracking and head-control system using movement increment-coordinate method , 2007 .

[2]  Francesco Lacquaniti,et al.  A novel method for measuring gaze orientation in space in unrestrained head conditions. , 2013, Journal of vision.

[3]  Eli Peli,et al.  Tracking the line of primary gaze in a walking simulator: Modeling and calibration , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Frans W. Cornelissen,et al.  The effect of visual field defects on eye movements and practical fitness to drive , 2002, Vision Research.

[6]  Wolfgang Einhäuser,et al.  Mind the step: complementary effects of an implicit task on eye and head movements in real-life gaze allocation , 2012, Experimental Brain Research.

[7]  Thomas Brandt,et al.  Fear of heights freezes gaze to the horizon. , 2014, Journal of vestibular research : equilibrium & orientation.

[8]  E. Peli,et al.  Eye movements of patients with tunnel vision while walking. , 2006, Investigative ophthalmology & visual science.

[9]  Mary Hayhoe,et al.  Visually-guided behavior of homonymous hemianopes in a naturalistic task , 2007, Vision Research.

[10]  Eli Peli,et al.  Community-based trial of a peripheral prism visual field expansion device for hemianopia. , 2008, Archives of ophthalmology.

[11]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  E. Peli.  OPTOMETRY AND VISION SCIENCE Copyright © 2000 American Academy of Optometry ORIGINAL ARTICLE Field Expansion for Homonymous Hemianopia by Optically Induced Peripheral Exotropia , 2022 .

[13]  Feng Li,et al.  A model-based approach to video-based eye tracking , 2008 .

[14]  Helge J. Ritter,et al.  Automatic analysis of 3D gaze coordinates on scene objects using data from eye-tracking and motion-capture systems , 2012, ETRA '12.

[15]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  L. Itti.  Author address: , 1999 .

[17]  Kathleen A Turano,et al.  Gaze Behavior of the Visually Impaired During Street Crossing , 2006, Optometry and vision science : official publication of the American Academy of Optometry.

[18]  Marcus Nyström,et al.  Compensation of head movements in mobile eye-tracking data using an inertial measurement unit , 2014, UbiComp Adjunct.

[19]  Julia Treleaven,et al.  Head Eye Co-ordination Using Simultaneous Measurement of Eye in Head and Head in Space Movements: Potential For Use in Subjects With a Whiplash Injury , 2009, Journal of Clinical Monitoring and Computing.

[20]  B. Cohen,et al.  Interaction of the body, head, and eyes during walking and turning , 2000, Experimental Brain Research.

[21]  Eli Peli,et al.  Driving with hemianopia: IV. Head scanning and detection at intersections in a simulator. , 2014, Investigative ophthalmology & visual science.

[22]  Michael J. Agnew,et al.  Accuracy of inertial motion sensors in static, quasistatic, and complex dynamic motion. , 2009, Journal of biomechanical engineering.

[23]  Michael F. Land,et al.  The coordination of rotations of the eyes, head and trunk in saccadic turns produced in natural situations , 2004, Experimental Brain Research.

[24]  Thomas Eggert,et al.  Eye movement recordings: methods. , 2007, Developments in ophthalmology.

[25]  E. Freedman.  Coordination of the eyes and head during visual orienting , 2008, Experimental Brain Research.

[26]  Himanshu Shekhar,et al.  Coordination of eye and head movements during reading. , 2003, Investigative ophthalmology & visual science.

[27]  Karen M. Evans,et al.  Ego-motion compensation improves fixation detection in wearable eye tracking , 2012, ETRA.

[28]  Naoya Hara,et al.  Using eye-tracking to identify pedestrians’ critical visual tasks, Part 1. Dual task approach , 2015 .

[29]  Li Liu,et al.  Calibration algorithm for eyetracking with unrestricted head movement , 2007, Behavior research methods.

[30]  Cancelling the sway motion of dynamic walking in visual servoing , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Yu Fang,et al.  Eye-Head Coordination for Visual Cognitive Processing , 2015, PloS one.

[32]  M. Land.  Vision, eye movements, and natural behavior , 2009, Visual Neuroscience.

[33]  Hamish G MacDougall,et al.  Functional Assessment of Head–Eye Coordination During Vehicle Operation , 2005, Optometry and vision science : official publication of the American Academy of Optometry.

[34]  E. Peli,et al.  Clinical and Laboratory Evaluation of Peripheral Prism Glasses for Hemianopia , 2009, Optometry and vision science : official publication of the American Academy of Optometry.

[35]  Hanspeter A. Mallot,et al.  Gaze patterns predicting successful collision avoidance in patients with homonymous visual field defects , 2011, Vision Research.

[36]  Shirin E. Hassan,et al.  Head Movements While Crossing Streets: Effect of Vision Impairment , 2005, Optometry and vision science : official publication of the American Academy of Optometry.