Mind the step: complementary effects of an implicit task on eye and head movements in real-life gaze allocation

Gaze in real-world scenarios is controlled by a huge variety of parameters, such as stimulus features, instructions or context, all of which have been studied systematically in laboratory studies. It is, however, unclear how these results transfer to real-world situations, when participants are largely unconstrained in their behavior. Here we measure eye and head orientation and gaze in two conditions, in which we ask participants to negotiate paths in a real-world outdoor environment. The implicit task set is varied by using paths of different irregularity: In one condition, the path consists of irregularly placed steps, and in the other condition, a cobbled road is used. With both paths located adjacently, the visual environment (i.e., context and features) for both conditions is virtually identical, as is the instruction. We show that terrain regularity causes differences in head orientation and gaze behavior, specifically in the vertical direction. Participants direct head and eyes lower when terrain irregularity increases. While head orientation is not affected otherwise, vertical spread of eye-in-head orientation also increases significantly for more irregular terrain. This is accompanied by altered patterns of eye movements, which compensate for the lower average gaze to still inspect the visual environment. Our results quantify the importance of implicit task demands for gaze allocation in the real world, and imply qualitatively distinct contributions of eyes and head in gaze allocation. This underlines the care that needs to be taken when inferring real-world behavior from constrained laboratory data.

[1]  J. Pelz,et al.  Oculomotor behavior in natural and man-made environments , 2007 .

[2]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[5]  Jill S. Higginson,et al.  What is the role of vision during stair descent , 2003 .

[6]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[7]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[8]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[9]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[10]  Michael F. Land,et al.  The coordination of rotations of the eyes, head and trunk in saccadic turns produced in natural situations , 2004, Experimental Brain Research.

[11]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[12]  H. Bekkering,et al.  Selection-for-action in visual search. , 2005, Acta psychologica.

[13]  Elia Vecellio,et al.  The role of binocular vision in walking , 2009, Visual Neuroscience.

[14]  B. Tatler,et al.  Steering with the head The visual strategy of a racing driver , 2001, Current Biology.

[15]  Josef Stoll,et al.  Validation of mobile eye-tracking as novel and efficient means for differentiating progressive supranuclear palsy from Parkinson's disease , 2012, Front. Behav. Neurosci..

[16]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[17]  M. Hollands,et al.  Age-related differences in stepping performance during step cycle-related removal of vision , 2006, Experimental Brain Research.

[18]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[19]  J. Henderson,et al.  Object–scene inconsistencies do not capture gaze: evidence from the flash-preview moving-window paradigm , 2011, Attention, perception & psychophysics.

[20]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[21]  D. Ballard,et al.  Modelling the role of task in the control of gaze , 2009, Visual cognition.

[22]  C. Zampieri,et al.  Balance and Eye Movement Training to Improve Gait in People With Progressive Supranuclear Palsy: Quasi-Randomized Clinical Trial , 2008, Physical Therapy.

[23]  Stefan Kohlbecher,et al.  BASIC AND CLINICAL ASPECTS OF VERTIGO AND DIZZINESS EyeSeeCam: An Eye Movement–Driven Head Camera for the Examination of Natural Visual Exploration , 2009 .

[24]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[25]  Roland J. Baddeley,et al.  The nature of the visual representations involved in eye movements when walking down the street , 2009 .

[26]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[27]  Robin L. Hill,et al.  Eye movements : a window on mind and brain , 2007 .

[28]  D. Ballard,et al.  Goal-directed arm movements change eye-head coordination , 1996, Experimental Brain Research.

[29]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[30]  Jeffrey M. Hausdorff,et al.  Walking is more like catching than tapping: gait in the elderly as a complex cognitive task , 2005, Experimental Brain Research.

[31]  R. Fitzpatrick,et al.  Effects of galvanic vestibular stimulation during human walking , 1999, The Journal of physiology.

[32]  Markus Lappe,et al.  Efficient encoding of natural optic flow , 2008, Network.

[33]  A. Patla,et al.  Visual information from the lower visual field is important for walking across multi-surface terrain , 2008, Experimental Brain Research.

[34]  John G. Buckley,et al.  Visuomotor control of step descent: evidence of specialised role of the lower visual field , 2009, Experimental Brain Research.

[35]  P. König,et al.  Gaze allocation in natural stimuli: Comparing free exploration to head-fixed viewing conditions , 2009 .

[36]  R. Rafal,et al.  Impaired control of the oculomotor reflexes in Parkinson's disease , 2009, Neuropsychologia.

[37]  Peter König,et al.  Salient features in gaze-aligned recordings of human visual input during free exploration of natural environments. , 2008, Journal of vision.

[38]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[39]  M. Hayhoe,et al.  Adaptive Gaze Control in Natural Environments , 2009, The Journal of Neuroscience.

[40]  John F. Greany,et al.  Aging and saccade-stepping interactions in humans , 2003, Neuroscience Letters.

[41]  Frank E. Ritter,et al.  The Rise of Cognitive Architectures , 2007, Integrated Models of Cognitive Systems.

[42]  Kathleen A Turano,et al.  Gaze Behavior while Crossing Complex Intersections , 2003, Optometry and vision science : official publication of the American Academy of Optometry.

[43]  Benoît G. Bardy,et al.  Motion parallax is used to control postural sway during walking , 1996, Experimental Brain Research.

[44]  Michael L. Mack,et al.  Viewing task influences eye movement control during active scene perception. , 2009, Journal of vision.

[45]  Andreas Zwergal,et al.  Gait disturbances in old age: classification, diagnosis, and treatment from a neurological perspective. , 2010, Deutsches Arzteblatt international.

[46]  A. E. Patla,et al.  Gaze fixation patterns for negotiating complex ground terrain , 2007, Neuroscience.

[47]  G. T. Buswell How People Look At Pictures: A Study Of The Psychology Of Perception In Art , 2012 .

[48]  Mary Hayhoe,et al.  The role of internal models and prediction in catching balls , 2005, AAAI 2005.

[49]  Constantin A Rothkopf,et al.  Image statistics at the point of gaze during human navigation , 2009, Visual Neuroscience.

[50]  Thomas Brandt,et al.  Differential effects of vestibular stimulation on walking and running , 2000, Neuroreport.

[51]  M. Hollands,et al.  Visually guided stepping under conditions of step cycle-related denial of visual information , 1996, Experimental Brain Research.

[52]  Joan N. Vickers,et al.  How far ahead do we look when required to step on specific locations in the travel path during locomotion? , 2002, Experimental Brain Research.

[53]  Michael F. Land,et al.  Predictable eye-head coordination during driving , 1992, Nature.

[54]  Miguel P. Eckstein,et al.  Gaze control and memory for objects while walking in a real world environment , 2009 .

[55]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[56]  M. Hollands,et al.  Evidence for a link between changes to gaze behaviour and risk of falling in older adults during adaptive locomotion. , 2005, Gait & posture.

[57]  Gerald Westheimer Visual Perception: The Influence of H.W. Leibowitz , 2003 .

[58]  Jan Kassubek,et al.  Differential diagnostic value of eye movement recording in PSP-parkinsonism, Richardson's syndrome, and idiopathic Parkinson's disease , 2008, Journal of Neurology.

[59]  Jan Kassubek,et al.  Differential diagnostic value of eye movement recording in PSP-Parkinsonism, Richardson's Syndrome, and Idiopathic Parkinson's Disease , 2008 .

[60]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[61]  Markus Lappe,et al.  Driving is smoother and more stable when using the tangent point. , 2009, Journal of vision.

[62]  B. Cohen,et al.  Interaction of the body, head, and eyes during walking and turning , 2000, Experimental Brain Research.

[63]  P. Cavanagh,et al.  Stair Negotiation in Older People: A Review , 2000, Journal of the American Geriatrics Society.

[64]  A. Bronstein,et al.  A new paradigm to investigate the roles of head and eye movements in the coordination of whole-body movements , 2003, Experimental Brain Research.

[65]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[66]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[67]  D. Guitton,et al.  Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. , 1987, Journal of neurophysiology.

[68]  M. B. Bender,et al.  Oculomotor function in patients with Parkinson's disease. , 1972, Journal of the neurological sciences.

[69]  R. C. Langford How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[70]  C. Paradas,et al.  Acute paraparesis following intravenous steroid therapy in a case of dural spinal arteriovenous fistula , 2008, Journal of Neurology.