Gaze and the Control of Foot Placement When Walking in Natural Terrain

SUMMARY Human locomotion through natural environments requires precise coordination between the biomechanics of the bipedal gait cycle and the eye movements that gather the information needed to guide foot placement. However, little is known about how the visual and locomotor systems work together to support movement through the world. We developed a system to simultaneously record gaze and full-body kinematics during locomotion over different outdoor terrains. We found that not only do walkers tune their gaze behavior to the specific information needed to traverse paths of varying complexity but that they do so while maintaining a constant temporal look-ahead window across all terrains. This strategy allows walkers to use gaze to tailor their energetically optimal preferred gait cycle to the upcoming path in order to balance between the drive to move efficiently and the need to place the feet in stable locations. Eye movements and locomotion are intimately linked in a way that reflects the integration of energetic costs, environmental uncertainty, and momentary informational demands of the locomotor task. Thus, the relationship between gaze and gait reveals the structure of the sensorimotor decisions that support successful performance in the face of the varying demands of the natural world.

[1]  J. Pelz,et al.  Oculomotor behavior in natural and man-made environments , 2007 .

[2]  Brett R Fajen,et al.  Visual control of foot placement when walking over complex terrain , 2014, Journal of experimental psychology. Human perception and performance.

[3]  J. Hamill,et al.  Energetic Cost and Stability during Human Walking at the Preferred Stride Frequency , 1995 .

[4]  James M. Finley,et al.  Learning to be economical: the energy cost of walking tracks motor adaptation , 2013, The Journal of physiology.

[5]  Michael F. Land,et al.  The coordination of rotations of the eyes, head and trunk in saccadic turns produced in natural situations , 2004, Experimental Brain Research.

[6]  S. Grillner,et al.  Visuomotor coordination in reaching and locomotion. , 1989, Science.

[7]  M. Anthony Lewis,et al.  Strategies and determinants for selection of alternate foot placement during human locomotion: influence of spatial and temporal constraints , 2004, Experimental Brain Research.

[8]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[9]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[10]  Shawn M O'Connor,et al.  Foot Placement Relies on State Estimation during Visually Guided Walking 1 2 , 2022 .

[11]  J. Gottlieb.  Attention, Learning, and the Value of Information , 2012, Neuron.

[12]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[13]  Arthur D Kuo,et al.  The six determinants of gait and the inverted pendulum analogy: A dynamic walking perspective. , 2007, Human movement science.

[14]  S. Javad Hasaneini,et al.  Two steps is enough: No need to plan far ahead for walking balance , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  H. Ralston.  Energy-speed relation and optimal speed during level walking , 1958, Internationale Zeitschrift für angewandte Physiologie einschließlich Arbeitsphysiologie.

[16]  Raymond F Reynolds,et al.  Visual guidance of the human foot during a step , 2005, The Journal of physiology.

[17]  Karen E. Adolph,et al.  Visually guided navigation: Head-mounted eye-tracking of natural locomotion in children and adults , 2010, Vision Research.

[18]  Wolfgang Einhäuser,et al.  Attention in natural scenes: contrast affects rapid visual processing and fixations alike , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  C. Lovejoy,et al.  The Pelvis and Femur of Ardipithecus ramidus: The Emergence of Upright Walking , 2009, Science.

[20]  B. Fajen,et al.  Humans exploit the biomechanics of bipedal gait during visually guided walking over complex terrain , 2013, Proceedings of the Royal Society B: Biological Sciences.

[21]  W. Einhäuser,et al.  Fixations on objects in natural scenes: dissociating importance from salience , 2013, Front. Psychol..

[22]  Jessica C. Selinger,et al.  Humans Can Continuously Optimize Energetic Cost during Walking , 2015, Current Biology.

[23]  A. Ruina,et al.  Multiple walking speed-frequency relations are predicted by constrained optimization. , 2001, Journal of theoretical biology.

[24]  Michael S Landy,et al.  Motor control is decision-making , 2012, Current Opinion in Neurobiology.

[25]  V. Tucker.  The energetic cost of moving about. , 1975, American Scientist.

[26]  Brett R Fajen,et al.  The biomechanics of walking shape the use of visual information during locomotion over complex terrain. , 2015, Journal of vision.

[27]  A E Patla,et al.  Where and when do we look as we approach and step over an obstacle in the travel path? , 1997, Neuroreport.

[28]  Brett R Fajen,et al.  Visual Regulation of Gait: Zeroing in on a Solution to the Complex Terrain Problem , 2017, Journal of experimental psychology. Human perception and performance.

[29]  Gilles Montagne,et al.  Perception–action coupling model for human locomotor pointing , 2002, Biological Cybernetics.

[30]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[31]  D. Ballard,et al.  Modeling Task Control of Eye Movements , 2014, Current Biology.

[32]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[33]  M. Hollands,et al.  Coordination of Eye and Leg Movements During Visually Guided Stepping , 2001, Journal of motor behavior.

[34]  B. Tatler,et al.  Steering with the head The visual strategy of a racing driver , 2001, Current Biology.

[35]  David N. Lee,et al.  Regulation of gait in long jumping. , 1982 .

[36]  Twan Koolen,et al.  Capturability-based analysis and control of legged locomotion, Part 2: Application to M2V2, a lower-body humanoid , 2012, Int. J. Robotics Res..

[37]  S. Benhamou.  How to reliably estimate the tortuosity of an animal's path: straightness, sinuosity, or fractal dimension? , 2004, Journal of theoretical biology.

[38]  Twan Koolen,et al.  Capturability-based analysis and control of legged locomotion, Part 1: Theory and application to three simple gait models , 2011, Int. J. Robotics Res..

[39]  D. E. Marple-Horvat,et al.  Human Eye Movements During Visually Guided Stepping. , 1995, Journal of motor behavior.

[40]  M. Hollands,et al.  Gaze Behavior of Young and Older Adults During Stair Walking , 2009, Journal of motor behavior.

[41]  M. Hayhoe,et al.  Look-ahead fixations: anticipatory eye movements in natural tasks , 2007, Experimental Brain Research.

[42]  L. Maloney,et al.  Decision-theoretic models of visual perception and action , 2010, Vision Research.

[43]  Andy Ruina,et al.  The Boundaries of Walking Stability: Viability and Controllability of Simple Models , 2018, IEEE Transactions on Robotics.

[44]  Jessica C. Selinger,et al.  Contribution of blood oxygen and carbon dioxide sensing to the energetic optimization of human walking. , 2017, Journal of neurophysiology.

[45]  Sean L. Barton,et al.  The critical phase for visual control of human walking over complex terrain , 2017, Proceedings of the National Academy of Sciences.

[46]  Chris R Sims,et al.  Adaptive Allocation of Vision under Competing Task Demands , 2011, The Journal of Neuroscience.

[47]  Jacqueline Gottlieb,et al.  Understanding active sampling strategies: Empirical approaches and implications for attention and decision research , 2017, Cortex.

[48]  A. Kuo.  A simple model of bipedal walking predicts the preferred speed-step length relationship. , 2001, Journal of biomechanical engineering.

[49]  A. Minetti,et al.  Effects of stride frequency on mechanical power and energy expenditure of walking. , 1995, Medicine and science in sports and exercise.

[50]  A. Patla.  How Is Human Gait Controlled by Vision , 1998 .

[51]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[52]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[53]  A. E. Patla,et al.  Gaze fixation patterns for negotiating complex ground terrain , 2007, Neuroscience.

[54]  Karen M. Evans,et al.  Collecting and Analyzing Eye-Tracking Data in Outdoor Environments , 2012 .

[55]  H. Ralston,et al.  Optimization of energy expenditure during level walking , 2004, European Journal of Applied Physiology and Occupational Physiology.

[56]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[57]  K. Hunt.  The evolution of human bipedality: ecology and functional morphology , 1994 .

[58]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.