Pose estimates from online videos show that side-by-side walkers synchronize movement under naturalistic conditions

Marker-less video-based pose estimation promises to allow us to do movement science on existing video databases. We revisited the old question of how people synchronize their walking using real world data. We thus applied pose estimation to 348 video segments extracted from YouTube videos of people walking in cities. As in previous, more constrained, research, we find a tendency for pairs of people to walk in phase or in anti-phase with each other. Large video databases, along with pose-estimation algorithms, promise answers to many movement questions without experimentally acquiring new data.

[1]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[2]  Francesco Lacquaniti,et al.  Human-Human Interaction Forces and Interlimb Coordination During Side-by-Side Walking With Hand Contact , 2018, Front. Physiol..

[3]  M L van der Linden,et al.  Validity and reliability of a kinematic protocol for determining foot contact events. , 2000, Gait & posture.

[4]  Sara J Gilliland,et al.  Nonlinear time series analysis of knee and ankle kinematics during side by side treadmill walking. , 2009, Chaos.

[5]  Juergen Gall,et al.  PoseTrack: Joint Multi-person Pose Estimation and Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Sophia Kelaini,et al.  RBPs Play Important Roles in Vascular Endothelial Dysfunction Under Diabetic Conditions , 2018, Front. Physiol..

[7]  Jeff A Nessler,et al.  Side by side treadmill walking reduces gait asymmetry induced by unilateral ankle weight. , 2015, Human movement science.

[8]  Kevin M. Cury,et al.  DeepLabCut: markerless pose estimation of user-defined body parts with deep learning , 2018, Nature Neuroscience.

[9]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[10]  J. Hidler,et al.  Biomechanics of overground vs. treadmill walking in healthy individuals. , 2008, Journal of applied physiology.

[11]  M. Srinivasan,et al.  The metabolic cost of changing walking speeds is significant, implies lower optimal speeds for shorter distances, and increases daily energy estimates , 2015, Biology Letters.

[12]  Jeff A Nessler,et al.  Kinematic analysis of side-by-side stepping with intentional and unintentional synchronization. , 2010, Gait & posture.

[13]  Konrad P. Kording,et al.  Synchronization of walking “in the wild” , 2018 .

[14]  Kunlin Wei,et al.  Behavioral tracking gets real , 2018, Nature Neuroscience.

[15]  R. R. Krausz.  Living in Groups , 2013 .

[16]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[17]  Iasonas Kokkinos,et al.  DensePose: Dense Human Pose Estimation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Sara J Gilliland,et al.  Interpersonal synchronization during side by side treadmill walking is influenced by leg length differential and altered sensory feedback. , 2009, Human movement science.

[19]  Tianjian Ji,et al.  FREQUENCY AND VELOCITY OF PEOPLE WALKING , 2005 .

[20]  Bernt Schiele,et al.  ArtTrack: Articulated Multi-Person Tracking in the Wild , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Alexander P. Demos,et al.  Journal of Experimental Psychology : General Rocking to the Beat : Effects of Music and Partner ' s Movements on Spontaneous Interpersonal Coordination , 2011 .

[22]  Jeffrey M. Hausdorff,et al.  Modality-specific communication enabling gait synchronization during over-ground side-by-side walking. , 2012, Human movement science.

[23]  A. Daffertshofer,et al.  Characteristics of instructed and uninstructed interpersonal coordination while walking side-by-side , 2008, Neuroscience Letters.

[24]  Dagmar Sternad,et al.  Treadmill vs. overground walking: different response to physical interaction. , 2017, Journal of neurophysiology.

[25]  Jeffrey M. Hausdorff,et al.  The sensory feedback mechanisms enabling couples to walk synchronously: An initial investigation , 2007, Journal of NeuroEngineering and Rehabilitation.

[26]  Konrad Paul Kording,et al.  Statistics of Natural Movements Are Reflected in Motor Errors , 2009, Journal of neurophysiology.

[27]  D. Wolpert,et al.  Naturalistic approaches to sensorimotor control. , 2011, Progress in brain research.

[28]  Melanie Killen,et al.  How social experience is related to children's intergroup attitudes , 2010 .

[29]  A. Berthoz,et al.  Timing and distance characteristics of interpersonal coordination during locomotion , 2005, Neuroscience Letters.

[30]  Jeff A Nessler,et al.  Varying treadmill speed and inclination affects spontaneous synchronization when two individuals walk side by side. , 2011, Journal of applied biomechanics.

[31]  Elizabeth Gilbert,et al.  Reproducibility Project: Results (Part of symposium called "The Reproducibility Project: Estimating the Reproducibility of Psychological Science") , 2014 .

[32]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[33]  Jens Krause,et al.  How perceived threat increases synchronization in collectively moving animal groups , 2010, Proceedings of the Royal Society B: Biological Sciences.

[34]  Jeffrey M. Hausdorff,et al.  The effects of dual tasking on gait synchronization during over-ground side-by-side walking. , 2018, Human movement science.

[35]  Michael J. Richardson,et al.  Dynamics of Interpersonal Coordination , 2008 .

[36]  Michael J. Richardson,et al.  Too late to coordinate: Contextual influences on behavioral synchrony , 2009 .

[37]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[38]  R. Riener,et al.  Journal of Neuroengineering and Rehabilitation Open Access Biofeedback for Robotic Gait Rehabilitation , 2022 .

[39]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  J. Issartel,et al.  Unintended interpersonal co-ordination: “can we march to the beat of our own drum?” , 2007, Neuroscience Letters.

[41]  R N Marshall,et al.  Algorithms to determine event timing during normal walking using kinematic data. , 2000, Journal of biomechanics.

[42]  N. A. Borghese,et al.  Kinematic determinants of human locomotion. , 1996, The Journal of physiology.