Ensemble coding of crowd speed using biological motion

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined.

[1]  David Whitney,et al.  Multi-level Crowding and the Paradox of Object Recognition in Clutter , 2018, Current Biology.

[2]  Jüri Allik,et al.  An almost general theory of mean size perception , 2013, Vision Research.

[3]  Ian M. Thornton,et al.  Influence of crowd behaviour on estimates of biological motion speed , 2018 .

[4]  David Whitney,et al.  Perceiving Crowd Attention , 2014, Psychological science.

[5]  D. Pelli,et al.  The uncrowded window of object recognition , 2008, Nature Neuroscience.

[6]  P. Cavanagh,et al.  Attention-based visual routines: sprites , 2001, Cognition.

[7]  D. Ariely Seeing Sets: Representation by Statistical Properties , 2001, Psychological science.

[8]  Shaul Hochstein,et al.  Relating categorization to set summary statistics perception , 2019, Attention, Perception, & Psychophysics.

[9]  Nikolaus Kriegeskorte Deep neural networks: a new framework for modelling biological vision and brain information processing , 2015 .

[10]  Zoe Leviston,et al.  Climate Change From a Distance: An Analysis of Construal Level and Psychological Distance From Climate Change , 2019, Front. Psychol..

[11]  F. Petzschner,et al.  A Bayesian perspective on magnitude estimation , 2015, Trends in Cognitive Sciences.

[12]  A. O'Toole,et al.  Recognizing moving faces: a psychological and neural synthesis , 2002, Trends in Cognitive Sciences.

[13]  D. Simons,et al.  Better than average: Alternatives to statistical summary representations for rapid judgments of average size , 2008, Perception & psychophysics.

[14]  Timothy D. Sweeny,et al.  Journal of Experimental Psychology : Human Perception and Performance Perceiving Group Behavior : Sensitive Ensemble Coding Mechanisms for Biological Motion of Human Crowds , 2012 .

[15]  George Mather,et al.  Adaptation reveals sensory and decision components in the visual estimation of locomotion speed , 2018, Scientific Reports.

[16]  Emily J. Ward,et al.  Can you perceive ensembles without perceiving individuals?: The role of statistical perception in determining whether awareness overflows access , 2016, Cognition.

[17]  Asal Baragchizadeh,et al.  Integrating faces and bodies: Psychological and neural perspectives on whole person perception , 2020, Neuroscience & Biobehavioral Reviews.

[18]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[19]  Ronald A. Rensink,et al.  Active versus passive processing of biological motion , 2002, Perception.

[20]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[21]  Nikolaus Kriegeskorte,et al.  Deep neural networks: a new framework for modelling biological vision and brain information processing , 2015, bioRxiv.

[22]  Sang Chul Chong,et al.  Distributed attention model of perceptual averaging , 2019, Attention, Perception, & Psychophysics.

[23]  G. Orban,et al.  Human velocity and direction discrimination measured with random dot patterns , 1988, Vision Research.

[24]  S. McKee,et al.  Simultaneous encoding of direction at a local and global scale , 1998, Perception & psychophysics.

[25]  Timothy D. Sweeny,et al.  Ensemble Perception of Dynamic Emotional Groups , 2015, Psychological science.

[26]  M. Shiffrar,et al.  Human Body Perception From The Inside Out , 2005 .

[27]  Jeffrey R. Spies,et al.  Something in the way we move: Motion dynamics, not perceived sex, influence head movements in conversation. , 2011, Journal of experimental psychology. Human perception and performance.

[28]  David Whitney,et al.  Reference repulsion in the categorical perception of biological motion , 2012, Vision Research.

[29]  Shenli Peng,et al.  Memory of Ensemble Representation Was Independent of Attention , 2019, Front. Psychol..

[30]  Gideon Paul Caplovitz,et al.  The global slowdown effect: Why does perceptual grouping reduce perceived speed? , 2014, Attention, perception & psychophysics.

[31]  M. Herzog,et al.  Crowding, grouping, and object recognition: A matter of appearance. , 2015, Journal of vision.

[32]  M. Pavlova,et al.  Orientation specificity in biological motion perception , 2000, Perception & psychophysics.

[33]  Hong Wang,et al.  Consequences of in utero exposure to Zika virus in offspring of AG129 mice , 2018, Scientific Reports.

[34]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[35]  Katsumi Watanabe,et al.  Contribution of global and local biological motion information to speed perception and discrimination. , 2018, Journal of Vision.

[36]  Anna Shafer-Skelton,et al.  Global Ensemble Texture Representations are Critical to Rapid Scene Perception , 2017, Journal of experimental psychology. Human perception and performance.

[37]  Ronald A. Rensink The Dynamic Representation of Scenes , 2000 .

[38]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[39]  Peter E. Keller,et al.  Music’s impact on the visual perception of emotional dyadic interactions , 2011 .

[40]  M. Pavlova Biological motion processing as a hallmark of social cognition. , 2012, Cerebral cortex.

[41]  Raja Parasuraman,et al.  Attention, biological motion, and action recognition , 2012, NeuroImage.

[42]  Q. Vuong,et al.  Incidental Processing of Biological Motion , 2004, Current Biology.

[43]  D. Levi,et al.  Visual crowding: a fundamental limit on conscious perception and object recognition , 2011, Trends in Cognitive Sciences.

[45]  G. Mather,et al.  Low-level visual processing of biological motion , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[46]  Katsumi Watanabe,et al.  Action Congruency Influences Crowding When Discriminating Biological Motion Direction , 2016, Perception.

[47]  Chris Oriet,et al.  Incidental statistical summary representation over time. , 2016, Journal of vision.

[48]  D. Helbing,et al.  The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd Dynamics , 2010, PloS one.

[49]  J. Fockert,et al.  Attention modulates set representation by statistical properties , 2008, Perception & psychophysics.

[50]  Michèle Fabre-Thorpe,et al.  Interaction of top-down and bottom-up processing in the fast visual analysis of natural scenes. , 2004, Brain research. Cognitive brain research.

[51]  Minsoo Kang,et al.  How fast is fast enough? Walking cadence (steps/min) as a practical estimate of intensity in adults: a narrative review , 2018, British Journal of Sports Medicine.

[52]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[53]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[54]  Jason M Haberman,et al.  Correspondences Rapid extraction of mean emotion and gender from sets of faces , 2007 .

[55]  Morris I. Stein,et al.  Attracting Assault: Victims’Nonverbal Cues , 1981 .

[56]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[57]  M C FLOM,et al.  VISUAL RESOLUTION AND CONTOUR INTERACTION. , 1963, Journal of the Optical Society of America.

[58]  Bennett I. Bertenthal,et al.  Global Processing of Biological Motions , 1994 .

[59]  Paul F. Bulakowski,et al.  Reexamining the possible benefits of visual crowding: dissociating crowding from ensemble percepts , 2011, Attention, perception & psychophysics.

[60]  Wolfgang Prinz,et al.  A Simon effect with stationary moving stimuli. , 2004, Journal of experimental psychology. Human perception and performance.

[61]  Daniel J Simons,et al.  Ensemble representations: effects of set size and item heterogeneity on average size perception. , 2013, Acta psychologica.

[62]  Patrick Cavanagh,et al.  Crowding of biological motion stimuli. , 2013, Journal of vision.

[63]  Anna Franklin,et al.  Accurate rapid averaging of multihue ensembles is due to a limited capacity subsampling mechanism. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[64]  Galit Yovel,et al.  Recognizing People in Motion , 2016, Trends in Cognitive Sciences.

[65]  S. Ullman,et al.  Visual categorization of social interactions , 2014 .

[66]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[67]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[68]  Natacha S. Santos,et al.  Perceiving nonverbal behavior: Neural correlates of processing movement fluency and contingency in dyadic interactions , 2014, Human brain mapping.

[69]  D. Whitney,et al.  Object-level visual information gets through the bottleneck of crowding. , 2011, Journal of neurophysiology.

[70]  Menna E. Jones,et al.  Sex bias in ability to cope with cancer: Tasmanian devils and facial tumour disease , 2018, Proceedings of the Royal Society B.

[71]  Dorita H. F. Chang,et al.  Acceleration carries the local inversion effect in biological motion perception. , 2009, Journal of vision.

[72]  Joshua A Solomon,et al.  Efficiencies for the statistics of size discrimination. , 2011, Journal of vision.

[73]  D. Massey A Brief History of Human Society: The Origin and Role of Emotion in Social Life , 2002, American Sociological Review.

[74]  Chris I Baker,et al.  Contributions of low- and high-level properties to neural processing of visual scenes in the human brain , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[75]  Allison Yamanashi Leib,et al.  Fast ensemble representations for abstract visual impressions , 2016, Nature Communications.

[76]  Andrew P. Duchon,et al.  The human visual system averages speed information , 1992, Vision Research.

[77]  H. BOUMA,et al.  Interaction Effects in Parafoveal Letter Recognition , 1970, Nature.

[78]  G. Pourtois,et al.  Capacity limitations to extract the mean emotion from multiple facial expressions depend on emotion variance , 2018, Vision Research.

[79]  Ian M. Thornton Top-Down Versus Bottom-Up Processing of Biological Motion , 2012 .

[80]  Robert S Allison,et al.  The dichoptiscope: an instrument for investigating cues to motion in depth. , 2013, Journal of vision.

[81]  Maggie Shiffrar,et al.  People Watching: Social, Perceptual, and Neurophysiological Studies of Body Perception , 2012 .

[82]  A. Treisman How the deployment of attention determines what we see , 2006, Visual cognition.

[83]  Michael S. Landy,et al.  Texture analysis and perception , 2013 .

[84]  Axel Cleeremans,et al.  Implicit change identification: a replication of Fernandez-Duque and Thornton (2003). , 2006, Journal of experimental psychology. Human perception and performance.

[85]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[86]  Robert Sekuler,et al.  Coherent global motion percepts from stochastic local motions , 1984, Vision Research.

[87]  David C. Burr,et al.  Seeing biological motion , 1998, Nature.

[88]  R. Watt,et al.  The computation of orientation statistics from visual texture , 1997, Vision Research.

[89]  J. D. de Fockert,et al.  Rapid extraction of mean identity from sets of faces. , 2009, Quarterly journal of experimental psychology.

[90]  Ian M Thornton,et al.  Explicit mechanisms do not account for implicit localization and identification of change: An empirical reply to Mitroff et al. (2002). , 2002, Journal of experimental psychology. Human perception and performance.

[91]  Yi Jiang,et al.  Motion speed modulates walking direction discrimination: The role of the feet in biological motion perception , 2011 .

[92]  Barton L Anderson,et al.  Texture-shading flow interactions and perceived reflectance. , 2014, Journal of vision.

[93]  P. Atchley,et al.  Discrimination of speed distributions: Sensitivity to statistical properties , 1995, Vision Research.

[94]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[95]  Karl Verfaillie,et al.  Perception of biological motion: A stimulus set of human point-light actions , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[96]  C.J. Cohen,et al.  A Surveillance System for the Recognition of Intent within Individuals and Crowds , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[97]  S. McKee,et al.  Sequential recruitment in the discrimination of velocity. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[98]  Timothy F. Brady,et al.  Individual differences in ensemble perception reveal multiple, independent levels of ensemble representation. , 2015, Journal of experimental psychology. General.

[99]  Maggie Shiffrar,et al.  Walking perception by walking observers. , 2005, Journal of experimental psychology. Human perception and performance.

[100]  Steven Dakin,et al.  Spatial limitations in averaging social cues , 2016, Scientific Reports.

[101]  A. Oliva,et al.  The Representation of Simple Ensemble Visual Features Outside the Focus of Attention , 2008, Psychological science.

[102]  Kevin A. Pelphrey,et al.  Social Inclusion Enhances Biological Motion Processing: A Functional Near-Infrared Spectroscopy Study , 2012, Brain Topography.

[103]  Elena K. Festa,et al.  Recruitment mechanisms in speed and fine-direction discrimination tasks , 1997, Vision Research.

[104]  A. Barbot,et al.  Optical and neural anisotropy in peripheral vision , 2016, Journal of vision.

[105]  N. Troje,et al.  The Inversion Effect in Biological Motion Perception: Evidence for a “Life Detector”? , 2006, Current Biology.

[106]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[107]  M. Webster,et al.  Perceiving the average hue of color arrays. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[108]  A. Treisman,et al.  Representation of statistical properties , 2003, Vision Research.

[109]  Pawan Sinha,et al.  Top-down influences on stereoscopic depth-perception , 1998, Nature Neuroscience.

[110]  Florian Meirer,et al.  Relating structure and composition with accessibility of a single catalyst particle using correlative 3-dimensional micro-spectroscopy , 2016, Nature Communications.

[111]  Vivek K. Bajpai,et al.  Antioxidant efficacy and the upregulation of Nrf2-mediated HO-1 expression by (+)-lariciresinol, a lignan isolated from Rubia philippinensis, through the activation of p38 , 2017, Scientific Reports.

[112]  S. Dakin Information limit on the spatial integration of local orientation signals. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[113]  Stephen J Heinen,et al.  Human smooth pursuit direction discrimination , 1999, Vision Research.

[114]  Rebecca J Sharman,et al.  Visual adaptation alters the apparent speed of real-world actions , 2017, Scientific Reports.

[115]  Ian M Thornton,et al.  Matching biological motion at extreme distances. , 2014, Journal of vision.

[116]  D. Levi Crowding—An essential bottleneck for object recognition: A mini-review , 2008, Vision Research.

[117]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[118]  Jason M Haberman,et al.  The visual system discounts emotional deviants when extracting average expression , 2010, Attention, perception & psychophysics.

[119]  B. Bauer Does Stevens’s Power Law for Brightness Extend to Perceptual Brightness Averaging? , 2009 .

[120]  Peter Neri,et al.  Meaningful interactions can enhance visual discrimination of human agents , 2006, Nature Neuroscience.

[121]  A. Burton,et al.  Viewers extract the mean from images of the same person: A route to face learning. , 2015, Journal of vision.

[122]  David Whitney,et al.  Exaggerated groups: amplification in ensemble coding of temporal and spatial features , 2018, Proceedings of the Royal Society B: Biological Sciences.

[123]  G. Alvarez Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[124]  Reza Malekzadeh,et al.  Verbal Autopsy: Reliability and Validity Estimates for Causes of Death in the Golestan Cohort Study in Iran , 2010, PloS one.

[125]  N. Troje,et al.  Embodiment of Sadness and Depression—Gait Patterns Associated With Dysphoric Mood , 2009, Psychosomatic medicine.

[126]  Jason M Haberman,et al.  Seeing the mean: ensemble coding for sets of faces. , 2009, Journal of experimental psychology. Human perception and performance.