Ensemble perception includes information from multiple spatial scales

Most visual scenes contain information at different spatial scales, including the local and global, or the detail and gist. Global processes have become increasingly implicated in research examining summary statistical perception, initially as the output of ensemble coding, and more recently as a gating mechanism for selecting which information is included in the averaging process itself. Yet local and global processing are known to be rapidly integrated by the visual system, and it is plausible that global-level information, like spatial organization, may be included as an input during ensemble coding. We tested this hypothesis using an ensemble shape-perception task in which observers evaluated the mean aspect ratios of sets of ellipses. In addition to varying the aspect ratios of the individual shapes, we independently varied the spatial arrangements of the sets so that they had either flat or tall organizations at the global level. We found that observers made precise summary judgments about the average aspect ratios of the sets by integrating information from multiple shapes. More importantly, global flat and tall organizations were incorporated into ensemble judgments about the sets; summary judgments were biased in the directions of the global spatial arrangements on each trial. This global-to-local integration even occurred when the global organizations were masked. Our results demonstrate that the process of summary representation can include information from both the local and global scales. The gist is not just an output of ensemble representation - it can be included as an input to the mechanism itself.

[1]  David Whitney,et al.  Perceiving Crowd Attention , 2014, Psychological science.

[2]  Jason M Haberman,et al.  Efficient summary statistical representation when change localization fails , 2011, Psychonomic bulletin & review.

[3]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[4]  Andrew M. Clark,et al.  Distinct Laminar Processing of Local and Global Context in Primate Primary Visual Cortex , 2017, Neuron.

[5]  S. C. Chong,et al.  Perceived Average Orientation Reflects Effective Gist of the Surface , 2018, Psychological science.

[6]  S. C. Chong,et al.  Power of averaging: Noise reduction by ensemble coding of multiple faces. , 2020, Journal of experimental psychology. General.

[7]  H. Bülthoff,et al.  Perceptual Organization of Local Elements into Global Shapes in the Human Visual Cortex , 2003, Current Biology.

[8]  Dominique Lamy,et al.  Integration Without Awareness , 2011, Psychological science.

[9]  Chenliang Xu,et al.  Can multisensory training aid visual learning? A computational investigation. , 2019, Journal of vision.

[10]  Timothy D. Sweeny,et al.  Perceptual averaging of facial expressions requires visual awareness and attention , 2018, Consciousness and Cognition.

[11]  Jüri Allik,et al.  An almost general theory of mean size perception , 2013, Vision Research.

[12]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[13]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[14]  Matthew F Tang,et al.  Separate banks of information channels encode size and aspect ratio. , 2017, Journal of vision.

[15]  I. Motoyoshi,et al.  Perception and decision mechanisms involved in average estimation of spatiotemporal ensembles , 2020, Scientific Reports.

[16]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[17]  Timothy D. Sweeny,et al.  Journal of Experimental Psychology : Human Perception and Performance Perceiving Group Behavior : Sensitive Ensemble Coding Mechanisms for Biological Motion of Human Crowds , 2012 .

[18]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[19]  C. Gerlach,et al.  Who's got the global advantage? Visual field differences in processing of global and local shape , 2019, Cognition.

[20]  Timothy D. Sweeny,et al.  Ensemble perception of size in 4-5-year-old children. , 2014, Developmental science.

[21]  Michael A. Cohen,et al.  What is the Bandwidth of Perceptual Experience? , 2016, Trends in Cognitive Sciences.

[22]  Jason M Haberman,et al.  Seeing the mean: ensemble coding for sets of faces. , 2009, Journal of experimental psychology. Human perception and performance.

[23]  Tsugumichi Saito,et al.  Transcriptional Regulation of the Angptl8 Gene by Hepatocyte Nuclear Factor-1 in the Murine Liver , 2020, Scientific Reports.

[24]  Markus Conci,et al.  Hierarchical organization in visual working memory: From global ensemble to individual object structure , 2017, Cognition.

[25]  P. Cavanagh,et al.  A shape-contrast effect for briefly presented stimuli. , 1998, Journal of experimental psychology. Human perception and performance.

[26]  Jennifer E. Corbett,et al.  The Whole Warps the Sum of Its Parts , 2017, Psychological science.

[27]  Brian J Stankiewicz,et al.  Empirical evidence for independent dimensions in the visual representation of three-dimensional shape. , 2002, Journal of experimental psychology. Human perception and performance.

[28]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[29]  Catherine Tallon-Baudry,et al.  Conscious Vision Proceeds from Global to Local Content in Goal-Directed Tasks and Spontaneous Vision , 2016, The Journal of Neuroscience.

[30]  A. Chetverikov,et al.  Building ensemble representations: How the shape of preceding distractor distributions affects visual search , 2016, Cognition.

[31]  Ruth Kimchi,et al.  The perception of hierarchical structure , 2015 .

[32]  S. Palmer,et al.  A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. , 2012, Psychological bulletin.

[33]  Jay A. Olson,et al.  Pupil dilation to illusory motion in peripheral drift images: Perception versus reality. , 2017, Journal of vision.

[34]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[35]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[36]  Timothy D. Sweeny,et al.  Object-substitution masking weakens but does not eliminate shape interactions , 2017, Attention, perception & psychophysics.

[37]  Huan Luo,et al.  Behavioral oscillation in global/local processing: Global alpha oscillations mediate global precedence effect. , 2019, Journal of vision.

[38]  G. Alvarez Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.

[39]  D. Burr,et al.  The knowing visual self , 2008, Trends in Cognitive Sciences.

[40]  Gregor Volberg,et al.  The integration of object levels and their content: a theory of global/local processing and related hemispheric differences. , 2005, Journal of experimental psychology. Human perception and performance.

[41]  L. Robertson,et al.  Spatial frequency selection and integration of global and local information in visual processing: A selective review and tribute to Shlomo Bentin , 2016, Neuropsychologia.

[42]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[43]  Timothy F. Brady,et al.  Hierarchical Encoding in Visual Working Memory , 2010, Psychological science.

[44]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[45]  Timothy D. Sweeny,et al.  Anisotropic visual awareness of shapes , 2019, Vision Research.

[46]  Timothy D. Sweeny,et al.  Internal curvature signal and noise in low- and high-level vision. , 2011, Journal of neurophysiology.

[47]  I. Biederman,et al.  Tuning for shape dimensions in macaque inferior temporal cortex , 2005, The European journal of neuroscience.

[48]  Shaul Hochstein,et al.  Global statistics are not neglected. , 2015, Journal of vision.

[49]  J. Pratt,et al.  Substituting objects from consciousness: A review of object substitution masking , 2013, Psychonomic bulletin & review.

[50]  G. Pourtois,et al.  Mean emotion from multiple facial expressions can be extracted with limited attention: Evidence from visual ERPs , 2018, Neuropsychologia.

[51]  D. Regan,et al.  Shape discrimination and the judgement of perfect symmetry: Dissociation of shape from size , 1992, Vision Research.

[52]  D. Whitney,et al.  Object-level visual information gets through the bottleneck of crowding. , 2011, Journal of neurophysiology.

[53]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.

[54]  Sang Chul Chong,et al.  Distributed attention model of perceptual averaging , 2019, Attention, Perception, & Psychophysics.

[55]  Timothy D. Sweeny,et al.  Ensemble Perception of Dynamic Emotional Groups , 2015, Psychological science.

[56]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[57]  J. Enns Object substitution and its relation to other forms of visual masking , 2004, Vision Research.

[58]  A. Angelucci,et al.  Circuits and Mechanisms for Surround Modulation in Visual Cortex. , 2017, Annual review of neuroscience.

[59]  R Kimchi,et al.  The Role of Wholistic/Configural Properties versus Global Properties in Visual Form Perception , 1994, Perception.

[60]  D. Rosenthal,et al.  Quality-space theory in olfaction , 2014, Front. Psychol..

[61]  Johan Wagemans,et al.  The effect of category learning on the representation of shape: dimensions can be biased but not differentiated. , 2003, Journal of experimental psychology. General.

[62]  Timothy F. Brady,et al.  Individual representations in visual working memory inherit ensemble properties. , 2020, Journal of experimental psychology. Human perception and performance.

[63]  Anna Shafer-Skelton,et al.  Global Ensemble Texture Representations are Critical to Rapid Scene Perception , 2017, Journal of experimental psychology. Human perception and performance.

[64]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[65]  Sieu K. Khuu,et al.  The processing of coherent global form and motion patterns without visual awareness , 2014, Front. Psychol..

[66]  Derek H. Arnold,et al.  Shape Adaptation Exaggerates Shape Differences , 2017, Journal of experimental psychology. Human perception and performance.

[67]  Satoru Suzuki,et al.  High-level Pattern Coding Revealed by Brief Shape Aftereffects , 2005 .

[68]  Marcia Grabowecky,et al.  Simultaneous shape repulsion and global assimilation in the perception of aspect ratio. , 2011, Journal of vision.

[69]  Timothy D. Sweeny,et al.  Integration and segmentation conflict during ensemble coding of shape. , 2020, Journal of experimental psychology. Human perception and performance.

[70]  Timothy D. Sweeny,et al.  Averaging multiple facial expressions through subsampling , 2020, Visual Cognition.