Color ensembles: Sampling and averaging spatial hue distributions

Color serves both to segment a scene into objects and background and to identify objects. Although objects and surfaces usually contain multiple colors, humans can readily extract a representative color description, for instance, that tomatoes are red and bananas yellow. The study of color discrimination and identification has a long history, yet we know little about the formation of summary representations of multicolored stimuli. Here, we characterize the human ability to integrate hue information over space for simple color stimuli varying in the amount of information, stimulus size, and spatial configuration of stimulus elements. We show that humans are efficient at integrating hue information over space beyond what has been shown before for color stimuli. Integration depends only on the amount of information in the display and not on spatial factors such as element size or spatial configuration in the range measured. Finally, we find that observers spontaneously prefer a simple averaging strategy even with skewed color distributions. These results shed light on how human observers form summary representations of color and make a link between the perception of polychromatic surfaces and the broader literature of ensemble perception.

[1]  Shoji Sunaga,et al.  Global color impressions of multicolored textured patterns with equal unique hue elements , 2007 .

[2]  I. Kuriki Testing the Possibility of Average-Color Perception from Multi-Colored Patterns , 2004 .

[3]  Frederick A.A. Kingdom,et al.  Perceiving light versus material , 2008, Vision Research.

[4]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[5]  A. Ishiguchi,et al.  Evidence for a Global Sampling Process in Extraction of Summary Statistics of Item Sizes in a Set , 2016, Front. Psychol..

[6]  Matteo Toscani,et al.  Categorizing natural color distributions , 2018, Vision Research.

[7]  Jüri Allik,et al.  An almost general theory of mean size perception , 2013, Vision Research.

[8]  D. Whitney,et al.  Ensemble Perception , 2018, Annual review of psychology.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  M. Webster,et al.  Perceiving the average hue of color arrays. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[12]  A. Franklin,et al.  Effects of ensemble complexity and perceptual similarity on rapid averaging of hue. , 2015, Journal of vision.

[13]  Timothy F. Brady,et al.  Ensemble statistics accessed through proxies: Range heuristic and dependence on low-level properties in variability discrimination , 2018, Journal of vision.

[14]  F. W. Edridge-Green,et al.  Test for Colour Blindness , 1895 .

[15]  A. Oliva,et al.  The Representation of Simple Ensemble Visual Features Outside the Focus of Attention , 2008, Psychological science.

[16]  Hee Yeon Im,et al.  The effects of sampling and internal noise on the representation of ensemble average size , 2012, Attention, Perception, & Psychophysics.

[17]  S. Dakin Information limit on the spatial integration of local orientation signals. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Mary Hayhoe,et al.  Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. , 2013, Journal of vision.

[19]  Milena Vurro,et al.  Memory color of natural familiar objects: effects of surface texture and 3-D shape. , 2013, Journal of vision.

[20]  Jonathan I. Flombaum,et al.  Why some colors appear more memorable than others: A model combining categories and particulars in color working memory. , 2015, Journal of experimental psychology. General.

[21]  F. edridge-green Tests for Colour-Blindness , 1895, Nature.

[22]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[23]  Jason M Haberman,et al.  Seeing the mean: ensemble coding for sets of faces. , 2009, Journal of experimental psychology. Human perception and performance.

[24]  Wei Ji Ma,et al.  Robust averaging during perceptual judgment is not optimal , 2012, Proceedings of the National Academy of Sciences.

[25]  Jennifer E. Corbett,et al.  The whole is indeed more than the sum of its parts: perceptual averaging in the absence of individual item representation. , 2011, Acta psychologica.

[26]  A. Franklin,et al.  Getting the gist of multiple hues: metric and categorical effects on ensemble perception of hue. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  J. Krauskopf,et al.  Color discrimination and adaptation , 1992, Vision Research.

[28]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[29]  Vebjørn Ekroll,et al.  Color appearance: The limited role of chromatic surround variance in the "gamut expansion effect". , 2008, Journal of vision.

[30]  J. Lund,et al.  Compulsory averaging of crowded orientation signals in human vision , 2001, Nature Neuroscience.

[31]  Jason M Haberman,et al.  Correspondences Rapid extraction of mean emotion and gender from sets of faces , 2007 .

[32]  C. Summerfield,et al.  Robust averaging during perceptual judgment , 2011, Proceedings of the National Academy of Sciences.

[33]  Eiji Kimura Averaging colors of multicolor mosaics. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  Steven L Franconeri,et al.  Selecting and tracking multiple objects. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[35]  A. Treisman,et al.  Representation of statistical properties , 2003, Vision Research.

[36]  Karl R Gegenfurtner,et al.  Color appearance of familiar objects: effects of object shape, texture, and illumination changes. , 2008, Journal of vision.

[37]  Anna Franklin,et al.  Accurate rapid averaging of multihue ensembles is due to a limited capacity subsampling mechanism. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  Steven C. Dakin,et al.  Local and global limitations on direction integration assessed using equivalent noise analysis , 2005, Vision Research.

[39]  A. Chetverikov,et al.  Representing Color Ensembles , 2017, Psychological science.

[40]  D. Macleod,et al.  Color appearance depends on the variance of surround colors , 1997, Current Biology.

[41]  G. Alvarez Representing multiple objects as an ensemble enhances visual cognition , 2011, Trends in Cognitive Sciences.