Low-level image statistics in natural scenes influence perceptual decision-making

A fundamental component of interacting with our environment is gathering and interpretation of sensory information. When investigating how perceptual information influences decision-making, most researchers have relied on manipulated or unnatural information as perceptual input, resulting in findings that may not generalize to real-world scenes. Unlike simplified, artificial stimuli, real-world scenes contain low-level regularities that are informative about the structural complexity, which the brain could exploit. In this study, participants performed an animal detection task on low, medium or high complexity scenes as determined by two biologically plausible natural scene statistics, contrast energy (CE) or spatial coherence (SC). In experiment 1, stimuli were sampled such that CE and SC both influenced scene complexity. Diffusion modelling showed that the speed of information processing was affected by low-level scene complexity. Experiment 2a/b refined these observations by showing how isolated manipulation of SC resulted in weaker but comparable effects, with an additional change in response boundary, whereas manipulation of only CE had no effect. Overall, performance was best for scenes with intermediate complexity. Our systematic definition quantifies how natural scene complexity interacts with decision-making. We speculate that CE and SC serve as an indication to adjust perceptual decision-making based on the complexity of the input.

[1]  Roger Ratcliff,et al.  Measuring psychometric functions with the diffusion model. , 2014, Journal of experimental psychology. Human perception and performance.

[2]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[3]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[4]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[5]  Thomas V. Wiecki,et al.  HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python , 2013, Front. Neuroinform..

[6]  Wilson S. Geisler,et al.  A Bayesian approach to the evolution of perceptual and cognitive systems , 2003, Cogn. Sci..

[7]  Thomas Serre,et al.  What are the Visual Features Underlying Rapid Object Recognition? , 2011, Front. Psychology.

[8]  Sennay Ghebreab,et al.  Scene complexity modulates degree of feedback activity during object detection in natural scenes , 2018, PLoS Comput. Biol..

[9]  Roger Ratcliff,et al.  Individual Differences and Fitting Methods for the Two-Choice Diffusion Model of Decision Making. , 2015, Decision.

[10]  Michelle R. Greene,et al.  What you see is what you expect: rapid scene understanding benefits from prior experience , 2015, Attention, Perception, & Psychophysics.

[11]  Victor A. F. Lamme,et al.  The role of Weibull image statistics in rapid object detection in natural scenes , 2010 .

[12]  Lourens J. Waldorp,et al.  Visual Information Shapes the Dynamics of Corticobasal Ganglia Pathways during Response Selection and Inhibition , 2015, Journal of Cognitive Neuroscience.

[13]  Victor A. F. Lamme,et al.  Spatially Pooled Contrast Responses Predict Neural and Perceptual Similarity of Naturalistic Image Categories , 2012, PLoS Comput. Biol..

[14]  Gregory J. Zelinsky,et al.  Scene context guides eye movements during visual search , 2006, Vision Research.

[15]  H. Steven Scholte,et al.  Spatial Frequency Information Modulates Response Inhibition and Decision-Making Processes , 2013, PloS one.

[16]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[17]  Sennay Ghebreab,et al.  From Image Statistics to Scene Gist: Evoked Neural Activity Reveals Transition from Low-Level Natural Image Structure to Scene Category , 2013, The Journal of Neuroscience.

[18]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[19]  Gidon Felsen,et al.  A natural approach to studying vision , 2005, Nature Neuroscience.

[20]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[21]  D J Field,et al.  Local Contrast in Natural Images: Normalisation and Coding Efficiency , 2000, Perception.

[22]  R. Rosenholtz,et al.  A summary statistic representation in peripheral vision explains visual search. , 2009, Journal of vision.

[23]  Arnold W. M. Smeulders,et al.  Brain responses strongly correlate with Weibull image statistics when processing natural images. , 2009, Journal of vision.

[24]  Michelle R. Greene,et al.  PSYCHOLOGICAL SCIENCE Research Article The Briefest of Glances The Time Course of Natural Scene Understanding , 2022 .

[25]  George L. Malcolm,et al.  Making Sense of Real-World Scenes , 2016, Trends in Cognitive Sciences.

[26]  Arnold W. M. Smeulders,et al.  A Biologically Plausible Model for Rapid Natural Scene Identification , 2009, NIPS.

[27]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[28]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[29]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[30]  Andriana Olmos,et al.  A biologically inspired algorithm for the recovery of shading and reflectance images , 2004 .

[31]  V. Lamme,et al.  The time course of natural scene perception with reduced attention. , 2016, Journal of neurophysiology.

[32]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[33]  R. Ratcliff,et al.  Bias in the Brain: A Diffusion Model Analysis of Prior Probability and Potential Payoff , 2012, The Journal of Neuroscience.

[34]  Peter Auer,et al.  Generic object recognition with boosting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[36]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.