Dense sampling reveals behavioral oscillations in rapid visual categorization

Perceptual systems must create discrete objects and events out of a continuous flow of sensory information. Previous studies have demonstrated oscillatory effects in the behavioral outcome of low-level visual tasks, suggesting a cyclic nature of visual processing as the solution. To investigate whether these effects extend to more complex tasks, a stream of “neutral” photographic images (not containing targets) was rapidly presented (20 ms/image). Embedded were one or two presentations of a randomly selected target image (vehicles and animals). Subjects reported the perceived target category. On dual-presentation trials, the ISI varied systematically from 0 to 600 ms. At randomized timing before first target presentation, the screen was flashed with the intent of creating a phase reset in the visual system. Sorting trials by temporal distance between flash and first target presentation revealed strong oscillations in behavioral performance, peaking at 5 Hz. On dual-target trials, longer ISIs led to reduced performance, implying a temporal integration window for object category discrimination. The “animal” trials exhibited a significant oscillatory component around 5 Hz. Our results indicate that oscillatory effects are not mere fringe effects relevant only with simple stimuli, but are resultant from the core mechanisms of visual processing and may well extend into real-life scenarios.

[1]  Victor A F Lamme,et al.  Two critical periods in early visual cortex during figure–ground segregation , 2012, Brain and behavior.

[2]  Ehud Zohary,et al.  Two Phases of V1 Activity for Visual Recognition of Natural Images , 2010, Journal of Cognitive Neuroscience.

[3]  Andreas Wutz,et al.  The temporal window of individuation limits visual capacity , 2014, Front. Psychol..

[4]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[5]  Huan Luo,et al.  Behavioral oscillation in priming: competing perceptual predictions conveyed in alternating theta-band rhythms. , 2015, Journal of vision.

[6]  Olivier R. Joubert,et al.  Animal Detection Precedes Access to Scene Category , 2012, PloS one.

[7]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[8]  L. Cosmides,et al.  Category-specific attention for animals reflects ancestral priorities, not expertise , 2007, Proceedings of the National Academy of Sciences.

[9]  Huan Luo,et al.  Behavioral Oscillation in Priming: Competing Perceptual Predictions Conveyed in Alternating Theta-Band Rhythms , 2015, The Journal of Neuroscience.

[10]  Á. Pascual-Leone,et al.  Fast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness , 2001, Science.

[11]  Victor A. F. Lamme,et al.  Confuse Your Illusion , 2013, Psychological science.

[12]  E. Callaway,et al.  Relationship between Reaction Time and Electroencephalographic Alpha Phase , 1960, Science.

[13]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[14]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[15]  Y. Saalmann,et al.  Rhythmic Sampling within and between Objects despite Sustained Attention at a Cued Location , 2013, Current Biology.

[16]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[17]  R. VanRullen,et al.  This Is the Rhythm of Your Eyes: The Phase of Ongoing Electroencephalogram Oscillations Modulates Saccadic Reaction Time , 2011, The Journal of Neuroscience.

[18]  R. E. Dustman,et al.  PHASE OF ALPHA BRAIN WAVES, REACTION TIME AND VISUALLY EVOKED POTENTIALS. , 1965, Electroencephalography and clinical neurophysiology.

[19]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[20]  P. Fries,et al.  Attention Samples Stimuli Rhythmically , 2012, Current Biology.

[21]  R. Lansing,et al.  Relation of brain and tremor rhythms to visual reaction time. , 1957, Electroencephalography and clinical neurophysiology.

[22]  G. Sandini,et al.  Rhythmic Oscillations of Visual Contrast Sensitivity Synchronized with Action , 2015, The Journal of Neuroscience.

[23]  I. Biederman,et al.  Accurate identification but no priming and chance recognition memory for pictures in RSVP sequences , 2000 .

[24]  Andreas Wutz,et al.  Saccades reset temporal integration windows , 2014 .

[25]  Yizhou Wang,et al.  Distinct processing for pictures of animals and objects: evidence from eye movements. , 2012, Emotion.

[26]  Mika Koivisto,et al.  Recurrent Processing Enhances Visual Awareness but Is Not Necessary for Fast Categorization of Natural Scenes , 2014, Journal of Cognitive Neuroscience.

[27]  G Richard,et al.  Ultra-rapid categorisation of natural scenes does not rely on colour cues: a study in monkeys and humans , 2000, Vision Research.

[28]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[29]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[30]  R. VanRullen,et al.  Ongoing EEG Phase as a Trial-by-Trial Predictor of Perceptual and Attentional Variability , 2011, Front. Psychology.

[31]  S. Thorpe,et al.  The time course of visual processing: Backward masking and natural scene categorisation , 2005, Vision Research.

[32]  S. Thorpe,et al.  Rapid categorization of achromatic natural scenes: how robust at very low contrasts? , 2005, The European journal of neuroscience.

[33]  Peter A. Tass,et al.  Desynchronization of brain rhythms with soft phase-resetting techniques , 2002, Biological Cybernetics.

[34]  Huan Luo,et al.  Behavioral Oscillations in Attention: Rhythmic α Pulses Mediated through θ Band , 2014, The Journal of Neuroscience.

[35]  Rufin VanRullen,et al.  Perceptual Echoes at 10 Hz in the Human Brain , 2012, Current Biology.

[36]  Karl R. Gegenfurtner,et al.  Animal detection in natural images: effects of color and image database , 2011 .

[37]  K L Shapiro,et al.  Similarity determines the attentional blink. , 1995, Journal of experimental psychology. Human perception and performance.

[38]  Brad Wyble,et al.  Detecting meaning in RSVP at 13 ms per picture , 2013, Attention, perception & psychophysics.

[39]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[40]  James W. Tanaka,et al.  The SHINE toolbox for controlling low-level image properties , 2010 .

[41]  M. Brandt Visual and auditory evoked phase resetting of the alpha EEG. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[42]  C. N. Boehler,et al.  Rapid recurrent processing gates awareness in primary visual cortex , 2008, Proceedings of the National Academy of Sciences.

[43]  R VanRullen,et al.  Is it a Bird? Is it a Plane? Ultra-Rapid Visual Categorisation of Natural and Artifactual Objects , 2001, Perception.

[44]  Kimron Shapiro,et al.  Attentional blink , 2009, Scholarpedia.

[45]  John J. Foxe,et al.  Ready, Set, Reset: Stimulus-Locked Periodicity in Behavioral Performance Demonstrates the Consequences of Cross-Sensory Phase Reset , 2011, The Journal of Neuroscience.

[46]  C. Koch,et al.  A category-specific response to animals in the right human amygdala , 2011, Nature Neuroscience.

[47]  M. Koivisto,et al.  Recurrent Processing in V1/V2 Contributes to Categorization of Natural Scenes , 2011, The Journal of Neuroscience.

[48]  Jan Drewes,et al.  Animal Detection in Natural Images: Effects of Color and Image Database , 2011, PloS one.

[49]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[50]  A. Ohman,et al.  Has evolution primed humans to "beware the beast"? , 2007, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[52]  C. Koch,et al.  Is perception discrete or continuous? , 2003, Trends in Cognitive Sciences.