The dynamics of contour integration: A simultaneous EEG–fMRI study

To study the dynamics of contour integration in the human brain, we simultaneously acquired EEG and fMRI data while participants were engaged in a passive viewing task. The stimuli were Gabor arrays with some Gabor elements positioned on the contour of an embedded shape, in three conditions: with local and global structure (perfect contour alignment), with global structure only (orthogonal orientations interrupting the alignment), or without contour. By applying JointICA to the EEG and fMRI responses of the subjects, new insights could be obtained that cannot be derived from unimodal recordings. In particular, only in the global structure condition, an ERP peak around 300ms was identified that involved a loop from LOC to the early visual areas. This component can be interpreted as being related to the verification of the consistency of the different local elements with the globally defined shape, which is necessary when perfect local-to-global alignment is absent. By modifying JointICA, a quantitative comparison of brain regions and the time-course of their interplay were obtained between different conditions. More generally, we provide additional support for the presence of feedback loops from higher areas to lower level sensory regions.

[1]  Bart Machilsen,et al.  Predictive Coding and the Neural Response to Predictable Stimuli , 2010, The Journal of Neuroscience.

[2]  Roelfsema Pieter.  Cortical algorithms for perceptual grouping , 2008 .

[3]  Sabine Van Huffel,et al.  The “why” and “how” of JointICA: Results from a visual detection task , 2012, NeuroImage.

[4]  Wu Li,et al.  Global contour saliency and local colinear interactions. , 2001, Journal of neurophysiology.

[5]  N. Logothetis,et al.  Integration of Local Features into Global Shapes Monkey and Human fMRI Studies , 2003, Neuron.

[6]  Zoe Kourtzi,et al.  Spatiotemporal characteristics of form analysis in the human visual cortex revealed by rapid event-related fMRI adaptation , 2005, NeuroImage.

[7]  Zoe Kourtzi,et al.  Flexible learning of natural statistics in the human brain. , 2009, Journal of neurophysiology.

[8]  W. Geisler.  Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[9]  S. Palmer,et al.  A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. , 2012, Psychological bulletin.

[10]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[11]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[12]  A. Angelucci,et al.  Contribution of feedforward, lateral and feedback connections to the classical receptive field center and extra-classical receptive field surround of primate V1 neurons. , 2006, Progress in brain research.

[13]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[14]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[15]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[16]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[17]  Michael W. Spratling.  Predictive Coding as a Model of Response Properties in Cortical Area V1 , 2010, The Journal of Neuroscience.

[18]  Kenneth Hugdahl,et al.  Realignment parameter-informed artefact correction for simultaneous EEG–fMRI recordings , 2009, NeuroImage.

[19]  René J. Huster,et al.  Methods for Simultaneous EEG-fMRI: An Introductory Review , 2012, The Journal of Neuroscience.

[20]  R. Kimchi.  Primacy of wholistic processing and global/local paradigm: a critical review. , 1992, Psychological bulletin.

[21]  Stephen D. Mayhew,et al.  Learning Acts on Distinct Processes for Visual Form Perception in the Human Brain , 2012, The Journal of Neuroscience.

[22]  Jan Gläscher,et al.  Visualization of Group Inference Data in Functional Neuroimaging , 2009, Neuroinformatics.

[23]  Masahiro Takei,et al.  Human resource development and visualization , 2009, J. Vis..

[24]  D. Field,et al.  Integration of contours: new insights , 1999, Trends in Cognitive Sciences.

[25]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[26]  C. Joyce,et al.  Automatic removal of eye movement and blink artifacts from EEG data using blind component separation. , 2004, Psychophysiology.

[27]  Manfred Fahle,et al.  The electrophysiological correlate of contour integration is modulated by task demands , 2006, Brain Research.

[28]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .

[29]  R. von der Heydt,et al.  Analysis of the Context Integration Mechanisms Underlying Figure–Ground Organization in the Visual Cortex , 2010, The Journal of Neuroscience.

[30]  Z. Kourtzi,et al.  Neural coding of global form in the human visual cortex. , 2008, Journal of neurophysiology.

[31]  Max Wertheimer,et al.  Untersuchungen zur Lehre von der Gestalt , .

[32]  Fang Fang,et al.  Perceptual grouping and inverse fMRI activity patterns in human visual cortex. , 2008, Journal of vision.

[33]  Sabine Van Huffel,et al.  Removal of BCG artifacts from EEG recordings inside the MR scanner: A comparison of methodological and validation-related aspects , 2010, NeuroImage.

[34]  Rami K. Niazy,et al.  Removal of FMRI environment artifacts from EEG data using optimal basis sets , 2005, NeuroImage.

[35]  Sabine Van Huffel,et al.  Spatially constrained ICA algorithm with an application in EEG processing , 2011, Signal Process..

[36]  Topi Tanskanen,et al.  From local to global: Cortical dynamics of contour integration. , 2008, Journal of vision.

[37]  Bart Machilsen,et al.  The construction of perceptual grouping displays using GERT , 2011, Behavior Research Methods.

[38]  A. Borst.  Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[39]  Abhyuday Mandal,et al.  Multi-objective optimal experimental designs for event-related fMRI studies , 2009, NeuroImage.

[40]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[41]  D. Navon.  What does a compound letter tell the psychologist's mind? , 2003, Acta psychologica.

[42]  Vince D. Calhoun,et al.  Neuronal chronometry of target detection: Fusion of hemodynamic and event-related potential data , 2005, NeuroImage.

[43]  Johan Wagemans,et al.  Context Modulates the ERP Signature of Contour Integration , 2011, PloS one.

[44]  H. Bülthoff,et al.  Perceptual Organization of Local Elements into Global Shapes in the Human Visual Cortex , 2003, Current Biology.

[45]  Wu Li,et al.  Adaptive shape processing in primary visual cortex , 2011, Proceedings of the National Academy of Sciences.

[46]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[47]  Johan Wagemans,et al.  Emergence of Perceptual Gestalts in the Human Visual Cortex , 2011, Psychological science.

[48]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[49]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[50]  Johan Wagemans,et al.  Bistable Gestalts reduce activity in the whole of V1, not just the retinotopically predicted parts. , 2012, Journal of vision.

[51]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.