Brain and DCNN representational geometries predict variability in conscious access

When two targets (T1 and T2) are presented in a rapidly sequentially-presented stream of distractors, subjects often show a clear deficiency to report T2 when presented 200-500 ms after T1. This effect is known as the Attentional Blink (AB). Using the AB as a method to quantify the probability of conscious access, we investigate why some images seem to rise to consciousness more readily. By defining the representational relationships between images using fMRI and CNNs, we show that images that are distinct in high-level representations are more resilient to the AB effect, while low-level similarity to other images increase the probability of conscious access. These results were replicated using representational geometries derived from both functional Magnetic Resonance Imaging (fMRI) and Convolutional Neural Network (CNN). This provides additional parallels between the hierarchical complexity of CNNs trained on object classification and the human visual ventral stream, with CNN and brain representations predicting behaviour in a similar way.

[1]  Jonathan Winawer,et al.  GLMdenoise: a fast, automated technique for denoising task-based fMRI data , 2013, Front. Neurosci..

[2]  Nikolaus Kriegeskorte,et al.  GLMdenoise improves multivariate pattern analysis of fMRI data , 2018, NeuroImage.

[3]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[4]  R. Marois,et al.  The attentional blink: A review of data and theory , 2009, Attention, perception & psychophysics.

[5]  K. Shapiro,et al.  Conscious perception of natural images is constrained by category-related visual features , 2019, Nature Communications.

[6]  Satrajit S. Ghosh,et al.  The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments , 2016, Scientific Data.

[7]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[8]  N. Kriegeskorte,et al.  Author ' s personal copy Representational geometry : integrating cognition , computation , and the brain , 2013 .

[9]  Satrajit S. Ghosh,et al.  FMRIPrep: a robust preprocessing pipeline for functional MRI , 2018, bioRxiv.

[10]  Justin Plantier,et al.  Repetition Blindness for Natural Images of Objects with Viewpoint Changes , 2013, Front. Psychology.

[11]  M. Chun,et al.  The Neural Fate of Consciously Perceived and Missed Events in the Attentional Blink , 2004, Neuron.

[12]  Jocelyn L. Sy,et al.  Target–target similarity and the attentional blink: Task-relevance matters! , 2009 .

[13]  J Mazziotta,et al.  A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[15]  N. Kanwisher Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[16]  Nikolaus Kriegeskorte,et al.  Relating Population-Code Representations between Man, Monkey, and Computational Models , 2009, Front. Neurosci..