Pinpointing the neural signatures of single-exposure visual familiarity

Memories of the images that we have seen are thought to be reflected in the reduction of neural responses in high-level visual areas such as inferotemporal (IT) cortex, a phenomenon known as repetition suppression (RS). We challenged this hypothesis with a task that required rhesus monkeys to report image familiarity while ignoring variations in contrast, a stimulus attribute that is also known to modulate the overall IT response. The monkeys’ behavior was largely contrast-invariant, contrary to the predictions of the RS encoding scheme, which could not distinguish response familiarity from changes in contrast. However, the monkeys’ behavioral patterns were well predicted by a linearly decodable variant in which the total spike count is corrected for contrast modulation. These results suggest that the IT neural activity pattern that best aligns with single-exposure visual familiarity behavior is not RS but rather “sensory referenced suppression (SRS)”: reductions in IT population response magnitude, corrected for sensory modulation.

[1]  Laudan B. Jahromi.  Recognition Memory , 2021, Encyclopedia of Autism Spectrum Disorders.

[2]  Jiye G. Kim,et al.  Functions of ventral visual cortex after bilateral medial temporal lobe damage , 2020, Progress in Neurobiology.

[3]  Eli J. Cornblath,et al.  Gender Diversity Statement and Code Notebook v1.0 , 2020 .

[4]  Kristin A. Linn,et al.  The extent and drivers of gender imbalance in neuroscience reference lists , 2020, Nature Neuroscience.

[5]  Aude Oliva,et al.  Population response magnitude variation in inferotemporal cortex predicts image memorability , 2019, eLife.

[6]  W. Suzuki,et al.  A neural signature of pattern separation in the monkey hippocampus , 2019, Proceedings of the National Academy of Sciences.

[7]  Rufin Vogels,et al.  Face Repetition Probability Does Not Affect Repetition Suppression in Macaque Inferotemporal Cortex , 2018, The Journal of Neuroscience.

[8]  Noam Roth,et al.  Inferotemporal cortex multiplexes behaviorally-relevant target match signals and visual representations in a manner that minimizes their interference , 2017, bioRxiv.

[9]  Nicole C. Rust,et al.  Single-exposure visual memory judgments are reflected in inferotemporal cortex , 2018, eLife.

[10]  Jonathan Winawer,et al.  Compressive Temporal Summation in Human Visual Cortex , 2017, The Journal of Neuroscience.

[11]  Caspar M. Schwiedrzik,et al.  High-Level Prediction Signals in a Low-Level Area of the Macaque Face-Processing Hierarchy , 2017, Neuron.

[12]  Neven Caplar,et al.  Quantitative evaluation of gender bias in astronomical publications from citation counts , 2016, Nature Astronomy.

[13]  Rufin Vogels,et al.  Sources of adaptation of inferior temporal cortical responses , 2016, Cortex.

[14]  David J. Freedman,et al.  Inferring learning rules from distribution of firing rates in cortical neurons , 2015, Nature Neuroscience.

[15]  Arne D. Ekstrom,et al.  Specific responses of human hippocampal neurons are associated with better memory , 2015, Proceedings of the National Academy of Sciences.

[16]  Jianxiong Xiao,et al.  What Makes a Photograph Memorable? , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Mareike Grotheer,et al.  Repetition Probability Effects Depend on Prior Experiences , 2014, The Journal of Neuroscience.

[18]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[19]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.

[20]  Brice A. Kuhl,et al.  Repetition Suppression and Multi-Voxel Pattern Similarity Differentially Track Implicit and Explicit Visual Memory , 2013, The Journal of Neuroscience.

[21]  Barbara F. Walter,et al.  The Gender Citation Gap in International Relations , 2013, International Organization.

[22]  Michael J. Jutras,et al.  Oscillatory activity in the monkey hippocampus during visual exploration and memory formation , 2013, Proceedings of the National Academy of Sciences.

[23]  James J. DiCarlo,et al.  Balanced Increases in Selectivity and Tolerance Produce Constant Sparseness along the Ventral Visual Stream , 2012, The Journal of Neuroscience.

[24]  C. Olson,et al.  Statistical learning of visual transitions in monkey inferotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[25]  Russell A. Poldrack,et al.  Spaced Learning Enhances Subsequent Recognition Memory by Reducing Neural Repetition Suppression , 2011, Journal of Cognitive Neuroscience.

[26]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[27]  Jim M. Monti,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008, Nature Neuroscience.

[28]  Tomaso Poggio,et al.  Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex , 2007, The Journal of Neuroscience.

[29]  M. Chun,et al.  Linking Implicit and Explicit Memory: Common Encoding Factors and Shared Representations , 2006, Neuron.

[30]  K. Norman,et al.  Memory Strength and Repetition Suppression: Multimodal Imaging of Medial Temporal Cortical Contributions to Recognition , 2005, Neuron.

[31]  M. W. Brown,et al.  Neuronal activity related to visual recognition memory: long-term memory and the encoding of recency and familiarity information in the primate anterior and medial inferior temporal and rhinal cortex , 2004, Experimental Brain Research.

[32]  M. W. Brown,et al.  Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe , 1998, Neuropharmacology.

[33]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[34]  R. Desimone,et al.  The representation of stimulus familiarity in anterior inferior temporal cortex. , 1993, Journal of neurophysiology.

[35]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[36]  I. Riches,et al.  The effects of visual stimulation and memory on neurons of the hippocampal formation and the neighboring parahippocampal gyrus and inferior temporal cortex of the primate , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  J. Ringo,et al.  A macaque remembers pictures briefly viewed six months earlier , 1985, Behavioural Brain Research.

[38]  L. Standing.  Learning 10000 pictures , 1973 .