Coarse-to-fine encoding of spatial frequency information into visual short-term memory for faces but impartial decay.

Face perception studies investigated how spatial frequencies (SF) are extracted from retinal display while forming a perceptual representation, or their selective use during task-imposed categorization. Here we focused on the order of encoding low-spatial frequencies (LSF) and high-spatial frequencies (HSF) from perceptual representations into visual short-term memory (VSTM). We also investigated whether different SF-ranges decay from VSTM at different rates during a study-test stimulus-onset asynchrony. An old/new VSTM paradigm was used in which two broadband faces formed the positive set and the probes preserved either low or high SF ranges. Exposure time of 500 ms was sufficient to encode both HSF and LSF in the perceptual representation (experiment 1). Nevertheless, when the positive-set was exposed for 500 ms, LSF-probes were better recognized in VSTM compared with HSF-probes; this effect vanished at 800-ms exposure time (experiment 2). Backward masking the positive set exposed for 800 ms re-established the LSF-probes advantage (experiment 3). The speed of decay up to 10 seconds was similar for LSF- and HSF-probes (experiment 4). These results indicate that LSF are extracted and consolidated into VSTM faster than HSF, supporting a coarse-to-fine order, while the decay from VSTM is not governed by SF.

[1]  R. Watt Scanning from coarse to fine spatial scales in the human visual system after the onset of a stimulus. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[2]  E. Vogel,et al.  Perceptual expertise enhances the resolution but not the number of representations in working memory , 2008, Psychonomic bulletin & review.

[3]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[4]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[5]  S Magnussen,et al.  The psychophysics of perceptual memory , 1999, Psychological research.

[6]  Rainer Goebel,et al.  From Coarse to Fine? Spatial and Temporal Dynamics of Cortical Face Processing , 2010, Cerebral cortex.

[7]  Arthur P. Ginsburg,et al.  Spatial filtering and visual form perception. , 1986 .

[8]  Francesc S. Beltran,et al.  Face perception: An integrative review of the role of spatial frequencies , 2006, Psychological research.

[9]  S. Luck,et al.  Sudden Death and Gradual Decay in Visual Working Memory , 2009, Psychological science.

[10]  Giulio Sandini,et al.  The Role of High Spatial Frequencies in Face Perception , 2013, Perception.

[11]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[12]  Stephane J. M. Rainville,et al.  The effects of spatial frequency overlap on face recognition. , 2000, Journal of experimental psychology. Human perception and performance.

[13]  Robert Sekuler,et al.  Visual Memory Decay Is Deterministic , 2005, Psychological science.

[14]  Nikolaus F Troje,et al.  Face recognition is affected by similarity in spatial frequency range to a greater degree than within-category object recognition. , 2004, Journal of experimental psychology. Human perception and performance.

[15]  Yaoda Xu,et al.  Limitations of object-based feature encoding in visual short-term memory. , 2002, Journal of experimental psychology. Human perception and performance.

[16]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[17]  S. Bentin,et al.  Dissociated neural mechanisms for face detection and configural encoding: evidence from N170 and induced gamma-band oscillation effects. , 2007, Cerebral cortex.

[18]  Eli Peli,et al.  Display nonlinearity in digital image processing for visual communications , 1991, Other Conferences.

[19]  J R Lishman,et al.  Evidence for the View That Temporospatial Integration in Vision is Temporally Anisotropic , 1997, Perception.

[20]  Yuhong Jiang,et al.  Visual working memory for simple and complex visual stimuli , 2005 .

[21]  Paul T. Sowden,et al.  Channel surfing in the visual brain , 2006, Trends in Cognitive Sciences.

[22]  G. Sandini,et al.  The Role of High Spatial Frequencies in Face Perception , 1983, Perception.

[23]  JH Maunsell,et al.  Does primate motion perception depend on the magnocellular pathway? , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Bruno Rossion,et al.  Faces are "spatial"--holistic face perception is supported by low spatial frequencies. , 2006, Journal of experimental psychology. Human perception and performance.

[25]  Erin M. Harley,et al.  How different spatial-frequency components contribute to visual information acquisition. , 2004, Journal of experimental psychology. Human perception and performance.

[26]  I. Craw,et al.  Spatial Content and Spatial Quantisation Effects in Face Recognition , 1994, Perception.

[27]  G Westheimer,et al.  The Fourier Theory of Vision , 2001, Perception.

[28]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[29]  Mark W. Greenlee,et al.  Stimulus-specific mechanisms of visual short-term memory , 1991, Vision Research.

[30]  Mary F. Howard,et al.  A theory of the visual system biology underlying development of spatial frequency lateralization , 2007, Brain and Cognition.

[31]  J. Townsend,et al.  Spatial frequencies in short-term memory for faces: A test of three frequency-dependent hypotheses , 2000, Memory & cognition.

[32]  R. Näsänen Spatial frequency bandwidth used in the recognition of facial images , 1999, Vision Research.

[33]  Shlomo Bentin,et al.  Stimulus type, level of categorization, and spatial-frequencies utilization: implications for perceptual categorization hierarchies. , 2009, Journal of experimental psychology. Human perception and performance.

[34]  Michael L. Peterson,et al.  Perception of Faces, Objects, and Scenes: Analytic and Holistic Processes (335-355) , 2006 .

[35]  A Baddeley,et al.  The fractionation of working memory. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  M C Morrone,et al.  Recognition of Positive and Negative Bandpass-Filtered Images , 1986, Perception.

[37]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[38]  Antonio Torralba,et al.  How many pixels make an image? , 2009, Visual Neuroscience.

[39]  Glyn W. Humphreys,et al.  Object and face recognition , 1994 .

[40]  A. Baddeley The concept of working memory: A view of its current state and probable future development , 1981, Cognition.

[41]  S. Dehaene,et al.  Is Consciousness a Gradual Phenomenon? , 2004, Psychological science.

[42]  A. Oliva,et al.  Coarse Blobs or Fine Edges? Evidence That Information Diagnosticity Changes the Perception of Complex Visual Stimuli , 1997, Cognitive Psychology.

[43]  Ingrid Wickelgren,et al.  Cognitive Neuroscience: Getting a Grasp on Working Memory , 1997, Science.

[44]  M. Masson Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[45]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[46]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[47]  Q. Vuong,et al.  The Respective Role of Low and High Spatial Frequencies in Supporting Configural and Featural Processing of Faces , 2005, Perception.

[48]  I Wickelgren Getting a grasp on working memory. , 1997, Science.

[49]  Billy Lee,et al.  Contrast Transfer Characteristics of Visual Short-term Memory , 1996, Vision Research.

[50]  Lynn C. Robertson,et al.  Processing the Trees and the Forest during Initial Stages of Face Perception: Electrophysiological Evidence , 2006, Journal of Cognitive Neuroscience.

[51]  Isabel Gauthier,et al.  A visual short-term memory advantage for objects of expertise. , 2009, Journal of experimental psychology. Human perception and performance.

[52]  H. Hughes,et al.  Global Precedence, Spatial Frequency Channels, and the Statistics of Natural Images , 1996, Journal of Cognitive Neuroscience.

[53]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[54]  S. Magnussen Low-level memory processes in vision , 2000, Trends in Neurosciences.

[55]  I. Gauthier,et al.  A visual short-term memory advantage for faces , 2007, Psychonomic bulletin & review.

[56]  Frédéric Gosselin,et al.  Diagnostic use of scale information for componential and holistic recognition. , 2003 .

[57]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[58]  Mowei Shen,et al.  Storing fine detailed information in visual working memory--evidence from event-related potentials. , 2009, Journal of vision.

[59]  Jussi Saarinen,et al.  Human working memory for shapes of radial frequency patterns , 2010, Vision Research.

[60]  Erin M. Harley,et al.  Why is it easier to identify someone close than far away? , 2005, Psychonomic Bulletin & Review.

[61]  I. Gauthier,et al.  Spatial scale contribution to early visual differences between face and object processing. , 2003, Brain research. Cognitive brain research.

[62]  Caren M. Rotello,et al.  Measures of sensitivity based on a single hit rate and false alarm rate: The accuracy, precision, and robustness of′,Az, andA’ , 2006, Perception & psychophysics.

[63]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[64]  A. Oliva,et al.  Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations , 1999, Cognition.

[65]  R. Kinchla,et al.  A diffusion model of perceptual memory , 1967 .

[66]  J M Findlay,et al.  An Examination of a Temporal Anisotropy in the Visual Integration of Spatial Frequencies , 1999, Perception.

[67]  V. Bruce,et al.  Recognizing objects and faces , 1994 .

[68]  H. Wilson,et al.  Configural masking of faces: Evidence for high-level interactions in face perception , 2005, Vision Research.

[69]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[70]  T. Bachmann Identification of spatially quantised tachistoscopic images of faces: How many pixels does it take to carry identity? , 1991 .

[71]  Gordon E. Legge,et al.  Stereopsis and contrast , 1989, Vision Research.

[72]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[73]  David E. Irwin,et al.  Sensory registration and informational persistence. , 1986, Journal of experimental psychology. Human perception and performance.

[74]  James R. Brockmole,et al.  The Visual World in Memory , 2008 .

[75]  Philippe G Schyns,et al.  Diagnostic recognition: task constraints, object information, and their interactions , 1998, Cognition.

[76]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[77]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[78]  F. Cornelissen,et al.  Visual memory for random block patterns defined by luminance and color contrast , 2000, Vision Research.

[79]  Yaoda Xu,et al.  Visual grouping in human parietal cortex , 2007, Proceedings of the National Academy of Sciences.

[80]  W. Kintsch,et al.  Memory and cognition , 1977 .

[81]  Isabel Gauthier,et al.  Why does selective attention to parts fail in face processing? , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[82]  P. Schyns,et al.  Usage of spatial scales for the categorization of faces, objects, and scenes , 2001, Psychonomic bulletin & review.

[83]  A. Baddeley,et al.  Working Memory and Language , 2018, Working Memories.

[84]  J. Maunsell,et al.  The effects of parvocellular lateral geniculate lesions on the acuity and contrast sensitivity of macaque monkeys , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[85]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[86]  G. Loftus,et al.  Sensory and cognitive components of visual information acquisition. , 1994, Psychological review.

[87]  P. Reuter-Lorenz,et al.  Global Versus Local Processing in the Absence of Low Spatial Frequencies , 1990, Journal of Cognitive Neuroscience.

[88]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[89]  Won Mok Shim,et al.  Visual memory for features, conjunctions, objects, and locations , 2008 .

[90]  J Wilson,et al.  Spatial Frequency and Selective Attention to Local and Global Information , 1987, Perception.

[91]  D. Regan Storage of spatial-frequency information and spatial-frequency discrimination , 1985 .

[92]  I. Craw,et al.  Effects of high-pass and low-pass spatial filtering on face identification , 1996, Perception & psychophysics.

[93]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[94]  Lynn C. Robertson,et al.  Using spatial frequency scales for processing face features and face configuration: An ERP analysis , 2008, Brain Research.

[95]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[96]  A. Oliva,et al.  Flexible, Diagnosticity-Driven, Rather Than Fixed, Perceptually Determined Scale Selection in Scene and Face Recognition , 1997, Perception.

[97]  Charles A. Poynton,et al.  Gamma and Its Disguises : The Nonlinear Mappings of Intensity in Perception, CRTs, Film, and Video , 1993 .

[98]  G. Loftus,et al.  The phenomenology of spatial integration: Data and models , 1989, Cognitive Psychology.

[99]  Matthew S. Peterson,et al.  Visual working memory capacity for objects from different categories: A face-specific maintenance effect , 2008, Cognition.

[100]  Steven J. Luck,et al.  Visual short term memory , 2007, Scholarpedia.

[101]  H. Halit,et al.  Is high-spatial frequency information used in the early stages of face detection? , 2006, Brain Research.

[102]  M. Greenlee,et al.  Perfect visual short-term memory for periodic patterns , 1990 .

[103]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[104]  Allison B. Sekuler,et al.  Spatial frequency tuning of upright and inverted face identification , 2008, Vision Research.

[105]  R. Ivry,et al.  The two sides of perception , 1997 .

[106]  David E. Irwin,et al.  On the Relations among Different Measures of Visible and Informational Persistence , 1998, Cognitive Psychology.

[107]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[108]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[109]  H. Ellis,et al.  Masking of faces by facial and non-facial stimuli , 1994 .

[110]  R. Logie Visuo-spatial Working Memory , 1994 .

[111]  M. J. Morgan,et al.  Spatial filtering precedes motion detection , 1992, Nature.