Perceptual Spaces: Mathematical Structures to Neural Mechanisms

A central goal of neuroscience is to understand how populations of neurons build and manipulate representations of percepts that provide useful information about the environment. This symposium explores the fundamental properties of these representations and the perceptual spaces in which they are organized. Spanning the domains of color, visual texture, environmental sound, music, tactile quality, and odor, we show how the geometric structures of perceptual spaces can be determined experimentally and how these structures provide insights into the principles of neural coding and the neural mechanisms that generate the codes, and into the neural processing of complex sensory stimuli. The diversity of the neural architecture in these different sensory systems provides an opportunity to compare their different solutions to common problems: the need for dimensionality reduction, strategies for topographic or nontopographic mapping, the utility of the higher-order statistical structure inherent in natural sensory stimuli, and the constraints of neural hardware.

[1]  William W. Gaver How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[2]  R. Plomp,et al.  Perceptual and physical space of vowel sounds. , 1969, The Journal of the Acoustical Society of America.

[3]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[4]  Eero P. Simoncelli,et al.  Article Sound Texture Perception via Statistics of the Auditory Periphery: Evidence from Sound Synthesis , 2022 .

[5]  J. Tenenbaum,et al.  Generalization, similarity, and Bayesian inference. , 2001, The Behavioral and brain sciences.

[6]  M. Wertheimer Experimental studies on the seeing of motion , 1961 .

[7]  David J. Kriegman,et al.  Toward a perceptual space for gloss , 2009, TOGS.

[8]  K. Johnson,et al.  Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness perception , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  A. Anastasi Individual differences. , 2020, Annual review of psychology.

[10]  Eero P. Simoncelli,et al.  Sound texture synthesis via filter statistics , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[11]  H S Colburn,et al.  Detection of tones in reproducible narrow-band noise. , 1991, The Journal of the Acoustical Society of America.

[12]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[13]  David Laurenson,et al.  Estimating clean speech thresholds for perceptual based speech enhancement , 1999, Proceedings of the 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. WASPAA'99 (Cat. No.99TH8452).

[14]  Brett A. Johnson,et al.  Relational representation in the olfactory system , 2007, Proceedings of the National Academy of Sciences.

[15]  J. F. Dammann,et al.  The Representation of Stimulus Orientation in the Early Stages of Somatosensory Processing , 2008, The Journal of Neuroscience.

[16]  Markus Meister,et al.  Precision and diversity in an odor map on the olfactory bulb , 2009, Nature Neuroscience.

[17]  J. Risset,et al.  Exploration of timbre by analysis and synthesis , 1999 .

[18]  Jonathan D. Victor,et al.  Perceptual salience of fourth-order visual textures and natural scene statistics , 2013 .

[19]  Praveen Sethupathy,et al.  Non-topographical contrast enhancement in the olfactory bulb , 2006, BMC Neuroscience.

[20]  Yoshitaka Nakajima,et al.  Auditory Scene Analysis: The Perceptual Organization of Sound Albert S. Bregman , 1992 .

[21]  R. D. D'Souza,et al.  Nicotinic Receptor-Mediated Filtering of Mitral Cell Responses to Olfactory Nerve Inputs Involves the α3β4 Subtype , 2012, The Journal of Neuroscience.

[22]  Hannes P. Saal,et al.  Millisecond Precision Spike Timing Shapes Tactile Perception , 2012, The Journal of Neuroscience.

[23]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[24]  A. Tversky Features of Similarity , 1977 .

[25]  J. Berger,et al.  The thirteen colors of timbre , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..

[26]  Donald P. Greenberg,et al.  Psychophysically based model of surface gloss perception , 2001, IS&T/SPIE Electronic Imaging.

[27]  D. Baylor,et al.  Spectral sensitivity of human cone photoreceptors , 1987, Nature.

[28]  M. Hollins,et al.  Vibrotaction and texture perception , 2002, Behavioural Brain Research.

[29]  P. Zsombor-Murray,et al.  Elementary Mathematics from an Advanced Standpoint , 1940, Nature.

[30]  Q Zaidi,et al.  Identification of illuminant and object colors: heuristic-based algorithms. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Forrest W. Young,et al.  Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling , 2000, Perception & psychophysics.

[32]  M. Mathews,et al.  Detection of auditory signals in reproducible noise. , 1964, The Journal of the Acoustical Society of America.

[33]  J. DiCarlo,et al.  Structure of Receptive Fields in Area 3b of Primary Somatosensory Cortex in the Alert Monkey , 1998, The Journal of Neuroscience.

[34]  Loïc Kessous,et al.  Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces , 2002, Organised Sound.

[35]  David D. Cox,et al.  A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation , 2009, PLoS Comput. Biol..

[36]  Isaac M. Carruthers,et al.  Encoding of ultrasonic vocalizations in the auditory cortex , 2013, Journal of neurophysiology.

[37]  J. Victor,et al.  Quality Time: Representation of a Multidimensional Sensory Domain through Temporal Coding , 2009, The Journal of Neuroscience.

[38]  Mary M. Conte,et al.  Local image statistics: maximum-entropy constructions and perceptual salience. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  J. Maxwell,et al.  On the theory of compound colours, and the relations of the colours of the spectrum , 1993 .

[40]  M. Lappe,et al.  Measurement of generalization fields for the recognition of biological motion , 2002, Vision Research.

[41]  M. Hollins,et al.  The vibrations of texture , 2003, Somatosensory & motor research.

[42]  PortillaJavier,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000 .

[43]  Y. Cohen,et al.  Neural and behavioral correlates of auditory categorization , 2007, Hearing Research.

[44]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[45]  Guoshi Li,et al.  A Two-Layer Biophysical Model of Cholinergic Neuromodulation in Olfactory Bulb , 2013, The Journal of Neuroscience.

[46]  Eero P. Simoncelli,et al.  Metamers of the ventral stream , 2011, Nature Neuroscience.

[47]  Qasim Zaidi,et al.  Color strategies for object identification , 2008, Vision Research.

[48]  Qasim Zaidi,et al.  Geometrical structure of perceptual color space is affine , 2013 .

[49]  David H Gire,et al.  Control of On/Off Glomerular Signaling by a Local GABAergic Microcircuit in the Olfactory Bulb , 2009, The Journal of Neuroscience.

[50]  L. Maloney,et al.  Proximity judgments in color space: Tests of a Euclidean color geometry , 1995, Vision Research.

[51]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[52]  Eero P. Simoncelli,et al.  Summary statistics in auditory perception , 2013, Nature Neuroscience.

[53]  R. Araneda,et al.  The molecular receptive range of an odorant receptor , 2000, Nature Neuroscience.

[54]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[55]  I. Nelken,et al.  Neurons and Objects: The Case of Auditory Cortex , 2008, Front. Neurosci..

[56]  Thomas A. Cleland,et al.  Early transformations in odor representation , 2010, Trends in Neurosciences.

[57]  Hannes P. Saal,et al.  Multiplexing Stimulus Information through Rate and Temporal Codes in Primate Somatosensory Cortex , 2013, PLoS biology.

[58]  S. Lakatos A common perceptual space for harmonic and percussive timbres , 2000, Perception & psychophysics.