Characterizing observers using external noise and observer models: assessing internal representations with external noise.

External noise methods and observer models have been widely used to characterize the intrinsic perceptual limitations of human observers and changes of the perceptual limitations associated with cognitive, developmental, and disease processes by highlighting the variance of internal representations. The authors conducted a comprehensive review of the 5 most prominent observer models through the development of a common formalism. They derived new predictions of the models for a common set of behavioral tests that were compared with the data in the literature and a new experiment. The comparison between the model predictions and the empirical data resulted in very strong constraints on the observer models. The perceptual template model provided the best account of all the empirical data in the visual domain. The choice of the observer model has significant implications for the interpretation of data from other external noise paradigms, as well as studies using external noise to assay changes of perceptual limitations associated with observer states. The empirical and theoretical development suggests possible parallel developments in other sensory modalities and studies of high-level cognitive processes.

[1]  R. Thouless Experimental Psychology , 1939, Nature.

[2]  H. Vries The quantum character of light and its bearing upon threshold of vision, the differential sensitivity and visual acuity of the eye , 1943 .

[3]  H.T. Friis,et al.  Noise Figures of Radio Receivers , 1944, Proceedings of the IRE.

[4]  A. Rose The sensitivity performance of the human eye on an absolute scale. , 1948, Journal of the Optical Society of America.

[5]  H. Barlow Retinal noise and absolute threshold. , 1956, Journal of the Optical Society of America.

[6]  Theodore G. Birdsall,et al.  Definitions of d′ and η as Psychophysical Measures , 1958 .

[7]  D. M. Green,et al.  Multiple Observations of Signals in Noise , 1959 .

[8]  W. P. Tanner PHYSIOLOGICAL IMPLICATIONS OF PSYCHOPHYSICAL DATA * , 1961, Annals of the New York Academy of Sciences.

[9]  D. M. Green,et al.  CONSISTENCY OF AUDITORY DETECTION JUDGMENTS. , 1963, Psychology Review.

[10]  A J Vendrik,et al.  Detection Theory Applied to the Absolute Sensitivity of Sensory Systems. , 1963, Biophysical journal.

[11]  N. Nagaraja,et al.  Effect of Luminance Noise on Contrast Thresholds , 1964 .

[12]  E. de Boer,et al.  Masking and Discrimination , 1966 .

[13]  Weber's law, power law, and internal noise. , 1966, The Journal of the Acoustical Society of America.

[14]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[15]  David Jaarsma,et al.  More on the Detection of One of M Orthogonal Signals , 1967 .

[16]  William Walden Mumford,et al.  Noise performance factors in communication systems , 1968 .

[17]  W. A. Wickelgren,et al.  Unidimensional strength theory and component analysis of noise in absolute and comparative judgments , 1968 .

[18]  B. Leshowitz,et al.  Visual detection of signals in the presence of continuous and pulsed backqrounds , 1968 .

[19]  G. Rollman Detection models: Experimental tests with electrocutaneous stimuli , 1969 .

[20]  J. Nachmias,et al.  Visual detection and discrimination of luminance increments. , 1970, Journal of the Optical Society of America.

[21]  A. Ahumada,et al.  Stimulus Features in Signal Detection , 1971 .

[22]  E. Osman,et al.  A Correlation Model of Binaural Masking Level Differences , 1971 .

[23]  G. A. Hay,et al.  Signal-transfer funcions in threshold and suprathreshold vision. , 1972, Journal of the Optical Society of America.

[24]  S. Klein,et al.  Spatial frequency channels in human vision as asymmetric (edge) mechanisms. , 1974, Vision research.

[25]  L. Thibos,et al.  Detectability of a luminance increment. , 1974, Journal of the Optical Society of America.

[26]  J Nachmias,et al.  Letter: Grating contrast: discrimination may be better than detection. , 1974, Vision research.

[27]  B C Moore Mechanisms of masking. , 1975, The Journal of the Acoustical Society of America.

[28]  Estimates of internal noise , 1978 .

[29]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[30]  R. F. Wagner,et al.  Efficiency of human visual signal discrimination. , 1981, Science.

[31]  J. M. Foley,et al.  Contrast detection and near-threshold discrimination in human vision , 1981, Vision Research.

[32]  D M Green,et al.  Two procedures for estimating internal noise. , 1981, The Journal of the Acoustical Society of America.

[33]  Theodore E. Cohn,et al.  Why luminance discrimination may be better than detection , 1981, Vision Research.

[34]  C. A. Burbeck,et al.  Contrast gain measurements and the transient/sustained. , 1981, Journal of the Optical Society of America.

[35]  H. Barlow,et al.  The statistical efficiency for detecting sinusoidal modulation of average dot density in random figures , 1981, Vision Research.

[36]  Misha Pavel,et al.  On the functional form of partial masking functions in psychoacoustics , 1981 .

[37]  Jacob Nachmias,et al.  On the psychometric function for contrast detection , 1981, Vision Research.

[38]  Estimates of the ratio of external to internal noise obtained using repeatable samples of noise , 1981 .

[39]  I. Ohzawa,et al.  Contrast gain control in the cat visual cortex , 1982, Nature.

[40]  W. Hays,et al.  Statistics (3rd ed.). , 1982 .

[41]  D. G. Albrecht,et al.  Striate cortex of monkey and cat: contrast response function. , 1982, Journal of neurophysiology.

[42]  R. Shapley,et al.  X and Y cells in the lateral geniculate nucleus of macaque monkeys. , 1982, The Journal of physiology.

[43]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[44]  P. Lennie,et al.  Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[45]  S. Klein,et al.  Hyperacuity thresholds of 1 sec: theoretical predictions and empirical validation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[46]  A Burgess,et al.  Visual signal detection. III. On Bayesian use of prior knowledge and cross correlation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[47]  D G Pelli,et al.  Uncertainty explains many aspects of visual contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[48]  A J Ahumada,et al.  Equivalent-noise model for contrast detection and discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[49]  Kenneth R. Boff,et al.  Sensory processes and perception , 1986 .

[50]  Donald C. Hood,et al.  Sensitivity to Light , 1986 .

[51]  G. Legge,et al.  Contrast discrimination in noise. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[52]  A J Ahumada,et al.  Putting the visual system noise back in the picture. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[53]  A E Burgess,et al.  Visual signal detection. IV. Observer inconsistency. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[54]  W. Hays Statistics, 4th ed. , 1988 .

[55]  W M Hartmann,et al.  Noise power fluctuations and the masking of sine signals. , 1988, The Journal of the Acoustical Society of America.

[56]  N. Graham Visual Pattern Analyzers , 1989 .

[57]  L. Humes,et al.  Models of the additivity of masking. , 1989, The Journal of the Acoustical Society of America.

[58]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[59]  G. Sperling Three stages and two systems of visual processing. , 1989, Spatial vision.

[60]  N. Macmillan,et al.  Response bias : characteristics of detection theory, threshold theory, and nonparametric indexes , 1990 .

[61]  D. Pelli The quantum efficiency of vision , 1990 .

[62]  John H. R. Maunsell,et al.  Coding of image contrast in central visual pathways of the macaque monkey , 1990, Vision Research.

[63]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[64]  Denis G. Pelli,et al.  Noise in the Visual System May Be Early , 1991 .

[65]  Colin Blakemore,et al.  Vision: Coding and Efficiency , 1991 .

[66]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[67]  D. G. Albrecht,et al.  Motion selectivity and the contrast-response function of simple cells in the visual cortex , 1991, Visual Neuroscience.

[68]  A. B. Bonds Temporal dynamics of contrast gain in single cells of the cat striate cortex , 1991, Visual Neuroscience.

[69]  D M Green,et al.  The Detection of a Tone Added to a Narrow Band of Noise: The Energy Model Revisited , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[70]  Mark W. Cannon,et al.  Spatial interactions in apparent contrast: Inhibitory effects among grating patterns of different spatial frequencies, spatial positions and orientations , 1991, Vision Research.

[71]  K R Gegenfurtner,et al.  Contrast detection in luminance and chromatic noise. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[72]  D. Heeger Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. , 1993, Journal of neurophysiology.

[73]  G. Sperling,et al.  The lateral inhibition of perceived contrast is indifferent to on-center/off-center segregation, but specific to orientation , 1993, Vision Research.

[74]  Denis G. Pelli,et al.  The visual filter mediating letter identification , 1994, Nature.

[75]  J. M. Foley,et al.  Human luminance pattern-vision mechanisms: masking experiments require a new model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[76]  Y. Tsau,et al.  Consistency in nervous systems: trial-to-trial and animal-to-animal variations in the responses to repeated applications of a sensory stimulus in Aplysia , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  Wendy L. Braje,et al.  Human efficiency for recognizing 3-D objects in luminance noise , 1995, Vision Research.

[78]  G. Sperling,et al.  Contrast gain control in first- and second-order motion perception. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[79]  John A. Swets,et al.  Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers , 1996 .

[80]  Torsten Daub Modeling auditory processing of amplitude modulation I. Detection and masking with narrow-band carriers , 1997 .

[81]  M P Eckstein,et al.  Visual signal detection in structured backgrounds. II. Effects of contrast gain control, background variations, and white noise. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[82]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[83]  T. Dau Modeling auditory processing of amplitude modulation , 1997 .

[84]  R. Hess,et al.  Temporal detection in human vision: dependence on stimulus energy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[85]  J A Solomon,et al.  Model of visual contrast gain control and pattern masking. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[86]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[87]  Z L Lu,et al.  Perceptual learning reflects external noise filtering and internal noise reduction through channel reweighting. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[88]  Kenneth Knoblauch,et al.  Spectral bandwidths for the detection of color , 1998, Vision Research.

[89]  B. Dosher,et al.  External noise distinguishes attention mechanisms , 1998, Vision Research.

[90]  A. B. Sekuler,et al.  Signal but not noise changes with perceptual learning , 1999, Nature.

[91]  J. M. Foley,et al.  Pattern detection in the presence of maskers that differ in spatial phase and temporal offset: threshold measurements and a model , 1999, Vision Research.

[92]  B. Dosher,et al.  Characterizing human perceptual inefficiencies with equivalent internal noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[93]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[94]  B. Dosher,et al.  Mechanisms of perceptual learning , 1999, Vision Research.

[95]  D G Pelli,et al.  Why use noise? , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[96]  B. Dosher,et al.  PSYCHOLOGICAL SCIENCE Research Article NOISE EXCLUSION IN SPATIAL ATTENTION , 2022 .

[97]  B. Dosher,et al.  Spatial attention: different mechanisms for central and peripheral temporal precues? , 2000, Journal of experimental psychology. Human perception and performance.

[98]  B. Dosher,et al.  Mechanisms of perceptual attention in precuing of location , 2000, Vision Research.

[99]  Barbara Anne Dosher,et al.  Attention mechanisms for multi-location first- and second-order motion perception , 2000, Vision Research.

[100]  D. Wilson,et al.  Effect of inherent location uncertainty on detection of stationary targets in noisy image sequences. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[101]  T. Wickens Elementary Signal Detection Theory , 2001 .

[102]  Dov Sagi,et al.  Disentangling signal from noise in visual contrast discrimination , 2001, Nature Neuroscience.

[103]  D M Levi,et al.  Surround modulation of perceived contrast and the role of brightness induction. , 2001, Journal of vision.

[104]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[105]  Z L Lu,et al.  Characterizing the spatial-frequency sensitivity of perceptual templates. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[106]  A. Ahumada Classification image weights and internal noise level estimation. , 2002, Journal of vision.

[107]  Miguel P Eckstein,et al.  The footprints of visual attention in the Posner cueing paradigm revealed by classification images. , 2002, Journal of vision.

[108]  Christopher W Tyler,et al.  Separating the effects of response nonlinearity and internal noise psychophysically , 2002, Vision Research.

[109]  Zhong-Lin Lu,et al.  Generating high gray-level resolution monochrome displays with conventional computer graphics cards and color monitors , 2003, Journal of Neuroscience Methods.

[110]  Dennis M Levi,et al.  Noise Provides Some New Signals About the Spatial Vision of Amblyopes , 2003, The Journal of Neuroscience.

[111]  Marisa Carrasco,et al.  Covert attention enhances letter identification without affecting channel tuning. , 2004, Journal of vision.

[112]  Barbara A Dosher,et al.  Perceptual learning retunes the perceptual template in foveal orientation identification. , 2004, Journal of vision.

[113]  Gordon D Logan,et al.  Cumulative progress in formal theories of attention. , 2004, Annual review of psychology.

[114]  Roger W Li,et al.  Perceptual learning improves efficiency by re-tuning the decision 'template' for position discrimination , 2004, Nature Neuroscience.

[115]  Bosco S. Tjan,et al.  Learning letter identification in peripheral vision , 2005, Vision Research.

[116]  Robert Sekuler,et al.  Visual Memory Decay Is Deterministic , 2005, Psychological science.

[117]  Mark S. Seidenberg,et al.  Deficits in perceptual noise exclusion in developmental dyslexia , 2005, Nature Neuroscience.

[118]  F. Ashby,et al.  Category learning and multiple memory systems , 2005, Trends in Cognitive Sciences.

[119]  Barbara Anne Dosher,et al.  Independent perceptual learning in monocular and binocular motion systems. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[120]  Luis A. Lesmes,et al.  Bayesian adaptive estimation of threshold versus contrast external noise functions: The quick TvC method , 2006, Vision Research.

[121]  Pengjing Xu,et al.  Identify mechanisms of amblyopia in Gabor orientation identification with external noise , 2006, Vision Research.

[122]  Miguel P. Eckstein,et al.  The effect of nonlinear human visual system components on performance of a channelized Hotelling observer in structured backgrounds , 2006, IEEE Transactions on Medical Imaging.

[123]  Mikhail Katkov,et al.  Singularities in the inverse modeling of 2AFC contrast discrimination data , 2006, Vision Research.

[124]  Debbie Y. Dao,et al.  Adaptation to sine-wave gratings selectively reduces the contrast gain of the adapted stimuli. , 2006, Journal of vision.

[125]  Miguel P Eckstein,et al.  Classification images for detection, contrast discrimination, and identification tasks with a common ideal observer. , 2006, Journal of vision.

[126]  Zhong-Lin Lu,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[127]  Zhong-Lin Lu,et al.  Extending observer models for more difficult identification and discrimination , 2010 .