Classification images reveal spatiotemporal contour interpolation

Contour interpolation is the process whereby spatially separated object fragments (inducers) are connected on the basis of their contour relations. An important characteristic of interpolation between simultaneously presented inducers is that observers rely on interpolation regions to perform a discrimination task. However, it is unclear if the same property holds when inducers are separated in both space and time. To address this question of spatiotemporal interpolation, we had participants discriminate spatiotemporally presented "fat" and "thin" noise-corrupted figures, when the figures were stationary (Experiment 1) or moving (Experiment 2), and when the connections across vertical gaps were either real, interpolated (illusory), or absent. Classification images from both experiments showed that noise regions near interpolated boundaries affect performance comparably to when real contours appear, but very little in the absence of interpolation. The classification images also revealed information about the time course of interpolation and suggested that contour interpolation between simultaneously visible inducers may be a special case of a more general spatiotemporal contour interpolation process.

[1]  Zili Liu,et al.  Computing dynamic classification images from correlation maps. , 2006, Journal of vision.

[2]  D. Levi,et al.  Receptive versus perceptive fields from the reverse-correlation viewpoint , 2006, Vision Research.

[3]  R. Shapley,et al.  Spatial and Temporal Properties of Illusory Contours and Amodal Boundary Completion , 1996, Vision Research.

[4]  P. Kellman,et al.  Perception of Partly Occluded Objects and Illusory Figures : Evidence for an Identity Hypothesis , 2004 .

[5]  Jean Lorenceau,et al.  Form constraints in motion binding , 2001, Nature Neuroscience.

[6]  P. Tse.  Voluntary attention modulates the brightness of overlapping transparent surfaces , 2005, Vision Research.

[7]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[8]  P. Lennie.  Single Units and Visual Cortical Organization , 1998, Perception.

[9]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[10]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[11]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[12]  P U Tse,et al.  Amodal Completion in the Absence of Image Tangent Discontinuities , 1998, Perception.

[13]  P. Kellman,et al.  Interpolation processes in object perception: reply to Anderson (2007). , 2007, Psychological review.

[14]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[15]  Eric Halgren,et al.  Cortical activation to illusory shapes as measured with magnetoencephalography , 2003, NeuroImage.

[16]  Mark A Changizi,et al.  Latency Correction Explains the Classical Geometrical Illusions , 2002, Perception.

[17]  Sharon E. Guttman,et al.  7 – Geometric and Neural Models of Object Perception , 2001 .

[18]  Michael T. Turvey,et al.  Retrieval from iconic memory with shape as the selection criterion , 1970 .

[19]  P. Schyns,et al.  Superstitious Perceptions Reveal Properties of Internal Representations , 2003, Psychological science.

[20]  Miguel P Eckstein,et al.  Classification image analysis: estimation and statistical inference for two-alternative forced-choice experiments. , 2002, Journal of vision.

[21]  D. Burr,et al.  Seeing objects in motion , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  T. Parks.  POST-RETINAL VISUAL STORAGE. , 1965, The American journal of psychology.

[23]  J J Gibson,et al.  The problem of temporal order in stimulation and perception. , 1966, The Journal of psychology.

[24]  Steven Yantis,et al.  Visual interactions in the path of apparent motion , 1998, Nature Neuroscience.

[25]  A. Ahumada,et al.  Stimulus Features in Signal Detection , 1971 .

[26]  John Ross,et al.  Visual processing of motion , 1986, Trends in Neurosciences.

[27]  Sharon E. Guttman,et al.  Contour interpolation revealed by a dot localization paradigm , 2004, Vision Research.

[28]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[29]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[30]  J M Findlay,et al.  Aperture Viewing*: A Review and a Synthesis , 1982, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[31]  Richard F Murray,et al.  Classification images predict absolute efficiency. , 2005, Journal of vision.

[32]  M. Carrasco,et al.  Attention alters the appearance of motion coherence , 2006, Psychonomic bulletin & review.

[33]  Barton L Anderson,et al.  The demise of the identity hypothesis and the insufficiency and nonnecessity of contour relatability in predicting object interpolation: comment on Kellman, Garrigan, and Shipley (2005). , 2007, Psychological review.

[34]  S. Nishida.  Motion-Based Analysis of Spatial Patterns by the Human Visual System , 2004, Current Biology.

[35]  Christopher W. Tyler,et al.  One Eye is Usually Centred Horizontally (and near the Golden Section Vertically) in Portraits over the Past 500 Years , 1997 .

[36]  P J Kellman,et al.  Kinetic subjective contours , 1984, Perception & psychophysics.

[37]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[38]  Richard F Murray,et al.  Optimal methods for calculating classification images: weighted sums. , 2002, Journal of vision.

[39]  M. Carrasco,et al.  Attention enhances contrast sensitivity at cued and impairs it at uncued locations , 2005, Vision Research.

[40]  D. Burr.  Temporal summation of moving images by the human visual system , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[41]  Erin Shubel,et al.  The spatiotemporal properties of visual completion measured by response classification. , 2006, Journal of vision.

[42]  Leila Montaser-Kouhsari,et al.  Attentional modulation of adaptation to illusory lines. , 2004, Journal of vision.

[43]  N Rubin,et al.  The Role of Junctions in Surface Completion and Contour Matching , 2001, Perception.

[44]  P. Kellman,et al.  From fragments to objects : segmentation and grouping in vision , 2001 .

[45]  W. Gerbino,et al.  Contour interpolation by vector-field combination. , 2003, Journal of vision.

[46]  Vision Research , 1961, Nature.

[47]  W Gerbino,et al.  Illusory Figures Based on Local Kinematics , 1991, Perception.

[48]  Jacob Feldman,et al.  Determination of visual figure and ground in dynamically deforming shapes , 2006, Cognition.

[49]  D. Burr,et al.  Two stages of visual processing for radial and circular motion , 1995, Nature.

[50]  P. Kellman,et al.  A common mechanism for illusory and occluded object completion. , 1998, Journal of experimental psychology. Human perception and performance.

[51]  M Bertamini,et al.  Identifying contours from occlusion events , 1990, Perception & psychophysics.

[52]  Scott N. J. Watamaniuk,et al.  Seeing motion behind occluders , 1995, Nature.

[53]  Barry D. Vaughan,et al.  Object-Based Visual Selection: Evidence From Perceptual Completion , 1998 .

[54]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[55]  Michael J. Hawken,et al.  Macaque VI neurons can signal ‘illusory’ contours , 1993, Nature.

[56]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[57]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[58]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[59]  M. Seghier,et al.  Functional Neuroimaging Findings on the Human Perception of Illusory Contours , 2022 .

[60]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Patrick Garrigan,et al.  Object interpolation in three dimensions. , 2005, Psychological review.

[62]  J. Ross,et al.  The pulfrich effect and short-term memory in stereopsis , 1975, Vision Research.

[63]  H. Barlow.  Temporal and spatial summation in human vision at different background intensities , 1958, The Journal of physiology.

[64]  T F Shipley,et al.  The role of discontinuities in the perception of subjective figures , 1990, Perception & psychophysics.

[65]  M. Lappe,et al.  Spatio-Temporal Interpolation Is Accomplished by Binocular Form and Motion Mechanisms , 2007, PloS one.

[66]  Guillermo Sapiro,et al.  A subspace reverse-correlation technique for the study of visual neurons , 1997, Vision Research.

[67]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[68]  Evan M. Palmer,et al.  A theory of dynamic occluded and illusory object perception. , 2006, Journal of experimental psychology. General.

[69]  J. V. von Wright.  Selection in visual immediate memory. , 1968, The Quarterly journal of experimental psychology.

[70]  John J. Foxe,et al.  Setting Boundaries: Brain Dynamics of Modal and Amodal Illusory Shape Completion in Humans , 2004, The Journal of Neuroscience.

[71]  A. Ahumada.  Perceptual Classification Images from Vernier Acuity Masked by Noise , 1996 .

[72]  R. Reynolds,et al.  Perception of an Illusory Contour as a Function of Processing Time , 1981, Perception.

[73]  P. Bennett,et al.  Deriving behavioural receptive fields for visually completed contours , 2000, Current Biology.

[74]  H Barlow,et al.  Correspondence Noise and Signal Pooling in the Detection of Coherent Visual Motion , 1997, The Journal of Neuroscience.

[75]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.