Going with the Flow: The Neural Mechanisms Underlying Illusions of Complex-Flow Motion

Studying the mismatch between perception and reality helps us better understand the constructive nature of the visual brain. The Pinna–Brelstaff motion illusion is a compelling example illustrating how a complex moving pattern can generate an illusory motion perception. When an observer moves toward (expansion) or away (contraction) from the Pinna–Brelstaff figure, the figure appears to rotate. The neural mechanisms underlying the illusory complex-flow motion of rotation, expansion, and contraction remain unknown. We studied this question at both perceptual and neuronal levels in behaving male macaques by using carefully parametrized Pinna–Brelstaff figures that induce the above motion illusions. We first demonstrate that macaques perceive illusory motion in a manner similar to that of human observers. Neurophysiological recordings were subsequently performed in the middle temporal area (MT) and the dorsal portion of the medial superior temporal area (MSTd). We find that subgroups of MSTd neurons encoding a particular global pattern of real complex-flow motion (rotation, expansion, contraction) also represent illusory motion patterns of the same class. They require an extra 15 ms to reliably discriminate the illusion. In contrast, MT neurons encode both real and illusory local motions with similar temporal delays. These findings reveal that illusory complex-flow motion is first represented in MSTd by the same neurons that normally encode real complex-flow motion. However, the extraction of global illusory motion in MSTd from other classes of real complex-flow motion requires extra processing time. Our study illustrates a cascaded integration mechanism from MT to MSTd underlying the transformation from external physical to internal nonveridical flow-motion perception. SIGNIFICANCE STATEMENT The neural basis of the transformation from objective reality to illusory percepts of rotation, expansion, and contraction remains unknown. We demonstrate psychophysically that macaques perceive these illusory complex-flow motions in a manner similar to that of human observers. At the neural level, we show that medial superior temporal (MSTd) neurons represent illusory flow motions as if they were real by globally integrating middle temporal area (MT) local motion signals. Furthermore, while MT neurons reliably encode real and illusory local motions with similar temporal delays, MSTd neurons take a significantly longer time to process the signals associated with illusory percepts. Our work extends previous complex-flow motion studies by providing the first detailed analysis of the neuron-specific mechanisms underlying complex forms of illusory motion integration from MT to MSTd.

[1]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[3]  R. Gregory,et al.  Cognitive Contours , 1972, Nature.

[4]  R. Hetherington The Perception of the Visual World , 1952 .

[5]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[6]  W H Warren,et al.  Perceiving Heading in the Presence of Moving Objects , 1995, Perception.

[7]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[8]  Yong Gu,et al.  Causal Evidence of Motion Signals in Macaque Middle Temporal Area Weighted-Pooled for Global Heading Perception , 2017, Cerebral cortex.

[9]  Hideo Sakata,et al.  Functional properties of rotation-sensitive neurons in the posterior parietal association cortex of the monkey , 1994, Experimental Brain Research.

[10]  J Anthony Movshon,et al.  Properties of pattern and component direction-selective cells in area MT of the macaque. , 2016, Journal of neurophysiology.

[11]  F. Kingdom,et al.  Applying the Model-Comparison Approach to Test Specific Research Hypotheses in Psychophysical Research Using the Palamedes Toolbox , 2018, Front. Psychol..

[12]  Christopher C. Pack,et al.  Hierarchical processing of complex motion along the primate dorsal visual pathway , 2012, Proceedings of the National Academy of Sciences.

[13]  Pascal Wallisch,et al.  Spiral motion selective neurons in area MSTd contribute to judgments of heading. , 2014, Journal of neurophysiology.

[14]  Thomas D. Albright,et al.  The Complex Structure of Receptive Fields in the Middle Temporal Area , 2013, Front. Syst. Neurosci..

[15]  R. M. Siegel,et al.  Analysis of optic flow in the monkey parietal area 7a. , 1997, Cerebral cortex.

[16]  Leslie G. Ungerleider,et al.  Cortical connections of visual area MT in the macaque , 1986, The Journal of comparative neurology.

[17]  Akiyoshi Kitaoka,et al.  Phenomenal characteristics of the peripheral drift illusion , 2003 .

[18]  Baingio Pinna,et al.  A new visual illusion of relative motion , 2000, Vision Research.

[19]  Rick Gurnsey,et al.  Effects of local and global factors in the Pinna illusion , 2006, Vision Research.

[20]  Christopher C. Pack,et al.  Integration of Contour and Terminator Signals in Visual Area MT of Alert Macaque , 2004, The Journal of Neuroscience.

[21]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[22]  N. Prins The psi-marginal adaptive method: How to give nuisance parameters the attention they deserve (no more, no less). , 2013, Journal of vision.

[23]  S. A. Talbot Physiology of the retina and the visual pathway , 1961 .

[24]  R H Wurtz,et al.  Neuronal Correlates of Optic Flow Stimulation , 1992, Annals of the New York Academy of Sciences.

[25]  N. Rubin,et al.  fMRI Activation in Response to Illusory Contours and Salient Regions in the Human Lateral Occipital Complex , 2003, Neuron.

[26]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[27]  D. Samuel Schwarzkopf,et al.  The surface area of human V1 predicts the subjective experience of object size , 2010, Nature Neuroscience.

[28]  R. Gregory The Most Expensive Painting in the World , 2007, Perception.

[29]  Mazyar Fallah,et al.  Response latencies of neurons in visual areas MT and MST of monkeys with striate cortex lesions , 2003, Neuropsychologia.

[30]  J. Movshon,et al.  Temporal and spatial limits of pattern motion sensitivity in macaque MT neurons. , 2015, Journal of neurophysiology.

[31]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[32]  S. Martinez-Conde,et al.  Microsaccades and Blinks Trigger Illusory Rotation in the “Rotating Snakes” Illusion , 2012, The Journal of Neuroscience.

[33]  Heiko Neumann,et al.  Neural Mechanisms of Visual Flow Integration and Segregation - Insights from the Pinna-Brelstaff Illusion and Variations of It , 2002, Biologically Motivated Computer Vision.

[34]  Frank Tong,et al.  Filling-in of visual phantoms in the human brain , 2005, Nature Neuroscience.

[35]  W. Newsome,et al.  Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[37]  A. Dale,et al.  Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging , 1995, Nature.

[38]  Michael S. Landy,et al.  Orientation-Selective Adaptation to Illusory Contours in Human Visual Cortex , 2007, The Journal of Neuroscience.

[39]  Margaret S Livingstone,et al.  End-Stopping and the Aperture Problem Two-Dimensional Motion Signals in Macaque V1 , 2003, Neuron.

[40]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[41]  C. Gross,et al.  Visual topography of striate projection zone (MT) in posterior superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[42]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[43]  D. Bradley,et al.  Velocity computation in the primate visual system , 2008, Nature Reviews Neuroscience.

[44]  Kai Hamburger,et al.  Last but not least. , 2007, Perception.

[45]  G. Orban,et al.  Response latencies of visual cells in macaque areas V1, V2 and V5 , 1989, Brain Research.

[46]  P. Good Permutation, Parametric, and Bootstrap Tests of Hypotheses , 2005 .

[47]  Ikuya Murakami,et al.  Direction-specific fMRI adaptation reveals the visual cortical network underlying the “Rotating Snakes” illusion , 2012, NeuroImage.

[48]  Kenneth H. Britten,et al.  Mechanisms of self-motion perception. , 2008, Annual review of neuroscience.

[49]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[50]  Leslie G. Ungerleider,et al.  Multiple visual areas in the caudal superior temporal sulcus of the macaque , 1986, The Journal of comparative neurology.

[51]  A. Kitaoka Color-Dependent Motion Illusions in Stationary Images and Their Phenomenal Dimorphism , 2014, Perception.

[52]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[53]  Wei Wang,et al.  Equivalent Representation of Real and Illusory Contours in Macaque V4 , 2012, The Journal of Neuroscience.

[54]  J. Duysens,et al.  Responses in ventral intraparietal area of awake macaque monkey to optic flow patterns corresponding to rotation of planes in depth can be explained by translation and expansion effects , 1997, Visual Neuroscience.

[55]  R. Born,et al.  Segregation of global and local motion processing in primate middle temporal visual area , 1993, Nature.

[56]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Matthew R. Krause,et al.  Contextual modulation and stimulus selectivity in extrastriate cortex , 2014, Vision Research.

[58]  E. Callaway,et al.  Parallel processing strategies of the primate visual system , 2009, Nature Reviews Neuroscience.

[59]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  G. Orban,et al.  Response latency of macaque area MT/V5 neurons and its relationship to stimulus parameters. , 1999, Journal of neurophysiology.

[61]  John H. R. Maunsell,et al.  The middle temporal visual area in the macaque: Myeloarchitecture, connections, functional properties and topographic organization , 1981, The Journal of comparative neurology.

[62]  David A. Leopold,et al.  pyElectrode: An open-source tool using structural MRI for electrode positioning and neuron mapping , 2013, Journal of Neuroscience Methods.

[63]  Semir Zeki,et al.  THE RESPONSES OF CELLS IN THE ANTERIOR BANK OF THE SUPERIOR TEMPORAL SULCUS IN MACAQUE MONKEYS , 1980 .

[64]  L. Spillmann,et al.  Visual Perception: The Neurophysiological Foundations , 1989 .

[65]  W. Bialek,et al.  Time Course of Information about Motion Direction in Visual Area MT of Macaque Monkeys , 2004, The Journal of Neuroscience.

[66]  Melvyn A. Goodale,et al.  Retinotopic activity in V1 reflects the perceived and not the retinal size of an afterimage , 2012, Nature Neuroscience.

[67]  Christopher C. Pack,et al.  Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys , 2001, Nature.

[68]  G. Brindley Physiology of the Retina and the Visual Pathway , 1960 .

[69]  Oliver W. Layton,et al.  A motion pooling model of visually guided navigation explains human behavior in the presence of independently moving objects. , 2012, Journal of vision.

[70]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[71]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[72]  R. Born Center-surround interactions in the middle temporal visual area of the owl monkey. , 2000, Journal of neurophysiology.

[73]  D. Eagleman Visual illusions and neurobiology , 2001, Nature Reviews Neuroscience.

[74]  K. Tanaka,et al.  Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.

[75]  A. T. Smith,et al.  Sensitivity to optic flow in human cortical areas MT and MST , 2006, The European journal of neuroscience.

[76]  K. Tanaka,et al.  Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  J. Movshon,et al.  Motion Integration by Neurons in Macaque MT Is Local, Not Global , 2007, The Journal of Neuroscience.

[78]  G. Orban,et al.  Responses of macaque STS neurons to optic flow components: a comparison of areas MT and MST. , 1994, Journal of neurophysiology.

[79]  Margaret S Livingstone,et al.  Two-Dimensional Substructure of MT Receptive Fields , 2001, Neuron.

[80]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. II. Mechanisms of response selectivity revealed by small-field stimuli. , 1991, Journal of neurophysiology.

[81]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[82]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[83]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[84]  David Whitney,et al.  Motion-Dependent Representation of Space in Area MT+ , 2013, Neuron.

[85]  K. H. Britten,et al.  Optic flow signals in extrastriate area MST: comparison of perceptual and neuronal sensitivity. , 2004, Journal of neurophysiology.

[86]  Charles J Duffy,et al.  Receptive field dynamics underlying MST neuronal optic flow selectivity. , 2010, Journal of neurophysiology.

[87]  Simone Gori,et al.  A New Motion Illusion: The Rotating-Tilted-Lines Illusion , 2006, Perception.

[88]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[89]  R. Tennant,et al.  Inhibition of leukaemia virus replication by polyadenylic acid. , 1972, Nature: New biology.

[90]  Bevil R. Conway,et al.  Spatiotemporal Structure of Nonlinear Subunits in Macaque Visual Cortex , 2006, The Journal of Neuroscience.

[91]  R. M. Siegel,et al.  Three-dimensional structure-from-motion selectivity in the anterior superior temporal polysensory area, STPa, of the behaving monkey. , 2005, Cerebral cortex.

[92]  J. Movshon,et al.  Dynamics of motion signaling by neurons in macaque area MT , 2005, Nature Neuroscience.

[93]  A. Dale,et al.  The Representation of Illusory and Real Contours in Human Cortical Visual Areas Revealed by Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[94]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[95]  Rick Gurnsey,et al.  Last but Not Least , 2002 .

[96]  Thomas D. Albright,et al.  Neural correlates of perceptual motion coherence , 1992, Nature.

[97]  Micah M. Murray,et al.  Illusory contours: a window onto the neurophysiology of constructing perception , 2013, Trends in Cognitive Sciences.

[98]  Guillaume S. Masson,et al.  Dynamics of Visual Motion Processing: Neuronal, Behavioral, and Computational Approaches , 2014 .

[99]  R. Born,et al.  Timescales of Sensory- and Decision-Related Activity in the Middle Temporal and Medial Superior Temporal Areas , 2010, The Journal of Neuroscience.

[100]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[101]  Robert L. Ward,et al.  A neural network model of spiral–planar motion tuning in MSTd , 2003, Vision Research.

[102]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[103]  Yuwei Cui,et al.  Diverse Suppressive Influences in Area MT and Selectivity to Complex Motion Features , 2013, The Journal of Neuroscience.

[104]  H. Komatsu The neural mechanisms of perceptual filling-in , 2006, Nature Reviews Neuroscience.

[105]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[106]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[107]  Dora E Angelaki,et al.  Spatial Reference Frames of Visual, Vestibular, and Multimodal Heading Signals in the Dorsal Subdivision of the Medial Superior Temporal Area , 2007, The Journal of Neuroscience.

[108]  Fang Fang,et al.  Perceptual grouping and inverse fMRI activity patterns in human visual cortex. , 2008, Journal of vision.

[109]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[110]  Kristina Zeljic,et al.  Dynamic Network Communication in the Human Functional Connectome Predicts Perceptual Variability in Visual Illusion , 2018, Cerebral cortex.

[111]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[112]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[113]  Michael J. Hawken,et al.  Macaque VI neurons can signal ‘illusory’ contours , 1993, Nature.

[114]  Richard C Saunders,et al.  Receptive field focus of visual area V4 neurons determines responses to illusory surfaces , 2013, Proceedings of the National Academy of Sciences.

[115]  L. Spillmann,et al.  Representation of illusory and physical rotations in human MST: A cortical site for the pinna illusion , 2016, Human brain mapping.

[116]  Constance S. Royden,et al.  Computing heading in the presence of moving objects: a model that uses motion-opponent operators , 2002, Vision Research.

[117]  Bevil R. Conway,et al.  Neural Basis for a Powerful Static Motion Illusion , 2005, The Journal of Neuroscience.

[118]  Oliver W. Layton,et al.  A neural model of MST and MT explains perceived object motion during self-motion , 2016 .