A massively asynchronous, parallel brain

Whether the visual brain uses a parallel or a serial, hierarchical, strategy to process visual signals, the end result appears to be that different attributes of the visual scene are perceived asynchronously—with colour leading form (orientation) by 40 ms and direction of motion by about 80 ms. Whatever the neural root of this asynchrony, it creates a problem that has not been properly addressed, namely how visual attributes that are perceived asynchronously over brief time windows after stimulus onset are bound together in the longer term to give us a unified experience of the visual world, in which all attributes are apparently seen in perfect registration. In this review, I suggest that there is no central neural clock in the (visual) brain that synchronizes the activity of different processing systems. More likely, activity in each of the parallel processing-perceptual systems of the visual brain is reset independently, making of the brain a massively asynchronous organ, just like the new generation of more efficient computers promise to be. Given the asynchronous operations of the brain, it is likely that the results of activities in the different processing-perceptual systems are not bound by physiological interactions between cells in the specialized visual areas, but post-perceptually, outside the visual brain.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[3]  M. Botez,et al.  Course and outcome of visual static agnosia. , 1967, Journal of the neurological sciences.

[4]  B. Cragg The topography of the afferent projections in the circumstriate visual cortex of the monkey studied by the Nauta method. , 1969, Vision research.

[5]  S. Zeki,et al.  Convergent input from the striate cortex (area 17) to the cortex of the superior temporal sulcus in the rhesus monkey. , 1971, Brain research.

[6]  S. Zeki,et al.  Colour coding in rhesus monkey prestriate cortex. , 1973, Brain research.

[7]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[8]  S. Zeki Cells responding to changing image size and disparity in the cortex of the rhesus monkey , 1974, The Journal of physiology.

[9]  L. Benevento,et al.  The cortical projections of the inferior pulvinar and adjacent lateral pulvinar in the rhesus monkey (macaca mulatta): An autoradiographic study , 1976, Brain Research.

[10]  S. Zeki Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[11]  S. Zeki Uniformity and diversity of structure and function in rhesus monkey prestriate visual cortex. , 1978, The Journal of physiology.

[12]  S. Zeki The representation of colours in the cerebral cortex , 1980, Nature.

[13]  W. Fries The projection from the lateral geniculate nucleus to the prestriate cortex of the macaque monkey , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  M. Yukie,et al.  Direct projection from the dorsal lateral geniculate nucleus to the prestriate cortex in macaque monkeys , 1981, The Journal of comparative neurology.

[15]  S. Zeki Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours , 1983, Neuroscience.

[16]  N. Mai,et al.  Selective disturbance of movement vision after bilateral brain damage. , 1983, Brain : a journal of neurology.

[17]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[18]  S. Zeki Colour coding in the cerebral cortex: The responses of wavelength-selective and colour-coded cells in monkey visual cortex to changes in wavelength composition , 1983, Neuroscience.

[19]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[20]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[21]  S. Zeki,et al.  The Organization of Connections between Areas V5 and V2 in Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[22]  C. Gross,et al.  Afferent basis of visual response properties in area MT of the macaque. I. Effects of striate cortex removal , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  S. Zeki,et al.  Modular Connections between Areas V2 and V4 of Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[24]  S. Zeki,et al.  The Organization of Connections between Areas V5 and V1 in Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[25]  C. Koch,et al.  Towards a neurobiological theory of consciousness , 1990 .

[26]  P. Goldman-Rakic,et al.  Preface: Cerebral Cortex Has Come of Age , 1991 .

[27]  S. Grossberg Why do parallel cortical systems exist for the perception of static form and moving form? , 1991, Perception & psychophysics.

[28]  C. Baker,et al.  Residual motion perception in a "motion-blind" patient, assessed with limited-lifetime random dot stimuli , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  S. Zeki,et al.  Cerebral akinetopsia (visual motion blindness). A review. , 1991, Brain : a journal of neurology.

[30]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[31]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[32]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[33]  S. Zeki A vision of the brain , 1993 .

[34]  C. Kennard,et al.  Residual colour vision in a human hemianope: spectral responses and colour discrimination , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[35]  Jean Bullier,et al.  The Role of Area 17 in the Transfer of Information to Extrastriate Visual Cortex , 1994 .

[36]  J. Movshon,et al.  Chromatic properties of neurons in macaque MT , 1994, Visual Neuroscience.

[37]  J. Bullier,et al.  Visual latencies in areas V1 and V2 of the macaque monkey , 1995, Visual Neuroscience.

[38]  A. Leventhal,et al.  Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[40]  C. N. Guy,et al.  The parallel visual motion inputs into areas V1 and V5 of human cerebral cortex. , 1995, Brain : a journal of neurology.

[41]  R. Andersen,et al.  Integration of motion and stereopsis in middle temporal cortical area of macaques , 1995, Nature.

[42]  Anthony J. Movshon,et al.  Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys , 1996, The Journal of Neuroscience.

[43]  Charles Sayward,et al.  A Possible Solution , 1996 .

[44]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  M Wagner,et al.  Fast visual evoked potential input into human area V5 , 1997, Neuroreport.

[46]  S. Zeki,et al.  A direct demonstration of perceptual asynchrony in vision , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[47]  K. Moutoussis,et al.  Functional segregation and temporal hierarchy of the visual perceptive systems , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[48]  C. Schroeder,et al.  A spatiotemporal profile of visual system activation revealed by current source density analysis in the awake macaque. , 1998, Cerebral cortex.

[49]  S. Zeki,et al.  The Riddoch syndrome: insights into the neurobiology of conscious vision. , 1998, Brain : a journal of neurology.

[50]  Semir Zeki,et al.  The theory of multistage integration in the visual brain , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  J. Alonso,et al.  Functional connectivity between simple cells and complex cells in cat striate cortex , 1998, Nature Neuroscience.

[52]  G. O'Brien,et al.  The disunity of consciousness , 1998 .

[53]  J L Barbur,et al.  Visual processing levels revealed by response latencies to changes in different visual attributes , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[54]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[55]  S. Zeki,et al.  Toward a Theory of Visual Consciousness , 1999, Consciousness and Cognition.

[56]  A. Morland,et al.  Visual perception of motion, luminance and colour in a human hemianope. , 1999, Brain : a journal of neurology.

[57]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[58]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[59]  D. Burr,et al.  A cortical area that responds specifically to optic flow, revealed by fMRI , 2000, Nature Neuroscience.

[60]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[61]  Victor A. F. Lamme Blindsight: the role of feedforward and feedback corticocortical connections. , 2001, Acta psychologica.

[62]  Derek H. Arnold,et al.  Asynchronous processing in vision Color leads motion , 2001, Current Biology.

[63]  P. Viviani,et al.  Colour, form, and movement are not perceived simultaneously , 2001, Vision Research.

[64]  O. Braddick,et al.  Brain Areas Sensitive to Coherent Visual Motion , 2001, Perception.

[65]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[66]  J. Kulikowski,et al.  Convergence of parvocellular and magnocellular information channels in the primary visual cortex of the macaque , 2002, The European journal of neuroscience.

[67]  E. Callaway,et al.  S Cone Contributions to the Magnocellular Visual Pathway in Macaque Monkey , 2002, Neuron.

[68]  Ivan E Sutherland,et al.  Computers without clocks. , 2002, Scientific American.

[69]  S. Zeki,et al.  Responses of spectrally selective cells in macaque area V2 to wavelengths and colors. , 2002, Journal of neurophysiology.

[70]  Colin W G Clifford,et al.  Determinants of asynchronous processing in vision , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[71]  Nicholas J. Priebe,et al.  Constraints on the source of short-term motion adaptation in macaque area MT. II. tuning of neural circuit mechanisms. , 2002, Journal of neurophysiology.

[72]  Jing Liu,et al.  Functional organization of speed tuned neurons in visual area MT. , 2003, Journal of neurophysiology.

[73]  C. Bundesen,et al.  Independent encoding of colors and shapes from two stimuli , 2003, Psychonomic bulletin & review.

[74]  Saumil S. Patel,et al.  Color and motion: which is the tortoise and which is the hare? , 2003, Vision Research.

[75]  K. Tanaka,et al.  Directionally selective response of cells in the middle temporal area (MT) of the macaque monkey to the movement of equiluminous opponent color stimuli , 2004, Experimental Brain Research.

[76]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[77]  Andreas Bartels,et al.  The chronoarchitecture of the human brain—natural viewing conditions reveal a time-based anatomy of the brain , 2004, NeuroImage.

[78]  Lawrence C. Sincich,et al.  Bypassing V1: a direct geniculate input to area MT , 2004, Nature Neuroscience.

[79]  J. Movshon,et al.  Dynamics of motion signaling by neurons in macaque area MT , 2005, Nature Neuroscience.

[80]  Andreas Bartels,et al.  Brain dynamics during natural viewing conditions—A new guide for mapping connectivity in vivo , 2005, NeuroImage.

[81]  W. Newsome,et al.  Correlation between Speed Perception and Neural Activity in the Middle Temporal Visual Area , 2005, The Journal of Neuroscience.

[82]  S. Zeki,et al.  The temporal order of binding visual attributes , 2006, Vision Research.

[83]  Semir Zeki,et al.  Effect of background colors on the tuning of color-selective cells in monkey area V4. , 2006, Journal of neurophysiology.

[84]  Joan López-Moliner,et al.  Perceptual asynchrony between color and motion with a single direction change. , 2006, Journal of vision.

[85]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[86]  Semir Zeki,et al.  Seeing Invisible Motion: A Human fMRI Study , 2006, Current Biology.

[87]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[88]  J. Movshon,et al.  Motion Integration by Neurons in Macaque MT Is Local, Not Global , 2007, The Journal of Neuroscience.

[89]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[90]  C. Bundesen,et al.  Parallel processing in a multifeature whole-report paradigm. , 2007, Journal of experimental psychology. Human perception and performance.

[91]  John L. Barbur,et al.  Colour constancy and conscious perception of changes of illuminant , 2008, Neuropsychologia.

[92]  M. Mallar Chakravarty,et al.  The Connectivity of the Human Pulvinar: A Diffusion Tensor Imaging Tractography Study , 2007, Int. J. Biomed. Imaging.

[93]  Nikos K. Logothetis,et al.  Visually Driven Activation in Macaque Areas V2 and V3 without Input from the Primary Visual Cortex , 2009, PloS one.

[94]  Andreas Bartels,et al.  The Coding of Color, Motion, and Their Conjunction in the Human Visual Cortex , 2009, Current Biology.

[95]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[96]  J. Mollon,et al.  A neural basis for unique hues? , 2009, Current Biology.

[97]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[98]  B. Staresina,et al.  Mind the Gap: Binding Experiences across Space and Time in the Human Hippocampus , 2009, Neuron.

[99]  Kazumi Hirayama,et al.  Visual Agnosia for Line Drawings and Silhouettes without Apparent Impairment of Real-Object Recognition: A Case Report , 2009, Behavioural neurology.

[100]  Relative timing and perceptual asynchrony , 2010 .

[101]  Scott D. Slotnick,et al.  Does the hippocampus mediate objective binding or subjective remembering? , 2010, NeuroImage.

[102]  Saumil S. Patel,et al.  Color and motion: which is the tortoise and which is the hare? , 2010 .

[103]  Paul B Hibbard,et al.  Consciousness of the first order in blindsight , 2010, Proceedings of the National Academy of Sciences.

[104]  Colin W. G. Clifford Space and Time in Perception and Action: Dynamics of visual feature binding , 2010 .

[105]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[106]  Semir Zeki,et al.  The primary visual cortex, and feedback to it, are not necessary for conscious vision. , 2011, Brain : a journal of neurology.

[107]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[108]  M. Husain,et al.  Forgetting What Was Where: The Fragility of Object-Location Binding , 2012, PloS one.

[109]  Emiliano Ricciardi,et al.  Evidence of a direct influence between the thalamus and hMT+ independent of V1 in the human brain as measured by fMRI , 2012, NeuroImage.

[110]  K. Moutoussis Asynchrony in Visual Consciousness and the Possible Involvement of Attention , 2012, Front. Psychology.

[111]  W. A. Escobar,et al.  Quantized visual awareness , 2013, Front. Psychol..

[112]  Mark Hymers,et al.  Specialized and independent processing of orientation and shape in visual field maps LO1 and LO2 , 2013, Nature Neuroscience.

[113]  Jonathan M. Schott,et al.  Binding deficits in memory following medial temporal lobe damage in patients with voltage-gated potassium channel complex antibody-associated limbic encephalitis , 2013, Brain : a journal of neurology.

[114]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[115]  Semir Zeki,et al.  Functional specialization and generalization for grouping of stimuli based on colour and motion , 2013, NeuroImage.

[116]  D. Heeger,et al.  Categorical Clustering of the Neural Representation of Color , 2013, The Journal of Neuroscience.

[117]  David Ferster,et al.  Functional Coupling from Simple to Complex Cells in the Visually Driven Cortical Circuit , 2013, The Journal of Neuroscience.

[118]  S. Zeki,et al.  Parallelism in the brain's visual form system , 2013, The European journal of neuroscience.

[119]  Semir Zeki,et al.  Masking reveals parallel form systems in the visual brain , 2014, Front. Hum. Neurosci..

[120]  Robert Desimone,et al.  Subcortical connections of area V4 in the macaque , 2000, The Journal of comparative neurology.

[121]  Semir Zeki,et al.  Non-binding relationship between visual features , 2014, Front. Hum. Neurosci..

[122]  Eriko Self Color–motion asynchrony assessed along the chromatic axes and with luminance variation , 2014, Attention, perception & psychophysics.

[123]  Thaddeus B. Czuba,et al.  Area MT Encodes Three-Dimensional Motion , 2014, The Journal of Neuroscience.

[124]  S. Zeki,et al.  Parallel processing of face and house stimuli by V1 and specialized visual areas: a magnetoencephalographic (MEG) study , 2014, Front. Hum. Neurosci..

[125]  Samuel W Cheadle,et al.  The role of parietal cortex in the formation of color and motion based concepts , 2014, Front. Hum. Neurosci..

[126]  Semir Zeki,et al.  Perceptual asynchrony for motion , 2014, Front. Hum. Neurosci..

[127]  Semir Zeki,et al.  Parallel processing in the brain's visual form system: an fMRI study , 2014, Front. Hum. Neurosci..

[128]  Gregory C DeAngelis,et al.  Neural Representation of Motion-In-Depth in Area MT , 2014, The Journal of Neuroscience.

[129]  M. Schoenfeld,et al.  Neural correlates of visual motion processing without awareness in patients with striate cortex and pulvinar lesions , 2015, Human brain mapping.

[130]  M. Overgaard,et al.  Reconciling current approaches to blindsight , 2015, Consciousness and Cognition.

[131]  Robert T. Foley The case for characterising type-2 blindsight as a genuinely visual phenomenon , 2015, Consciousness and Cognition.

[132]  F. Macpherson The structure of experience, the nature of the visual, and type 2 blindsight , 2015, Consciousness and Cognition.

[133]  Robert W. Kentridge What is it like to have type-2 blindsight? Drawing inferences from residual function in type-1 blindsight , 2015, Consciousness and Cognition.