Physical, Neural, and Mental Timing

The conclusions drawn by Benjamin Libet from his work with colleagues on the timing of somatosensorial conscious experiences has met with a lot of praise and criticism. In this issue we find three examples of the latter. Here I attempt to place the divide between the two opponent camps in a broader perspective by analyzing the question of the relation between physical timing, neural timing, and experiential (mental) timing. The nervous system does a sophisticated job of recombining and recoding messages from the sensorial surfaces and if these processes are slighted in a theory, it might become necessary to postulate weird operations, including subjective back-referral. Neuroscientifically inspired theories are of necessity still based on guesses, extrapolations, and philosophically dubious manners of speech. They often assume some neural correlate of consciousness (NCC) as a part of the nervous system that transforms neural activity in reportable experiences. The majority of neuroscientists appear to assume that the NCC can compare and bind activity patterns only if they arrive simultaneously at the NCC. This leads to a search for synchrony or to theories in terms of the compensation of differences in neural delays (latencies). This is the main dimension of the Libet discussion. Examples from vision research, such as "temporal-binding-by-synchrony" and the "flash-lag" effect, are then used to illustrate these reasoning patterns in more detail. Alternatively one could assume symbolic representations of time and space (symbolic "tags") that are not coded in their own dimension (not time in time and space in space). Unless such tags are multiplexed with the quality message (tickle, color, or motion), one gets a binding problem for tags. One of the hidden aspects of the discussion between Libet and opponents appears to be the following. Is the NCC smarter than the rest of the nervous system, so that it can solve the problems of local sign (e.g., "where is the event"?) and timing (e.g., "when did it occur?" and "how long did it last?") on its own, or are these pieces of information coded symbolically early on in the system? A supersmart NCC appears to be the assumption of Libet's camp (which includes Descartes, but also mystics). The wish to distribute the smartness evenly across all stages of processing in the nervous system (smart recodings) appears to motivate the opponents. I argue that there are reasons to side with the latter group.

[1]  David C. Van Essen,et al.  Multiple processing streams in occipitotemporal visual cortex , 1994, Nature.

[2]  S. Zeki Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[3]  B. Libet,et al.  Readiness-potentials preceding unrestricted 'spontaneous' vs. pre-planned voluntary acts. , 1982, Electroencephalography and clinical neurophysiology.

[4]  IAN M. GLYNN Conscious vs neural time , 1991, Nature.

[5]  C. Malsburg Binding in models of perception and brain function , 1995, Current Opinion in Neurobiology.

[6]  Jeff Miller,et al.  Cortical Movement Preparation before and after a Conscious Decision to Move , 2002, Consciousness and Cognition.

[7]  I. Murakami,et al.  Latency difference, not spatial extrapolation , 1998, Nature Neuroscience.

[8]  J. Konorski Conditioned reflexes and neuron organization. , 1948 .

[9]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[10]  B. Libet,et al.  Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential). The unconscious initiation of a freely voluntary act. , 1983, Brain : a journal of neurology.

[11]  M. Sanders Handbook of Sensory Physiology , 1975 .

[12]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[13]  Jan J. Koenderink,et al.  Limits in perception , 1984 .

[14]  Jan J. Koenderink,et al.  Simultaneous order in nervous nets from a functional standpoint , 2004, Biological Cybernetics.

[15]  P. Churchland On the Alleged Backwards Referral of Experiences and Its Relevance to the Mind-Body Problem , 1981, Philosophy of Science.

[16]  Frans A. J. Verstraten,et al.  A new transparent motion aftereffect , 1999, Nature Neuroscience.

[17]  S. Pockett On Subjective Back-Referral and How Long It Takes to Become Conscious of a Stimulus: A Reinterpretation of Libet's Data , 2002, Consciousness and Cognition.

[18]  Christos Constantinidis,et al.  The sensory nature of mnemonic representation in the primate prefrontal cortex , 2001, Nature Neuroscience.

[19]  S. Zeki,et al.  The asynchrony of consciousness , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  Frans A. J. Verstraten,et al.  Slow and fast visual motion channels have independent binocular–rivalry stages , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[22]  R Nijhawan,et al.  The Flash-Lag Phenomenon: Object Motion and Eye Movements , 2001, Perception.

[23]  Gilberto Gomes,et al.  Problems in the Timing of Conscious Experience , 2002, Consciousness and Cognition.

[24]  M Lappe,et al.  The position of moving objects. , 2000, Science.

[25]  Markus Lappe,et al.  Temporal recruitment along the trajectory of moving objects and the perception of position , 1999, Vision Research.

[26]  K. Moutoussis,et al.  Functional segregation and temporal hierarchy of the visual perceptive systems , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  R. Eckhorn,et al.  High frequency (60-90 Hz) oscillations in primary visual cortex of awake monkey. , 1993, Neuroreport.

[28]  Kuno Kirschfeld,et al.  The Fröhlich effect: a consequence of the interaction of visual focal attention and metacontrast , 1999, Vision Research.

[29]  H. Bedell,et al.  Flash-lag effect: differential latency, not postdiction. , 2000, Science.

[30]  Ian M. Glynn,et al.  Consciousness and time , 1990, Nature.

[31]  Semir Zeki,et al.  The theory of multistage integration in the visual brain , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  Jan J. Koenderink,et al.  Local operations : the embodiment of geometry , 1992 .

[33]  M. Lappe,et al.  Neuronal latencies and the position of moving objects , 2001, Trends in Neurosciences.

[34]  S Zeki,et al.  The autonomy of the visual systems and the modularity of conscious vision. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  R. Snowden,et al.  Shifts in perceived position following adaptation to visual motion , 1998, Current Biology.

[36]  B. Libet Time Factors in Conscious Processes: Reply to Gilberto Gomes , 2000, Consciousness and Cognition.

[37]  Unfolding perceptual continua , 2002 .

[38]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[39]  E. John,et al.  A Field Theory of Consciousness , 2001, Consciousness and Cognition.

[40]  Gopathy Purushothaman,et al.  Moving ahead through differential visual latency , 1998, Nature.

[41]  C. Malsburg Nervous Structures with Dynamical Links , 1985 .

[42]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[43]  Michael F. Shlesinger,et al.  Proceedings of the 1st Experimental Chaos Conference , 1992 .

[44]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[45]  Shinsuke Shimojo,et al.  Changing objects lead briefly flashed ones , 2000, Nature Neuroscience.

[46]  S Zeki,et al.  Localization and globalization in conscious vision. , 2001, Annual review of neuroscience.

[47]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .

[48]  Stanley A. Klein,et al.  Extrapolation or attention shift? , 1995, Nature.

[49]  K Kirschfeld,et al.  Oscillations in the insect brain: do they correspond to the cortical gamma-waves of vertebrates? , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[50]  D. Burr Motion smear , 1980, Nature.

[51]  P. Cavanagh,et al.  Illusory spatial offset of a flash relative to a moving stimulus is caused by differential latencies for moving and flashed stimuli , 2000, Vision Research.

[52]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[53]  G. Mowbray,et al.  Visual Masking , 1964, Nature.

[54]  S. Zeki,et al.  Toward a Theory of Visual Consciousness , 1999, Consciousness and Cognition.

[55]  J. J. Koenderink,et al.  Scale-time , 1988, Biological Cybernetics.

[56]  Friedrich W. Fröhlich,et al.  Über die Messung der Empfindungszeit , 1930 .

[57]  W. Metzger,et al.  Versuch einer gemeinsamen Theorie der Phänomene Fröhlichs und Hazelhoffs und Kritik ihrer Verfahren zur Messung der Empfindungszeit , 1932 .

[58]  B. Libet Unconscious cerebral initiative and the role of conscious will in voluntary action , 1985, Behavioral and Brain Sciences.

[59]  R. Nijhawan,et al.  Visual decomposition of colour through motion extrapolation , 1997, Nature.

[60]  B. Krekelberg,et al.  The persistence of position , 2001, Vision Research.

[61]  Gilberto Gomes,et al.  The Timing of Conscious Experience: A Critical Review and Reinterpretation of Libet's Research , 1998, Consciousness and Cognition.

[62]  P. Goldman-Rakic The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[63]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[64]  Shin'ya Nishida,et al.  Influence of motion signals on the perceived position of spatial pattern , 1999, Nature.

[65]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[66]  U. Eysel,et al.  Fluorescent tube light evokes flicker responses in visual neurons , 1984, Vision Research.

[67]  Romi Nijhawan,et al.  Extrapolation or attention shift? , 1995, Nature.

[68]  R Nijhawan,et al.  The Role of Attention in Motion Extrapolation: Are Moving Objects ‘Corrected’ or Flashed Objects Attentionally Delayed? , 2000, Perception.

[69]  R. Moxon,et al.  Unusual mutational mechanisms and evolution. , 1993, Science.

[70]  P. Churchland The Timing of Sensations: Reply to Libet , 1981, Philosophy of Science.

[71]  D. Mackay Perceptual Stability of a Stroboscopically Lit Visual Field containing Self-Luminous Objects , 1958, Nature.

[72]  S. Zeki,et al.  Temporal hierarchy of the visual perceptive systems in the Mondrian world , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[73]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[74]  Markus Lappe,et al.  A model of the perceived relative positions of moving objects based upon a slow averaging process , 2000, Vision Research.

[75]  P. Goldman-Rakic,et al.  Space and time in the mental universe , 1997, Nature.

[76]  J. Koenderink The brain a geometry engine , 1990, Psychological research.

[77]  D. Liberman,et al.  [Time perception]. , 1955, Revista de psicoanalisis.

[78]  E. Brenner,et al.  Motion extrapolation is not responsible for the flash–lag effect , 2000, Vision Research.

[79]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[80]  David Whitney,et al.  Motion distorts visual space: shifting the perceived position of remote stationary objects , 2000, Nature Neuroscience.