A functioning model of human time perception

Despite being a fundamental dimension of experience, how the human brain generates the perception of time remains unknown. Predominant models of human time perception propose the existence of oscillatory neural processes that continually track physical time - so called pacemakers - similar to the system clock of a computer. However, clear neural evidence for pacemakers at psychologically relevant timescales is lacking, raising the question of whether internal pacemakers are necessary for time perception. Here we show that clock-like pacemaker processes are not required for human time perception. We built an artificial neural system based on a feed-forward image classification network, functionally similar to human visual processing. In this system, input videos of natural scenes drive changes in activation within an image classification network and accumulation of salient changes in activations are used to estimate time. Estimates produced by this system match human reports made about the same videos, replicating key qualitative aspects such as report variability proportional to duration (scalar variability/Weber9s law) and response regression to the mean (Vierordt9s law). System-generated estimates also differentiate by scene type, such as walking around a busy city or sitting in a cafe, producing the same pattern of differences as human reports. Our results show how time perception can be derived from the operation of non-temporal perceptual classification processes, without any neural pacemaker, opening new opportunities for investigating the neural foundations of this central aspect of human experience.

[1]  William M. Connelly,et al.  Differential Short-Term Plasticity at Convergent Inhibitory Synapses to the Substantia Nigra Pars Reticulata , 2010, The Journal of Neuroscience.

[2]  Dean V Buonomano,et al.  Neurocomputational models of interval and pattern timing , 2016, Current Opinion in Behavioral Sciences.

[3]  Sylvie Droit-Volet,et al.  Development of time , 2016, Current Opinion in Behavioral Sciences.

[4]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[5]  Hugo Merchant,et al.  Interval Tuning in the Primate Medial Premotor Cortex as a General Timing Mechanism , 2013, The Journal of Neuroscience.

[6]  J. Staddon Interval timing: memory, not a clock , 2005, Trends in Cognitive Sciences.

[7]  P. Tse,et al.  Time and the Brain: How Subjective Time Relates to Neural Time , 2005 .

[8]  Leon A. Gatys,et al.  Deep convolutional models improve predictions of macaque V1 responses to natural images , 2019, PLoS Comput. Biol..

[9]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[10]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  Nikolaus Kriegeskorte,et al.  Deep neural networks: a new framework for modelling biological vision and brain information processing , 2015, bioRxiv.

[13]  Martin P. Paulus,et al.  Accumulation of neural activity in the posterior insula encodes the passage of time , 2008, Neuropsychologia.

[14]  Gavin L. Woodhall,et al.  Functional characterization of GABAergic pallidopallidal and striatopallidal synapses in the rat globus pallidus in vitro , 2008, The European journal of neuroscience.

[15]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  Marc Wittmann,et al.  Body signals, cardiac awareness, and the perception of time , 2011, Biological Psychology.

[17]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[18]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[19]  John E. Schlerf,et al.  Dedicated and intrinsic models of time perception , 2008, Trends in Cognitive Sciences.

[20]  Dean V. Buonomano,et al.  Timing as an intrinsic property of neural networks: evidence from in vivo and in vitro experiments , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[21]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[22]  Bon-Mi Gu,et al.  Dedicated clock/timing-circuit theories of time perception and timed performance. , 2014, Advances in experimental medicine and biology.

[23]  Sylvie Droit-Volet,et al.  Speeding up an Internal Clock in Children? Effects of Visual Flicker on Subjective Duration , 2002, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[24]  Tomoyasu Horikawa,et al.  Hierarchical Neural Representation of Dreamed Objects Revealed by Brain Decoding with Deep Neural Network Features , 2016, Front. Comput. Neurosci..

[25]  D. Homa,et al.  Duration judgment and the experience of change , 1983, Perception & psychophysics.

[26]  P. Hancock,et al.  How cognitive load affects duration judgments: A meta-analytic review. , 2010, Acta psychologica.

[27]  Richard A. Block,et al.  Remembered duration: Effects of event and sequence complexity , 1978 .

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  U. Karmarkar,et al.  Timing in the Absence of Clocks: Encoding Time in Neural Network States , 2007, Neuron.

[31]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[32]  R. Block,et al.  Memory and the experience of duration in retrospect , 1974, Memory & cognition.

[33]  Andrea Vedaldi,et al.  Understanding deep image representations by inverting them , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[35]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[36]  Vani Pariyadath,et al.  Is subjective duration a signature of coding efficiency? , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[37]  Catalin V. Buhusi,et al.  Interval timing as an emergent learning property. , 2003 .

[38]  Sylvie Droit-Volet,et al.  Time perception in children: A neurodevelopmental approach , 2013, Neuropsychologia.

[39]  Warren H. Meck,et al.  Oscillatory multiplexing of neural population codes for interval timing and working memory , 2015, Neuroscience & Biobehavioral Reviews.

[40]  Peter A. Hancock,et al.  Developmental Changes in Human Duration Judgments: A Meta-Analytic Review , 1999 .

[41]  D. Buonomano,et al.  Population clocks: motor timing with neural dynamics , 2010, Trends in Cognitive Sciences.

[42]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[43]  E. Boersma,et al.  Prevention of Catheter-Related Bacteremia with a Daily Ethanol Lock in Patients with Tunnelled Catheters: A Randomized, Placebo-Controlled Trial , 2010, PloS one.

[44]  P. Tse,et al.  Attention and the subjective expansion of time , 2004, Perception & psychophysics.

[45]  W. Meck,et al.  Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. , 2004, Brain research. Cognitive brain research.

[46]  Li Su,et al.  A Toolbox for Representational Similarity Analysis , 2014, PLoS Comput. Biol..

[47]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[48]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[49]  John A. Michon,et al.  Processing of Temporal Information and the Cognitive Theory of Time Experience , 1972 .

[50]  Daniel Schmitt,et al.  Whole Body Mechanics of Stealthy Walking in Cats , 2008, PloS one.

[51]  Neil W Roach,et al.  Generalization of prior information for rapid Bayesian time estimation , 2016, Proceedings of the National Academy of Sciences.

[52]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[53]  D. Eagleman Human time perception and its illusions , 2008, Current Opinion in Neurobiology.

[54]  Dominic Mathew,et al.  Acoustic modeling using auditory model features and Convolutional neural Network , 2015, 2015 International Conference on Power, Instrumentation, Control and Computing (PICC).

[55]  Christopher J. MacDonald,et al.  Prospective and retrospective duration memory in the hippocampus: is time in the foreground or background? , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[56]  Caspar Addyman,et al.  Computational models of interval timing , 2016, Current Opinion in Behavioral Sciences.

[57]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[58]  Mark D. Humphries,et al.  Reconstructing the Three-Dimensional GABAergic Microcircuit of the Striatum , 2010, PLoS Comput. Biol..

[59]  Anil K. Seth,et al.  Neurophysiological signatures of duration and rhythm prediction across sensory modalities , 2017, bioRxiv.

[60]  S. Grondin Timing and time perception: A review of recent behavioral and neuroscience findings and theoretical directions , 2010, Attention, perception & psychophysics.

[61]  N. Busch,et al.  How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration , 2013, PloS one.