Regular Cycles of Forward and Backward Signal Propagation in Prefrontal Cortex and in Consciousness

This paper addresses two fundamental questions: (1) Is it possible to develop mathematical neural network models which can explain and replicate the way in which higher-order capabilities like intelligence, consciousness, optimization, and prediction emerge from the process of learning (Werbos, 1994, 2016a; National Science Foundation, 2008)? and (2) How can we use and test such models in a practical way, to track, to analyze and to model high-frequency (≥ 500 hz) many-channel data from recording the brain, just as econometrics sometimes uses models grounded in the theory of efficient markets to track real-world time-series data (Werbos, 1990)? This paper first reviews some of the prior work addressing question (1), and then reports new work performed in MATLAB analyzing spike-sorted and burst-sorted data on the prefrontal cortex from the Buzsaki lab (Fujisawa et al., 2008, 2015) which is consistent with a regular clock cycle of about 153.4 ms and with regular alternation between a forward pass of network calculations and a backwards pass, as in the general form of the backpropagation algorithm which one of us first developed in the period 1968–1974 (Werbos, 1994, 2006; Anderson and Rosenfeld, 1998). In business and finance, it is well known that adjustments for cycles of the year are essential to accurate prediction of time-series data (Box and Jenkins, 1970); in a similar way, methods for identifying and using regular clock cycles offer large new opportunities in neural time-series analysis. This paper demonstrates a few initial footprints on the large “continent” of this type of neural time-series analysis, and discusses a few of the many further possibilities opened up by this new approach to “decoding” the neural code (Heller et al., 1995).

[1]  D. Foata ON THE NETTO INVERSION NUMBER OF A SEQUENCE , 1968 .

[2]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[3]  S Grossberg,et al.  Pavlovian pattern learning by nonlinear neural networks. , 1971, Proceedings of the National Academy of Sciences of the United States of America.

[4]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[5]  R. Jindra Mass action in the nervous system W. J. Freeman, Academic Press, New York (1975), 489 pp., (hard covers). $34.50 , 1976, Neuroscience.

[6]  Michael Stuart,et al.  Understanding Robust and Exploratory Data Analysis , 1984 .

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Paul J. Werbos,et al.  2.1. Econometric techniques: Theory versus practice , 1990 .

[9]  Edgar E. Peters Chaos and order in the capital markets , 1991 .

[10]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[11]  T. Bliss,et al.  Transsynaptic expression of a presynaptic glutamate receptor during hippocampal long-term potentiation. , 1993, Science.

[12]  R. Llinás,et al.  Uniform olivocerebellar conduction time underlies Purkinje cell complex spike synchronicity in the rat cerebellum. , 1993, The Journal of physiology.

[13]  J. Mallet,et al.  Characterization of a presynaptic glutamate receptor. , 1993, Science.

[14]  Paul J. Werbos,et al.  The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting , 1994 .

[15]  M. Nicolelis,et al.  Sensorimotor encoding by synchronous neural ensemble activity at multiple levels of the somatosensory system. , 1995, Science.

[16]  Edgar E. Peters Chaos and Order in the Capital Markets: A New View of Cycles, Prices, and Market Volatility , 1996 .

[17]  I. K. Wood Neuroscience: Exploring the brain , 1996 .

[18]  J. Csicsvari,et al.  Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. , 2000, Journal of neurophysiology.

[19]  M. Kahana,et al.  Theta returns , 2001, Current Opinion in Neurobiology.

[20]  Yehuda Rav PERSPECTIVES ON THE HISTORY OF THE CYBERNETICS MOVEMENT: THE PATH TO CURRENT RESEARCH THROUGH THE CONTRIBUTIONS OF NORBERT WIENER, WARREN McCULLOCH, AND JOHN VON NEUMANN , 2002, Cybern. Syst..

[21]  Barry J. Richmond,et al.  Information flow and temporal coding in primate pattern vision , 1995, Journal of Computational Neuroscience.

[22]  P. Werbos Backwards Differentiation in AD and Neural Nets: Past Links and New Opportunities , 2006 .

[23]  M. Paradiso,et al.  Neuroscience: Exploring the brain, 3rd ed. , 2007 .

[24]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[25]  Paul J. Werbos,et al.  2009 Special Issue: Intelligence in the brain: A theory of how it works and how to build it , 2009 .

[26]  Sisir Roy,et al.  The ‘prediction imperative’ as the basis for self-awareness , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  John P. Cunningham,et al.  Empirical models of spiking in neural populations , 2011, NIPS.

[28]  W. Freeman,et al.  Synchronized Minima in ECoG Power at Frequencies Between Beta-Gamma Oscillations Disclose Cortical Singularities in Cognition , 2012 .

[29]  Paul J. Werbos,et al.  Neural networks and the experience and cultivation of mind , 2012, Neural Networks.

[30]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[31]  Frank L. Lewis,et al.  Reinforcement Learning and Approximate Dynamic Programming for Feedback Control , 2012 .

[32]  R. Wesson Emerging Frontiers in Research and Innovation (EFRI) , 2013 .

[33]  Paul J. Werbos,et al.  From ADP to the brain: Foundations, roadmap, challenges and research priorities , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[34]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[35]  Yuan Yuan,et al.  Cortical neural responses to previous trial outcome during learning of a directional choice task. , 2015, Journal of neurophysiology.

[36]  Cyrille Rossant,et al.  Spike sorting for large, dense electrode arrays , 2015 .

[37]  Paul J. Werbos,et al.  Analog quantum computing (AQC) and the need for time-symmetric physics , 2015, Quantum Information Processing.

[38]  P. Werbos Commentary by Paul J. Werbos , 2016 .

[39]  W. Freeman,et al.  Cortical rhythms are modulated by respiration , 2016, bioRxiv.

[40]  Robert Kozma,et al.  Introduction—On the Languages of Brains , 2016 .

[41]  Bernard J. Baars Commentary by B. Baars , 2016 .

[42]  J. Davis A Brief Introduction to the Neuro-Genetics of Spirituality towards a Systemic Peace Propagation Model , 2016 .

[43]  P. Werbos Links Between Consciousness and the Physics of Time , 2018 .