Definitions of state variables and state space for brain-computer interface

Neocortical state variables are defined and evaluated at three levels: microscopic using multiple spike activity (MSA), mesoscopic using local field potentials (LFP) and electrocorticograms (ECoG), and macroscopic using electroencephalograms (EEG) and brain imaging. Transactions between levels occur in all areas of cortex, upwardly by integration (abstraction, generalization) and downwardly by differentiation (speciation). The levels are joined by circular causality: microscopic activity upwardly creates mesoscopic order parameters, which downwardly constrain the microscopic activity that creates them. Integration dominates in sensory cortices. Microscopic activity evoked by receptor input in sensation induces emergence of mesoscopic activity in perception, followed by integration of perceptual activity into macroscopic activity in concept formation. The reverse process dominates in motor cortices, where the macroscopic activity embodying the concepts supports predictions of future states as goals. These macroscopic states are conceived to order mesoscopic activity in patterns that constitute plans for actions to achieve the goals. These planning patterns are conceived to provide frames in which the microscopic activity evolves in trajectories that adapted to the immediate environmental conditions detected by new stimuli. This circular sequence forms the action-perception cycle. Its upward limb is understood through correlation of sensory cortical activity with behavior. Now brain-machine interfaces (BMI) offer a means to understand the downward sequence through correlation of behavior with motor cortical activity, beginning with macroscopic goal states and concluding with recording of microscopic MSA trajectories that operate neuroprostheses. Part 1 develops a hypothesis that describes qualitatively the neurodynamics that supports the action-perception cycle and derivative reflex arc. Part 2 describes episodic, “cinematographic–spatial pattern formation and predicts some properties of the macroscopic and mesoscopic frames by which the embedded trajectories of the microscopic activity of cortical sensorimotor neurons might be organized and controlled.

[1]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[2]  Yiwen Wang,et al.  Analysis of the Correlation between Local Field Potentials and Neuronal Firing Rate in the Motor Cortex , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  D. Tucker,et al.  EEG coherency. I: Statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales. , 1997, Electroencephalography and clinical neurophysiology.

[4]  W. Freeman,et al.  Analysis of spatial patterns of phase in neocortical gamma EEGs in rabbit. , 2000, Journal of neurophysiology.

[5]  W J Freeman,et al.  Relation of glomerular neuronal activity to glomerular transmission attenuation. , 1974, Brain research.

[6]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[7]  W. Freeman,et al.  Spatial spectral analysis of human electrocorticograms including the alpha and gamma bands , 2000, Journal of Neuroscience Methods.

[8]  James J. Wright,et al.  Dynamics of the brain at global and microscopic scales: Neural networks and the EEG , 1996, Behavioral and Brain Sciences.

[9]  Catherine Tallon-Baudry,et al.  Induced γ-Band Activity during the Delay of a Visual Short-Term Memory Task in Humans , 1998, The Journal of Neuroscience.

[10]  W. Freeman,et al.  Fine temporal resolution of analytic phase reveals episodic synchronization by state transitions in gamma EEGs. , 2002, Journal of neurophysiology.

[11]  José Carlos Príncipe,et al.  Ascertaining the importance of neurons to develop better brain-machine interfaces , 2004, IEEE Transactions on Biomedical Engineering.

[12]  Julie Clayton,et al.  Ripe fruit leads to a ripe old age , 2001, Trends in Cognitive Sciences.

[13]  T. Blanche,et al.  Polytrodes: high-density silicon electrode arrays for large-scale multiunit recording. , 2005, Journal of neurophysiology.

[14]  W. Freeman.  Origin, structure, and role of background EEG activity. Part 2. Analytic phase , 2004, Clinical Neurophysiology.

[15]  W. Freeman,et al.  Relation of olfactory EEG to behavior: time series analysis. , 1986, Behavioral neuroscience.

[16]  N. Birbaumer,et al.  A brain–computer interface (BCI) for the locked-in: comparison of different EEG classifications for the thought translation device , 2003, Clinical Neurophysiology.

[17]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  W J Freeman,et al.  Relation of olfactory EEG to behavior: factor analysis. , 1987, Behavioral neuroscience.

[19]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[20]  D. Watts.  The “New” Science of Networks , 2004 .

[21]  W. Freeman,et al.  Nonlinear brain dynamics as macroscopic manifestation of underlying many-body field dynamics , 2005, q-bio/0511037.

[22]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[23]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[24]  Albert-László Barabási,et al.  Linked: The New Science of Networks , 2002 .

[25]  R. Traub,et al.  Neuronal fast oscillations as a target site for psychoactive drugs. , 2000, Pharmacology & therapeutics.

[26]  S. Bok.  Histonomy of the cerebral cortex , 1959 .

[27]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[28]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[29]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[30]  C. B. Ferster,et al.  Schedules of reinforcement , 1957 .

[31]  W. Freeman,et al.  A neurobiological theory of meaning in perception. Part 5. Multicortical patterns of phase modulation in gamma EEG - eScholarship , 2003 .

[32]  Brian C. Burke,et al.  A neurobiological theory of meaning in perception . Part 4 . Multicortical patterns of amplitude modulation in gamma EEG International Journal of Bifurcation & Chaos [ 2003 ] 13 : in , 2004 .

[33]  John G. Harris,et al.  Design and implementation of a biologically realistic olfactory cortex in analog VLSI , 2001, Proc. IEEE.

[34]  Walter J. Freeman,et al.  Neurodynamics: An Exploration in Mesoscopic Brain Dynamics , 2000, Perspectives in Neural Computing.

[35]  Matthias M. Müller,et al.  Visually induced gamma-band responses in human electroencephalographic activity — a link to animal studies , 1996, Experimental Brain Research.

[36]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[37]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[38]  Jean,et al.  The Computer and the Brain , 1989, Annals of the History of Computing.

[39]  Walter J. Freeman,et al.  Origin, structure, and role of background EEG activity. Part 3. Neural frame classification , 2005, Clinical Neurophysiology.

[40]  Robert Kozma,et al.  Chaotic Resonance - Methods and Applications for Robust Classification of noisy and Variable Patterns , 2001, Int. J. Bifurc. Chaos.

[41]  H. Swadlow.  Efferent neurons and suspected interneurons in motor cortex of the awake rabbit: axonal properties, sensory receptive fields, and subthreshold synaptic inputs. , 1994, Journal of neurophysiology.

[42]  G. Ermentrout,et al.  Gamma rhythms and beta rhythms have different synchronization properties. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[43]  P. Robinson,et al.  Modal analysis of corticothalamic dynamics, electroencephalographic spectra, and evoked potentials. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  David T. J. Liley,et al.  Alpha rhythm emerges from large-scale networks of realistically coupled multicompartmental model cortical neurons , 1999 .

[45]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[46]  I. Tsuda.  Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[47]  Siegfried Othmer,et al.  EEG Biofeedback: An Emerging Model for Its Global Efficacy , 1999 .

[48]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[49]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[50]  Guang Li,et al.  Study of a bionic pattern classifier based on olfactory neural system , 2004, Int. J. Bifurc. Chaos.

[51]  R. J. Vetter,et al.  Silicon-substrate intracortical microelectrode arrays for long-term recording of neuronal spike activity in cerebral cortex , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  D. Stuart,et al.  Integration of posture and movement: contributions of Sherrington, Hess, and Bernstein. , 2005, Human movement science.

[53]  John P. Donoghue,et al.  Connecting cortex to machines: recent advances in brain interfaces , 2002, Nature Neuroscience.

[54]  Maurice Merleau-Ponty.  Phenomenology of Perception , 1964 .

[55]  W. Freeman,et al.  Frequency analysis of olfactory system EEG in cat, rabbit, and rat. , 1980, Electroencephalography and clinical neurophysiology.

[56]  Péter Érdi,et al.  The KIV model - nonlinear spatio-temporal dynamics of the primordial vertebrate forebrain , 2003, Neurocomputing.

[57]  C. Mehring,et al.  Inference of hand movements from local field potentials in monkey motor cortex , 2003, Nature Neuroscience.

[58]  Manfred Schroeder,et al.  Fractals, Chaos, Power Laws: Minutes From an Infinite Paradise , 1992 .

[59]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[60]  R. Sperry.  Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[61]  R. Solé.  Linked: The New Science of Networks.ByAlbert‐László Barabási.Cambridge (Massachusetts): Perseus Publishing.$26.00. vii + 280 p; ill.; index. ISBN: 0–7382–0667–9. 2002. , 2003 .

[62]  Christoph Braun,et al.  Coherence of gamma-band EEG activity as a basis for associative learning , 1999, Nature.

[63]  D. Kernell,et al.  Quantitative aspects of repetitive firing of mammalian motoneurones, caused by injected currents , 1963, The Journal of physiology.

[64]  Walter J. Freeman,et al.  A field-theoretic approach to understanding scale-free neocortical dynamics , 2005, Biological Cybernetics.

[65]  J. Pernier,et al.  Induced gamma-band activity during the delay of a visual short-term memory task in humans. , 1998, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  E. Basar.  Brain Function and Oscillations , 1998 .

[67]  R. Traub,et al.  A mechanism for generation of long-range synchronous fast oscillations in the cortex , 1996, Nature.

[68]  W. Freeman,et al.  Bidirectional processing in the olfactory-limbic axis during olfactory behavior. , 1998, Behavioral neuroscience.

[69]  J. Pernier,et al.  Stimulus Specificity of Phase-Locked and Non-Phase-Locked 40 Hz Visual Responses in Human , 1996, The Journal of Neuroscience.

[70]  A. Fingelkurts,et al.  MAKING COMPLEXITY SIMPLER: MULTIVARIABILITY AND METASTABILITY IN THE BRAIN , 2004, The International journal of neuroscience.

[71]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[72]  George A. Agoston,et al.  From Being to Becoming: Time and Complexity in the Physical Sciences by Ilya Prigogine (review) , 1982 .

[73]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[74]  David Holcman,et al.  Statistical evaluation of clusters derived by nonlinear mapping of EEG spatial patterns , 1999, Journal of Neuroscience Methods.

[75]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[76]  Hermann Haken,et al.  Synergetics of brain function. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[77]  I. Prigogine,et al.  From Being to Becoming: Time and Complexity in the Physical Sciences , 1982 .

[78]  L. Garey.  Cortex: Statistics and Geometry of Neuronal Connectivity, 2nd edn. By V. BRAITENBERG and A. SCHÜZ. (Pp. xiii+249; 90 figures; ISBN 3 540 63816 4). Berlin: Springer. 1998. , 1999 .

[79]  Walter J. Freeman,et al.  Origin, structure, and role of background EEG activity. Part 4: Neural frame simulation , 2006, Clinical Neurophysiology.

[80]  D. Sholl.  The organization of the cerebral cortex , 1957 .

[81]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[82]  W. Freeman,et al.  Change in pattern of ongoing cortical activity with auditory category learning , 2001, Nature.

[83]  R. Andersen,et al.  Selecting the signals for a brain–machine interface , 2004, Current Opinion in Neurobiology.

[84]  Erol Başar,et al.  Brain oscillations : principles and approaches , 1998 .

[85]  A. Abbott.  Neuroprosthetics: In search of the sixth sense , 2006, Nature.

[86]  Jean Millay.  Multidimensional Mind: Remote Viewing in Hyperspace , 2000 .

[87]  W. Freeman,et al.  Spatiotemporal analysis of prepyriform, visual, auditory, and somesthetic surface EEGs in trained rabbits. , 1996, Journal of neurophysiology.

[88]  Jürgen Kurths,et al.  Complex Phase Synchronization in Neurophysiological Data , 1999 .

[89]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[90]  W. Freeman.  Nonlinear gain mediating cortical stimulus-response relations , 1979, Biological Cybernetics.

[91]  Justin C. Sanchez,et al.  Analysis of Amplitude Modulated Control Features for ECoG Neuroprosthetics , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[92]  J. Kelso,et al.  Cortical coordination dynamics and cognition , 2001, Trends in Cognitive Sciences.

[93]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[94]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[95]  José del R. Millán,et al.  Very high frequency oscillations (VHFO) as a predictor of movement intentions , 2006, NeuroImage.

[96]  R. Granit,et al.  Net depolarization and discharge rate of motoneurones, as measured by recurrent inhibition , 1961, The Journal of physiology.

[97]  James C. Houk,et al.  Agents of the mind , 2005, Biological Cybernetics.

[98]  Walter J. Freeman,et al.  Origin, structure, and role of background EEG activity. Part 1. Analytic amplitude , 2004, Clinical Neurophysiology.

[99]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[100]  C. Uhl.  Analysis of neurophysiological brain functioning , 1999 .

[101]  Béla Bollobás,et al.  Neuropercolation: A Random Cellular Automata Approach to Spatio-temporal Neurodynamics , 2004, ACRI.

[102]  Walter J. Freeman,et al.  A neurobiological theory of meaning in perception , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[103]  Miguel A L Nicolelis,et al.  Reduction of Single-Neuron Firing Uncertainty by Cortical Ensembles during Motor Skill Learning , 2004, The Journal of Neuroscience.

[104]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[105]  Maurice Merleau-Ponty,et al.  Phenomenology of perception , 2016 .

[106]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[107]  James J. Wright,et al.  Intracortical connectivity of pyramidal and stellate cells: estimates of synaptic densities and coupling symmetry , 1994 .

[108]  Justin C. Sanchez,et al.  Improved Linear BMI Systems via Population Averaging , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[109]  Walter J. Freeman,et al.  A Neurobiological Theory of Meaning in Perception Part III: Multiple Cortical Areas Synchronize without Loss of Local Autonomy , 2003, Int. J. Bifurc. Chaos.