A new EEG measure using the 1D cluster variation method

A new information measure, drawing on the 1-D Cluster Variation Method (CVM), describes local pattern distributions (nearest-neighbor and next-nearest neighbor) in a binary 1-D vector in terms of a single interaction enthalpy parameter h for the specific case where the fractions of elements in each of two states are the same (x1=x2=0.5). An example application of this method would be for EEG interpretation in Brain-Computer Interfaces (BCIs), especially in the frontier of invariant biometrics based on distinctive and invariant individual responses to stimuli containing an image of a person with whom there is a strong affiliative response (e.g., to a person’s grandmother). This measure is obtained by mapping EEG observed configuration variables (z1, z2, z3 for next-nearest neighbor triplets) to h using the analytic function giving h in terms of these variables at equilibrium. This mapping results in a small phase space region of resulting h values, which characterizes local pattern distributions in the source data. The 1-D vector with equal fractions of units in each of the two states can be obtained using the method for transforming natural images into a binarized equi-probability ensemble (Saremi & Sejnowski, 2014; Stephens et al., 2013). An intrinsically 2-D data configuration can be mapped to 1-D using the 1-D Peano-Hilbert space-filling curve, which has demonstrated a 20 dB lower baseline using the method compared with other approaches (cf. SPIE ICA etc. by Hsu & Szu, 2014). This CVM-based method has multiple potential applications; one near-term one is optimizing classification of the EEG signals from a COTS 1-D BCI baseball hat. This can result in a convenient 3-D lab-tethered EEG, configured in a 1-D CVM equiprobable binary vector, and potentially useful for Smartphone wireless display. Longer-range applications include interpreting neural assembly activations via high-density implanted soft, cellular-scale electrodes.

[1]  A. Maren,et al.  A Theoretical Model of Solid State Phase Reactions: Hysteresis and Kinetics , 1984 .

[2]  Harold Szu.  Thermodynamics Energy for both Supervised and Unsupervised Learning Neural Nets at a Constant Temperature , 1999, Int. J. Neural Syst..

[3]  A. Engel,et al.  Intrinsic Coupling Modes: Multiscale Interactions in Ongoing Brain Activity , 2013, Neuron.

[4]  Alessandro Pelizzola,et al.  Cluster Variation Method in Statistical Physics and Probabilistic Graphical Models , 2005, ArXiv.

[5]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[6]  Kiseon Kim,et al.  Review of Wireless Brain-Computer Interface Systems , 2013 .

[7]  G. Edelman,et al.  The Mindful Brain: Cortical Organization and the Group-Selective Theory of Higher Brain Function , 1978 .

[8]  S. Cocco,et al.  Ising models for neural activity inferred via selective cluster expansion: structural and coding properties , 2013 .

[9]  C. Kemere,et al.  Neural stimulation and recording with bidirectional, soft carbon nanotube fiber microelectrodes. , 2015, ACS nano.

[10]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[11]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[12]  Jong-Hwan Lee,et al.  Brain order disorder 2nd group report of f-EEG , 2014, Sensing Technologies + Applications.

[13]  S. Ganguli,et al.  Statistical mechanics of complex neural systems and high dimensional data , 2013, 1301.7115.

[14]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[15]  James J. S. Norton,et al.  Soft, curved electrode systems capable of integration on the auricle as a persistent brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[16]  D. Whitteridge,et al.  Learning and Relearning , 1959, Science's STKE.

[17]  Terrence J. Sejnowski,et al.  On Criticality in High-Dimensional Data , 2014, Neural Computation.

[18]  Michael J. Berry,et al.  Searching for Collective Behavior in a Large Network of Sensory Neurons , 2013, PLoS Comput. Biol..

[19]  A. Maren.  A Logical Topology of Neural Networks , 2015 .

[20]  R. Kikuchi.  A Theory of Cooperative Phenomena , 1951 .

[21]  Lars Kai Hansen,et al.  The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System , 2013, PloS one.

[22]  Ivica Kopriva,et al.  Unsupervised learning with stochastic gradient , 2005, Neurocomputing.

[23]  Hairong Qi,et al.  Unsupervised learning with mini free energy , 2007, SPIE Defense + Commercial Sensing.

[24]  Harold H. Szu,et al.  Low-discrepancy sampling of parametric surface using adaptive space-filling curves (SFC) , 2014, Sensing Technologies + Applications.

[25]  Karl J. Friston,et al.  Neural masses and fields in dynamic causal modeling , 2013, Front. Comput. Neurosci..

[26]  Alianna J. Maren,et al.  Hybrid and complex networks , 1990 .

[27]  C. Koch,et al.  What is the function of the claustrum? , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[29]  Timothy W. Finin,et al.  Taming Wild Big Data , 2014, AAAI Fall Symposia.

[30]  T. Mohri.  SHORT RANGE ORDERING AND LOCAL DISPLACEMENT OF ALLOYS STUDIED BY CVM , 2012 .

[31]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[32]  W. Singer.  Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[33]  Tzyy-Ping Jung,et al.  A brain-machine interface using dry-contact, low-noise EEG sensors , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[34]  J. Cowan,et al.  Self-organized criticality in a network of interacting neurons , 2012, 1209.3829.

[35]  S. Cogan.  Neural stimulation and recording electrodes. , 2008, Annual review of biomedical engineering.

[36]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[37]  Frederico A. C. Azevedo,et al.  Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain , 2009, The Journal of comparative neurology.

[38]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[39]  Harold H. Szu,et al.  Authentication, privacy, security can exploit brainwave by biomarker , 2014, Sensing Technologies + Applications.

[40]  Michael J. Berry,et al.  The simplest maximum entropy model for collective behavior in a neural network , 2012, 1207.6319.

[41]  A. J. Maren,et al.  Configurational entropy stabilizes pattern formation in a hetero-associative neural network , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[42]  W. Bialek,et al.  Statistical thermodynamics of natural images. , 2008, Physical review letters.