An Information-Theoretic View of EEG Sensing

This paper uses an information-theoretic lens to examine the use and implementation of electroencephalography (EEG) systems for neural imaging. There is a widespread belief in the clinical and neuroscientific community that ultra-high-density EEG imaging of the brain (beyond the typically used few hundred or fewer electrodes) will not yield higher spatial resolution. Theoretically, this belief rests on a spatial Nyquist rate analysis for human head models. This analysis in turn relies on the understanding that high spatial frequencies (that carry high-resolution information) decay as they travel from the brain to the scalp surface. Interestingly, the belief continues to be held despite being recently challenged experimentally, in part because of the spatial Nyquist results. In this work, we question the spatial Nyquist rate analysis, mathematically as well as conceptually. Mathematically, we correct and generalize the Nyquist rate analysis, and then use it to obtain improved estimates for spatial Nyquist rates. Conceptually, we observe that the Nyquist rate analysis provides a limit on the following problem: what is the minimum number of sensors required to reconstruct the scalp EEG to within a specified (small) mean-squared error? However, this problem is fundamentally different from the imaging problem of minimizing error in reconstructing the neural source inside the brain, which optimizes a different objective, and requires inclusion of noise in the analysis. To that end, we utilize the transfer function to obtain an information-theoretic fundamental limit on the achievable accuracy in localizing single-dipole sources. The technique relies on computing the distortion-rate function for a single dipole source and evaluating it at an upper bound on mutual information across the brain-to-scalp channel, and can be extended to more general sources as well. Finally, we observe that the main obstacle in understanding the required number of EEG sensors is the lack of ultra-high-density systems that can test these limits, and information theory can prove helpful in this context as well. One engineering difficulty is that the required circuit area and energy for sampling EEG signals can be too large to enable these systems to be safe, compact, and portable. Toward reducing this area and energy, we observe that the decay of high spatial frequencies in EEG, while being a detriment to reconstruction accuracy, also leads to large spatial correlations in the recorded EEG signals. Interestingly, these correlations can be harnessed using a novel information-theoretic "hierarchical referencing" technique that can reduce circuit energy and area to enable high-resolution high-density implementations.

[1]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[2]  Jan M. Rabaey,et al.  Physical principles for scalable neural recording , 2013, Front. Comput. Neurosci..

[3]  B. N. Cuffin,et al.  Experimental tests of EEG source localization accuracy in spherical head models , 2001, Clinical Neurophysiology.

[4]  Seppo P. Ahlfors,et al.  Sensitivity of MEG and EEG to Source Orientation , 2010, Brain Topography.

[5]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[6]  W. Freeman,et al.  Spatial spectra of scalp EEG and EMG from awake humans , 2003, Clinical Neurophysiology.

[7]  Yichong Xu,et al.  Novel Quantization Strategies for Linear Prediction with Guarantees , 2016 .

[8]  Xin Li,et al.  Energy-Constrained Distributed Learning and Classification by Exploiting Relative Relevance of Sensors’ Data , 2016, IEEE Journal on Selected Areas in Communications.

[9]  Power spectral density changes and language lateralization during covert object naming tasks measured with high-density EEG recordings , 2009, Epilepsy & Behavior.

[10]  Emery N. Brown,et al.  An Analysis of How Spatiotemporal Dynamic Models of Brain Activity Could Improve MEG/EEG Inverse Solutions , 2015, 1511.03726.

[11]  Rodney A. Kennedy,et al.  An Optimal-Dimensionality Sampling Scheme on the Sphere With Fast Spherical Harmonic Transforms , 2014, IEEE Transactions on Signal Processing.

[12]  Rey Ramírez,et al.  Source localization , 2008, Scholarpedia.

[13]  Sergio VerdÂ,et al.  Statistical Inference Under Multiterminal Data Compression , 2000 .

[14]  M. E. Spencer,et al.  Error bounds for EEG and MEG dipole source localization. , 1993, Electroencephalography and clinical neurophysiology.

[15]  Max Tegmark,et al.  An Icosahedron-based Method for Pixelizing the Celestial Sphere , 1996, The Astrophysical Journal.

[16]  Yuval Kochman,et al.  Achieving the Gaussian Rate-Distortion Function by Prediction , 2006, ISIT.

[17]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[18]  Sylvain Baillet Electromagnetic Brain Mapping Using MEG and EEG , 2011 .

[19]  Yves Wiaux,et al.  A Novel Sampling Theorem on the Sphere , 2011, IEEE Transactions on Signal Processing.

[20]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[21]  Todd P. Coleman,et al.  Dynamic and Succinct Statistical Analysis of Neuroscience Data , 2014, Proceedings of the IEEE.

[22]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[23]  Pulkit Grover,et al.  Is the direction of greater Granger causal influence the same as the direction of information flow? , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[24]  Klaus Scheffler,et al.  Differences Between MEG and High-Density EEG Source Localizations Using a Distributed Source Model in Comparison to fMRI , 2014, Brain Topography.

[25]  Xin Li,et al.  Using relative-relevance of data pieces for efficient communication, with an application to Neural data acquisition , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[26]  Seppo P. Ahlfors,et al.  Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates , 2006, NeuroImage.

[27]  Jihye Bae,et al.  Brain Source Imaging in Preclinical Rat Models of Focal Epilepsy using High-Resolution EEG Recordings , 2015, Journal of visualized experiments : JoVE.

[28]  Paul B. Colditz,et al.  Spatial patterning of the neonatal EEG suggests a need for a high number of electrodes , 2013, NeuroImage.

[29]  Pulkit Grover,et al.  Containing errors in computations for neural sensing: Does a hierarchical-referencing strategy lead to energy savings? , 2016, 2016 Information Theory and Applications Workshop (ITA).

[30]  R. Pascual-Marqui Review of methods for solving the EEG inverse problem , 1999 .

[31]  Toby Berger,et al.  The Degree of Suboptimality of Sending a Lossy Version of the Innovations Process in Gauss-Markov Rate-Distortion , 2006, 2006 IEEE International Symposium on Information Theory.

[32]  Brendan Z. Allison,et al.  Comparison of Dry and Gel Based Electrodes for P300 Brain–Computer Interfaces , 2012, Front. Neurosci..

[33]  A. Cayley A theorem on trees , 2009 .

[34]  Toby Berger,et al.  Sending a lossy version of the innovations process is suboptimal in QG rate-distortion , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[35]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[36]  Christopher Hughes,et al.  Ultra-dense EEG sampling results in two-fold increase of functional brain information , 2014, NeuroImage.

[37]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[38]  Brian R. Tietz,et al.  Deciding Which Way to Go: How Do Insects Alter Movements to Negotiate Barriers? , 2012, Front. Neurosci..

[39]  Pulkit Grover Ultra-high-density EEG: How many bits of resolution do the electrodes need? , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[40]  W. van Drongelen,et al.  Estimation of in vivo brain-to-skull conductivity ratio in humans. , 2006, Applied physics letters.

[41]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[42]  Ramesh Srinivasan,et al.  Estimating the spatial Nyquist of the human EEG , 1998 .

[43]  Petre Stoica,et al.  On biased estimators and the unbiased Cramér-Rao lower bound , 1990, Signal Process..

[44]  Christoph M. Michel,et al.  Epileptic source localization with high density EEG: how many electrodes are needed? , 2003, Clinical Neurophysiology.

[45]  P. V. van Rijen,et al.  Measurement of the Conductivity of Skull, Temporarily Removed During Epilepsy Surgery , 2004, Brain Topography.

[46]  Michael Hardy An Illuminating Counterexample , 2003, Am. Math. Mon..