Decoding Hidden Cognitive States From Behavior and Physiology Using a Bayesian Approach

Cognitive processes, such as learning and cognitive flexibility, are both difficult to measure and to sample continuously using objective tools because cognitive processes arise from distributed, high-dimensional neural activity. For both research and clinical applications, that dimensionality must be reduced. To reduce dimensionality and measure underlying cognitive processes, we propose a modeling framework in which a cognitive process is defined as a low-dimensional dynamical latent variable—called a cognitive state, which links high-dimensional neural recordings and multidimensional behavioral readouts. This framework allows us to decompose the hard problem of modeling the relationship between neural and behavioral data into separable encoding-decoding approaches. We first use a state-space modeling framework, the behavioral decoder, to articulate the relationship between an objective behavioral readout (e.g., response times) and cognitive state. The second step, the neural encoder, involves using a generalized linear model (GLM) to identify the relationship between the cognitive state and neural signals, such as local field potential (LFP). We then use the neural encoder model and a Bayesian filter to estimate cognitive state using neural data (LFP power) to generate the neural decoder. We provide goodness-of-fit analysis and model selection criteria in support of the encoding-decoding result. We apply this framework to estimate an underlying cognitive state from neural data in human participants (N=8) performing a cognitive conflict task. We successfully estimated the cognitive state within the 95% confidence intervals of that estimated using behavior readout for an average of 90% of task trials across participants. In contrast to previous encoder-decoder models, our proposed modeling framework incorporates LFP spectral power to encode and decode a cognitive state. The framework allowed us to capture the temporal evolution of the underlying cognitive processes, which could be key to the development of closed-loop experiments and treatments.

[1]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[2]  Emery N. Brown,et al.  Estimating a dynamic state to relate neural spiking activity to behavioral signals during cognitive tasks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  B. Gold,et al.  Common and Distinct Mechanisms of Cognitive Flexibility in Prefrontal Cortex , 2011, The Journal of Neuroscience.

[4]  D. G. Weeks,et al.  Linear structural equations with latent variables , 1980 .

[5]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[6]  K. Shenoy,et al.  Neural Population Dynamics Underlying Motor Learning Transfer , 2018, Neuron.

[7]  Edward I. George,et al.  The Practical Implementation of Bayesian Model Selection , 2001 .

[8]  Rob J Hyndman,et al.  Computing and Graphing Highest Density Regions , 1996 .

[9]  L. Miller,et al.  Accurate decoding of reaching movements from field potentials in the absence of spikes , 2012, Journal of neural engineering.

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  Alan J. Miller Subset Selection in Regression , 1992 .

[12]  M. Nicolelis,et al.  Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. , 2017, Physiological reviews.

[13]  Shinichi Nakagawa A farewell to Bonferroni: the problems of low statistical power and publication bias , 2004, Behavioral Ecology.

[14]  S. Rabe-Hesketh,et al.  Latent Variable Modelling: A Survey * , 2007 .

[15]  G. Bush,et al.  The Multi-Source Interference Task: an fMRI task that reliably activates the cingulo-frontal-parietal cognitive/attention network , 2006, Nature Protocols.

[16]  Miguel A. L. Nicolelis,et al.  Adaptive Decoding for Brain-Machine Interfaces Through Bayesian Parameter Updates , 2011, Neural Computation.

[17]  Emery N. Brown,et al.  A mixed filter algorithm for cognitive state estimation from simultaneously recorded continuous and binary measures of performance , 2008, Biological Cybernetics.

[18]  J. R. Koehler,et al.  Modern Applied Statistics with S-Plus. , 1996 .

[19]  Jonathon Shlens,et al.  Notes on Generalized Linear Models of Neurons , 2014, ArXiv.

[20]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[21]  T. Egner,et al.  Dissociable neural systems resolve conflict from emotional versus nonemotional distracters. , 2008, Cerebral cortex.

[22]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.

[23]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[24]  Emery N Brown,et al.  Dynamic Analysis of Learning in Behavioral Experiments , 2004, The Journal of Neuroscience.

[25]  G. Schöner The Cambridge Handbook of Computational Psychology: Dynamical Systems Approaches to Cognition , 2008 .

[26]  Robert E. Kass,et al.  A Spike-Train Probability Model , 2001, Neural Computation.

[27]  K. Vahala Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[28]  Joseph R. Madsen,et al.  Individualized localization and cortical surface-based registration of intracranial electrodes , 2012, NeuroImage.

[29]  Olaf Sporns,et al.  Communication dynamics in complex brain networks , 2017, Nature Reviews Neuroscience.

[30]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[31]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[32]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[33]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[34]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[35]  T. Egner Creatures of habit (and control): a multi-level learning perspective on the modulation of congruency effects , 2014, Front. Psychol..

[36]  Ajay B. Satpute,et al.  Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain , 2013, Current Opinion in Neurobiology.

[37]  John P. Cunningham,et al.  Single-trial dynamics of motor cortex and their applications to brain-machine interfaces , 2015, Nature Communications.

[38]  Chethan Pandarinath,et al.  Cortical control of a tablet computer by people with paralysis , 2018, PloS one.

[39]  M. Quirk,et al.  Construction and analysis of non-Poisson stimulus-response models of neural spiking activity , 2001, Journal of Neuroscience Methods.

[40]  Fredrik Lindsten,et al.  Backward Simulation Methods for Monte Carlo Statistical Inference , 2013, Found. Trends Mach. Learn..

[41]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[42]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[43]  Sarah M. N. Woolley,et al.  A Generalized Linear Model for Estimating Spectrotemporal Receptive Fields from Responses to Natural Sounds , 2011, PloS one.

[44]  A. M. F. L. M. de Sá,et al.  A note on the sampling distribution of coherence estimate for the detection of periodic signals , 2004, IEEE Signal Process. Lett..

[45]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[46]  M. Carrillo-de-la-Peña,et al.  Brain electrical activity signatures during performance of the Multisource Interference Task. , 2017, Psychophysiology.

[47]  Brian J. Fischer,et al.  Owl's behavior and neural representation predicted by Bayesian inference , 2011, Nature Neuroscience.

[48]  Wei Wu,et al.  Neural Decoding of Hand Motion Using a Linear State-Space Model With Hidden States , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  J. Detre,et al.  Perfusion functional MRI reveals cerebral blood flow pattern under psychological stress. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[50]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[51]  R. Wilcox Kolmogorov–Smirnov Test , 2005 .

[52]  Emery N Brown,et al.  Behavioral and neurophysiological analyses of dynamic learning processes. , 2005, Behavioral and cognitive neuroscience reviews.

[53]  J. Loehlin Latent variable models , 1987 .

[54]  B R Rosen,et al.  The Multi-Source Interference Task: validation study with fMRI in individual subjects , 2003, Molecular Psychiatry.

[55]  J. E. Korteling,et al.  Using neurophysiological signals that reflect cognitive or affective state: six recommendations to avoid common pitfalls , 2015, Front. Neurosci..

[56]  Russell A. Poldrack,et al.  The low dimensional dynamic and integrative core of cognition in the human brain , 2018 .

[57]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[58]  Nils Lid Hjort,et al.  Model Selection and Model Averaging: Contents , 2008 .

[59]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[60]  M. D’Esposito,et al.  A Trial-Based Experimental Design for fMRI , 1997, NeuroImage.

[61]  Mehdi Aghagolzadeh,et al.  Inference and Decoding of Motor Cortex Low-Dimensional Dynamics via Latent State-Space Models , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[62]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[63]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[64]  Bruce Fischl,et al.  Highly accurate inverse consistent registration: A robust approach , 2010, NeuroImage.

[65]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[66]  R. Tibshirani,et al.  A note on the group lasso and a sparse group lasso , 2010, 1001.0736.

[67]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[68]  Cun-Hui Zhang,et al.  A group bridge approach for variable selection , 2009, Biometrika.

[69]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[70]  R. Poldrack Inferring Mental States from Neuroimaging Data: From Reverse Inference to Large-Scale Decoding , 2011, Neuron.

[71]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[72]  S. Bressler,et al.  Large-scale brain networks in cognition: emerging methods and principles , 2010, Trends in Cognitive Sciences.

[73]  Sridevi V. Sarma,et al.  Characterizing Complex Human Behaviors and Neural Responses Using Dynamic Models , 2018 .

[74]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[75]  Jonathan D. Cohen,et al.  Anterior Cingulate Cortex, Conflict Monitoring, and Levels of Processing , 2001, NeuroImage.

[76]  R. Knight,et al.  Dynamic Network Communication as a Unifying Neural Basis for Cognition, Development, Aging, and Disease , 2015, Biological Psychiatry.

[77]  J R Simon,et al.  Effect of conflicting cues on information processing: the 'Stroop effect' vs. the 'Simon effect'. , 1990, Acta psychologica.

[78]  G. Deco,et al.  Emerging concepts for the dynamical organization of resting-state activity in the brain , 2010, Nature Reviews Neuroscience.

[79]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[80]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[81]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[82]  Michael X Cohen,et al.  Analyzing Neural Time Series Data: Theory and Practice , 2014 .

[83]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[84]  R. Kass,et al.  Bayesian decoding of neural spike trains , 2010 .

[85]  Konrad P. Körding,et al.  The Development and Analysis of Integrated Neuroscience Data , 2016, Front. Comput. Neurosci..

[86]  R. Senf Tactics of Scientific Research: Evaluating Experimental Data in Psychology , 1962 .

[87]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.

[88]  Ishita Basu,et al.  COMPASS: An Open-Source, General-Purpose Software Toolkit for Computational Psychiatry , 2018, bioRxiv.

[89]  Michael J. Jutras,et al.  Direct Brain Stimulation Modulates Encoding States and Memory Performance in Humans , 2017, Current Biology.

[90]  Hiroaki Hara A relation between non-Markov and Markov processes , 1980 .

[91]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[92]  M. Kramer,et al.  Treating refractory mental illness with closed-loop brain stimulation: Progress towards a patient-specific transdiagnostic approach , 2017, Experimental Neurology.

[93]  Emad N. Eskandar,et al.  Cognitive state prediction using an EM algorithm applied to Gamma distributed data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[94]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[95]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[96]  Jonathan W. Pillow,et al.  Likelihood-based approaches to modeling the neural code , 2007 .

[97]  Wei Wu,et al.  Neural Decoding of Cursor Motion Using a Kalman Filter , 2002, NIPS.

[98]  Birte U. Forstmann,et al.  A Bayesian framework for simultaneously modeling neural and behavioral data , 2013, NeuroImage.

[99]  R. Davidson,et al.  Dysfunction in the neural circuitry of emotion regulation--a possible prelude to violence. , 2000, Science.

[100]  E. Perret The left frontal lobe of man and the suppression of habitual responses in verbal categorical behaviour. , 1974, Neuropsychologia.

[101]  D. Bassett,et al.  Dynamic reconfiguration of frontal brain networks during executive cognition in humans , 2015, Proceedings of the National Academy of Sciences.

[102]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[103]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[104]  Robert E. Hampson,et al.  A cognitive prosthesis for memory facilitation by closed-loop functional ensemble stimulation of hippocampal neurons in primate brain , 2017, Experimental Neurology.

[105]  Fabian Kloosterman,et al.  Bayesian decoding using unsorted spikes in the rat hippocampus. , 2014, Journal of neurophysiology.

[106]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[107]  Yuxiao Yang,et al.  Mood variations decoded from multi-site intracranial human brain activity , 2018, Nature Biotechnology.

[108]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[109]  Jan-Mathijs Schoffelen,et al.  A Tutorial Review of Functional Connectivity Analysis Methods and Their Interpretational Pitfalls , 2016, Front. Syst. Neurosci..

[110]  A. Alexander Beaujean,et al.  Path Models in Factor, Path, and Structural Equation Analysis , 2016 .

[111]  Thomas E. Nichols,et al.  Anterior cingulate gyrus dysfunction and selective attention deficits in schizophrenia: [15O]H2O PET study during single-trial Stroop task performance. , 1997, The American journal of psychiatry.

[112]  Emery N. Brown,et al.  The BRAIN Initiative: developing technology to catalyse neuroscience discovery , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[113]  Sheikh Shanawaz Mostafa,et al.  Mental states estimation with the variation of physiological signals , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[114]  Emad N. Eskandar,et al.  Multimodal Encoding of Novelty, Reward, and Learning in the Primate Nucleus Basalis of Meynert , 2018, The Journal of Neuroscience.

[115]  Shaun R. Patel,et al.  Human Dorsal Anterior Cingulate Cortex Neurons Mediate Ongoing Behavioral Adaptation , 2012, Nature.