A modular high-density μECoG system on macaque vlPFC for auditory cognitive decoding

OBJECTIVE A fundamental goal of the auditory system is to parse the auditory environment into distinct perceptual representations. Auditory perception is mediated by the ventral auditory pathway, which includes the ventrolateral prefrontal cortex (vlPFC). Because large-scale recordings of auditory signals are quite rare, the spatiotemporal resolution of the neuronal code that underlies vlPFC's contribution to auditory perception has not been fully elucidated. Therefore, we developed a modular, chronic, high-resolution, multi-electrode array system with long-term viability in order to identify the information that could be decoded from μECoG vlPFC signals. APPROACH We molded three separate μECoG arrays into one and implanted this system in a non-human primate. A custom 3D-printed titanium chamber was mounted on the left hemisphere. The molded 294-contact μECoG array was implanted subdurally over vlPFC. μECoG activity was recorded while the monkey participated in a "hearing-in-noise" task in which they reported hearing a "target" vocalization from a background "chorus" of vocalizations. We titrated task difficulty by varying the sound level of the target vocalization, relative to the chorus (target-to-chorus ratio, TCr). MAIN RESULTS We decoded the TCr and the monkey's behavioral choices from the μECoG signal. We analyzed decoding accuracy as a function of number of electrodes, spatial resolution, and time from implantation. Over a one-year period, we found significant decoding with individual electrodes that increased significantly as we decoded simultaneously more electrodes. Further, we found that the decoding for behavioral choice was better than the decoding of TCr. Finally, because the decoding accuracy of individual electrodes varied on a day-by-day basis, electrode arrays with high channel counts ensure robust decoding in the long term. SIGNIFICANCE Our results demonstrate the utility of high-resolution and high-channel-count, chronic µECoG recording. We developed a surface electrode array that can be scaled to cover larger cortical areas without increasing the chamber footprint.

[1]  Bijan Pesaran,et al.  Semi-chronic chamber system for simultaneous subdural electrocorticography, local field potentials, and spike recordings , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[2]  J. Maunsell,et al.  A Neuronal Population Measure of Attention Predicts Behavioral Performance on Individual Trials , 2010, The Journal of Neuroscience.

[3]  H. Carl Gerhardt,et al.  Female green treefrogs (Hyla cinerea) do not selectively respond to signals with a harmonic structure in noise , 1990, Journal of Comparative Physiology A.

[4]  Y. Cohen,et al.  Representation of speech categories in the primate auditory cortex. , 2011, Journal of neurophysiology.

[5]  Houman Safaai,et al.  Coordinated Population Activity Underlying Texture Discrimination in Rat Barrel Cortex , 2013, The Journal of Neuroscience.

[6]  R. Oostenveld,et al.  A MEMS-based flexible multichannel ECoG-electrode array , 2009, Journal of neural engineering.

[7]  R Plomp,et al.  Effect of multiple speechlike maskers on binaural speech recognition in normal and impaired hearing. , 1992, The Journal of the Acoustical Society of America.

[8]  Spencer Kellis,et al.  Multi-scale analysis of neural activity in humans: Implications for micro-scale electrocorticography , 2016, Clinical Neurophysiology.

[9]  A. Oxenham Pitch Perception and Auditory Stream Segregation: Implications for Hearing Loss and Cochlear Implants , 2008, Trends in amplification.

[10]  Yale E Cohen,et al.  Contribution of spiking activity in the primary auditory cortex to detection in noise. , 2017, Journal of neurophysiology.

[11]  Albert S. Bregman,et al.  Effects of time intervals and tone durations on auditory stream segregation , 2000, Perception & psychophysics.

[12]  S. Rosen,et al.  Uncomodulated glimpsing in "checkerboard" noise. , 1993, The Journal of the Acoustical Society of America.

[13]  Brian Litt,et al.  Flexible, Foldable, Actively Multiplexed, High-Density Electrode Array for Mapping Brain Activity in vivo , 2011, Nature Neuroscience.

[14]  R. M. McAndrew,et al.  Individualized recording chambers for non-human primate neurophysiology , 2012, Journal of Neuroscience Methods.

[15]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[16]  Li Min Chen,et al.  IMAGING IN , 2022 .

[17]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[18]  Y. Cohen,et al.  Neural and behavioral correlates of auditory categorization , 2007, Hearing Research.

[19]  S. H. Hulse,et al.  Auditory scene analysis by songbirds: stream segregation of birdsong by European starlings (Sturnus vulgaris). , 1997, Journal of comparative psychology.

[20]  James J. DiCarlo,et al.  Balanced Increases in Selectivity and Tolerance Produce Constant Sparseness along the Ventral Visual Stream , 2012, The Journal of Neuroscience.

[21]  I. Nelken,et al.  Single neuron and population coding of natural sounds in auditory cortex , 2014, Current Opinion in Neurobiology.

[22]  Yale E. Cohen,et al.  Recent refinements to cranial implants for rhesus macaques (Macaca mulatta) , 2016, Lab Animal.

[23]  D. M. Green,et al.  A panoramic code for sound location by cortical neurons. , 1994, Science.

[24]  Yale E. Cohen,et al.  Natural variability in species-specific vocalizations constrains behavior and neural activity , 2014, Hearing Research.

[25]  Masato Inoue,et al.  High Spatiotemporal Resolution ECoG Recording of Somatosensory Evoked Potentials with Flexible Micro-Electrode Arrays , 2017, Front. Neural Circuits.

[26]  Yale E Cohen,et al.  Acoustic features of rhesus vocalizations and their representation in the ventrolateral prefrontal cortex. , 2007, Journal of neurophysiology.

[27]  S. Cash,et al.  Long-term treatment with responsive brain stimulation in adults with refractory partial seizures , 2015, Neurology.

[28]  John C. Middlebrooks,et al.  Distributed coding of sound locations in the auditory cortex , 2003, Biological Cybernetics.

[29]  Michael Petrides,et al.  Frameless stereotaxy in the nonhuman primate , 2004, NeuroImage.

[30]  M. Chait,et al.  Neural Correlates of Auditory Figure-Ground Segregation Based on Temporal Coherence , 2016, Cerebral cortex.

[31]  Yale E Cohen,et al.  Modulation of LIP activity by predictive auditory and visual cues. , 2004, Cerebral cortex.

[32]  Mamiko Niwa,et al.  Task Engagement Selectively Modulates Neural Correlations in Primary Auditory Cortex , 2015, The Journal of Neuroscience.

[33]  M. Kilgard,et al.  Cortical activity patterns predict speech discrimination ability , 2008, Nature Neuroscience.

[34]  M. Maharbiz,et al.  Fabrication and testing of a large area, high density, parylene MEMS µECoG array , 2011, 2011 IEEE 24th International Conference on Micro Electro Mechanical Systems.

[35]  Josef P Rauschecker,et al.  Neural Encoding and Retrieval of Sound Sequences , 2005, Annals of the New York Academy of Sciences.

[36]  J.A. Wilson,et al.  A cortical recording platform utilizing μECoG electrode arrays , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Virginia Best,et al.  Cortical interference effects in the cocktail party problem , 2007, Nature Neuroscience.

[38]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[39]  J. C. Middlebrooks,et al.  Sensitivity to sound-source elevation in nontonotopic auditory cortex. , 1998, Journal of neurophysiology.

[40]  Isaac M. Carruthers,et al.  Emergence of invariant representation of vocalizations in the auditory cortex. , 2015, Journal of neurophysiology.

[41]  Yale E Cohen,et al.  Coding of auditory-stimulus identity in the auditory non-spatial processing stream. , 2008, Journal of neurophysiology.

[42]  Y. Cohen,et al.  The what, where and how of auditory-object perception , 2013, Nature Reviews Neuroscience.

[43]  T. Parrish,et al.  Cortical mechanisms of speech perception in noise. , 2008, Journal of speech, language, and hearing research : JSLHR.

[44]  G. Recanzone,et al.  Serial and parallel processing in the primate auditory cortex revisited , 2010, Behavioural Brain Research.

[45]  Mitchell Steinschneider,et al.  Neural Representation of Concurrent Vowels in Macaque Primary Auditory Cortex123 , 2016, eNeuro.

[46]  Virginia Woods,et al.  A low-cost, multiplexed μECoG system for high-density recordings in freely moving rodents , 2016, Journal of neural engineering.

[47]  C. Schroeder,et al.  Tuning of the Human Neocortex to the Temporal Dynamics of Attended Events , 2011, The Journal of Neuroscience.

[48]  P. Goldman-Rakic,et al.  An auditory domain in primate prefrontal cortex , 2002, Nature Neuroscience.

[49]  G. Buzsáki,et al.  NeuroGrid: recording action potentials from the surface of the brain , 2014, Nature Neuroscience.

[50]  Greg Worrell,et al.  Long-Term Measurement of Impedance in Chronically Implanted Depth and Subdural Electrodes During Responsive Neurostimulation in Humans , 2013, Brain Stimulation.

[51]  Sarah M. N. Woolley,et al.  Sparse and Background-Invariant Coding of Vocalizations in Auditory Scenes , 2013, Neuron.

[52]  Jialin Zou,et al.  A low-cost, scalable, current-sensing digital headstage for high channel count μECoG , 2017, Journal of neural engineering.

[53]  Israel Nelken,et al.  The Effects of Background Noise on the Neural Responses to Natural Sounds in Cat Primary Auditory Cortex , 2007, Frontiers Comput. Neurosci..

[54]  Shay Ohayon,et al.  Open Ephys: an open-source, plugin-based platform for multichannel electrophysiology , 2017, Journal of neural engineering.

[55]  Stephen G Lisberger,et al.  Relationship between adapted neural population responses in MT and motion adaptation in speed and direction of smooth-pursuit eye movements. , 2009, Journal of neurophysiology.

[56]  Brian E. Russ,et al.  A functional role for the ventrolateral prefrontal cortex in non-spatial auditory cognition , 2009, Proceedings of the National Academy of Sciences.

[57]  Christoph E Schreiner,et al.  Effects of Signal-to-Noise Ratio on Auditory Cortical Frequency Processing , 2016, The Journal of Neuroscience.

[58]  J. C. Middlebrooks,et al.  Codes for sound-source location in nontonotopic auditory cortex. , 1998, Journal of neurophysiology.

[59]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[60]  R A Normann,et al.  The Utah intracortical Electrode Array: a recording structure for potential brain-computer interfaces. , 1997, Electroencephalography and clinical neurophysiology.

[61]  B. A. Hollenberg,et al.  A MEMS fabricated flexible electrode array for recording surface field potentials , 2006, Journal of Neuroscience Methods.

[62]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[63]  K. Molina-Luna,et al.  Cortical stimulation mapping using epidurally implanted thin-film microelectrode arrays , 2007, Journal of Neuroscience Methods.

[64]  Pieter R. Roelfsema,et al.  3D printing and modelling of customized implants and surgical guides for non-human primates , 2017, Journal of Neuroscience Methods.

[65]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[66]  Nicole C. Rust,et al.  Signals in inferotemporal and perirhinal cortex suggest an “untangling” of visual target information , 2013, Nature Neuroscience.

[67]  D. L. Adams,et al.  A biocompatible titanium headpost for stabilizing behaving monkeys. , 2007, Journal of neurophysiology.

[68]  J. Gold,et al.  Post-decision processing in primate prefrontal cortex influences subsequent choices on an auditory decision-making task , 2019, bioRxiv.

[69]  Mamiko Niwa,et al.  Hierarchical differences in population coding within auditory cortex. , 2017, Journal of neurophysiology.

[70]  Sophie K. Scott,et al.  The neural processing of masked speech , 2013, Hearing Research.

[71]  Robert H. Pierzycki,et al.  Relation between Speech-in-Noise Threshold, Hearing Loss and Cognition from 40–69 Years of Age , 2014, PloS one.

[72]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[73]  Yonggang Huang,et al.  A high-density, high-channel count, multiplexed μECoG array for auditory-cortex recordings. , 2014, Journal of neurophysiology.

[74]  Hui Fang,et al.  Development of a neural interface for high-definition, long-term recording in rodents and nonhuman primates , 2020, Science Translational Medicine.

[75]  Lee M. Miller,et al.  Populations of auditory cortical neurons can accurately encode acoustic space across stimulus intensity , 2009, Proceedings of the National Academy of Sciences.

[76]  Rok Blagus,et al.  Class prediction for high-dimensional class-imbalanced data , 2010, BMC Bioinformatics.

[77]  Robert Desimone,et al.  Custom-fit radiolucent cranial implants for neurophysiological recording and stimulation , 2014, Journal of Neuroscience Methods.

[78]  Josh H. McDermott The cocktail party problem , 2009, Current Biology.

[79]  Virginia Woods,et al.  Long-term recording reliability of liquid crystal polymer µECoG arrays , 2018, Journal of neural engineering.

[80]  Charles M Gray,et al.  Multichannel micromanipulator and chamber system for recording multineuronal activity in alert, non-human primates. , 2007, Journal of neurophysiology.

[81]  Yale E Cohen,et al.  Selectivity for the Spatial and Nonspatial Attributes of Auditory Stimuli in the Ventrolateral Prefrontal Cortex , 2004, The Journal of Neuroscience.

[82]  E. C. Cherry Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[83]  Robin A. A. Ince,et al.  Neural Codes Formed by Small and Temporally Precise Populations in Auditory Cortex , 2013, The Journal of Neuroscience.

[84]  M. Kilgard,et al.  Cortical activity patterns predict robust speech discrimination ability in noise , 2011, The European journal of neuroscience.

[85]  M. Hauser,et al.  Functional referents and acoustic similarity: field playback experiments with rhesus monkeys , 1998, Animal Behaviour.

[86]  Brian E. Russ,et al.  Prefrontal Activity Predicts Monkeys' Decisions During an Auditory Category Task , 2009, Front. Integr. Neurosci..

[87]  Brian E. Russ,et al.  Prefrontal Neurons Predict Choices during an Auditory Same-Different Task , 2008, Current Biology.

[88]  Bruno B Averbeck,et al.  Probabilistic Encoding of Vocalizations in Macaque Ventral Lateral Prefrontal Cortex , 2006, The Journal of Neuroscience.

[89]  David M Rector,et al.  Hemispheric mapping of secondary somatosensory cortex in the rat. , 2007, Journal of neurophysiology.

[90]  Lizabeth M. Romanski,et al.  Coding of vocalizations by single neurons in ventrolateral prefrontal cortex , 2013, Hearing Research.

[91]  G. Buzsáki,et al.  Organic electronics for high-resolution electrocorticography of the human brain , 2016, Science Advances.

[92]  M. Sahani,et al.  State-Dependent Population Coding in Primary Auditory Cortex , 2015, The Journal of Neuroscience.

[93]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[94]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[95]  Marc D. Hauser,et al.  The Neurophysiology of Functionally Meaningful Categories: Macaque Ventrolateral Prefrontal Cortex Plays a Critical Role in Spontaneous Categorization of Species-Specific Vocalizations , 2005, Journal of Cognitive Neuroscience.

[96]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[97]  Yale E Cohen,et al.  Effect of a central fixation light on auditory spatial responses in area LIP. , 2004, Journal of neurophysiology.

[98]  Israel Nelken,et al.  Responses of auditory-cortex neurons to structural features of natural sounds , 1999, Nature.