Informative Neural Codes to Separate Object Categories

In order to develop object recognition algorithms, which can approach human-level recognition performance, researchers have been studying how the human brain performs recognition in the past five decades. This has already in-spired AI-based object recognition algorithms, such as convolutional neural networks, which are among the most successful object recognition platforms today and can approach human performance in specific tasks. However, it is not yet clearly known how recorded brain activations convey information about object category processing. One main obstacle has been the lack of large feature sets, to evaluate the information contents of multiple aspects of neural activations. Here, we compared the information contents of a large set of 25 features, extracted from time series of electroencephalography (EEG) recorded from human participants doing an object recognition task. We could characterize the most informative aspects of brain activations about object categories. Among the evaluated features, event-related potential (ERP) components of N1 and P2a were among the most informative features with the highest information in the Theta frequency bands. Upon limiting the analysis time window, we observed more information for features detecting temporally informative patterns in the signals. The results of this study can constrain previous theories about how the brain codes object category information.

[1]  Bakhshi Sara,et al.  Cognitive Flexibility, Attention and Speed of Mental Processing in Opioid and Methamphetamine Addicts in Comparison with Non-Addicts , 2011 .

[2]  Hamid Karimi-Rouzbahani,et al.  Three-stage processing of category and variation information by entangled interactive mechanisms of peri-occipital and peri-frontal cortices , 2018, Scientific Reports.

[3]  A. Norcia,et al.  A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification , 2015, PloS one.

[4]  Abbas Erfanian,et al.  Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces Using PCA and High-Order Statistics , 2009 .

[5]  Ian Palmer,et al.  Why Are Face and Object Processing Segregated in the Human Brain? Testing Computational Hypotheses with Deep Convolutional Neural Networks , 2019, 2019 Conference on Cognitive Computational Neuroscience.

[6]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[7]  Matthias Niemeier,et al.  The Neural Dynamics of Facial Identity Processing: Insights from EEG-Based Pattern Analysis and Image Reconstruction , 2018, eNeuro.

[8]  H. Kennedy,et al.  Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels , 2014, Neuron.

[9]  Li Yao,et al.  Combining features from ERP components in single-trial EEG for discriminating four-category visual objects , 2012, Journal of neural engineering.

[10]  Nikolaus Kriegeskorte,et al.  Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation , 2014, PLoS Comput. Biol..

[11]  Timothée Masquelier,et al.  Humans and Deep Networks Largely Agree on Which Kinds of Variation Make Object Recognition Harder , 2016, Front. Comput. Neurosci..

[12]  Connor J. Parde,et al.  Face Space Representations in Deep Convolutional Neural Networks , 2018, Trends in Cognitive Sciences.

[13]  C. Buss,et al.  Children's Brain Development Benefits from Longer Gestation , 2011, Front. Psychology.

[14]  Roman Racine.  Estimating the Hurst Exponent , 2011 .

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Mohammad Reza Daliri,et al.  EEG phase patterns reflect the representation of semantic categories of objects , 2015, Medical & Biological Engineering & Computing.

[17]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  L. Levin,et al.  Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps , 2015, PloS one.

[19]  Anina N. Rich,et al.  Perceptual difficulty modulates the direction of information flow in familiar face recognition , 2020, NeuroImage.

[20]  S. Guzzetti,et al.  Physiological time-series analysis using approximate entropy and sample entropy , 2000 .

[21]  Nasour Bagheri,et al.  Average activity, but not variability, is the dominant factor in the representation of object categories in the brain , 2017, Neuroscience.

[22]  Chris I. Baker,et al.  Deconstructing multivariate decoding for the study of brain function , 2017, NeuroImage.

[23]  Mohammad Bagher Menhaj,et al.  Spatiotemporal analysis of category and target-related information processing in the brain during object detection , 2018, Behavioural Brain Research.

[24]  Hamidreza Namazi,et al.  Complexity Based Analysis of the Correlation between External Stimuli and Bio Signals , 2018 .

[25]  Guillaume A. Rousselet,et al.  Quantifying the Time Course of Visual Object Processing Using ERPs: It's Time to Up the Game , 2011, Front. Psychology.

[26]  M. Daliri,et al.  Diagnosis of Parkinson's disease in human using voice signals , 2011 .

[27]  Deepak Joshi,et al.  Classification of Targets and Distractors Present in Visual Hemifields Using Time-Frequency Domain EEG Features , 2018, Journal of healthcare engineering.

[28]  Anina N. Rich,et al.  Neural signatures of vigilance decrements predict behavioural errors before they occur , 2020, bioRxiv.

[29]  K. R. Ridderinkhof,et al.  No Evidence That Frontal Eye Field tDCS Affects Latency or Accuracy of Prosaccades , 2018, bioRxiv.

[30]  Mohammad Reza Daliri,et al.  Decoding Objects of Basic Categories from Electroencephalographic Signals Using Wavelet Transform and Support Vector Machines , 2014, Brain Topography.

[31]  Anina N. Rich,et al.  Neural signatures of vigilance decrements predict behavioural errors before they occur , 2020, bioRxiv.

[32]  Sanne ten Oever,et al.  Coarse-to-fine information integration in human vision , 2019, NeuroImage.

[33]  Armita Faghani Jadidi,et al.  Categorizing visual objects; using ERP components , 2016, 2016 23rd Iranian Conference on Biomedical Engineering and 2016 1st International Iranian Conference on Biomedical Engineering (ICBME).

[34]  Nobuhito Saito,et al.  Decoding visual object categories from temporal correlations of ECoG signals , 2014, NeuroImage.

[35]  C. Stam,et al.  Nonlinear dynamical analysis of EEG and MEG: Review of an emerging field , 2005, Clinical Neurophysiology.

[36]  Alona Fyshe,et al.  Improved object recognition using neural networks trained to mimic the brain's statistical properties , 2020, Neural Networks.

[37]  Christopher R. Ratto,et al.  Semantic attributes are encoded in human electrocorticographic signals during visual object recognition , 2017, NeuroImage.

[38]  Sydney S. Cash,et al.  Decoding word and category-specific spatiotemporal representations from MEG and EEG , 2011, NeuroImage.

[39]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[40]  Kei Majima,et al.  Heterogeneous Redistribution of Facial Subcategory Information Within and Outside the Face-Selective Domain in Primate Inferior Temporal Cortex , 2018, Cerebral cortex.

[41]  Mohamed H. Zaki,et al.  Fast CNN-Based Object Tracking Using Localization Layers and Deep Features Interpolation , 2019, 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC).

[42]  Nasour Bagheri,et al.  Hard-wired feed-forward visual mechanisms of the brain compensate for affine variations in object recognition , 2017, Neuroscience.

[43]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[44]  Keiji Tanaka,et al.  Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. , 2007, Journal of neurophysiology.

[45]  Mohammad Reza Daliri,et al.  Semantic Category-Based Classification Using Nonlinear Features and Wavelet Coefficients of Brain Signals , 2017, Cognitive Computation.

[46]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[47]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[48]  Nasour Bagheri,et al.  Invariant object recognition is a personalized selection of invariant features in humans, not simply explained by hierarchical feed-forward vision models , 2017, Scientific Reports.

[49]  Yuguo Yu,et al.  Decoding English Alphabet Letters Using EEG Phase Information , 2018, Front. Neurosci..