Visual Feature Extraction From Voxel-Weighted Averaging of Stimulus Images in 2 fMRI Studies

Multiple studies have provided evidence for distributed object representation in the brain, with several recent experiments leveraging basis function estimates for partial image reconstruction from fMRI data. Using a novel combination of statistical decomposition, generalized linear models, and stimulus averaging on previously examined image sets and Bayesian regression of recorded fMRI activity during presentation of these data sets, we identify a subset of relevant voxels that appear to code for covarying object features. Using a technique we term “voxel-weighted averaging,” we isolate image filters that these voxels appear to implement. The results, though very cursory, appear to have significant implications for hierarchical and deep-learning-type approaches toward the understanding of neural coding and representation.

[1]  Yukiyasu Kamitani,et al.  Estimating image bases for visual image reconstruction from human brain activity , 2009, NIPS.

[2]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Manel Martínez-Ramón,et al.  fMRI pattern classification using neuroanatomically constrained boosting , 2006, NeuroImage.

[4]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[5]  Sadato Norihiro,et al.  Visual image reconstruction from human brain activity , 2009 .

[6]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[7]  K. H. Britten,et al.  Contrast dependence of response normalization in area MT of the rhesus macaque. , 2002, Journal of neurophysiology.

[8]  J. Gallant,et al.  Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies , 2011, Current Biology.

[9]  D. Pitcher,et al.  The role of the occipital face area in the cortical face perception network , 2011, Experimental Brain Research.

[10]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[11]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[12]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[13]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  Vince D. Calhoun,et al.  CCA for joint blind source separation of multiple datasets with application to group FMRI analysis , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Bryan R. Conroy,et al.  A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex , 2011, Neuron.

[16]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[17]  Alois Schlögl A new linear classification method for an EEG-based Brain-Computer Interface , 2004 .

[18]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[19]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[20]  Jiquan Ngiam,et al.  Sparse Filtering , 2011, NIPS.

[21]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.