Second Order Scattering Descriptors Predict fMRI Activity Due to Visual Textures

Second layer scattering descriptors are known to provide good classification performance on natural quasi-stationary processes such as visual textures due to their sensitivity to higher order moments and continuity with respect to small deformations. In a functional Magnetic Resonance Imaging (fMRI) experiment we present visual textures to subjects and evaluate the predictive power of these descriptors with respect to the predictive power of simple contour energy - the first scattering layer. We are able to conclude not only that invariant second layer scattering coefficients better encode voxel activity, but also that well predicted voxels need not necessarily lie in known retinotopic regions.

[1]  Maxim Zaitsev,et al.  Combining prospective motion correction and distortion correction for EPI: towards a comprehensive correction of motion and susceptibility-induced artifacts , 2010, Magnetic Resonance Materials in Physics, Biology and Medicine.

[2]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Lorenzo Rosasco,et al.  Learning Manifolds with K-Means and K-Flats , 2012, NIPS.

[4]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Stéphane Mallat,et al.  Classification with scattering operators , 2010, CVPR 2011.

[6]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[7]  Russell A. Poldrack,et al.  Spatiotemporal activity estimation for multivoxel pattern analysis with rapid event-related designs , 2012, NeuroImage.

[8]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[9]  Stéphane Mallat,et al.  Group Invariant Scattering , 2011, ArXiv.

[10]  Stéphane Mallat,et al.  Combined scattering for rotation invariant texture analysis , 2012, ESANN.

[11]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.

[12]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[13]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[14]  Vincent Lepetit,et al.  A fast local descriptor for dense matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Michael Eickenberg,et al.  HRF Estimation Improves Sensitivity of fMRI Encoding and Decoding Models , 2013, 2013 International Workshop on Pattern Recognition in Neuroimaging.

[16]  Michael Eickenberg,et al.  Multilayer Scattering Image Analysis Fits fMRI Activity in Visual Areas , 2012, 2012 Second International Workshop on Pattern Recognition in NeuroImaging.