Convolutional spike-triggered covariance analysis for neural subunit models

Subunit models provide a powerful yet parsimonious description of neural responses to complex stimuli. They are defined by a cascade of two linear-nonlinear (LN) stages, with the first stage defined by a linear convolution with one or more filters and common point nonlinearity, and the second by pooling weights and an output nonlinearity. Recent interest in such models has surged due to their biological plausibility and accuracy for characterizing early sensory responses. However, fitting poses a difficult computational challenge due to the expense of evaluating the log-likelihood and the ubiquity of local optima. Here we address this problem by providing a theoretical connection between spike-triggered covariance analysis and nonlinear subunit models. Specifically, we show that a "convolutional" decomposition of a spike-triggered average (STA) and covariance (STC) matrix provides an asymptotically efficient estimator for class of quadratic subunit models. We establish theoretical conditions for identifiability of the subunit and pooling weights, and show that our estimator performs well even in cases of model mismatch. Finally, we analyze neural data from macaque primary visual cortex and show that our moment-based estimator outperforms a highly regularized generalized quadratic model (GQM), and achieves nearly the same prediction performance as the full maximum-likelihood estimator, yet at substantially lower cost.

[1]  S. R. Simanca,et al.  On Circulant Matrices , 2012 .

[2]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Maneesh Sahani,et al.  Evidence Optimization Techniques for Estimating Stimulus-Response Functions , 2002, NIPS.

[5]  Eero P. Simoncelli,et al.  Efficient and direct estimation of a neural subunit model for sensory coding , 2012, NIPS.

[6]  Jonathan W. Pillow,et al.  Spectral methods for neural characterization using generalized quadratic models , 2013, NIPS.

[7]  Liam Paninski,et al.  Fast inference in generalized linear models via expected log-likelihoods , 2013, Journal of Computational Neuroscience.

[8]  D. Dacey,et al.  Y-Cell Receptive Field and Collicular Projection of Parasol Ganglion Cells in Macaque Monkey Retina , 2008, The Journal of Neuroscience.

[9]  Maneesh Sahani,et al.  Equating information-theoretic and likelihood-based methods for neural dimensionality reduction , 2013, 1308.3542.

[10]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Adrienne L. Fairhall,et al.  What Causes a Neuron to Spike? , 2003, Neural Computation.

[12]  C E Schreiner,et al.  Neural processing of amplitude-modulated sounds. , 2004, Physiological reviews.

[13]  William Bialek,et al.  Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions , 2002, Neural Computation.

[14]  Il Memming Park,et al.  Bayesian Spike-Triggered Covariance Analysis , 2011, NIPS.

[15]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[16]  Eero P. Simoncelli,et al.  A Convolutional Subunit Model for Neuronal Responses in Macaque V1 , 2015, The Journal of Neuroscience.

[17]  Olivier Marre,et al.  Features and functions of nonlinear spatial integration by retinal ganglion cells , 2012, Journal of Physiology-Paris.

[18]  R. Shapley,et al.  Linear and nonlinear spatial subunits in Y cat retinal ganglion cells. , 1976, The Journal of physiology.

[19]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[21]  J. B. Demb,et al.  Bipolar Cells Contribute to Nonlinear Spatial Summation in the Brisk-Transient (Y) Ganglion Cell in Mammalian Retina , 2001, The Journal of Neuroscience.

[22]  Eero P. Simoncelli,et al.  Spatiotemporal Elements of Macaque V1 Receptive Fields , 2005, Neuron.

[23]  Eero P. Simoncelli,et al.  Dimensionality reduction in neural models: an information-theoretic generalization of spike-triggered average and covariance analysis. , 2006, Journal of vision.

[24]  J. Touryan,et al.  Isolation of Relevant Visual Features from Random Stimuli for Cortical Complex Cells , 2002, The Journal of Neuroscience.