On nonlinearity in neural encoding models applied to the primary visual cortex

Within the regression framework, we show how different levels of nonlinearity influence the instantaneous firing rate prediction of single neurons. Nonlinearity can be achieved in several ways. In particular, we can enrich the predictor set with basis expansions of the input variables (enlarging the number of inputs) or train a simple but different model for each area of the data domain. Spline-based models are popular within the first category. Kernel smoothing methods fall into the second category. Whereas the first choice is useful for globally characterizing complex functions, the second is very handy for temporal data and is able to include inner-state subject variations. Also, interactions among stimuli are considered. We compare state-of-the-art firing rate prediction methods with some more sophisticated spline-based nonlinear methods: multivariate adaptive regression splines and sparse additive models. We also study the impact of kernel smoothing. Finally, we explore the combination of various local models in an incremental learning procedure. Our goal is to demonstrate that appropriate nonlinearity treatment can greatly improve the results. We test our hypothesis on both synthetic data and real neuronal recordings in cat primary visual cortex, giving a plausible explanation of the results from a biological perspective.

[1]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[2]  Forrest W. Young,et al.  Regression with qualitative and quantitative variables: An alternating least squares method with optimal scaling features , 1976 .

[3]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[4]  J. Lafferty,et al.  Sparse additive models , 2007, 0711.4555.

[5]  D. Perkel,et al.  Simultaneously Recorded Trains of Action Potentials: Analysis and Functional Interpretation , 1969, Science.

[6]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[7]  Liam Paninski,et al.  Hidden Markov Models for the Stimulus-Response Relationships of Multistate Neural Systems , 2011, Neural Computation.

[8]  Eero P. Simoncelli,et al.  Dimensionality reduction in neural models: an information-theoretic generalization of spike-triggered average and covariance analysis. , 2006, Journal of vision.

[9]  Robert E Kass,et al.  Statistical issues in the analysis of neuronal data. , 2005, Journal of neurophysiology.

[10]  D. McCormick,et al.  Enhancement of visual responsiveness by spontaneous local network activity in vivo. , 2007, Journal of neurophysiology.

[11]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[12]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.

[13]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[14]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[15]  M. Wand Local Regression and Likelihood , 2001 .

[16]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[17]  Daeyeol Lee,et al.  Activity in prefrontal cortex during dynamic selection of action sequences , 2006, Nature Neuroscience.

[18]  L. Schumaker Spline Functions: Basic Theory , 1981 .

[19]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[20]  Guohua Pan,et al.  Local Regression and Likelihood , 1999, Technometrics.

[21]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[22]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[23]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[24]  Emery N. Brown,et al.  A Point Process Model for Auditory Neurons Considering Both Their Intrinsic Dynamics and the Spectrotemporal Properties of an Extrinsic Signal , 2011, IEEE Transactions on Biomedical Engineering.

[25]  Maneesh Sahani,et al.  How Linear are Auditory Cortical Responses? , 2002, NIPS.

[26]  I. Ohzawa,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[27]  L. Paninski,et al.  Inferring input nonlinearities in neural encoding models , 2008, Network.

[28]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[29]  J. Alonso,et al.  Thalamic Burst Mode and Inattention in the Awake LGNd , 2006, Neuron.

[30]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[31]  Uri T Eden,et al.  Analysis of between-trial and within-trial neural spiking dynamics. , 2008, Journal of neurophysiology.

[32]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[33]  Hao Helen Zhang,et al.  Component selection and smoothing in multivariate nonparametric regression , 2006, math/0702659.