A New Nonlinear Sparse Component Analysis for a Biologically Plausible Model of Neurons

It is known that brain can create a sparse representation of the environment in both sensory and mnemonic forms (Olshausen & Field, 2004). Such sparse representation can be combined in downstream areas to create rich multisensory responses to support various cognitive and motor functions. Determining the components present in neuronal responses in a given region is key to deciphering its functional role and connection with upstream areas. One approach for parsing out various sources of information in a single neuron is by using linear blind source separation (BSS) techniques. However, applying linear techniques to neuronal spiking activity is likely to be suboptimal due to inherent and unknown nonlinearity of neuronal responses to inputs. This letter proposes a nonlinear sparse component analysis (SCA) method to separate jointly sparse inputs to neurons with post summation nonlinearity, or SCA for post-nonlinear neurons (SCAPL). Specifically, a linear clustering approach followed by principal curve regression (PCR) and a nonlinear curve fitting are used to separate sources. Analysis using simulated data shows that SCAPL accuracy outperforms ones obtained by linear SCA, as well as other separating methods, including linear independent and principal component analyses. In SCAPL, the number of derived sparse components is not limited by the number of neurons, unlike most BSS methods. Furthermore, this method allows for a broad range of post-summation nonlinearities that could differ among neurons. The sensitivity of our method to noise, joint sparseness, degree, and shape of nonlinearity and mixing ill conditions is discussed and compared to existing methods. Our results show that the proposed method can successfully separate input components in a population of neurons provided that they are temporally sparse to some degree. Application of SCAPL should facilitate comparison of functional roles across regions by parsing various elements present in a region.

[1]  Naoshige Uchida,et al.  Demixed principal component analysis of neural population data , 2014, eLife.

[2]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[3]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[4]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[5]  Antti Honkela,et al.  Bayesian Non-Linear Independent Component Analysis by Multi-Layer Perceptrons , 2000 .

[6]  T. Hromádka,et al.  Sparse Representation of Sounds in the Unanesthetized Auditory Cortex , 2008, PLoS biology.

[7]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .

[8]  Motoaki Kawanabe,et al.  Blind Separation of Post-nonlinear Mixtures using Linearizing Transformations and Temporal Decorrelation , 2003, J. Mach. Learn. Res..

[9]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[10]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[11]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[12]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[13]  Athanasios Mouchtaris,et al.  Post-Nonlinear Sparse Component Analysis Using Single-Source Zones and Functional Data Clustering , 2012, ArXiv.

[14]  Christian Jutten,et al.  A geometric approach for separating post non-linear mixtures , 2002, 2002 11th European Signal Processing Conference.

[15]  B. Raman,et al.  Sparse odor representation and olfactory learning , 2008, Nature Neuroscience.

[16]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[17]  J. Poulet,et al.  Synaptic Mechanisms Underlying Sparse Coding of Active Touch , 2011, Neuron.

[18]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[19]  William B. Levy,et al.  Energy Efficient Neural Codes , 1996, Neural Computation.

[20]  J. Poulet,et al.  Synaptic Mechanisms Underlying Sparse Coding of Active Touch , 2011, Neuron.

[21]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[22]  Christian Jutten,et al.  Sparse ICA via cluster-wise PCA , 2006, Neurocomputing.

[23]  Ignacio Santamaría,et al.  A spectral clustering approach to underdetermined postnonlinear blind source separation of sparse sources , 2006, IEEE Transactions on Neural Networks.

[24]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[25]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[26]  Fabian J. Theis,et al.  Postnonlinear Overcomplete Blind Source Separation Using Sparse Sources , 2004, ICA.

[27]  Erkki Oja,et al.  Independent Component Analysis , 2001, IEEE Transactions on Neural Networks.

[28]  S. Nicola,et al.  Roles of Nucleus Accumbens Core and Shell in Incentive-Cue Responding and Behavioral Inhibition , 2011, The Journal of Neuroscience.

[29]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[30]  Jun Wang,et al.  Nonlinear Blind Source Separation Using Higher Order Statistics and a Genetic Algorithm , 2001 .

[31]  W. Gerstner,et al.  Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  W. Massy Principal Components Regression in Exploratory Statistical Research , 1965 .

[33]  Ali Ghazizadeh,et al.  Isolating event-related neuronal responses by deconvolution. , 2010, Journal of neurophysiology.

[34]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.