A 3D Convolutional Neural Network to Model Retinal Ganglion Cell's Responses to Light Patterns in Mice

Deep Learning offers flexible powerful tools that have advanced our understanding of the neural coding of neurosensory systems. In this work, a 3D Convolutional Neural Network (3D CNN) is used to mimic the behavior of a population of mice retinal ganglion cells in response to different light patterns. For this purpose, we projected homogeneous RGB flashes and checkerboards stimuli with variable luminances and wavelength spectrum to mimic a more naturalistic stimuli environment onto the mouse retina. We also used white moving bars in order to localize the spatial position of the recorded cells. Then recorded spikes were smoothed with a Gaussian kernel and used as the output target when training a 3D CNN in a supervised way. To find a suitable model, two hyperparameter search stages were performed. In the first stage, a trial and error process allowed us to obtain a system that is able to fit the neurons firing rates. In the second stage, a systematic procedure was used to compare several gradient-based optimizers, loss functions and the model's convolutional layers number. We found that a three layered 3D CNN was able to predict the ganglion cells firing rates with high correlations and low prediction error, as measured with Mean Squared Error and Dynamic Time Warping in test sets. These models were either competitive or outperformed other models used already in neuroscience, as Feed Forward Neural Networks and Linear-Nonlinear models. This methodology allowed us to capture the temporal dynamic response patterns in a robust way, even for neurons with high trial-to-trial variable spontaneous firing rates, when providing the peristimulus time histogram as an output to our model.

[1]  J. B. Demb,et al.  Contrast Adaptation in Subthreshold and Spiking Responses of Mammalian Y-Type Retinal Ganglion Cells , 2005, The Journal of Neuroscience.

[2]  Jing Shen,et al.  Uncorrelated Neural Firing in Mouse Visual Cortex during Spontaneous Retinal Waves , 2017, Front. Cell. Neurosci..

[3]  J. Gallant,et al.  Predicting neuronal responses during natural vision , 2005, Network.

[4]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[5]  Mario Fiorani,et al.  Automatic mapping of visual cortex receptive fields: A fast and precise algorithm , 2014, Journal of Neuroscience Methods.

[6]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[9]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[10]  R. Reid,et al.  Predicting Every Spike A Model for the Responses of Visual Neurons , 2001, Neuron.

[11]  Yu Cao,et al.  ALAMO: FPGA acceleration of deep learning algorithms with a modularized RTL compiler , 2018, Integr..

[12]  Leonardo Franco,et al.  Layer multiplexing FPGA implementation for deep back-propagation learning , 2017, Integr. Comput. Aided Eng..

[13]  Antonio Martínez-Álvarez,et al.  Towards the Reconstruction of Moving Images by Populations of Retinal Ganglion Cells , 2015, IWINAC.

[14]  Francesco Carlo Morabito,et al.  Deep Learning Representation from Electroencephalography of Early-Stage Creutzfeldt-Jakob Disease and Features for Differentiation from Rapidly Progressive Dementia , 2017, Int. J. Neural Syst..

[15]  M. Meister,et al.  Fast and Slow Contrast Adaptation in Retinal Circuitry , 2002, Neuron.

[16]  N. Lesica,et al.  Encoding of Natural Scene Movies by Tonic and Burst Spikes in the Lateral Geniculate Nucleus , 2004, The Journal of Neuroscience.

[17]  M. Quirk,et al.  Construction and analysis of non-Poisson stimulus-response models of neural spiking activity , 2001, Journal of Neuroscience Methods.

[18]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[19]  C. Soto-Sánchez,et al.  Time–frequency analysis of neuronal populations with instantaneous resolution based on noise-assisted multivariate empirical mode decomposition , 2016, Journal of Neuroscience Methods.

[20]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[21]  R. Normann,et al.  Population coding in spike trains of simultaneously recorded retinal ganglion cells 1 1 Published on the World Wide Web on 7 November 2000. , 2000, Brain Research.

[22]  Surya Ganguli,et al.  Pyret: A Python package for analysis of neurophysiology data , 2017, J. Open Source Softw..

[23]  Pierre Kornprobst,et al.  Virtual Retina: A biological retina model and simulator, with contrast gain control , 2009, Journal of Computational Neuroscience.

[24]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[25]  Antonio Martínez-Álvarez,et al.  On the Automatic Tuning of a Retina Model by Using a Multi-objective Optimization Genetic Algorithm , 2015, IWINAC.

[26]  Boguslaw Cyganek,et al.  Image recognition with deep neural networks in presence of noise - Dealing with and taking advantage of distortions , 2017, Integr. Comput. Aided Eng..

[27]  I. Tsuda Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[28]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[29]  Yi-Zhou Lin,et al.  Structural Damage Detection with Automatic Feature‐Extraction through Deep Learning , 2017, Comput. Aided Civ. Infrastructure Eng..

[30]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[31]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[32]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[33]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.