Sparse coding predicts optic flow specificities of zebrafish pretectal neurons

Zebrafish pretectal neurons exhibit specificities for large-field optic flow patterns associated with rotatory or translatory body motion. We investigate the hypothesis that these specificities reflect the input statistics of natural optic flow. Realistic motion sequences were generated using computer graphics simulating self-motion in an underwater scene. Local retinal motion was estimated with a motion detector and encoded in four populations of directionally tuned retinal ganglion cells, represented as two signed input variables. This activity was then used as input into one of two learning networks: a sparse coding network (competitive learning) and backpropagation network (supervised learning). Both simulations develop specificities for optic flow which are comparable to those found in a neurophysiological study [8], and relative frequencies of the various neuronal responses are best modeled by the sparse coding approach. We conclude that the optic flow neurons in the zebrafish pretectum do reflect the optic flow statistics. The predicted vectorial receptive fields show typical optic flow fields but also “Gabor” and dipole-shaped patterns that likely reflect difference fields needed for reconstruction by linear superposition.

[1]  Aristides B. Arrenberg,et al.  Functional Architecture of an Optic Flow-Responsive Area that Drives Horizontal Eye Movements in Zebrafish , 2014, Neuron.

[2]  Alison S. Walker,et al.  Parametric Functional Maps of Visual Inputs to the Tectum , 2012, Neuron.

[3]  G. Gerlach,et al.  The behaviour and ecology of the zebrafish, Danio rerio , 2007, Biological reviews of the Cambridge Philosophical Society.

[4]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[5]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[6]  Guy A Orban,et al.  Higher order visual processing in macaque extrastriate cortex. , 2008, Physiological reviews.

[7]  Thomas Brox,et al.  FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[9]  David J. Field,et al.  How Close Are We to Understanding V1? , 2005, Neural Computation.

[10]  Noah Snavely,et al.  Unsupervised Learning of Depth and Ego-Motion from Video , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Luc Van Gool,et al.  Sparse Flow: Sparse Matching for Small to Large Displacement Optical Flow , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[12]  Robert A. A. Campbell,et al.  Cellular-Resolution Population Imaging Reveals Robust Sparse Coding in the Drosophila Mushroom Body , 2011, The Journal of Neuroscience.

[13]  Aapo Hyvärinen,et al.  Natural Image Statistics - A Probabilistic Approach to Early Computational Vision , 2009, Computational Imaging and Vision.

[14]  Wei Lu,et al.  Replicating Kernels with a Short Stride Allows Sparse Reconstructions with Fewer Independent Kernels , 2014, ArXiv.

[15]  Cordelia Schmid,et al.  SfM-Net: Learning of Structure and Motion from Video , 2017, ArXiv.

[16]  Holger G. Krapp,et al.  Insect-Inspired Estimation of Egomotion , 2004, Neural Computation.

[17]  Richard G. Baraniuk,et al.  Sparse Coding via Thresholding and Local Competition in Neural Circuits , 2008, Neural Computation.

[18]  S. Coombs,et al.  Going with, then against the flow: evidence against the optomotor hypothesis of fish rheotaxis , 2015, Animal Behaviour.

[19]  Michael J. Black,et al.  Efficient sparse-to-dense optical flow estimation using a learned basis and layers , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  H. Barlow,et al.  Single Units and Sensation: A Neuron Doctrine for Perceptual Psychology? , 1972, Perception.

[21]  G. Laurent,et al.  Normalization for Sparse Encoding of Odors by a Wide-Field Interneuron , 2011, Science.

[22]  Heiko Neumann,et al.  A review and evaluation of methods estimating ego-motion , 2012, Comput. Vis. Image Underst..

[23]  R. Hindges,et al.  Neural Mechanisms Generating Orientation Selectivity in the Retina , 2016, Current Biology.