Mouse retinal specializations reflect knowledge of natural environment statistics

Pressures for survival drive sensory circuit adaption to a species’ habitat, making it essential to statistically characterise natural scenes. Mice, a prominent visual system model, are dichromatic with enhanced sensitivity to green and UV. Their visual environment, however, is rarely considered. Here, we built a UV-green camera to record footage from mouse habitats. We found chromatic contrast to greatly diverge in the upper but not the lower visual field, an environmental difference that may underlie the species’ superior colour discrimination in the upper visual field. Moreover, training an autoencoder on upper but not lower visual field scenes was sufficient for the emergence of colour-opponent filters. Furthermore, the upper visual field was biased towards dark UV contrasts, paralleled by more light-offset-sensitive cells in the ventral retina. Finally, footage recorded at twilight suggests that UV promotes aerial predator detection. Our findings support that natural scene statistics shaped early visual processing in evolution. Lead contact Further information and requests for resources and reagents should be directed to and will be fulfilled by the Lead Contact, Thomas Euler (thomas.euler@cin.uni-tuebingen.de)

[1]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[2]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[3]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[7]  Dana H. Ballard,et al.  Modular Learning in Neural Networks , 1987, AAAI.

[8]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[10]  Bruno A. Olshausen,et al.  Pattern recognition, attention, and information bottlenecks in the primate visual system , 1991, Defense, Security, and Sensing.

[11]  G. Aguirre,et al.  Unique topographic separation of two spectral classes of cones in the mouse retina , 1992, The Journal of comparative neurology.

[12]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[13]  Á. Szél,et al.  Two different visual pigments in one retinal cone cell , 1994, Neuron.

[14]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[15]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[16]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[18]  R. W. Rodieck The First Steps in Seeing , 1998 .

[19]  S. Daan,et al.  Can the circadian system of a diurnal and a nocturnal rodent entrain to ultraviolet light? , 2000, Journal of Comparative Physiology A.

[20]  M. Antoch,et al.  The Murine Cone Photoreceptor A Single Cone Type Expresses Both S and M Opsins with Retinal Spatial Patterning , 2000, Neuron.

[21]  K. Donner,et al.  In search of the visual pigment template , 2000, Visual Neuroscience.

[22]  D. Altshuler Ultraviolet reflectance in fruits, ambient light composition and fruit removal in a tropical forest , 2001 .

[23]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[24]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Mark C. W. van Rossum,et al.  Effects of noise on the spike timing precision of retinal ganglion cells. , 2003, Journal of neurophysiology.

[26]  Roland J. Baddeley,et al.  Synaptic energy efficiency in retinal processing , 2003, Vision Research.

[27]  Konrad P. Körding,et al.  The world from a cat’s perspective – statistics of natural videos , 2003, Biological Cybernetics.

[28]  L. Peichl,et al.  Retinal spectral sensitivity, fur coloration, and urine reflectance in the genus octodon (rodentia): implications for visual ecology. , 2003, Investigative ophthalmology & visual science.

[29]  Á. Szél,et al.  Different patterns of retinal cone topography in two genera of rodents, Mus and Apodemus , 1994, Cell and Tissue Research.

[30]  K. Donner,et al.  Thermal activation and photoactivation of visual pigments. , 2004, Biophysical journal.

[31]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[32]  G. H. Jacobs,et al.  Influence of cone pigment coexpression on spectral sensitivity and color vision in the mouse , 2004, Vision Research.

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  Robert A. Frazor,et al.  Independence of luminance and contrast in natural scenes and in the early visual system , 2005, Nature Neuroscience.

[35]  Nicole C. Rust,et al.  In praise of artifice , 2005, Nature Neuroscience.

[36]  L. Peichl Diversity of mammalian photoreceptor properties: adaptations to habitat and lifestyle? , 2005, The anatomical record. Part A, Discoveries in molecular, cellular, and evolutionary biology.

[37]  Daniel J. Graham,et al.  Can the theory of “whitening” explain the center-surround properties of retinal ganglion cell receptive fields? , 2006, Vision Research.

[38]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[39]  Michael S. Lewicki,et al.  A Theory of Retinal Population Coding , 2006, NIPS.

[40]  Robert A. Frazor,et al.  Local luminance and contrast in natural images , 2006, Vision Research.

[41]  Alison M. Sweeney,et al.  Crepuscular and nocturnal illumination and its effects on color perception by the nocturnal hawkmoth Deilephila elpenor , 2006, Journal of Experimental Biology.

[42]  G. H. Jacobs,et al.  Emergence of Novel Color Vision in Mice Engineered to Express a Human Cone Photopigment , 2007, Science.

[43]  Paul R. Martin,et al.  The unsolved mystery of vision , 2007, Current Biology.

[44]  J. Stahl,et al.  Eye orientation during static tilts and its relationship to spontaneous head pitch in the laboratory mouse , 2008, Brain Research.

[45]  R. Shapley,et al.  “Black” Responses Dominate Macaque Primary Visual Cortex V1 , 2009, The Journal of Neuroscience.

[46]  Jiri Najemnik,et al.  Optimal stimulus encoders for natural tasks. , 2009, Journal of vision.

[47]  P. Sterling,et al.  How the Optic Nerve Allocates Space, Energy Capacity, and Information , 2009, The Journal of Neuroscience.

[48]  James J DiCarlo,et al.  A rodent model for the study of invariant visual object recognition , 2009, Proceedings of the National Academy of Sciences.

[49]  Fred Rieke,et al.  Review the Challenges Natural Images Pose for Visual Adaptation , 2022 .

[50]  Charles P. Ratliff,et al.  Retina is structured to process an excess of darkness in natural scenes , 2010, Proceedings of the National Academy of Sciences.

[51]  R. Shapley,et al.  Generation of Black-Dominant Responses in V1 Cortex , 2010, The Journal of Neuroscience.

[52]  T. M. Esdaille,et al.  Dark Light, Rod Saturation, and the Absolute and Incremental Sensitivity of Mouse Cone Vision , 2010, The Journal of Neuroscience.

[53]  J. T. Henriksson,et al.  Ultraviolet radiation transmittance of the mouse eye and its individual media components. , 2010, Experimental eye research.

[54]  C. Niell,et al.  What can mice tell us about how vision works? , 2011, Trends in Neurosciences.

[55]  S. Daan,et al.  Working for Food Shifts Nocturnal Mouse Activity into the Day , 2011, PloS one.

[56]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[57]  J. Sanes,et al.  The most numerous ganglion cell type of the mouse retina is a selective feature detector , 2012, Proceedings of the National Academy of Sciences.

[58]  David C. Sterratt,et al.  Standard Anatomical and Visual Space for the Mouse Retina: Computational Reconstruction and Transformation of Flattened Retinae with the Retistruct Package , 2013, PLoS Comput. Biol..

[59]  David S. Greenberg,et al.  Rats maintain an overhead binocular field at the expense of constant fusion , 2013, Nature.

[60]  Thomas Euler,et al.  A Tale of Two Retinal Domains: Near-Optimal Sampling of Achromatic Contrasts in Natural Scenes through Asymmetric Photoreceptor Distribution , 2013, Neuron.

[61]  Thomas Euler,et al.  Chromatic Coding from Cone-type Unselective Circuits in the Mouse Retina , 2013, Neuron.

[62]  M. Land Eye movements of vertebrates and their relation to eye form and function , 2014, Journal of Comparative Physiology A.

[63]  Alexander S. Ecker,et al.  Population code in mouse V1 facilitates read-out of natural scenes through increased sparseness , 2014, Nature Neuroscience.

[64]  H. Sompolinsky,et al.  Benefits of Pathway Splitting in Sensory Coding , 2014, The Journal of Neuroscience.

[65]  J. Alonso,et al.  COLUMNAR ORGANIZATION OF SPATIAL PHASE IN VISUAL CORTEX , 2014, Nature Neuroscience.

[66]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[67]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[68]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[69]  Emily A. Cooper,et al.  Predicting Cortical Dark/Bright Asymmetries from Natural Image Statistics and Early Visual Transforms , 2015, PLoS Comput. Biol..

[70]  J. Alonso,et al.  PRINCIPLES UNDERLYING SENSORY MAP TOPOGRAPHY IN PRIMARY VISUAL CORTEX , 2016, Nature.

[71]  C. Niell,et al.  Vision Drives Accurate Approach Behavior during Prey Capture in Laboratory Mice , 2016, Current Biology.

[72]  Dmitri B. Chklovskii,et al.  Do retinal ganglion cells project natural scenes to their principal subspace and whiten them? , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[73]  Matthias Bethge,et al.  The functional diversity of retinal ganglion cells in the mouse , 2015, Nature.

[74]  M. Meister,et al.  A neuronal circuit for colour vision based on rod–cone opponency , 2016, Nature.

[75]  Michael J. Bok,et al.  Photoreception and vision in the ultraviolet , 2016, Journal of Experimental Biology.

[76]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[77]  Benjamin S. White,et al.  Ultraviolet Imaging with Low Cost Smartphone Sensors: Development and Application of a Raspberry Pi-Based UV Camera , 2016, Sensors.

[78]  Tania A Seabrook,et al.  Architecture, Function, and Assembly of the Mouse Visual System. , 2017, Annual review of neuroscience.

[79]  Johannes Burge,et al.  Accuracy Maximization Analysis for Sensory-Perceptual Tasks: Computational Improvements, Filter Robustness, and Coding Advantages for Scaled Additive Noise , 2017, PLoS Comput. Biol..

[80]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[81]  O. Marre,et al.  Toward a unified theory of efficient, predictive, and sparse coding , 2017, Proceedings of the National Academy of Sciences.

[82]  Nicolò Cesa-Bianchi,et al.  Advances in Neural Information Processing Systems 31 , 2018, NIPS 2018.

[83]  Maxime J. Y. Zimmermann,et al.  Zebrafish Differentially Process Color across Visual Space to Match Natural Scenes , 2018, Current Biology.

[84]  Derric Williams,et al.  Mouse color and wavelength-specific luminance contrast sensitivity are non-uniform across visual space , 2018, eLife.

[85]  Odelia Schwartz,et al.  Stimulus- and goal-oriented frameworks for understanding natural vision , 2018, Nature Neuroscience.

[86]  Surya Ganguli,et al.  The emergence of multiple retinal cell types through efficient coding of natural movies , 2018, bioRxiv.

[87]  Maria C. Dadarlat,et al.  Flow stimuli reveal ecologically appropriate responses in mouse visual cortex , 2018, Proceedings of the National Academy of Sciences.

[88]  Maneesh Sahani,et al.  A Head-Mounted Camera System Integrates Detailed Behavioral Monitoring with Multichannel Electrophysiology in Freely Moving Mice , 2018, Neuron.

[89]  Katelyn B. Sondereker,et al.  A novel map of the mouse eye for orienting retinal topography in anatomical space , 2018, The Journal of comparative neurology.

[90]  Philipp Berens,et al.  Understanding the retinal basis of vision across species , 2019, Nature Reviews Neuroscience.

[91]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[92]  Congping Shang,et al.  A subcortical excitatory circuit for sensory-triggered predatory hunting in mice , 2019, Nature Neuroscience.

[93]  David J. Anderson,et al.  Computational Neuroethology: A Call to Action , 2019, Neuron.

[94]  Jose-Manuel Alonso,et al.  Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision. , 2019, Cell reports.

[95]  Uri Hasson,et al.  Direct Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks , 2019, Neuron.

[96]  Philipp Bartel,et al.  An arbitrary-spectrum spatial visual stimulator for vision research , 2019, eLife.

[97]  D. Nilsson,et al.  Avian UV vision enhances leaf surface contrasts in forest environments , 2019, Nature Communications.

[98]  C. Niell,et al.  Defined Cell Types in Superior Colliculus Make Distinct Contributions to Prey Capture Behavior in the Mouse , 2019, Current Biology.

[99]  Philipp Bartel,et al.  Author response: An arbitrary-spectrum spatial visual stimulator for vision research , 2019 .

[100]  M. Land Eye movements in man and other animals , 2019, Vision Research.

[101]  I. Nauhaus,et al.  Variations in photoreceptor throughput to mouse visual cortex and the unique effects on tuning , 2020, Scientific Reports.

[102]  Angie M Michaiel,et al.  Dynamics of gaze control during prey capture in freely moving mice , 2020, eLife.

[103]  Two Distinct Types of Eye-Head Coupling in Freely Moving Mice , 2020, Current Biology.

[104]  Neural circuits in the mouse retina support color vision in the upper visual field , 2020, Nature Communications.

[105]  Vincent P. Kunze,et al.  Author response: True S-cones are concentrated in the ventral mouse retina and wired for color detection in the upper visual field , 2020 .

[106]  Samuel A. Nastase,et al.  Direct Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks , 2019, Neuron.

[107]  Nicholas A. Steinmetz,et al.  Arousal Modulates Retinal Output , 2020, Neuron.

[108]  Vincent P. Kunze,et al.  True S-cones are concentrated in the ventral mouse retina and wired for color detection in the upper visual field , 2020, eLife.

[109]  J. O’Keefe,et al.  Two Distinct Types of Eye-Head Coupling in Freely Moving Mice , 2020, Current Biology.

[110]  Edgar Y. Walker,et al.  Object manifold geometry across the mouse cortical visual hierarchy , 2020, bioRxiv.