A fast and flexible panoramic virtual reality system for behavioural and electrophysiological experiments

Ideally, neuronal functions would be studied by performing experiments with unconstrained animals whilst they behave in their natural environment. Although this is not feasible currently for most animal models, one can mimic the natural environment in the laboratory by using a virtual reality (VR) environment. Here we present a novel VR system based upon a spherical projection of computer generated images using a modified commercial data projector with an add-on fish-eye lens. This system provides equidistant visual stimulation with extensive coverage of the visual field, high spatio-temporal resolution and flexible stimulus generation using a standard computer. It also includes a track-ball system for closed-loop behavioural experiments with walking animals. We present a detailed description of the system and characterize it thoroughly. Finally, we demonstrate the VR system’s performance whilst operating in closed-loop conditions by showing the movement trajectories of the cockroaches during exploratory behaviour in a VR forest.

[1]  Roland Strauss,et al.  Virtual-Reality Techniques Resolve the Visual Cues Used by Fruit Flies to Evaluate Object Distances , 2002, Current Biology.

[2]  Gidon Felsen,et al.  A natural approach to studying vision , 2005, Nature Neuroscience.

[3]  A. Borst,et al.  Fly motion vision. , 2010, Annual review of neuroscience.

[4]  M. Land Visual acuity in insects. , 1997, Annual review of entomology.

[5]  F. Dodge,et al.  Deciphering a neural code for vision. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[6]  K. Pearson,et al.  Alteration of bursting properties in interneurons during locust flight. , 1993, Journal of neurophysiology.

[7]  C. Koch,et al.  Neuronal connections underlying orientation selectivity in cat visual cortex , 1987, Trends in Neurosciences.

[8]  Adrian L. R. Thomas,et al.  New experimental approaches to the biology of flight control systems , 2008, Journal of Experimental Biology.

[9]  E. Buchner Elementary movement detectors in an insect visual system , 1976, Biological Cybernetics.

[10]  D. Tank,et al.  Intracellular dynamics of hippocampal place cells during virtual navigation , 2009, Nature.

[11]  M Egelhaaf,et al.  Behavioural state affects motion-sensitive neurones in the fly visual system , 2010, Journal of Experimental Biology.

[12]  Simon B. Laughlin,et al.  Form and function in retinal processing , 1987, Trends in Neurosciences.

[13]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[14]  Holger G Krapp,et al.  State-dependent performance of optic-flow processing interneurons. , 2009, Journal of neurophysiology.

[15]  S B Laughlin,et al.  Voltage‐activated potassium channels in blowfly photoreceptors and their role in light adaptation. , 1991, The Journal of physiology.

[16]  A Schnee,et al.  Rats are able to navigate in virtual environments , 2005, Journal of Experimental Biology.

[17]  Michael B. Reiser,et al.  Walking Modulates Speed Sensitivity in Drosophila Motion Vision , 2010, Current Biology.

[18]  Roger C. Hardie,et al.  Visual transduction in Drosophila , 2001, Nature.

[19]  A. Borst,et al.  Neural networks in the cockpit of the fly , 2002, Journal of Comparative Physiology A.

[20]  Mikko Vähäsöyrinki,et al.  Interactions between light-induced currents, voltage-gated currents, and input signal properties in Drosophila photoreceptors. , 2004, Journal of neurophysiology.

[21]  Masakazu Konishi,et al.  Gating of auditory responses in the vocal control system of awake songbirds , 1998, Nature Neuroscience.

[22]  Michael H. Dickinson,et al.  A modular display system for insect behavioral neuroscience , 2008, Journal of Neuroscience Methods.

[23]  Holger G. Krapp,et al.  Neural encoding of behaviourally relevant visual-motion information in the fly , 2002, Trends in Neurosciences.

[24]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[25]  Karl Georg Götz,et al.  Visual control of locomotion in the walking fruitflyDrosophila , 1973, Journal of comparative physiology.

[26]  J. V. van Hateren,et al.  Encoding of naturalistic optic flow by a population of blowfly motion-sensitive neurons. , 2006, Journal of neurophysiology.

[27]  B Hedwig,et al.  Mechanisms underlying phonotactic steering in the cricket Gryllus bimaculatus revealed with a fast trackball system , 2005, Journal of Experimental Biology.

[28]  M. Dickinson,et al.  Active flight increases the gain of visual motion processing in Drosophila , 2010, Nature Neuroscience.

[29]  Mikko Vähäsöyrinki,et al.  Ultrasmall and customizable multichannel electrodes for extracellular recordings. , 2011, Journal of neurophysiology.

[30]  J. P. Lindemann,et al.  FliMax, a novel stimulus device for panoramic and highspeed presentation of behaviourally generated optic flow , 2003, Vision Research.

[31]  Michael B. Reiser,et al.  Two-photon calcium imaging from motion-sensitive neurons in head-fixed Drosophila during optomotor walking behavior , 2010, Nature Methods.

[32]  Allen Cheung,et al.  Honeybee flight: a novel ‘streamlining’ response , 2011, Journal of Experimental Biology.

[33]  M Järvilehto,et al.  Contrast gain, signal-to-noise ratio, and linearity in light-adapted blowfly photoreceptors , 1994, The Journal of general physiology.

[34]  Matti Weckström,et al.  Large Functional Variability in Cockroach Photoreceptors: Optimization to Low Light Levels , 2006, The Journal of Neuroscience.

[35]  R. Strauss,et al.  Processing of artificial visual feedback in the walking fruit fly Drosophila melanogaster. , 1997, The Journal of experimental biology.

[36]  A. Dubs,et al.  The dynamics of phototransduction in insects , 1984, Journal of Comparative Physiology A.

[37]  Franz Huber,et al.  Auditory behavior of the cricket , 1981, Journal of comparative physiology.

[38]  Pamela Reinagel How do visual neurons respond in the real world? , 2001, Current Opinion in Neurobiology.

[39]  F. Gabbiani,et al.  Multiplexing of Motor Information in the Discharge of a Collision Detecting Neuron during Escape Behaviors , 2011, Neuron.

[40]  Mark A Willis,et al.  A method for recording behavior and multineuronal CNS activity from tethered insects flying in virtual space , 2002, Journal of Neuroscience Methods.

[41]  Michael B. Reiser,et al.  Corrigendum: Two-photon calcium imaging from head-fixed Drosophila during optomotor walking behavior , 2011, Nature Methods.

[42]  Michael Brecht,et al.  Head-anchored whole-cell recordings in freely moving rats , 2009, Nature Protocols.

[43]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[44]  Michael H. Dickinson,et al.  TrackFly: Virtual reality for a behavioral system analysis in free-flying fruit flies , 2008, Journal of Neuroscience Methods.

[45]  Roger D. Santer,et al.  Arousal facilitates collision avoidance mediated by a looming sensitive visual neuron in a flying locust. , 2008, Journal of neurophysiology.

[46]  K. Götz Course-control, metabolism and wing interference during ultralong tethered flight in Drosophila melanogaster , 1987 .