Sensory flow shaped by active sensing: sensorimotor strategies in electric fish

Summary Goal-directed behavior in most cases is composed of a sequential order of elementary motor patterns shaped by sensorimotor contingencies. The sensory information acquired thus is structured in both space and time. Here we review the role of motion during the generation of sensory flow focusing on how animals actively shape information by behavioral strategies. We use the well-studied examples of vision in insects and echolocation in bats to describe commonalities of sensory-related behavioral strategies across sensory systems, and evaluate what is currently known about comparable active sensing strategies in electroreception of electric fish. In this sensory system the sensors are dispersed across the animal's body and the carrier source emitting energy used for sensing, the electric organ, is moved while the animal moves. Thus ego-motions strongly influence sensory dynamics. We present, for the first time, data of electric flow during natural probing behavior in Gnathonemus petersii (Mormyridae), which provide evidence for this influence. These data reveal a complex interdependency between the physical input to the receptors and the animal's movements, posture and objects in its environment. Although research on spatiotemporal dynamics in electrolocation is still in its infancy, the emerging field of dynamical sensory systems analysis in electric fish is a promising approach to the study of the link between movement and acquisition of sensory information.

[1]  R. Sperry Neural basis of the spontaneous optokinetic response produced by visual inversion. , 1950, Journal of comparative and physiological psychology.

[2]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[3]  J. Gibson Observations on active touch. , 1962, Psychological review.

[4]  Susumu Hagiwara,et al.  A latency-change mechanism involved in sensory coding of electric fish (mormyrids) , 1967 .

[5]  H. Schnitzler,et al.  Die Ultraschallortungslaute der Hufeisen-Fledermause (Chiroptera-Rhinolophidae) in vershiedenen Orientierungssituationen , 1968 .

[6]  H. Poincaré La science et l'hypothèse , 1968 .

[7]  WALTER HEILIGENBERG “Electromotor” Response in the Electric Fish Eigenmannia (Rhamphichthyidae, Gymnotoidei) , 1973, Nature.

[8]  G A Horridge,et al.  The separation of visual axes in apposition compound eyes. , 1978, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  S. Sherman The functional significance of X and Y cells in normal and visually deprived cats , 1979, Trends in Neurosciences.

[10]  J. Simmons,et al.  Echolocation and pursuit of prey by bats. , 1979, Science.

[11]  T. Poggio,et al.  3-D Analysis of the Flight Trajectories of Flies (Drosophila melanogaster) , 1980 .

[12]  C. Carr,et al.  Peripheral organization and central projections of the electrosensory nerves in gymnotiform fish , 1982, The Journal of comparative neurology.

[13]  H. Schnitzler,et al.  The Acoustical Image of Fluttering Insects in Echolocating Bats , 1983 .

[14]  R. Shapley,et al.  Photoreception and Vision in Invertebrates , 1984, NATO ASI Series.

[15]  Peter Moller,et al.  Locomotor and electric displays associated with electrolocation during exploratory behavior in mormyrid fish , 1984, Behavioural Brain Research.

[16]  K. Behrend Cerebellar influence on the time structure of movement in the electric fish Eigenmannia , 1984, Neuroscience.

[17]  Erich Buchner,et al.  Behavioural Analysis of Spatial Vision in Insects , 1984 .

[18]  H. Wagner Flight Performance and Visual Control of Flight of the Free-Flying Housefly (Musca Domestica L.) I. Organization of the Flight Motor , 1986 .

[19]  Walter Heiligenberg,et al.  Behavior of Mormyridae , 1986 .

[20]  H. Wagner Flight performance and visual control of flight of the free-flying housefly (Musca domestica L.) II. Pursuit of targets , 1986 .

[21]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[22]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989 .

[23]  M. Srinivasan,et al.  Range perception through apparent image speed in freely flying honeybees , 1991, Visual Neuroscience.

[24]  B. Johansson Chapter 25: Experimental models of altering the blood-brain barrier , 1992 .

[25]  N Suga,et al.  Delay-tuned neurons in the midbrain of the big brown bat. , 1995, Journal of neurophysiology.

[26]  D. Dennett Darwin's Dangerous Idea: Evolution and the Meanings of Life , 1995 .

[27]  K. Kral,et al.  VISUAL DISTANCE DISCRIMINATION BETWEEN STATIONARY TARGETS IN PRAYING MANTIS : AN INDEX OF THE USE OF MOTION PARALLAX , 1995 .

[28]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[29]  C. Hopkins,et al.  The dorsal filament of the weakly electric Apteronotidae (Gymnotiformes; Teleostei) is specialized for electroreception. , 1996, Brain, behavior and evolution.

[30]  James M. Bower,et al.  Computational Neuroscience: Trends in Research , 1996 .

[31]  K. Gallagher Darwin’s Dangerous Idea: Evolution and the Meanings of Life , 1996 .

[32]  J. Fritz,et al.  Representation of perceptual dimensions of insect prey during terminal pursuit by echolocating bats. , 1996, The Biological bulletin.

[33]  M. Egelhaaf,et al.  Edge detection by landing honeybees: Behavioural analysis and model simulations of the underlying mechanism , 1997, Vision Research.

[34]  Mark E. Nelson,et al.  Estimation of signal characteristics during electrolocation from video analysis of prey capture behavior in weakly electric fish , 1997 .

[35]  J. Juranek,et al.  A sensory brain map for each behavior? , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[36]  M V Srinivasan,et al.  Visual control of honeybee flight. , 1997, EXS.

[37]  Ruben Budelli,et al.  Electric fish measure distance in the dark , 1998, Nature.

[38]  J. Zeil,et al.  Active vision in insects: an analysis of object-directed zig-zag flights in wasps (Odynerus spinipes , Eumenidae) , 1998, Journal of Comparative Physiology A.

[39]  J. Bastian,et al.  Plasticity of feedback inputs in the apteronotid electrosensory system. , 1999, The Journal of experimental biology.

[40]  M. A. MacIver,et al.  Prey capture in the weakly electric fish Apteronotus albifrons: sensory acquisition strategies and electrosensory consequences. , 1999, The Journal of experimental biology.

[41]  Meek,et al.  Structural organization of the mormyrid electrosensory lateral line lobe , 1999, The Journal of experimental biology.

[42]  Mandyam V. Srinivasan,et al.  Motion detection in insect orientation and navigation , 1999, Vision Research.

[43]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[44]  B Rasnow,et al.  Electric organ discharges and electric images during electrolocation. , 1999, The Journal of experimental biology.

[45]  D. M. Hutton,et al.  Cambrian Intelligence: The Early History of the New AI , 2000 .

[46]  A. Caputi,et al.  Electroreception in Gymnotus carapo: pre-receptor processing and the distribution of electroreceptor types. , 2000, The Journal of experimental biology.

[47]  A. Caputi,et al.  The electric image in weakly electric fish: perception of objects of complex impedance. , 2000, The Journal of experimental biology.

[48]  Gerhard von der Emde,et al.  Distance discrimination during active electrolocation in the weakly electric fish Gnathonemus petersii , 2001, Journal of Comparative Physiology A.

[49]  M. A. MacIver,et al.  Prey-capture behavior in gymnotid electric fish: motion analysis and effects of water conductivity. , 2001, The Journal of experimental biology.

[50]  J. E. Lewis,et al.  Neuronal Population Codes and the Perception of Object Distance in Weakly Electric Fish , 2001, The Journal of Neuroscience.

[51]  Curtis C Bell,et al.  Memory-based expectations in electrosensory systems , 2001, Current Opinion in Neurobiology.

[52]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[53]  L Maler,et al.  Blurring of the senses: common cues for distance perception in diverse sensory systems , 2002, Neuroscience.

[54]  Mark E. Nelson,et al.  Modeling Electrosensory and Mechanosensory Images during the Predatory Behavior of Weakly Electric Fish , 2002, Brain, Behavior and Evolution.

[55]  K. Grant,et al.  The electric image in Gnathonemus petersii , 2002, Journal of Physiology-Paris.

[56]  A. Caputi,et al.  Probability and amplitude of novelty responses as a function of the change in contrast of the reafferent image in G. carapo , 2003, Journal of Experimental Biology.

[57]  M. Bacher,et al.  A new method for the simulation of electric fields, generated by electric fish, and their distorsions by objects , 1983, Biological Cybernetics.

[58]  H. Schnitzler,et al.  Die Ultraschall-Ortungslaute der Hufeisen-Fledermäuse (Chiroptera-Rhinolophidae) in verschiedenen Orientierungssituationen , 1968, Zeitschrift für vergleichende Physiologie.

[59]  Ruben Budelli,et al.  Pre-receptor profile of sensory images and primary afferent neuronal representation in the mormyrid electrosensory system , 2004, Journal of Experimental Biology.

[60]  Michael J. Lannoo,et al.  Why do electric fishes swim backwards? An hypothesis based on gymnotiform foraging behavior interpreted through sensory constraints , 1993, Environmental Biology of Fishes.

[61]  Angel A. Caputi,et al.  Contributions of electric fish to the understanding sensory processing by reafferent systems , 2004, Journal of Physiology-Paris.

[62]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[63]  Mark E. Nelson,et al.  Modeling signal and background components of electrosensory scenes , 2005, Journal of Comparative Physiology A.

[64]  T. S. Collett,et al.  Relative motion parallax and target localisation in the locust, Schistocerca gregaria , 2004, Journal of Comparative Physiology A.

[65]  J. Bastian,et al.  Pyramidal-cell plasticity in weakly electric fish: a mechanism for attenuating responses to reafferent electrosensory inputs , 2004, Journal of Comparative Physiology A.

[66]  M. Goodale,et al.  A mammalian model of optic-flow utilization in the control of locomotion , 2004, Experimental Brain Research.

[67]  M. Toerring,et al.  Motor programmes and electroreception in mormyrid fish , 1979, Behavioral Ecology and Sociobiology.

[68]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[69]  Gary J. Rose,et al.  Longitudinal tracking responses of the weakly electric fish, Sternopygus , 2004, Journal of Comparative Physiology A.

[70]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[71]  Walter Heiligenberg,et al.  Theoretical and experimental approaches to spatial aspects of electrolocation , 2004, Journal of comparative physiology.

[72]  Curtis C Bell,et al.  Immunocytochemical identification of cell types in the mormyrid electrosensory lobe , 2005, The Journal of comparative neurology.

[73]  Dylan F. Cooke,et al.  Arm movements evoked by electrical stimulation in the motor cortex of monkeys. , 2005, Journal of neurophysiology.

[74]  Martin Egelhaaf,et al.  A single control system for smooth and saccade-like pursuit in blowflies , 2005, Journal of Experimental Biology.

[75]  Bruce A Carlson,et al.  Electric organ discharge patterns during group hunting by a mormyrid fish , 2005, Proceedings of the Royal Society B: Biological Sciences.

[76]  W. H. Kirchner,et al.  Bees perceive illusionary distance information from rotating spirals , 2005, Naturwissenschaften.

[77]  T. Collett,et al.  Visual control of flight behaviour in the hoverflySyritta pipiens L. , 1975, Journal of comparative physiology.

[78]  Adriana Migliaro,et al.  Theoretical Analysis of Pre-Receptor Image Conditioning in Weakly Electric Fish , 2005, PLoS Comput. Biol..

[79]  Walter Heiligenberg,et al.  Electrolocation of objects in the electric fishEigenmannia (Rhamphichthyidae, Gymnotoidei) , 1973, Journal of comparative physiology.

[80]  Mark E. Nelson,et al.  Target Detection, Image Analysis, and Modeling , 2005 .

[81]  M. A. MacIver,et al.  Sensory acquisition in active sensing systems , 2006, Journal of Comparative Physiology A.

[82]  R. Budelli,et al.  Peripheral electrosensory imaging by weakly electric fish , 2006, Journal of Comparative Physiology A.

[83]  G. von der Emde,et al.  Non-visual environmental imaging and object detection through active electrolocation in weakly electric fish. , 2006, Journal of comparative physiology. A, Neuroethology, sensory, neural, and behavioral physiology.

[84]  Martin Egelhaaf,et al.  The neural computation of visual motion information. , 2006 .

[85]  W. Michael Brown,et al.  Optimal Neuronal Tuning for Finite Stimulus Spaces , 2004, Neural Computation.

[86]  Cynthia F Moss,et al.  Echolocating Bats Use a Nearly Time-Optimal Strategy to Intercept Prey , 2006, PLoS biology.

[87]  Gerhard von der Emde,et al.  Effects of Sensing Behavior on a Latency Code , 2006, The Journal of Neuroscience.

[88]  Eric S Fortune,et al.  The decoding of electrosensory systems , 2006, Current Opinion in Neurobiology.

[89]  Gerhard von der Emde,et al.  Distance, shape and more: recognition of object features during active electrolocation in a weakly electric fish , 2007, Journal of Experimental Biology.

[90]  Mark E Nelson,et al.  Omnidirectional Sensory and Motor Volumes in Electric Fish , 2007, PLoS biology.

[91]  André Longtin,et al.  Spatial Acuity and Prey Detection in Weakly Electric Fish , 2007, PLoS Comput. Biol..

[92]  N. Franceschini,et al.  A Bio-Inspired Flying Robot Sheds Light on Insect Piloting Abilities , 2007, Current Biology.

[93]  B. Lindner,et al.  Control of neuronal firing by dynamic parallel fiber feedback: implications for electrosensory reafference suppression , 2007, Journal of Experimental Biology.

[94]  Hiroshi Riquimaroux,et al.  On-board telemetry of emitted sounds from free-flying bats: compensation for velocity and distance stabilizes echo frequency and amplitude , 2008, Journal of Comparative Physiology A.

[95]  Giulio Sandini,et al.  The iCub humanoid robot: an open platform for research in embodied cognition , 2008, PerMIS.

[96]  Jacob Engelmann,et al.  Distribution, density and morphology of electroreceptor organs in mormyrid weakly electric fish: anatomical investigations of a receptor mosaic , 2008 .

[97]  N. Sawtell,et al.  Cerebellum-like structures and their implications for cerebellar function. , 2008, Annual review of neuroscience.

[98]  Maurice J Chacron,et al.  Temporal processing across multiple topographic maps in the electrosensory system. , 2008, Journal of neurophysiology.

[99]  Gerhard von der Emde,et al.  Functional foveae in an electrosensory system , 2008, The Journal of comparative neurology.

[100]  Roland Pusch,et al.  Active electrolocation in Gnathonemus petersii: Behaviour, sensory performance, and receptor systems , 2008, Journal of Physiology-Paris.

[101]  Malcolm A. MacIver,et al.  The Cambridge Handbook of Situated Cognition: Neuroethology , 2008 .

[102]  Jacob Engelmann,et al.  Receptive field properties of neurons in the electrosensory lateral line lobe of the weakly electric fish, Gnathonemus petersii , 2008, Journal of Comparative Physiology A.

[103]  Nicolas Franceschini,et al.  A bee in the corridor: centering and wall-following , 2008, Naturwissenschaften.

[104]  Olaf Sporns,et al.  The Synthetic Approach to Embodied Cognition , 2008 .

[105]  N. Ulanovsky,et al.  What the bat's voice tells the bat's brain , 2008, Proceedings of the National Academy of Sciences.

[106]  Roland Pusch,et al.  Electric imaging through active electrolocation: implication for the analysis of complex scenes , 2008, Biological Cybernetics.

[107]  Jeffrey S. Johnson,et al.  The Dynamic Field Theory and Embodied Cognitive Dynamics , 2008 .

[108]  Gerhard von der Emde,et al.  Active sensing in a mormyrid fish: electric images and peripheral modifications of the signal carrier give evidence of dual foveation , 2008, Journal of Experimental Biology.

[109]  G. Ribak,et al.  Saccadic head rotations during walking in the stalk-eyed fly (Cyrtodiopsis dalmanni) , 2009, Proceedings of the Royal Society B: Biological Sciences.

[110]  Norbert Boeddeker,et al.  Visual gaze control during peering flight manoeuvres in honeybees , 2010, Proceedings of the Royal Society B: Biological Sciences.

[111]  Leonard Maler,et al.  Receptive field organization across multiple electrosensory maps. I. Columnar organization and estimation of receptive field size , 2009, The Journal of comparative neurology.

[112]  T. Prescott,et al.  Active touch sensing in the rat: anticipatory and regulatory control of whisker movements during surface exploration. , 2009, Journal of neurophysiology.

[113]  Leonard Maler,et al.  Receptive field organization across multiple electrosensory maps. II. Computational analysis of the effects of receptive field size on prey localization , 2009, The Journal of comparative neurology.

[114]  J. Kennedy The Visual Responses of Flying Mosquitoes. , 2009 .

[115]  Stéphane Viollet,et al.  Optic Flow Based Visual Guidance: From Flying Insects to Miniature Aerial Vehicles , 2009 .

[116]  J. Engelmann,et al.  3-Dimensional Scene Perception during Active Electrolocation in a Weakly Electric Pulse Fish , 2010, Front. Behav. Neurosci..

[117]  Lawrence A. Shapiro Embodied Cognition , 2010 .

[118]  Gerhard von der Emde,et al.  Electrolocation of capacitive objects in four species of pulse-type weakly electric fish. I : Discrimination performance , 2010 .

[119]  Gerhard von der Emde,et al.  Electrolocation of capacitive objects in four species of pulse-type weakly electric fish. II: Electric signalling behaviour , 2010 .

[120]  Martin Egelhaaf,et al.  Identifying Prototypical Components in Behaviour Using Clustering Algorithms , 2010, PloS one.

[121]  Martin Egelhaaf,et al.  A syntax of hoverfly flight prototypes , 2010, Journal of Experimental Biology.

[122]  Nathaniel B Sawtell,et al.  Multimodal Integration in Granule Cells as a Basis for Associative Plasticity and Sensory Prediction in a Cerebellum-like Circuit , 2010, Neuron.

[123]  Neelesh A. Patankar,et al.  Energy-Information Trade-Offs between Movement and Sensing , 2010, PLoS Comput. Biol..

[124]  M. Borde,et al.  Neural substrate of an increase in sensory sampling triggered by a motor command in a gymnotid fish. , 2010, Journal of neurophysiology.

[125]  Margaret L. Brandeau,et al.  Optimal Localization by Pointing Off Axis , 2010 .

[126]  G. von der Emde,et al.  Active Electroreception: Vertebrates , 2010 .

[127]  Reid R. Harrison,et al.  Wireless Neural/EMG Telemetry Systems for Small Freely Moving Animals , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[128]  Stephan K. U. Zibner,et al.  Dynamic Neural Fields as Building Blocks of a Cortex-Inspired Architecture for Robotic Scene Representation , 2011, IEEE Transactions on Autonomous Mental Development.

[129]  Adriana Migliaro,et al.  Fish Geometry and Electric Organ Discharge Determine Functional Organization of the Electrosensory Epithelium , 2011, PloS one.

[130]  DaeEun Kim,et al.  Electrolocation based on tail-bending movements in weakly electric fish , 2011, Journal of Experimental Biology.

[131]  Mandyam V Srinivasan,et al.  Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics. , 2011, Physiological reviews.

[132]  Holger G. Krapp,et al.  Sensory Neurophysiology: Motion Vision during Motor Action , 2011, Current Biology.

[133]  Noah J. Cowan,et al.  Active sensing via movement shapes spatiotemporal patterns of sensory feedback , 2012, Journal of Experimental Biology.

[134]  DaeEun Kim,et al.  Electrolocation of multiple objects based on temporal sweep motions , 2012, Adapt. Behav..

[135]  Angel A Caputi,et al.  The active electrosensory range of Gymnotus omarorum , 2012, Journal of Experimental Biology.

[136]  Von Der Emde Gerhard Spatial coding and receptive field properties of neurons in the electrosensory lateral line lobe of Gnathonemus petersii stimulated by real objects , 2012 .

[137]  R. Budelli,et al.  Mind the gap: the minimal detectable separation distance between two objects during active electrolocation. , 2012, Journal of fish biology.

[138]  Engelmann Jacob Linking behavior and sensory processing: analysis of distance estimation capability in neurons of the Mormyrid ELL , 2012 .

[139]  Gerhard von der Emde,et al.  Figure–ground separation during active electrolocation in the weakly electric fish, Gnathonemus petersii , 2013, Journal of Physiology-Paris.

[140]  Jacob Engelmann,et al.  From static electric images to electric flow: Towards dynamic perceptual cues in active electroreception , 2013, Journal of Physiology-Paris.

[141]  J.,et al.  Optic Flow , 2014, Computer Vision, A Reference Guide.