Elements of a stochastic 3D prediction engine in larval zebrafish prey capture

Many predatory animals rely on accurate sensory perception, predictive models, and precise pursuits to catch moving prey. Larval zebrafish intercept paramecia during their hunting behavior, but the precise trajectories of their prey have never been recorded in relation to fish movements in three dimensions. As a means of uncovering what a simple organism understands about its physical world, we have constructed a 3D-imaging setup to simultaneously record the behavior of larval zebrafish, as well as their moving prey, during hunting. We show that zebrafish robustly transform their 3D displacement and rotation according to the position of their prey while modulating both of these variables depending on prey velocity. This is true for both azimuth and altitude, but particulars of the hunting algorithm in the two planes are slightly different to accommodate an asymmetric strike zone. We show that the combination of position and velocity perception provides the fish with a preferred future positional estimate, indicating an ability to project trajectories forward in time. Using computational models, we show that this projection ability is critical for prey capture efficiency and success. Further, we demonstrate that fish use a graded stochasticity algorithm where the variance around the mean result of each swim scales with distance from the target. Notably, this strategy provides the animal with a considerable improvement over equivalent noise-free strategies. In sum, our quantitative and probabilistic modeling shows that zebrafish are equipped with a stochastic recursive algorithm that embodies an implicit predictive model of the world. This algorithm, built by a simple set of behavioral rules, allows the fish to optimize their hunting strategy in a naturalistic three-dimensional environment.

[1]  Herwig Baier,et al.  Visual Prey Capture in Larval Zebrafish Is Controlled by Identified Reticulospinal Neurons Downstream of the Tectum , 2005, The Journal of Neuroscience.

[2]  Malcolm A. MacIver,et al.  Visually guided gradation of prey capture movements in larval zebrafish , 2013, Journal of Experimental Biology.

[3]  Martin C. Rinard,et al.  Bayesian synthesis of probabilistic programs for automatic data modeling , 2019, Proc. ACM Program. Lang..

[4]  H. Baier,et al.  Deconstructing Hunting Behavior Reveals a Tightly Coupled Stimulus-Response Loop , 2019, Current Biology.

[5]  H. Maturana,et al.  The Tree of Knowledge: The Biological Roots of Human Understanding , 2007 .

[6]  Andreas F. Haselsteiner,et al.  Tiger beetles pursue prey using a proportional control law with a delay of one half-stride , 2014, Journal of The Royal Society Interface.

[7]  Gregory C. DeAngelis,et al.  A neural representation of depth from motion parallax in macaque visual cortex , 2008, Nature.

[8]  Timothy W. Dunn,et al.  Brain-wide mapping of neural activity controlling zebrafish exploratory locomotion , 2016, eLife.

[9]  Florian Engert,et al.  A novel mechanism for mechanosensory-based rheotaxis in larval zebrafish , 2017, Nature.

[10]  Petros Koumoutsakos,et al.  Efficient collective swimming by harnessing vortices through deep reinforcement learning , 2018, Proceedings of the National Academy of Sciences.

[11]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[12]  Lilach Avitan,et al.  Limitations of Neural Map Topography for Decoding Spatial Information , 2016, The Journal of Neuroscience.

[13]  H. Baier,et al.  Deconstructing Hunting Behavior Reveals a Tightly Coupled Stimulus-Response Loop , 2019, Current Biology.

[14]  J. Deloache,et al.  Young Infants ' Reasoning about the Physical and Spatial Properties of a Hidden Object , 2004 .

[15]  Marvin Minsky,et al.  Society of Mind: A Response to Four Reviews , 1991, Artif. Intell..

[16]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[17]  M. Orger,et al.  Structure of the Zebrafish Locomotor Repertoire Revealed with Unsupervised Behavioral Clustering , 2018, Current Biology.

[18]  B. Borghuis,et al.  The Role of Motion Extrapolation in Amphibian Prey Capture , 2015, The Journal of Neuroscience.

[19]  D. O'Malley,et al.  Locomotor repertoire of the larval zebrafish: swimming, turning and prey capture. , 2000, The Journal of experimental biology.

[20]  J. Apter,et al.  Eye movements following strychninization of the superior colliculus of cats. , 1946, Journal of neurophysiology.

[21]  Yonathan Zohar,et al.  Lactobacillus rhamnosus Accelerates Zebrafish Backbone Calcification and Gonadal Differentiation through Effects on the GnRH and IGF Systems , 2012, PloS one.

[22]  Isaac H. Bianco,et al.  Nucleus Isthmi Is Required to Sustain Target Pursuit during Visually Guided Prey-Catching , 2019, Current Biology.

[23]  Joshua B. Tenenbaum,et al.  Stochastic Digital Circuits for Probabilistic Inference , 2008 .

[24]  Scott W. Linderman,et al.  Probabilistic Models of Larval Zebrafish Behavior: Structure on Many Scales , 2019, bioRxiv.

[25]  Joshua B. Tenenbaum,et al.  CrossCat: A Fully Bayesian Nonparametric Method for Analyzing Heterogeneous, High Dimensional Data , 2015, J. Mach. Learn. Res..

[26]  F. Engert,et al.  Visuomotor Transformations Underlying Hunting Behavior in Zebrafish , 2015, Current Biology.

[27]  Emmanuel Dupoux,et al.  Continuity, competence, and the object concept , 2001 .

[28]  D. Ingle Focal attention in the frog: behavioral and physiological correlates. , 1975, Science.

[29]  Geoffrey J. Goodhill,et al.  Spontaneous Activity in the Zebrafish Tectum Reorganizes over Development and Is Influenced by Visual Experience , 2017, Current Biology.

[30]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[31]  Sergio A. Lambertucci,et al.  Energy Landscapes Shape Animal Movement Ecology , 2013, The American Naturalist.

[32]  R. Sperry CHEMOAFFINITY IN THE ORDERLY GROWTH OF NERVE FIBER PATTERNS AND CONNECTIONS. , 1963, Proceedings of the National Academy of Sciences of the United States of America.

[33]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[34]  Joshua B. Tenenbaum,et al.  Building machines that learn and think like people , 2016, Behavioral and Brain Sciences.

[35]  M. Arbib Levels of modeling of mechanisms of visually guided behavior , 1987, Behavioral and Brain Sciences.

[36]  Feras Saad,et al.  Probabilistic Data Analysis with Probabilistic Programming , 2016, ArXiv.

[37]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[38]  T. S. Collett Do toads plan routes? A study of the detour behaviour ofBufo viridis , 2004, Journal of comparative physiology.

[39]  Haim Sompolinsky,et al.  From Whole-Brain Data to Functional Circuit Models: The Zebrafish Optomotor Response , 2016, Cell.

[40]  Frank Moss,et al.  Use of behavioural stochastic resonance by paddle fish for feeding , 1999, Nature.

[41]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[42]  Scott P. Johnson,et al.  Development of object concepts in infancy: Evidence for early learning in an eye-tracking paradigm , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Junichi Nakai,et al.  Real-Time Visualization of Neuronal Activity during Perception , 2013, Current Biology.

[44]  I. Couzin,et al.  Self-Organization and Collective Behavior in Vertebrates , 2003 .

[45]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[46]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[47]  J. Tenenbaum,et al.  Mind Games: Game Engines as an Architecture for Intuitive Physics , 2017, Trends in Cognitive Sciences.

[48]  Cornelia I. Bargmann,et al.  Neuromodulatory Control of Long-Term Behavioral Patterns and Individuality across Development , 2017, Cell.

[49]  Adrian L. R. Thomas,et al.  Terminal attack trajectories of peregrine falcons are described by the proportional navigation guidance law of missiles , 2017, Proceedings of the National Academy of Sciences.

[50]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[51]  Anthony Leonardo,et al.  Internal models direct dragonfly interception steering , 2014, Nature.

[52]  Chintan A. Trivedi,et al.  Visually driven chaining of elementary swim patterns into a goal-directed motor sequence: a virtual reality study of zebrafish prey capture , 2013, Front. Neural Circuits.

[53]  Florian Engert,et al.  Prey Capture Behavior Evoked by Simple Visual Stimuli in Larval Zebrafish , 2011, Front. Syst. Neurosci..