Spatial planning with long visual range benefits escape from visual predators in complex naturalistic environments

It is uncontroversial that land animals have more elaborated cognitive abilities than their aquatic counterparts such as fish. Yet there is no apparent a-priori reason for this. A key cognitive faculty is planning. We show that in visually guided predator-prey interactions, planning provides a significant advantage, but only on land. During animal evolution, the water-to-land transition resulted in a massive increase in visual range. Simulations of behavior identify a specific type of terrestrial habitat, clustered open and closed areas (savanna-like), where the advantage of planning peaks. Our computational experiments demonstrate how this patchy terrestrial structure, in combination with enhanced visual range, can reveal and hide agents as a function of their movement and create a selective benefit for imagining, evaluating, and selecting among possible future scenarios—in short, for planning. The vertebrate invasion of land may have been an important step in their cognitive evolution. Habitat complexity influences the sensory ecology of predator-prey interactions. Here, the authors show that habitat complexity also affects the use of different decision-making paradigms, namely habit- and plan-based action selection. Simulations across habitat types show that only savanna-like terrestrial habitats favor planning during visually-guided predator evasion, while aquatic and simple terrestrial habitats do not.

[1]  Nguyen Xuan Thinh,et al.  Adapting lacunarity techniques for gradient-based analyses of landscape surfaces , 2011 .

[2]  C. S. Holling,et al.  Prey capture by the African lion , 1977 .

[3]  Lucia F. Jacobs,et al.  From chemotaxis to the cognitive map: The function of olfaction , 2012, Proceedings of the National Academy of Sciences.

[4]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[5]  W. Hargrove,et al.  Lacunarity analysis: A general technique for the analysis of spatial patterns. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[6]  J. Lupovitch In the Blink of an Eye: How Vision Sparked the Big Bang of Evolution , 2006 .

[7]  S. Grillner,et al.  Evolutionary Conservation of the Basal Ganglia as a Common Vertebrate Mechanism for Action Selection , 2011, Current Biology.

[8]  Maik C. Stüttgen,et al.  Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale , 2013, PloS one.

[9]  Jacqueline N. Crawley,et al.  Anxiety-Related Behaviors in Mice , 2009 .

[10]  James R. Anderson,et al.  A land use and land cover classification system for use with remote sensor data , 1976 .

[11]  T. Shackelford,et al.  The Oxford handbook of comparative evolutionary psychology , 2012 .

[12]  Hong S. He,et al.  Evaluating the effectiveness of neutral landscape models to represent a real landscape , 2004 .

[13]  R. Yosef,et al.  Cooperative hunting in Brown-Necked Raven (Corvus rufficollis) on Egyptian Mastigure (Uromastyx aegyptius) , 2010, Journal of Ethology.

[14]  S. L. Lima Ecological and evolutionary perspectives on escape from predatory attack: a survey of North American birds , 1993 .

[15]  T. Nakashizuka,et al.  Integrative Observations and Assessments , 2014, Ecological Research Monographs.

[16]  F. Rodríguez,et al.  Hippocampal Pallium and Map-Like Memories through Vertebrate Evolution , 2015 .

[17]  M. A. MacIver,et al.  Massive increase in visual range preceded the origin of terrestrial vertebrates , 2017, Proceedings of the National Academy of Sciences.

[18]  Seng Bum Michael Yoo,et al.  The Neural Basis of Predictive Pursuit , 2019, Nature Neuroscience.

[19]  David P. Williams Fast Unsupervised Seafloor Characterization in Sonar Imagery Using Lacunarity , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  David J. Foster Replay Comes of Age. , 2017, Annual review of neuroscience.

[21]  K. O. Niemann,et al.  Simulation and quantification of the fine-scale spatial pattern and heterogeneity of forest canopy structure: A lacunarity-based method designed for analysis of continuous canopy heights , 2005 .

[22]  Y. Malhi,et al.  Analysis of lacunarity and scales of spatial homogeneity in IKONOS images of Amazonian tropical forest canopies , 2008 .

[23]  R. Bshary,et al.  Fish cognition: a primate's eye view , 2002, Animal Cognition.

[24]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[25]  Gabriel B. Mindlin,et al.  Temperature manipulation of neuronal dynamics in a forebrain motor control nucleus , 2017, PLoS Comput. Biol..

[26]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[27]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[28]  S. Bell,et al.  Influence of physical setting on seagrass landscapes near Beaufort, North Carolina, USA , 1998 .

[29]  Lawrence M. Witmer,et al.  Evolution of olfaction in non-avian theropod dinosaurs and birds , 2011, Proceedings of the Royal Society B: Biological Sciences.

[30]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[31]  G. Boggs,et al.  Measuring fragmentation of seagrass landscapes: which indices are most appropriate for detecting change? , 2005 .

[32]  M. Brunet,et al.  The mammal assemblage of the hominid site TM266 (Late Miocene, Chad Basin): ecological structure and paleoenvironmental implications , 2009, Naturwissenschaften.

[33]  K. Jeffery Self-localization and the entorhinal–hippocampal system , 2007, Current Opinion in Neurobiology.

[34]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[35]  Allison M. Barnard,et al.  The evolution of self-control , 2014, Proceedings of the National Academy of Sciences.

[36]  David J. Foster,et al.  A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[37]  Todd D. Murphey,et al.  Ergodic Exploration of Distributed Information , 2016, IEEE Transactions on Robotics.

[38]  Andrew A. Biewener,et al.  Unpredictability of escape trajectory explains predator evasion ability and microhabitat preference of desert rodents , 2017, Nature Communications.

[39]  R. Kadmon,et al.  Indirect effects of cattle grazing on shrub spatial pattern in a mediterranean scrub community , 2006 .

[40]  Sönke Johnsen,et al.  Computational visual ecology in the pelagic realm , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  Redouan Bshary,et al.  Interspecific Communicative and Coordinated Hunting between Groupers and Giant Moray Eels in the Red Sea , 2006, PLoS biology.

[42]  P. Dayan,et al.  Adaptive integration of habits into depth-limited planning defines a habitual-goal–directed spectrum , 2016, Proceedings of the National Academy of Sciences.

[43]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[44]  Mihir A. Topiwala,et al.  Synchronized Activity between the Ventral Hippocampus and the Medial Prefrontal Cortex during Anxiety , 2010, Neuron.

[45]  Maureen C. Kennedy,et al.  Scaling and Complexity in Landscape Ecology , 2019, Front. Ecol. Evol..

[46]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[47]  Jean-Baptiste Masson,et al.  Olfactory searches with limited space perception , 2013, Proceedings of the National Academy of Sciences.

[48]  André Longtin,et al.  A time-stamp mechanism may provide temporal information necessary for egocentric to allocentric spatial transformations , 2018, eLife.

[49]  Christopher M. Berry,et al.  Surprisingly complex community discovered in the mid-Devonian fossil forest at Gilboa , 2012, Nature.

[50]  T. Robinson,et al.  Using empirical and simulation approaches to quantify merits of rival measures of structural complexity in marine habitats. , 2019, Marine environmental research.

[51]  L. Maler,et al.  Cellular and Network Mechanisms May Generate Sparse Coding of Sequential Object Encounters in Hippocampal-Like Circuits , 2019, eNeuro.

[52]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[53]  L. David Mech,et al.  Possible Use of Foresight, Understanding, and Planning by Wolves Hunting Muskoxen , 2009 .

[54]  L. Maler,et al.  Hippocampal‐like circuitry in the pallium of an electric fish: Possible substrates for recursive pattern separation and completion , 2017, The Journal of comparative neurology.

[55]  Phillip Bonacich,et al.  Some unique properties of eigenvector centrality , 2007, Soc. Networks.

[56]  Jennifer L. Dungan,et al.  Illustrations and guidelines for selecting statistical methods for quantifying spatial pattern in ecological data , 2002 .

[57]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[58]  Alan M. Wilson,et al.  Energy cost and return for hunting in African wild dogs and cheetahs , 2016, Nature Communications.

[59]  Mattias P. Karlsson,et al.  Constant Sub-second Cycling between Representations of Possible Futures in the Hippocampus , 2019, Cell.

[60]  B. Finlay,et al.  The Limbic System in Mammalian Brain Evolution , 2007, Brain, Behavior and Evolution.

[61]  Jonathan D Victor,et al.  Elementary sensory-motor transformations underlying olfactory navigation in walking fruit-flies , 2018, bioRxiv.

[62]  R. Colwill,et al.  On the edge: Pharmacological evidence for anxiety-related behavior in zebrafish larvae , 2012, Behavioural Brain Research.

[63]  M. A. MacIver,et al.  Visual Threat Assessment and Reticulospinal Encoding of Calibrated Responses in Larval Zebrafish , 2017, Current Biology.

[64]  Zeb Kurth-Nelson,et al.  What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior , 2018, Neuron.

[65]  N. Daw Are we of two minds? , 2018, Nature Neuroscience.

[66]  Andrew Parker In The Blink Of An Eye: How Vision Sparked The Big Bang Of Evolution , 2004 .

[67]  M. A. MacIver,et al.  Sensory acquisition in active sensing systems , 2006, Journal of Comparative Physiology A.

[68]  G. Vermeij How the Land Became the Locus of Major Evolutionary Innovations , 2017, Current Biology.

[69]  O. Güntürkün The avian ‘prefrontal cortex’ and cognition , 2005, Current Opinion in Neurobiology.

[70]  Sönke Johnsen,et al.  Visual Acuity and the Evolution of Signals. , 2018, Trends in ecology & evolution.

[71]  Manuela M. Veloso,et al.  Probabilistic policy reuse in a reinforcement learning agent , 2006, AAMAS '06.

[72]  R. O'Neill,et al.  Lacunarity indices as measures of landscape texture , 1993, Landscape Ecology.

[73]  B. H. Kaye A random walk through fractal dimensions , 1989 .

[74]  Takehisa Yamakita,et al.  Landscape Mosaicness in the Ocean: Its Significance for Biodiversity Patterns in Benthic Organisms and Fish , 2014 .

[75]  Jack E. Bresenham,et al.  Run Length Slice Algorithm for Incremental Lines , 1985 .

[76]  Kevin J. Miller,et al.  Dorsal hippocampus contributes to model-based planning , 2017, Nature Neuroscience.

[77]  Anders Hedenström,et al.  Predator versus prey: on aerial hunting and escape strategies in birds , 2001 .

[78]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[79]  J. Marshall,et al.  Mid-Devonian Archaeopteris Roots Signal Revolutionary Change in Earliest Fossil Forests , 2019, Current Biology.

[80]  Jai Y. Yu,et al.  Hippocampal–cortical interaction in decision making , 2015, Neurobiology of Learning and Memory.

[81]  Xinyu Liu,et al.  The role of nidopallium caudolaterale in the goal-directed behavior of pigeons , 2017, Behavioural Brain Research.

[82]  P. Trontelj,et al.  No need to hide in caves: shelter-seeking behavior of surface and cave ecomorphs of Asellus aquaticus (Isopoda: Crustacea). , 2019, Zoology.

[83]  G. Buzsáki Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[84]  Peter Dayan,et al.  Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange , 2015, PLoS Comput. Biol..

[85]  Todd D. Murphey,et al.  Sense organ control in moths to moles is a gamble on information through motion , 2019, bioRxiv.

[86]  D. Bonchev,et al.  Complexity in chemistry, biology, and ecology , 2005 .

[87]  Timothy B. Rowe,et al.  Fossil Evidence on Origin of the Mammalian Brain , 2011, Science.

[88]  D. O’Carroll,et al.  Vision in dim light: highlights and challenges , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[89]  J. G. Taylor,et al.  Vicarious trial and error. , 1951, Psychological review.

[90]  S. Purkis,et al.  Morphometric Patterns in Modern Carbonate Platforms Can Be Applied to the Ancient Rock Record: Similarities Between Modern Alacranes Reef and Upper Palaeozoic Platforms of the Barents Sea , 2015 .

[91]  Leo Peichl,et al.  Cone Photoreceptor Diversity in the Retinas of Fruit Bats (Megachiroptera) , 2005, Brain, Behavior and Evolution.

[92]  Alan M. Wilson,et al.  Locomotion dynamics of hunting in wild cheetahs , 2013, Nature.

[93]  Emily R. Boeving,et al.  Comparative social grooming networks in captive chimpanzees and bonobos , 2018, Primates.

[94]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[95]  M. Fee,et al.  A hypothesis for basal ganglia-dependent reinforcement learning in the songbird , 2011, Neuroscience.

[96]  Rae A. Earnshaw,et al.  Fundamental Algorithms for Computer Graphics , 1986, NATO ASI Series.

[97]  C. Ware,et al.  A novel three-dimensional analysis of functional architecture that describes the properties of macroalgae as a refuge , 2019, Marine Ecology Progress Series.

[98]  M. Brecht,et al.  Behavioral and neural correlates of hide-and-seek in rats , 2019, Science.

[99]  Sreekanth H. Chalasani,et al.  Maximally informative foraging by Caenorhabditis elegans , 2014, eLife.