Internal state dynamics shape brainwide activity and foraging behaviour

The brain has persistent internal states that can modulate every aspect of an animal’s mental experience 1 – 4 . In complex tasks such as foraging, the internal state is dynamic 5 – 8 . Caenorhabditis elegans alternate between local search and global dispersal 5 . Rodents and primates exhibit trade-offs between exploitation and exploration 6 , 7 . However, fundamental questions remain about how persistent states are maintained in the brain, which upstream networks drive state transitions and how state-encoding neurons exert neuromodulatory effects on sensory perception and decision-making to govern appropriate behaviour. Here, using tracking microscopy to monitor whole-brain neuronal activity at cellular resolution in freely moving zebrafish larvae 9 , we show that zebrafish spontaneously alternate between two persistent internal states during foraging for live prey ( Paramecia ). In the exploitation state, the animal inhibits locomotion and promotes hunting, generating small, localized trajectories. In the exploration state, the animal promotes locomotion and suppresses hunting, generating long-ranging trajectories that enhance spatial dispersion. We uncover a dorsal raphe subpopulation with persistent activity that robustly encodes the exploitation state. The exploitation-state-encoding neurons, together with a multimodal trigger network that is associated with state transitions, form a stochastically activated nonlinear dynamical system. The activity of this oscillatory network correlates with a global retuning of sensorimotor transformations during foraging that leads to marked changes in both the motivation to hunt for prey and the accuracy of motor sequences during hunting. This work reveals an important hidden variable that shapes the temporal structure of motivation and decision-making. During foraging for live prey, zebrafish larvae alternate between persistent exploitation and exploration behavioural states that correlate with distinct patterns of neuronal activation.

[1]  M. Orger,et al.  Structure of the Zebrafish Locomotor Repertoire Revealed with Unsupervised Behavioral Clustering , 2018, Current Biology.

[2]  Nicholas F. Polys,et al.  High-precision registration between zebrafish brain atlases using symmetric diffeomorphic normalization , 2016, bioRxiv.

[3]  Donald M. O’Malley,et al.  Prey Capture by Larval Zebrafish: Evidence for Fine Axial Motor Control , 2002, Brain, Behavior and Evolution.

[4]  M. Sundvik,et al.  The comparative neuroanatomy and neurochemistry of zebrafish CNS systems of relevance to human neuropsychiatric diseases , 2010, Neurobiology of Disease.

[5]  Kevin M. Cury,et al.  DeepLabCut: markerless pose estimation of user-defined body parts with deep learning , 2018, Nature Neuroscience.

[6]  E. Kremmer,et al.  The serotonergic phenotype is acquired by converging genetic mechanisms within the zebrafish central nervous system , 2007, Developmental dynamics : an official publication of the American Association of Anatomists.

[7]  Donald M. O’Malley,et al.  Prey Tracking by Larval Zebrafish: Axial Kinematics and Visual Control , 2005, Brain, Behavior and Evolution.

[8]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[9]  Robin Sibson,et al.  SLINK: An Optimally Efficient Algorithm for the Single-Link Cluster Method , 1973, Comput. J..

[10]  Stephen W. Wilson,et al.  The habenular nuclei: a conserved asymmetric relay station in the vertebrate brain , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[12]  Rainer W. Friedrich,et al.  Olfactory pattern classification by discrete neuronal network states , 2010, Nature.

[13]  Dal Hyung Kim,et al.  Pan-neuronal calcium imaging with cellular resolution in freely swimming zebrafish , 2017, Nature Methods.

[14]  L. Wiklund,et al.  Possible excitatory amino acid afferents to nucleus raphe dorsalis of the rat investigated with retrograde wheat germ agglutinin and d-[3H]aspartate tracing , 1985, Brain Research.

[15]  Wolfgang Driever,et al.  Genetic dissection of dopaminergic and noradrenergic contributions to catecholaminergic tracts in early larval zebrafish , 2009, The Journal of comparative neurology.

[16]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[17]  P. Dayan How to set the switches on this thing , 2012, Current Opinion in Neurobiology.

[18]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[19]  F. Engert,et al.  Visuomotor Transformations Underlying Hunting Behavior in Zebrafish , 2015, Current Biology.

[20]  W. Driever,et al.  Expression of the paralogous tyrosine hydroxylase encoding genes th1 and th2 reveals the full complement of dopaminergic and noradrenergic neurons in zebrafish larval and juvenile brain , 2009, The Journal of comparative neurology.

[21]  William E. Allen,et al.  Ancestral Circuits for the Coordinated Modulation of Brain State , 2017, Cell.

[22]  Badi H. Baltagi,et al.  A companion to theoretical econometrics , 2003 .

[23]  Alessandro Filosa,et al.  Feeding State Modulates Behavioral Choice and Processing of Prey Stimuli in the Zebrafish Tectum , 2016, Neuron.

[24]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  E. Charnov Optimal foraging, the marginal value theorem. , 1976, Theoretical population biology.

[26]  Takashi Kawashima,et al.  Mapping brain activity at scale with cluster computing , 2014, Nature Methods.

[27]  Z. Mainen,et al.  Activation of serotonin neurons promotes active persistence in a probabilistic foraging task , 2018, Nature Communications.

[28]  M. Wullimann,et al.  Axonal projections originating from raphe serotonergic neurons in the developing and adult zebrafish, Danio rerio, using transgenics to visualize raphe‐specific pet1 expression , 2009, The Journal of comparative neurology.

[29]  James E. Fitzgerald,et al.  Whole-brain activity mapping onto a zebrafish brain atlas , 2015, Nature Methods.

[30]  Matthias Bethge,et al.  Using DeepLabCut for 3D markerless pose estimation across species and behaviors , 2018, Nature Protocols.

[31]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  J. Fetcho,et al.  Ontogeny and innervation patterns of dopaminergic, noradrenergic, and serotonergic neurons in larval zebrafish , 2004, The Journal of comparative neurology.

[33]  G. Rainer,et al.  Basal forebrain contributes to default mode network regulation , 2018, Proceedings of the National Academy of Sciences.

[34]  João C Marques,et al.  Clusterdv: a simple density-based clustering method that is robust, general and automatic , 2018, Bioinform..

[35]  Bernt Schiele,et al.  DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model , 2016, ECCV.

[36]  Claire Wyart,et al.  Cholinergic left-right asymmetry in the habenulo-interpeduncular pathway , 2013, Proceedings of the National Academy of Sciences.

[37]  Hitoshi Okamoto,et al.  Identification of the Zebrafish Ventral Habenula As a Homolog of the Mammalian Lateral Habenula , 2010, The Journal of Neuroscience.

[38]  P. Phillips Understanding spurious regressions in econometrics , 1986 .

[39]  Evan Z. Macosko,et al.  Serotonin and the Neuropeptide PDF Initiate and Extend Opposing Behavioral States in C. elegans , 2013, Cell.