Dual exploration strategies using artificial spiking neural networks in a robotic learning task

Spatial information can be valuable, but new environments may be perceived as risky and thus often evoke fear responses and risk-averse exploration strategies such as thigmotaxis or wall-following ...

[1]  M. Giurfa.  Cognition with few neurons: higher-order learning in insects , 2013, Trends in Neurosciences.

[2]  Kostis P. Michmizos,et al.  Gridbot: An autonomous robot controlled by a Spiking Neural Network mimicking the brain's navigational system , 2018, ArXiv.

[3]  Simon Benhamou,et al.  Spatial memory and animal movement. , 2013, Ecology letters.

[4]  S. Bertram,et al.  Spatial cognitive performance is linked to thigmotaxis in field crickets , 2019, Animal Behaviour.

[5]  Mounir Boukadoum,et al.  Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot's controller , 2014, Front. Neurorobot..

[6]  N. Boogert,et al.  Personality, plasticity and predictability in sticklebacks: bold fish are less plastic and more predictable than shy fish , 2019, Animal Behaviour.

[7]  S. Hamilton.  From a sea of phenotypic traits, fast reaction and boldness emerge as the most influential to survival in marine fish , 2018 .

[8]  G. A. Clark,et al.  Operant Conditioning of Gill Withdrawal in Aplysia , 2006, The Journal of Neuroscience.

[9]  E. Carvalho-Netto,et al.  Aversion in the elevated plus-maze: Role of visual and tactile cues , 2014, Behavioural Processes.

[10]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[11]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[12]  L. Chittka,et al.  Information processing in miniature brains , 2011, Proceedings of the Royal Society B: Biological Sciences.

[13]  Daniel T. Blumstein,et al.  Quantifying personality in the terrestrial hermit crab: Different measures, different inferences , 2012, Behavioural Processes.

[14]  James R. White,et al.  A Comparison of Measures of Boldness and Their Relationships to Survival in Young Fish , 2013, PloS one.

[15]  Siddharth Gaikwad,et al.  Understanding spatio-temporal strategies of adult zebrafish exploration in the open field test , 2012, Brain Research.

[16]  S. Morato,et al.  Thigmotactic responses in an open-field. , 2008, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[17]  Barbara Webb,et al.  The internal maps of insects , 2019, Journal of Experimental Biology.

[18]  G. Audesirk,et al.  One-trial reward learning in the snail Lymnea stagnalis. , 1984, Journal of neurobiology.

[19]  Jeffrey L. Krichmar,et al.  Neurorobotics—A Thriving Community and a Promising Pathway Toward Intelligent Cognitive Robots , 2018, Front. Neurorobot..

[20]  W. Schultz.  Predictive reward signal of dopamine neurons. , 1998, Journal of neurophysiology.

[21]  Henning Sprekeler,et al.  Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity , 2010, The Journal of Neuroscience.

[22]  Brian R. Tietz,et al.  Deciding Which Way to Go: How Do Insects Alter Movements to Negotiate Barriers? , 2012, Front. Neurosci..

[23]  Florentin Wörgötter,et al.  Multiple chaotic central pattern generators with learning for legged locomotion and malfunction compensation , 2014, Inf. Sci..

[24]  Ioannis M. Kyprianidis,et al.  Experimental investigation on coverage performance of a chaotic autonomous mobile robot , 2013, Robotics Auton. Syst..

[25]  F. Gherardi,et al.  Behavioral plasticity, behavioral syndromes and animal personality in crustacean decapods: An imperfect map is better than no map , 2012 .

[26]  Yongxiang Zhang,et al.  Bright lighting conditions during testing increase thigmotaxis and impair water maze performance in BALB/c mice , 2012, Behavioural Brain Research.

[27]  Vivek Jayaraman,et al.  Studying small brains to understand the building blocks of cognition , 2016, Current Opinion in Neurobiology.

[28]  P. Pauli,et al.  A Human Open Field Test Reveals Thigmotaxis Related to Agoraphobic Fear , 2016, Biological Psychiatry.

[29]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[30]  F. Wörgötter,et al.  Self-organized adaptation of a simple neural circuit enables complex robot behaviour , 2010, ArXiv.

[31]  A. Cronin.  Individual and Group Personalities Characterise Consensus Decision‐Making in an Ant , 2015 .

[32]  Ella F Cole,et al.  Studying the evolutionary ecology of cognition in the wild: a review of practical and conceptual challenges , 2016, Biological reviews of the Cambridge Philosophical Society.

[33]  N. Dingemanse,et al.  Integrating animal temperament within ecology and evolution , 2007, Biological reviews of the Cambridge Philosophical Society.

[34]  A. Avarguès-Weber,et al.  Sameness/difference spiking neural circuit as a relational concept precursor model: A bio-inspired robotic implementation , 2017, BICA 2017.

[35]  S. Healy,et al.  Environmental enrichment enhances spatial cognition in rats by reducing thigmotaxis (wall hugging) during testing , 2009, Animal Behaviour.

[36]  B. Brembs.  Operant conditioning in invertebrates , 2003, Current Opinion in Neurobiology.

[37]  Su Guo,et al.  Identification of environmental stressors and validation of light preference as a measure of anxiety in larval zebrafish , 2016, BMC Neuroscience.

[38]  André Cyr,et al.  Action Selection and Operant Conditioning: A Neurorobotic Implementation , 2015, J. Robotics.

[39]  Pierre Poirier,et al.  AI-SIMCOG: a simulator for spiking neurons and multiple animats’ behaviours , 2009, Neural Computing and Applications.

[40]  E. Fernández-Juricic,et al.  Individual variation in behavioural plasticity: direct and indirect effects of boldness, exploration and sociability on habituation to predators in lizards , 2011, Proceedings of the Royal Society B: Biological Sciences.

[41]  Joël Fagot,et al.  First trial rewards promote 1-trial learning and prolonged memory in pigeon and baboon , 2009, Proceedings of the National Academy of Sciences.

[42]  N. Dochtermann,et al.  Multiple Facets of Exploratory Behavior in House Crickets (Acheta domesticus): Split Personalities or Simply Different Behaviors? , 2014 .

[43]  N. Ravaja,et al.  Twenty-three generations of mice bidirectionally selected for open-field thigmotaxis: Selection response and repeated exposure to the open field , 2006, Behavioural Processes.

[44]  M. Giurfa.  Learning and cognition in insects. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[45]  Clint J. Perry,et al.  Invertebrate learning and cognition: relating phenomena to neural substrate. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[46]  Ezequiel A. Di Paolo,et al.  Evolving spike-timing-dependent plasticity for single-trial learning in robots , 2003 .

[47]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[48]  J. Stamps,et al.  Individual differences in behavioural plasticities , 2016, Biological reviews of the Cambridge Philosophical Society.

[49]  Guy Theraulaz,et al.  The Embodiment of Cockroach Aggregation Behavior in a Group of Micro-robots , 2008, Artificial Life.

[50]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[51]  B. Webb.  Neural mechanisms for prediction: do insects have forward models? , 2004, Trends in Neurosciences.

[52]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[53]  Angelo Cangelosi,et al.  A review of abstract concept learning in embodied agents and robots , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  J. Deneubourg,et al.  The role of personality variation, plasticity and social facilitation in cockroach aggregation , 2018, Biology Open.