Modeling the interplay between conditioning and attention in a humanoid robot: Habituation and attentional blocking

A novel model of role of conditioning in attention is presented and evaluated on a Nao humanoid robot. The model implements conditioning and habituation in interaction with a dynamic neural field where different stimuli compete for activation. The model can be seen as a demonstration of how stimulus-selection and action-selection can be combined and illustrates how positive or negative reinforcement have different effects on attention and action. Attention is directed toward both rewarding and punishing stimuli, but appetitive actions are only directed toward positive stimuli. We present experiments where the model is used to control a Nao robot in a task where it can select between two objects. The model demonstrates some emergent effects also observed in similar experiments with humans and animals, including attentional blocking and latent inhibition.

[1]  George K. I. Mann,et al.  A Biologically Inspired Bayesian Model of Visual Attention for Humanoid Robots , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[2]  Stephan K. U. Zibner,et al.  Using Dynamic Field Theory to extend the embodiment stance toward higher cognition , 2013 .

[3]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[4]  S. Grossberg A neural model of attention, reinforcement and discrimination learning. , 1975, International review of neurobiology.

[5]  Jeremy M Wolfe,et al.  Visual Attention , 2020, Computational Models for Cognitive Vision.

[6]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[7]  L. Kamin Attention-like processes in classical conditioning , 1967 .

[8]  Gordon Cheng,et al.  Biologically Based Top-Down Attention Modulation for Humanoid Interactions , 2008, Int. J. Humanoid Robotics.

[9]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  Fakhri Karray,et al.  A Probabilistic Model of Overt Visual Attention for Cognitive Robots , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[12]  R. Lubow,et al.  Latent inhibition: the effect of nonreinforced pre-exposure to the conditional stimulus. , 1959, Journal of comparative and physiological psychology.

[13]  Christian Balkenius,et al.  Interactions between motivation, emotion and attention: From biology to robotics , 2009, EpiRob.

[14]  C. Balkenius Attention, habituation and conditioning: toward a computational model , 2000 .

[15]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[16]  J. Kruschke Toward a unified model of attention in associative learning , 2001 .

[17]  Christian Balkenius,et al.  EMOTIONAL LEARNING: A COMPUTATIONAL MODEL OF THE AMYGDALA , 2001, Cybern. Syst..

[18]  Alexandre Bernardino,et al.  Multimodal saliency-based bottom-up attention a framework for the humanoid robot iCub , 2008, 2008 IEEE International Conference on Robotics and Automation.

[19]  A. Dale,et al.  The Retinotopy of Visual Spatial Attention , 1998, Neuron.

[20]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[21]  Stefan Schaal,et al.  Overt visual attention for a humanoid robot , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[22]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[23]  C. Büchel,et al.  Neurobiological Mechanisms Underlying the Blocking Effect in Aversive Learning , 2012, The Journal of Neuroscience.

[24]  Ravi V. Chacko,et al.  Effects of Amygdala Lesions on Reward-Value Coding in Orbital and Medial Prefrontal Cortex , 2013, Neuron.