Emotional metacontrol of attention: Top-down modulation of sensorimotor processes in a robotic visual search task

Emotions play a significant role in internal regulatory processes. In this paper, we advocate four key ideas. First, novelty detection can be grounded in the sensorimotor experience and allow higher order appraisal. Second, cognitive processes, such as those involved in self-assessment, influence emotional states by eliciting affects like boredom and frustration. Third, emotional processes such as those triggered by self-assessment influence attentional processes. Last, close emotion-cognition interactions implement an efficient feedback loop for the purpose of top-down behavior regulation. The latter is what we call ‘Emotional Metacontrol’. We introduce a model based on artificial neural networks. This architecture is used to control a robotic system in a visual search task. The emotional metacontrol intervenes to bias the robot visual attention during active object recognition. Through a behavioral and statistical analysis, we show that this mechanism increases the robot performance and fosters the exploratory behavior to avoid deadlocks.

[1]  Christopher E. Peters,et al.  Novelty Processing and Emotion: Conceptual Developments, Empirical Findings and Virtual Environments , 2011 .

[2]  Lola Cañamero,et al.  Hormonal modulation of interaction between autonomous agents , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[3]  Christian Frings,et al.  Decomposing the emotional Stroop effect , 2010, Quarterly journal of experimental psychology.

[4]  Philippe Gaussier,et al.  From grid cells and visual place cells to multimodal place cell: a new robotic architecture , 2015, Front. Neurorobot..

[5]  Philippe Gaussier,et al.  Frustration as a way toward autonomy and self-improvement in robotic navigation , 2013, 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[6]  Philippe Gaussier,et al.  Emotions as a dynamical system: the interplay between the meta-control and communication function of emotions , 2011, Paladyn J. Behav. Robotics.

[7]  Francisco J. Román,et al.  So Far So Good: Emotion in the Peripersonal/Extrapersonal Space , 2012, PloS one.

[8]  M. Coltheart,et al.  The quarterly journal of experimental psychology , 1985 .

[9]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[10]  M. Raichle,et al.  Integration of emotion and cognition in the lateral prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Marc D. Lewis Bridging emotion theory and neurobiology through dynamic systems modeling , 2005, Behavioral and Brain Sciences.

[12]  Wolfgang Grodd,et al.  Differential Influences of Emotion, Task, and Novelty on Brain Regions Underlying the Processing of Speech Melody , 2009, Journal of Cognitive Neuroscience.

[13]  Tina Iachini,et al.  Embodied perception of reachable space: how do we manage threatening objects? , 2012, Cognitive Processing.

[14]  Brian Scassellati,et al.  Active vision for sociable robots , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[16]  Tom Ziemke,et al.  Affective Modulation of Embodied Dynamics , 2008 .

[17]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[18]  J. D. McGaugh Consolidating memories. , 2015, Annual review of psychology.

[19]  J. Fellous,et al.  Emotions: from brain to robot , 2004, Trends in Cognitive Sciences.

[20]  Joseph E LeDoux Rethinking the Emotional Brain , 2012, Neuron.

[21]  J. Lisman,et al.  Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine , 2001, Hippocampus.

[22]  Graça Gaspar,et al.  Unifying Emotion and Cognition: The Flow Model Approach , 2004, FLAIRS Conference.

[23]  Graça Gaspar,et al.  Abstraction Level Regulation of Cognitive Processing Through Emotion-Based Attention Mechanisms , 2007, WAPCV.

[24]  Jeffrey L. Krichmar,et al.  A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior , 2013, Front. Neurorobot..

[25]  K. Scherer Appraisal considered as a process of multilevel sequential checking. , 2001 .

[26]  Philippe Gaussier,et al.  From self-assessment to frustration, a small step toward autonomy in robotic navigation , 2013, Front. Neurorobot..

[27]  Emily Balcetis,et al.  Wishful Seeing , 2010, Psychological science.

[28]  Tom Ziemke,et al.  The Embodied Dynamics of Emotion, Appraisal and Attention , 2008, WAPCV.

[29]  D. Hoang FLOW: The Psychology of Optimal Experience , 2018 .

[30]  R. Knight Contribution of human hippocampal region to novelty detection , 1996, Nature.

[31]  Philippe Gaussier,et al.  Emotion understanding: robots as tools and models , 2004 .

[32]  Ana Tajadura-Jiménez,et al.  I-Space: The Effects of Emotional Valence and Source of Music on Interpersonal Distance , 2011, PloS one.

[33]  Philippe Gaussier,et al.  Emotional modulation of peripersonal space as a way to represent reachable and comfort areas , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  C. Izard The Many Meanings/Aspects of Emotion: Definitions, Functions, Activation, and Regulation , 2010 .

[35]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[36]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[37]  Luiz Pessoa,et al.  Emergent processes in cognitive-emotional interactions , 2010, Dialogues in clinical neuroscience.

[38]  Lucas Paletta,et al.  Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint , 2008, Lecture Notes in Computer Science.

[39]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[40]  Philippe Gaussier,et al.  Toward a Cognitive System Algebra: Application to Facial Expression Learning and Imitation , 2003, Embodied Artificial Intelligence.

[41]  A. Hall,et al.  Adaptive Switching Circuits , 2016 .

[42]  Jean-Marc Fellous,et al.  From human emotions to robot emotions , 2004, AAAI 2004.

[43]  Martin Lotze,et al.  The functional connectivity between amygdala and extrastriate visual cortex activity during emotional picture processing depends on stimulus novelty , 2011, Biological Psychology.

[44]  Dimitri Ognibene,et al.  Ecological Active Vision: Four Bioinspired Principles to Integrate Bottom–Up and Adaptive Top–Down Attention Tested With a Simple Camera-Arm Robot , 2015, IEEE Transactions on Autonomous Mental Development.

[45]  W. Brogden Annual Review of Psychology , 1957 .

[46]  T. Dalgleish,et al.  The emotional Stroop task and psychopathology. , 1996, Psychological bulletin.

[47]  S. Marsland Novelty Detection in Learning Systems , 2008 .