A Model of Emotion as Patterned Metacontrol

Abstract Adaptive agents use feedback as a key strategy to cope with uncertainty and change in their environments. The information fed back from the sensorimotor loop into the control subsystem can be used to change four different elements of the controller: parameters associated to the control model, the control model itself, the functional organization of the agent and the functional realization of the agent. There are many change alternatives and hence the complexity of the agent’s space of potential configurations is daunting. The only viable alternative for space- and time-constrained agents in practical, economical, evolutionary terms is to achieve a reduction of the dimensionality of this configuration space. Emotions play a critical role in this reduction. The reduction is achieved by functionalization, interface minimization and by patterning, i.e. by selection among a predefined set of organizational configurations. This analysis lets us state how autonomy emerges from the integration of cognitive, emotional and autonomic systems in strict functional terms: autonomy is achieved by the closure of functional dependency. Emotion-based morphofunctional systems are able to exhibit complex adaptation patterns at a reduced cognitive cost. In this article we show a general model of how emotion supports functional adaptation and how the emotional biological systems operate following this theoretical model. We will also show how this model is also of applicability to the construction of a wide spectrum of artificial systems.

[1]  José Luis de la Mata,et al.  Accident prevention by control system reconfiguration , 2010, Comput. Chem. Eng..

[2]  James L. McClelland The Place of Modeling in Cognitive Science , 2009, Top. Cogn. Sci..

[3]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[4]  Carlos Hernández,et al.  Principles for consciousness in integrated cognitive control , 2007, Neural Networks.

[5]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[6]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[7]  Jan Treur An integrative dynamical systems perspective on emotions , 2013, BICA 2013.

[8]  David A Lewis,et al.  Neural and behavioral substrates of mood and mood regulation , 2002, Biological Psychiatry.

[9]  D. Dennett Kinds of Minds: Towards an Understanding of Consciousness , 1996 .

[10]  Papez Jw A proposed mechanism of emotion. 1937. , 1995 .

[11]  Ricardo Sanz,et al.  About the Validity of Computer Models in Cognitive Science - eScholarship , 2010 .

[12]  Richard J. Davidson,et al.  Parsing the subcomponents of emotion and disorders of emotion: Perspectives from affective neuroscience. , 2003 .

[13]  Joseph E LeDoux Rethinking the Emotional Brain , 2012, Neuron.

[14]  R. H. Weston,et al.  Reconfigurable, component-based systems and the role of enterprise engineering concepts , 1999 .

[15]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[16]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[17]  B. Cuthbert,et al.  Fear and the startle reflex: blink modulation and autonomic response patterns in animal and mutilation fearful subjects. , 1997, Psychophysiology.

[18]  Ricardo Sanz,et al.  CONSCIOUSNESS, ACTION SELECTION, MEANING AND PHENOMENIC ANTICIPATION , 2012 .

[19]  Rogério de Lemos,et al.  Software Engineering for Self-Adaptive Systems [outcome of a Dagstuhl Seminar] , 2009, Software Engineering for Self-Adaptive Systems.

[20]  Pierre Poirier,et al.  The emergence of (artificial) emotions from cognitive and neurological processes , 2013, BICA 2013.

[21]  J. Krichmar Design principles for biologically inspired cognitive robotics , 2012, BICA 2012.

[22]  Carlos Hernández,et al.  Cognitive Ontologies: Mapping Structure and Function of the Brain from a Systemic View , 2008, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[23]  R. Sanz,et al.  Enhancing control architectures using CORBA , 2001, Proceeding of the 2001 IEEE International Symposium on Intelligent Control (ISIC '01) (Cat. No.01CH37206).

[24]  Bradley R. Schmerl,et al.  Architecture-based self-adaptation in the presence of multiple objectives , 2006, SEAMS '06.

[25]  Filip De Turck,et al.  An Ontology-Driven Semantic Bus for Autonomic Communication Elements , 2010, MACE.

[26]  Gabor Karsai,et al.  Model-Integrated Computing , 1997, Computer.

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  P. Petta,et al.  Computational models of emotion , 2010 .

[29]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[30]  H. Klüver,et al.  PRELIMINARY ANALYSIS OF FUNCTIONS OF THE TEMPORAL LOBES IN MONKEYS , 1939 .

[31]  Amir Hussain,et al.  Brain Inspired Cognitive Systems 2008 , 2009 .

[32]  R. Adolphs,et al.  Fear and the human amygdala , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  R. Sanz,et al.  Fridges, elephants, and the meaning of autonomy and intelligence , 2000, Proceedings of the 2000 IEEE International Symposium on Intelligent Control. Held jointly with the 8th IEEE Mediterranean Conference on Control and Automation (Cat. No.00CH37147).

[34]  M. Bradley,et al.  Affective startle modulation in anticipation and perception. , 2001, Psychophysiology.

[35]  Richard L. Lewis,et al.  A computational unification of cognitive behavior and emotion , 2009, Cognitive Systems Research.

[36]  Hod Lipson,et al.  The Nature of Life: Classical and Contemporary Perspectives from Philosophy and Science: Automatic design and manufacture of robotic life forms , 2010 .

[37]  Kristen A. Lindquist,et al.  A functional architecture of the human brain: emerging insights from the science of emotion , 2012, Trends in Cognitive Sciences.

[38]  Mark D. Humphries,et al.  BRAHMS: Novel middleware for integrated systems computation , 2010, Adv. Eng. Informatics.

[39]  Michael L. Hines,et al.  NeuroML: A Language for Describing Data Driven Models of Neurons and Networks with a High Degree of Biological Detail , 2010, PLoS Comput. Biol..

[40]  Martin L. Griss Product-line architectures , 2001 .

[41]  Joseph E LeDoux The emotional brain , 1996 .

[42]  Tom Ziemke,et al.  On the role of emotion in biological and robotic autonomy , 2008, Biosyst..

[43]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[44]  Etienne B. Roesch,et al.  A Blueprint for Affective Computing: A Sourcebook and Manual , 2010 .

[45]  Antonio Chella,et al.  From Brains to Systems , 2011 .

[46]  J. Gabrieli,et al.  Rethinking Feelings: An fMRI Study of the Cognitive Regulation of Emotion , 2002, Journal of Cognitive Neuroscience.

[47]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[48]  Rolf Pfeifer,et al.  Morpho-functional machines : the new species : designing embodied intelligence , 2003 .

[49]  E. Phelps Emotion and cognition: insights from studies of the human amygdala. , 2006, Annual review of psychology.

[50]  Ricardo Sanz,et al.  An Ontological Framework for Autonomous Systems Modelling , 2010 .

[51]  J. Rosen,et al.  Animal studies of amygdala function in fear and uncertainty: Relevance to human research , 2006, Biological Psychology.

[52]  J. W. Papez A PROPOSED MECHANISM OF EMOTION , 1937 .

[53]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[54]  J. Fellous,et al.  Emotions: from brain to robot , 2004, Trends in Cognitive Sciences.

[55]  A. Damasio The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[56]  M. Uschold,et al.  Methods and applications , 1953 .

[57]  Arda Yurdakul,et al.  A dynamically reconfigurable communication architecture for multicore embedded systems , 2012, J. Syst. Archit..

[58]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[59]  Mary Shaw,et al.  A Design Space for Self-Adaptive Systems , 2010, Software Engineering for Self-Adaptive Systems.

[60]  Alex M. Andrew A Missing Link in Cybernetics: Logic and Continuity , 2009 .

[61]  Barbara Webb,et al.  Animals Versus Animats: Or Why Not Model the Real Iguana? , 2009, Adapt. Behav..

[62]  Silvestro Micera,et al.  Robotics as a future and emerging technology: biomimetics, cybernetics, and neuro-robotics in European projects , 2005, IEEE Robotics & Automation Magazine.

[63]  A. Zinober Variable Structure and Lyapunov Control , 1994 .

[64]  M. Bradley,et al.  Emotion and motivation. , 2007 .

[65]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[66]  David Brown,et al.  Model-driven systems development , 2006, IEEE Engineering Management Review.

[67]  José Luiz Fiadeiro,et al.  A Model for Dynamic Reconfiguration in Service-Oriented Architectures , 2010, ECSA.

[68]  Mary Shaw,et al.  A field guide to boxology: preliminary classification of architectural styles for software systems , 1997, Proceedings Twenty-First Annual International Computer Software and Applications Conference (COMPSAC'97).

[69]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[70]  Klaus R Scherer,et al.  Emotions are emergent processes: they require a dynamic computational architecture , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[71]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[72]  George J. Klir,et al.  An approach to general systems theory , 1971 .

[73]  Kristinn R. Thórisson From Constructionist to Constructivist A.I , 2009, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[74]  D. Moffat,et al.  Analysis of a model of emotions , 1993 .

[75]  R. Davidson,et al.  Affective neuroscience: the emergence of a discipline , 1995, Current Opinion in Neurobiology.

[76]  S. Gould The Structure of Evolutionary Theory , 2002 .

[77]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[78]  C. Bartneck Integrating the OCC model of emotions in embodied characters , 2002 .

[79]  Lisa Feldman Barrett,et al.  Grounding emotion in situated conceptualization , 2011, Neuropsychologia.

[80]  B. Baars,et al.  Cognition, Brain, and Consciousness: Introduction to Cognitive Neuroscience , 2007 .

[81]  R. Lazarus Emotion and Adaptation , 1991 .

[82]  Sven van der Meer,et al.  Modelling Autonomic Communication Environments , 2010, Lecture Notes in Computer Science.

[83]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[84]  Tibor Bosse,et al.  Formalisation of Damasio’s theory of emotion, feeling and core consciousness , 2008, Consciousness and Cognition.

[85]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[86]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[87]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[88]  Guglielmo Tamburrini,et al.  Machine Experiments and Theoretical Modelling: from Cybernetic Methodology to Neuro-Robotics , 2005, Minds and Machines.

[89]  Christopher Edwards,et al.  Sliding mode control : theory and applications , 1998 .

[90]  Vadim I. Utkin,et al.  Sliding Modes in Control and Optimization , 1992, Communications and Control Engineering Series.

[91]  J. Takeno,et al.  Robot uses emotions to detect and learn the unknown , 2013, BICA 2013.

[92]  Robert Cloutier,et al.  Applying the concept of patterns to systems architecture , 2007 .

[93]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[94]  Terrence C. Stewart,et al.  Deconstructing and reconstructing ACT-R: Exploring the architectural space , 2007, Cognitive Systems Research.

[95]  Umberto Scarfogliero,et al.  A Biologically Founded Design and Control of a Humanoid Biped , 2009 .

[96]  Cynthia Breazeal,et al.  Function meets style: insights from emotion theory applied to HRI , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[97]  Johan Vounckx,et al.  Fault-Tolerance in Massively Parallel Systems , 1994 .

[98]  P. Maclean Psychosomatic Disease and the "Visceral Brain": Recent Developments Bearing on the Papez Theory of Emotion , 1949, Psychosomatic medicine.

[99]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[100]  F. Barker Phineas among the phrenologists: the American crowbar case and nineteenth-century theories of cerebral localization. , 1995, Journal of neurosurgery.

[101]  Eva Hudlicka,et al.  CHALLENGES IN DEVELOPING COMPUTATIONAL MODELS OF EMOTION AND CONSCIOUSNESS , 2009 .

[102]  Risto Miikkulainen,et al.  The constructivist learning architecture: a model of cognitive development for robust autonomous robots , 2004 .

[103]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[104]  Julita Bermejo-Alonso,et al.  Systems, models and self-awareness: Towards architectural models of consciousness , 2009 .

[105]  Josh Weisberg,et al.  Higher-order theories of consciousness , 2008, Scholarpedia.

[106]  Ricardo Sanz,et al.  A rationale and vision for machine consciousness in complex controllers , 2007 .

[107]  Giovanna Di Marzo Serugendo,et al.  Modeling Self-* Systems Using Chemically-Inspired Composable Patterns , 2011, 2011 IEEE Fifth International Conference on Self-Adaptive and Self-Organizing Systems.

[108]  Michael A. Arbib,et al.  Who Needs Emotions? - The brain meets the robot , 2004, Who Needs Emotions?.

[109]  Alexandru D. Iordan,et al.  Neural correlates of emotion–cognition interactions: A review of evidence from brain imaging investigations , 2011, Journal of cognitive psychology.

[110]  W. Ashby,et al.  An Introduction to Cybernetics , 1957 .

[111]  Carlos Hernández,et al.  The Epistemic Control Loop , 2010 .

[112]  D. C. Dashfield HER MAJESTY'S STATIONERY OFFICE , 1954 .

[113]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[114]  Carlos Herrera Pérez,et al.  The morphofunctional approach to emotion modelling in robotics , 2012, Adapt. Behav..

[115]  Ian Horswill,et al.  Reinforcement Sensitivity Theory and Cognitive Architectures , 2009, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[116]  Ricardo Sanz,et al.  The operative mind: A functional, computational and modeling approach to machine consciousness , 2009 .

[117]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[118]  Carlos Herrera Pérez,et al.  Emotion as Morphofunctionality , 2013, Artificial Life.

[119]  Jean-Marc Fellous,et al.  From human emotions to robot emotions , 2004, AAAI 2004.

[120]  Eva Hudlicka,et al.  Beyond Cognition: Modeling Emotion in Cognitive Architectures , 2004, ICCM.

[121]  Jaak Panksepp,et al.  Toward a general psychobiological theory of emotions , 1982, Behavioral and Brain Sciences.

[122]  R. Davidson,et al.  The integration of negative affect, pain and cognitive control in the cingulate cortex , 2011, Nature Reviews Neuroscience.

[123]  Aaron Sloman,et al.  Exploring Design Space and Niche Space , 1995, SCAI.

[124]  Axel van Lamsweerde,et al.  From System Goals to Software Architecture , 2003, SFM.

[125]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[126]  Rodney A. Brooks,et al.  Humanoid robots , 2002, CACM.

[127]  K. Berridge,et al.  Towards a functional neuroanatomy of pleasure and happiness , 2009, Trends in Cognitive Sciences.

[128]  L. Cosmides,et al.  Evolutionary Psychology: Theoretical Foundations , 2006 .

[129]  M. Dyer Emotions and their computations: Three computer models , 1987 .

[130]  Klaus R. Scherer,et al.  Emotion, Development, and Self-Organization: Emotions as Episodes of Subsystem Synchronization Driven by Nonlinear Appraisal Processes , 2000 .

[131]  Rosalind W. Picard Affective Computing , 1997 .

[132]  Alexei V. Samsonovich,et al.  On a roadmap for the BICA Challenge , 2012, BICA 2012.

[133]  John E. Laird,et al.  The soar papers : research on integrated intelligence , 1993 .