Adaptivity, Emotion, and Rationality in Human and Ambient Agent Models

A system which has the ability to take a flexible autonomous action in a dynamic, unpredictable and open environment is referred to as an agent. Agent technology has a great impact on all spheres of society. For instance, agent technology is being applied within the area of ambient intelligence, which has become one of the most dynamic, demanding and exciting domains of computational sciences nowadays. The ambient intelligence domain, aimed at having a ubiquitous computing environment with the focus of providing invisible support for humans, can play a vital role in future developments. The goal of this PhD thesis is to contribute to the domain of ambient intelligence by means of the development of ambient agents that are aware of the various characteristics of humans as well as their mental processes and states. Using this knowledge, ambient agents can provide highly personalized and dedicated support for humans, for instance to support them during decision making. In this PhD thesis three human aspects are considered, namely adaptivity, emotions, and rationality. To come to ambient agents that are able to understand these processes, models that represent the human processes have been developed and incorporated within ambient agents. These models are based on well recognized theories that are available in different disciplines, such as biology, neurology, psychology, and sociology. The goal of this PhD thesis is to determine a way in which such models of human processes can be developed, as well as to develop measures using which they can be evaluated. For this purpose, first, a variety of approaches is explored to design ambient agents equipped with the awareness of a human’s cognitive and affective states. The models designed and analyzed in this dissertation indeed show that ambient agents can be made aware of various characteristics of humans and their environment. In particular three levels have been explored: the cognitive level, the neurological level, and the level of interaction of the human with the environment. For the cognitive level, it has been shown how beliefs, desires, intentions, emotional states, and visual attention can be modeled. From the neurological perspective, models for mirroring, inverse mirroring and false attribution of self-generated (e.g., manual or verbal) actions to other agents have been developed. With respect to the interaction of the human with the environment, the ecological domain has been addressed, which covers the background for modeling an ambient agent that can reason about environmental dynamics. Secondly, to introduce measures through which the ‘human likeness’ of the proposed models can be assessed, a nontrivial question is addressed, namely whether the agent is behaving rationally in a changing environment or not. For this purpose, in this dissertation two rationality measures are introduced, which prove useful to evaluate the behavior of the proposed model.

[1]  G. Saridis Parameter estimation: Principles and problems , 1983, Proceedings of the IEEE.

[2]  Jan Treur,et al.  A Cognitive Agent Model Incorporating Prior and Retrospective Ownership States for Actions , 2011, IJCAI.

[3]  A. Damasio The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[4]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[5]  Patrick T. Vargas,et al.  Mood effects on eyewitness memory: Affective influences on susceptibility to misinformation , 2005 .

[6]  Tibor Bosse,et al.  Specification and Verification of Dynamics in Cognitive Agent Models , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[7]  Peter D. Richardson,et al.  Numerical Methods in Engineering and Science , 1987 .

[8]  Floris Linnebank,et al.  A qualitative model of limiting factors for a salmon life cycle in the context of river rehabilitation , 2009, Ecol. Informatics.

[9]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[10]  Manuela M. Veloso,et al.  A real-time world model for multi-robot teams with high-latency communication , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[11]  Sara E. Morrison,et al.  Re-valuing the amygdala , 2010, Current Opinion in Neurobiology.

[12]  N. Weinberger Specific long-term memory traces in primary auditory cortex , 2004, Nature Reviews Neuroscience.

[13]  Jan Treur,et al.  Analysis of multi-interpretable ecological monitoring information , 2002, Applications of Uncertainty Formalisms.

[14]  A. Fuchs,et al.  Prediction in the oculomotor system: smooth pursuit during transient disappearance of a visual target , 2004, Experimental Brain Research.

[15]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Tibor Bosse,et al.  An Adaptive Model for Dynamics of Desiring and Feeling Based on Hebbian Learning , 2010, Brain Informatics.

[17]  Jan Treur,et al.  A Cognitive Agent Model Using Inverse Mirroring for False Attribution of Own Actions to Other Agents , 2011, IEA/AIE.

[18]  Leonardo Franklin Fontenelle,et al.  Obsessive-Compulsive Disorder, Impulse Control Disorders and Drug Addiction , 2011, Drugs.

[19]  István Vajk,et al.  INTERNAL MODEL-BASED CONTROLLER FOR A SOLAR PLANT , 2002 .

[20]  N. Yamamura,et al.  A simple model of host-parasitoid interaction with host-feeding , 1988, Researches on Population Ecology.

[21]  Tibor Bosse,et al.  Attention Manipulation for Naval Tactical Picture Compilation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[22]  I. Sobol Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[23]  David B. Kaber,et al.  Situation awareness and attention allocation measures for quantifying telepresence experiences in teleoperation , 2004 .

[24]  James C. Lester,et al.  Deictic Believability: Coordinated Gesture, Locomotion, and Speech in Lifelike Pedagogical Agents , 1999, Appl. Artif. Intell..

[25]  M. Iacoboni Mirroring People: The New Science of How We Connect with Others , 2008 .

[26]  Tibor Bosse,et al.  Model-Based Reasoning Methods within an Ambient Intelligent Agent Model , 2007, AmI Workshops.

[27]  Soroosh Sorooshian,et al.  A 'User-Friendly' approach to parameter estimation in hydrologic models , 2006 .

[28]  M. Potenza,et al.  Introduction to Behavioral Addictions , 2010, The American journal of drug and alcohol abuse.

[29]  Alois Ferscha,et al.  Constructing Ambient Intelligence - AmI 2007 Workshops Darmstadt, Germany, November 7-10, 2007 Revised Papers , 2008, AmI Workshops.

[30]  E. Murray The amygdala, reward and emotion , 2007, Trends in Cognitive Sciences.

[31]  Antonio Damasio,et al.  The somatic marker hypothesis: A neural theory of economic decision , 2005, Games Econ. Behav..

[32]  B. C. Patten,et al.  Control system approaches to ecological systems analysis: Invariants and frequency response , 2009 .

[33]  Giovanni Galfano,et al.  Color, form and luminance capture attention in visual search , 2000, Vision Research.

[34]  Shahram Jamali,et al.  Internet congestion control using nature population control tactics , 2007, Ecol. Informatics.

[35]  Tibor Bosse,et al.  Adaptive Estimation of Emotion Generation for an Ambient Agent Model , 2008, AmI.

[36]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[37]  Jaime A. Pineda,et al.  Mirror neuron systems : the role of mirroring processes in social cognition , 2009 .

[38]  R. Abielmona,et al.  Robotic sensor agents: a new generation of intelligent agents for complex environment monitoring , 2004, IEEE Instrumentation & Measurement Magazine.

[39]  Ellen van Donk,et al.  Chemical information transfer in freshwater plankton , 2007, Ecol. Informatics.

[40]  杉江 昇,et al.  J.H. Milsum: Biological Control Systems Analysis, McGraw-Hill Book Co., New York, 1966, 466頁, 15×23cm, 7,000円. , 1967 .

[41]  Jon C. Helton,et al.  Numerical methods in engineering and science , 1986 .

[42]  Tracey J. Shors,et al.  Memory traces of trace memories: neurogenesis, synaptogenesis and awareness , 2004, Trends in Neurosciences.

[43]  H. Hemami Principles in biological regulation: An introduction to feedback systems , 1975, Proceedings of the IEEE.

[44]  N. Yamamura Evolution of mutualistic symbiosis: A differential equation model , 1996, Researches on Population Ecology.

[45]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[46]  A. Damasio,et al.  Role of the Amygdala in Decision‐Making , 2003, Annals of the New York Academy of Sciences.

[47]  Bert Bredeweg,et al.  Representing and managing uncertainty in qualitative ecological models , 2009, Ecol. Informatics.

[48]  K. Mazi,et al.  A groundwater-based, objective-heuristic parameter optimisation method for a precipitation-runoff model and its application to a semi-arid basin , 2004 .

[49]  Tibor Bosse,et al.  A RECURSIVE BDI AGENT MODEL FOR THEORY OF MIND AND ITS APPLICATIONS , 2011, Appl. Artif. Intell..

[50]  Ewart R. Carson,et al.  Dealing with bio- and ecological complexity: Challenges and opportunities☆ , 2005, Annual Reviews in Control.

[51]  Amy Coplan Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading by goldman, alvin , 2008 .

[52]  Tibor Bosse,et al.  A Language and Environment for Analysis of Dynamics by Simulation , 2005, Int. J. Artif. Intell. Tools.

[53]  Michel C. A. Klein,et al.  An Agent-Based Generic Model for Human-Like Ambience , 2007, AmI Workshops.

[54]  Tibor Bosse,et al.  Automated Visual Attention Manipulation , 2009, WAPCV.

[55]  Gregory P. Lee,et al.  Different Contributions of the Human Amygdala and Ventromedial Prefrontal Cortex to Decision-Making , 1999, The Journal of Neuroscience.

[56]  Jan Treur,et al.  On Rationality of Decision Models Incorporating Emotion-Related Valuing and Hebbian Learning , 2011, ICONIP.

[57]  Jan Treur,et al.  A software environment for a human-aware ambient agent supporting attention-demanding tasks , 2010, ICCS.

[58]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[59]  Andrew Fall,et al.  A domain-specific language for models of landscape dynamics , 2001 .

[60]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[61]  Xiaohui Xie,et al.  Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.

[62]  Michel C. A. Klein,et al.  A Component-Based Ambient Agent Model for Assessment of Driving Behaviour , 2008, UIC.

[63]  Chisato Numaoka,et al.  Symbioses and Co-Evolution in Animats , 1995, ECAL.

[64]  E.M. Petriu,et al.  Intelligent robotic sensor agents for environment monitoring , 2002, 2002 IEEE International Symposium on Virtual and Intelligent Measurement Systems (IEEE Cat. No.02EX545).

[65]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[66]  E. R. Carson,et al.  Control approaches to bio- and ecological systems , 2004 .

[67]  Zhenkun Huang,et al.  Incorporate intelligence into an ecological system: An adaptive fuzzy control approach , 2006, Appl. Math. Comput..

[68]  Bert Bredeweg,et al.  Expertise in Qualitative Prediction of Behaviour , 2001 .

[69]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[70]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[71]  Tibor Bosse,et al.  An Adaptive Human-Aware Software Agent Supporting Attention-Demanding Tasks , 2009, PRIMA.

[72]  Mark Hoogendoorn,et al.  Modelling the Interplay of Emotions, Beliefs and Intentions within Collective Decision Making Based on Insights from Social Neuroscience , 2010, ICONIP.

[73]  John K. Tsotsos,et al.  Attention in Cognitive Systems, 5th International Workshop on Attention in Cognitive Systems, WAPCV 2008, Fira, Santorini, Greece, May 12, 2008, Revised Selected Papers , 2009, WAPCV.

[74]  Jan Treur,et al.  An agent model integrating an adaptive model for environmental dynamics , 2011, Int. J. Intell. Inf. Database Syst..

[75]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[76]  Bert Bredeweg,et al.  The Ants' Garden: Qualitative Models of complex Interactions between Populations , 2006 .

[77]  Henrik Madsen,et al.  Parameter estimation in distributed hydrological catchment modelling using automatic calibration with multiple objectives , 2003 .

[78]  Peter Gärdenfors Slicing the theory of mind , 2001 .

[79]  P. Reed,et al.  Hydrology and Earth System Sciences Discussions Comparing Sensitivity Analysis Methods to Advance Lumped Watershed Model Identification and Evaluation , 2022 .

[80]  Bert Bredeweg,et al.  Modelling population and community dynamics with qualitative reasoning , 2006 .

[81]  T. B. Üstün,et al.  Age of onset of mental disorders: a review of recent literature , 2007, Current opinion in psychiatry.

[82]  P. Hessburg,et al.  Decision support for evaluating landscape departure and prioritizing forest management activities in a changing environment , 2008 .

[83]  Tibor Bosse,et al.  Formalisation of Damasio’s theory of emotion, feeling and core consciousness , 2008, Consciousness and Cognition.

[84]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[85]  H. M. Rauscher,et al.  Decision Support for Ecosystem Management and Ecological Assessments (Chapter 12) , 1999 .

[86]  Jan Treur,et al.  Multi-interpretation operators and approximate classification , 2003, Int. J. Approx. Reason..

[87]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[88]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[89]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[90]  J. De Baerdemaeker,et al.  Optimization of storage system of fruits using neural networks and genetic algorithms , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[91]  Soroosh Sorooshian,et al.  Sensitivity analysis of a land surface scheme using multicriteria methods , 1999 .

[92]  Jan Treur,et al.  An Ambient Agent Model Incorporating an Adaptive Model for Environmental Dynamics , 2010, ACIIDS.

[93]  Paul D. Bates,et al.  Distributed Sensitivity Analysis of Flood Inundation Model Calibration , 2005 .

[94]  Mark E. Jensen,et al.  A guidebook for integrated ecological assessments , 2001 .

[95]  Claus C. Hilgetag,et al.  Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala , 2007, NeuroImage.

[96]  Floris Linnebank,et al.  Garp3 - Workbench for qualitative modelling and simulation , 2009, Ecol. Informatics.

[97]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[98]  M. Winterbottom,et al.  How Homo became Sapiens — On the Evolution of Thinking , 2006 .

[99]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[100]  P. Haggard,et al.  Awareness of action: Inference and prediction , 2008, Consciousness and Cognition.

[101]  Sang-Hee Lee,et al.  A simulation study of subterranean termites' territory formation , 2009, Ecol. Informatics.

[102]  Mark Hoogendoorn,et al.  An Ecological Model-Based Reasoning Model to Support Nature Park Managers , 2009, IEA/AIE.

[103]  K. Reynolds Integrated decision support for sustainable forest management in the United States: Fact or fiction? , 2005 .

[104]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[105]  Eugenia Cioaca,et al.  A qualitative reasoning model of algal bloom in the Danube Delta Biosphere Reserve (DDBR) , 2009, Ecol. Informatics.

[106]  P. Reed,et al.  Sensitivity-guided reduction of parametric dimensionality for multi-objective calibration of watershed models , 2009 .

[107]  Tetsuo Morimoto,et al.  Intelligent systems for agriculture in Japan , 2001 .

[108]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[109]  Stefano Fusi,et al.  Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. , 2010, Annual review of neuroscience.

[110]  Tibor Bosse,et al.  Simulation and formal analysis of visual attention , 2009, Web Intell. Agent Syst..