Adaptive Support for Human-Computer Teams : Exploring the Use of Cognitive Models of Trust and Attention

Increasing machine intelligence leads to a shift from a mere interactive to a much more complex cooperative human-machine relation requiring a multidisciplinary development approach. This paper presents a generic multidisciplinary cognitive engineering method CE+ for the integration of human factors and artificial intelligence in the development of human-machine cooperation. Four case-studies are presented which contain a description of the developed human-machine cooperation and the adjusted CE+ method used. For each case-study the method supported research and development activities in such a way that sound knowledge bases, methodologies, and user interfaces for human-machine cooperation could be established. However, the method always needed to be tailored to the specific goals and circumstances, such as the available time, novelty, and required integration.

[1]  D. Broadbent.  Perception and communication , 1958 .

[2]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[3]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[4]  D. Kahneman,et al.  Attention and Effort , 1973 .

[5]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[6]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[7]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[8]  J. Duncan.  Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[9]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[10]  R. Wood.  Task complexity: Definition of the construct , 1986 .

[11]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[12]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[13]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[14]  Pattie Maes,et al.  Meta-Level Architectures and Reflection , 1988 .

[15]  J A Swets,et al.  Measuring the accuracy of diagnostic systems. , 1988, Science.

[16]  B. Baars.  A cognitive theory of consciousness , 1988 .

[17]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[18]  Bruce G. Coury,et al.  Status or Recommendation: Selecting the Type of Information for Decision Aiding , 1990 .

[19]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[20]  Mark H. Bickhard,et al.  Representational content in humans and machines , 1993, J. Exp. Theor. Artif. Intell..

[21]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[22]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[23]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[24]  J. Theeuwes.  Abrupt luminance change pops out; abrupt color change does not , 1995, Perception & psychophysics.

[25]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[26]  Mustapha Mouloua,et al.  Effects of Adaptive Task Allocation on Monitoring of Automated Systems , 1996, Hum. Factors.

[27]  Jaegwon Kim,et al.  Philosophy of Mind , 1996 .

[28]  G. Logan.  The CODE theory of visual attention: an integration of space-based and object-based attention. , 1996, Psychological review.

[29]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[30]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[31]  Pierre Jacob,et al.  What Minds Can Do: Intentionality in a Non-Intentional World , 1997 .

[32]  J. B. Levitt,et al.  Contrast dependence of contextual effects in primate visual cortex , 1997, nature.

[33]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[34]  David Kortenkamp,et al.  Adjustable Autonomy for Human-Centered Autonomous Systems on Mars , 1998 .

[35]  I. Rock,et al.  Inattentional blindness: Perception without attention. , 1998 .

[36]  R. Parasuraman.  The attentive brain in aging and Alzheimer's disease. , 1998 .

[37]  Rino Falcone,et al.  Principles of trust for MAS: cognitive anatomy, social importance, and quantification , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[38]  Nadine B. Sarter,et al.  Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains , 1999, Hum. Factors.

[39]  Kathleen L. Mosier,et al.  Does automation bias decision-making? , 1999, Int. J. Hum. Comput. Stud..

[40]  Linda G. Pierce,et al.  Misuse and Disuse of Automated AIDS , 1999 .

[41]  Paul Schutte,et al.  Complemation: An Alternative to Automation , 1999 .

[42]  Catholijn M. Jonker,et al.  Formal Analysis of Models for the Dynamics of Trust Based on Experiences , 1999, MAAMAW.

[43]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[44]  N. Moray,et al.  Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. , 2000, Journal of experimental psychology. Applied.

[45]  Giovanni Galfano,et al.  Color, form and luminance capture attention in visual search , 2000, Vision Research.

[46]  Dario D. Salvucci.  A Model of Eye Movements and Visual Attention , 2000 .

[47]  S. Gregor,et al.  Measuring Human-Computer Trust , 2000 .

[48]  H. Nothdurft.  Salience from feature contrast: variations with texture density , 2000, Vision Research.

[49]  Toshiyuki Inagaki,et al.  Adaptive Automation: Sharing and Trading of Control , 2001 .

[50]  Hall P. Beck,et al.  A Framework of Automation Use , 2001 .

[51]  Peter A. Hancock,et al.  Implementing Adaptive Function Allocation , 2001 .

[52]  Nadine B. Sarter,et al.  Supporting Decision Making and Action Selection under Time Pressure and Uncertainty: The Case of In-Flight Icing , 2001, Hum. Factors.

[53]  Hong Hong,et al.  Human Cognition and Social Agent Technology , 2001, J. Educ. Technol. Soc..

[54]  Raja Parasuraman,et al.  EFFECTS OF UNRELIABLE AUTOMATION ON DECISION MAKING IN COMMAND AND CONTROL , 2002 .

[55]  B. A. Chalmers,et al.  Modeling shipboard tactical picture compilation , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[56]  R. Engle,et al.  The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective , 2002, Psychonomic bulletin & review.

[57]  Sidney W. A. Dekker,et al.  MABA-MABA or Abracadabra? Progress on Human–Automation Co-ordination , 2002, Cognition, Technology & Work.

[58]  David LaBerge,et al.  Attentional control: brief and prolonged , 2002, Psychological research.

[59]  Laurent Itti,et al.  A Goal Oriented Attention Guidance Model , 2002, Biologically Motivated Computer Vision.

[60]  David B. Kaber,et al.  Comparison of Performance Effects of Adaptive Automation Applied to Various Stages of Human-Machine System Information Processing , 2002 .

[61]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[62]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[63]  Lance Chun Che Fung,et al.  Intelligent Agent Technology in E-commerce , 2003, IDEAL.

[64]  Yaoru Sun,et al.  Hierarchical object-based visual attention for machine vision , 2003 .

[65]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[66]  Misha Pavel,et al.  Augmented cognition: allocation of attention , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[67]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[68]  Catholijn M. Jonker,et al.  A temporal-interactivist perspective on the dynamics of mental states , 2003, Cognitive Systems Research.

[69]  Heinz Hügli,et al.  Empirical Validation of the Saliency-based Model of Visual Attention , 2003 .

[70]  Fred Keijzer,et al.  Duality of the mind: a bottom up approach toward cognition , 2003 .

[71]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[72]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[73]  Jordi Sabater-Mir,et al.  Review on Computational Trust and Reputation Models , 2005, Artificial Intelligence Review.

[74]  Lai Xu,et al.  Automated support for adaptive incident management [Extended Abstract] , 2004 .

[75]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[76]  David V. Pynadath,et al.  PsychSim: Agent-based Modeling of Social Interactions and Influence , 2004, ICCM.

[77]  Lai Xu,et al.  Automated support for adaptive incident management , 2004 .

[78]  Sarvapali D. Ramchurn,et al.  Trust in multi-agent systems , 2004, The Knowledge Engineering Review.

[79]  Catholijn M. Jonker,et al.  Human Experiments in Trust Dynamics , 2004, iTrust.

[80]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[81]  Mark A. Neerincx,et al.  Integrating Human Factors and Artificial Intelligence in the Development of Human-Machine Cooperation , 2005, IC-AI.

[82]  Harvey S. Smallman,et al.  Heuristic Automation for Decluttering Tactical Displays , 2005, Hum. Factors.

[83]  Jadwiga Indulska,et al.  Personalising Context-Aware Applications , 2005, OTM Workshops.

[84]  Tjerk de Greef,et al.  Automated Adaptive Support for Task and Information Prioritizing , 2005, IJCAI.

[85]  P. P. van Maanen,et al.  Designing for dynamic task allocation , 2005 .

[86]  Mark Hoogendoorn,et al.  A Meta-Level Architecture for Strategic Reasoning in Naval Planning (extended abstract) , 2005, BNAIC.

[87]  Peter-Paul van Maanen,et al.  Towards Task Allocation Decision Support by means of Cognitive Modeling of Trust (Extended Abstract) , 2005, BNAIC.

[88]  Tibor Bosse,et al.  LEADSTO: A Language and Environment for Analysis of Dynamics by SimulaTiOn , 2005, IEA/AIE.

[89]  David B. Kaber,et al.  Adaptive Automation of Human-Machine System Information-Processing Functions , 2005, Hum. Factors.

[90]  Mark Hoogendoorn,et al.  An Agent-Based Meta-level Architecture for Strategic Reasoning in Naval Planning , 2005, AOIS.

[91]  Under-trust in decision support systems , 2006 .

[92]  Ji Gao,et al.  Extending the decision field theory to model operators' reliance on automation in supervisory control situations , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[93]  Tibor Bosse,et al.  A Cognitive Model for Visual Attention and Its Application , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[94]  Ana Paiva,et al.  Using Anticipation to Create Believable Behaviour , 2006, AAAI.

[95]  M. A. Neerincx.  Operator Load Management during Task Execution in Process Control , 2006 .

[96]  Peter-Paul van Maanen,et al.  Under-reliance on the decision aid: A difference in calibration and attribution between self and aid , 2006 .

[97]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[98]  Neerincx,et al.  Task based interpretation of operator state information for adaptive support , 2006 .

[99]  A. Heuvelink,et al.  BOA: A Cognitive Tactical Picture Compilation Agent , 2007, 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT'07).

[100]  Tibor Bosse,et al.  Augmented Metacognition Addressing Dynamic Allocation of Tasks Requiring Visual Attention , 2007, HCI.

[101]  Tibor Bosse,et al.  Simulation and Formal Analysis of Visual Attention in Cognitive Systems , 2008, WAPCV.

[102]  Tibor Bosse,et al.  A Two-Level BDI-Agent Model for Theory of Mind and its Use in Social Manipulation , 2007 .

[103]  Christopher D. Wickens,et al.  Attention-Situation Awareness (A-SA) Model of Pilot Error , 2007 .

[104]  Tina Mioch,et al.  Enhancing Human Understanding through Intelligent Explanations , 2007, AmI Workshops.

[105]  Peter Carruthers,et al.  The illusion of conscious will , 2007, Synthese.

[106]  Peter-Paul van Maanen,et al.  Design and Validation of HABTA: Human Attention-Based Task Allocator , 2007, AmI Workshops.

[107]  Peter-Paul van Maanen,et al.  Aiding Human Reliance Decision Making Using Computational Models of Trust , 2007, 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops.

[108]  Tibor Bosse,et al.  Model-Based Reasoning Methods within an Ambient Intelligent Agent Model , 2007, AmI Workshops.

[109]  Tibor Bosse,et al.  Temporal differentiation of attentional processes , 2007 .

[110]  Peter-Paul van Maanen,et al.  Closed-Loop Adaptive Decision Support Based on Automated Trust Assessment , 2007, HCI.

[111]  Disclosure with an emotional intelligent synthetic partner , 2007 .

[112]  Peter-Paul van Maanen,et al.  Effects of Task Performance and Task Complexity on the Validity of Computational Models of Attention , 2008 .

[113]  Jan Treur,et al.  Cognitive and Biological Agent Models for Emotion Reading , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[114]  Mark Hoogendoorn,et al.  Formal analysis of empirical traces in incident management , 2008, Reliab. Eng. Syst. Saf..

[115]  Mehdi Dastani,et al.  2APL: a practical agent programming language , 2008, Autonomous Agents and Multi-Agent Systems.

[116]  P. P. van Maanen,et al.  Design and Validation of HABTA: Human Attention-Based Task Allocator (Extended Abstract) , 2008 .

[117]  Tibor Bosse,et al.  Automated Visual Attention Manipulation , 2009, WAPCV.

[118]  P. V. Maanen,et al.  A virtual diary companion , 2008 .

[119]  Mark Hoogendoorn,et al.  Modeling Dynamics of Relative Trust of Competitive Information Agents , 2008, CIA.

[120]  Mark Hoogendoorn,et al.  An Adaptive Agent Model Estimating Human Trust in Information Sources , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[121]  Virginia N. L. Franqueira,et al.  Finding multi-step attacks in computer networks using heuristic search and mobile ambients , 2009 .

[122]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[123]  Peter-Paul van Maanen,et al.  Adaptive Work-Centered and Human-Aware Support Agents for Augmented Cognition in Tactical Environments , 2009, HCI.

[124]  Jan Treur,et al.  Adaptation and Validation of an Agent Model of Functional State and Performance for Individuals , 2009, PRIMA.

[125]  Tibor Bosse,et al.  Simulation and formal analysis of visual attention , 2009, Web Intell. Agent Syst..

[126]  Mark Hoogendoorn,et al.  Agent-based analysis and simulation of meta-reasoning processes in strategic naval planning , 2009, Knowl. Based Syst..

[127]  Tibor Bosse,et al.  Automated visual attention manipulation [Extended Abstract] , 2009 .

[128]  Tibor Bosse,et al.  An Interface Agent for Attention Manipulation (Extended Abstract) , 2009, AAMAS 2009.

[129]  AI en HA. Human Ambience: de omgeving als beste vriend , 2009 .

[130]  Brian F. Gore,et al.  A Computational Implementation of a Human Attention Guiding Mechanism in MIDAS v5 , 2009, HCI.

[131]  Tibor Bosse,et al.  Attention Manipulation for Naval Tactical Picture Compilation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[132]  Tibor Bosse,et al.  Specification and Verification of Dynamics in Agent Models , 2009, Int. J. Cooperative Inf. Syst..

[133]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[134]  Laurent Itti,et al.  A Bayesian model for efficient visual search and recognition , 2010, Vision Research.

[135]  Rianne van Lambalgen,et al.  Personalisation of Computational Models of Attention by Simulated Annealing Parameter Tuning , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[136]  Mark Hoogendoorn,et al.  Validation and Verification of Agent Models for Trust: Independent Compared to Relative Trust , 2011, IFIPTM.

[137]  Mark Hoogendoorn,et al.  Modelling Trust Dynamics from a Neurological Perspective , 2011 .

[138]  Christopher D. Wickens,et al.  Supporting Situation Assessment through Attention Guidance and Diagnostic Aiding: The Benefits and Costs of Display Enhancement on Judgment Skill , 2012 .

[139]  Raymond C. Kurzweil,et al.  The Singularity Is Near , 2018, The Infinite Desire for Growth.