Situation Awareness-Based Agent Transparency

Abstract : Autonomous agents have been increasingly used for military operations (e.g., casualty extraction, explosive detection and disposals, reconnaissance and surveillance, supply transportation, building clearing, and firefighting), search and rescue, transportation safety, space exploration, farming, and many other purposes yet to emerge (Barnes and Evans, 2010; Greenemeier, 2010; Jones and Schmidlin, 2011; Morals and the Machine, 2012; Murphy and Burke, 2010; Osborn, 2011; Purdy, 2008; Singer, 2010). As these agents become more sophisticated and independent, it is critical for their human counterparts to understand their behaviors, the reasoning process behind those behaviors, and the expected outcomes to properly calibrate their trust in the systems and make appropriate decisions (de Visser et al., 2014; Lee and See, 2004). Indeed, past studies have shown that human operators sometimes question the accuracy and effectiveness of agents actions due to the operators difficulties understanding the state/status of the agent (Bitan and Meyer, 2007; Seppelt and Lee, 2007; Stanton et al., 2007) and the rationales behind the behaviors (Linegang et al., 2006). These limitations can be substantial impediments to overall system and task performance.

[1]  Robin R. Murphy,et al.  The Safe Human-Robot Ratio , 2016 .

[2]  Hiroshi Furukawa,et al.  Supporting System-Centered View of Operators Through Ecological Interface Design: Two Experiments on Human-Centered Automation , 2003 .

[3]  Ido Erev,et al.  The Negative Effect of Probability Assessments on Decision Quality , 1993 .

[4]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[5]  W. Hays.  Semiology of Graphics: Diagrams Networks Maps. , 1985 .

[6]  Michael J. Barnes and A. William Evans.  Soldier-Robot Teams in Future Battlefields: An Overview , 2016 .

[7]  J. Lygeros,et al.  Decision Making I , 2014 .

[8]  R. Buehler,et al.  Frequency, Probability, and Prediction: Easy Solutions to Cognitive Illusions? , 1999, Cognitive Psychology.

[9]  D. Kahneman,et al.  Conditions for intuitive expertise: a failure to disagree. , 2009, The American psychologist.

[10]  V. Reyna,et al.  Communicating Numerical Risk: Human Factors That Aid Understanding in Health Care. , 2013, Review of human factors and ergonomics.

[11]  Helwig Hauser,et al.  An Interaction View on Information Visualization , 2003, Eurographics.

[12]  Ann M. Bisantz,et al.  The impact of cognitive feedback on judgment performance and trust with decision aids , 2008 .

[13]  B. Marx.  The Visual Display of Quantitative Information , 1985 .

[14]  Linda G. Pierce,et al.  Automation Usage Decisions: Controlling Intent and Appraisal Errors in a Target Detection Task , 2007, Hum. Factors.

[15]  James T. Enns,et al.  High-speed visual estimation using preattentive processing , 1996, TCHI.

[16]  Emilie Roth,et al.  Techniques for Effective Collaborative Automation for Air Mission Replanning , 2009 .

[17]  Kim J. Vicente,et al.  Ecological Interface Design: Progress and Challenges , 2002, Hum. Factors.

[18]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[19]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[20]  M. Cummings,et al.  Human-Automation Collaboration in Complex Multivariate Resource Allocation Decision Support Systems , 2010 .

[21]  Ellen M Purdy.  The Increasing Role of Robots in National Security , 2008 .

[22]  Mary Czerwinski,et al.  Selected Human Factors Issues in Information Visualization , 2009 .

[23]  Patricia L. McDermott,et al.  Framing, Loss Aversion, and Visualization of Risk for a Dynamic Simulation Environment , 2011 .

[24]  Tor Guttormsen,et al.  Visual Calamity: Exploring Interactive Information Visualization for Tablet Interfaces , 2013 .

[25]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[26]  Philip N. Johnson-Laird,et al.  Naive Probability: A Mental Model Theory of Extensional Reasoning , 1999 .

[27]  K. J. Vicente,et al.  The Ecology of Human-Machine Systems II: Mediating 'Direct Perception' in Complex Work Domains , 1990 .

[28]  Paul R. Havig,et al.  Transparency in a Human-Machine Context: Approaches for Fostering Shared Awareness/Intent , 2014, HCI.

[29]  E. Bass,et al.  The Effect of Information Analysis Automation Display Content on Human Judgment Performance in Noisy Environments , 2013, Journal of cognitive engineering and decision making.

[30]  R. D'Andrade.  The Development of Cognitive Anthropology , 1995 .

[31]  Ching-Yuan Lin,et al.  Exploratory research on reading cognition and escape-route planning using building evacuation plan diagrams. , 2008, Applied ergonomics.

[32]  Jean-Marc Robert,et al.  Trust in new decision aid systems , 2006, IHM '06.

[33]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[34]  Bobbie D. Seppelt,et al.  Making adaptive cruise control (ACC) limits visible , 2007, Int. J. Hum. Comput. Stud..

[35]  Eric A. Cring,et al.  Architecting Human Operator Trust in Automation to Improve System Effectiveness in Multiple Unmanned Aerial Vehicles (UAV) Control , 2009 .

[36]  Ryan M. Kilgore,et al.  Increasing the Transparency of Unmanned Systems: Applications of Ecological Interface Design , 2014, HCI.

[37]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[38]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[39]  Guy H. Walker,et al.  The psychology of driving automation: a discussion with Professor Don Norman , 2007 .

[40]  P W Singer.  War of the machines. , 2010, Scientific American.

[41]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[42]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[43]  Susan S. Kirschenbaum,et al.  Effects of Graphic and Verbal Probability Information on Command Decision Making , 1994 .

[44]  N. Charness.  Search in chess: Age and skill differences. , 1981 .

[45]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots , 2012, Hum. Factors.

[46]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  John D. Lee,et al.  Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological Approach , 2006 .

[48]  Caroline C. Hayes,et al.  Uncertainty Visualizations , 2012 .

[49]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[50]  E. Vincent Cross,et al.  Explaining robot actions , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[51]  S. Kosslyn.  Understanding charts and graphs , 1989 .

[52]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[53]  A. Kirlik.  Requirements for psychological models to support design: Towards ecological task analysis , 1991 .

[54]  J. Flavell.  Metacognitive aspects of problem solving , 1976 .

[55]  Raja Parasuraman,et al.  A Design Methodology for Trust Cue Calibration in Cognitive Agents , 2014, HCI.

[56]  Richard Gonzalez,et al.  On the Shape of the Probability Weighting Function , 1999, Cognitive Psychology.

[57]  Mihnea Moldoveanu,et al.  False memories of the future: a critique of the applications of probabilistic reasoning to the study of cognitive processes. , 2002, Psychological review.

[58]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[59]  Mark Gahegan,et al.  Visual Semiotics & Uncertainty Visualization: An Empirical Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[60]  Keith S. Jones,et al.  Human-Robot Interaction Toward Usable Personal Service Robots , 2011 .

[61]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[62]  Maia B. Cook,et al.  Human Factors of the Confirmation Bias in Intelligence Analysis: Decision Support From Graphical Evidence Landscapes , 2008, Hum. Factors.

[63]  Jessie Y C Chen,et al.  Supervisory control of multiple robots in dynamic tasking environments , 2012, Ergonomics.

[64]  Stephen F. Smith,et al.  Designing Collaborative Automated Planners for Agile Adaptation to Dynamic Change , 2012 .

[65]  Jeffrey Heer,et al.  A Tour through the Visualization Zoo , 2010 .

[66]  P. Johnson-Laird,et al.  Reasoning from inconsistency to consistency. , 2004, Psychological review.

[67]  Jeffrey Heer,et al.  A tour through the visualization zoo , 2010, Commun. ACM.

[68]  Christopher A. Miller,et al.  Future Unmanned Aerial Systems Control: Feedback on Highly Flexible Operator-Automation Delegation Interface Concept , 2012, Infotech@Aerospace.

[69]  Justin G. Hollands,et al.  Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System , 2011, Hum. Factors.

[70]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[71]  A. Tversky,et al.  Unpacking, repacking, and anchoring: advances in support theory. , 1997 .

[72]  Justin G. Hollands,et al.  Human Reliance on an Automated Combat ID System: Effects of Display Format , 2009 .

[73]  Robert P. Goldman,et al.  The Playbook™ Approach to Adaptive Automation , 2005 .

[74]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[75]  A. Treisman.  Preattentive processing in vision , 1985, Comput. Vis. Graph. Image Process..

[76]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[77]  Ros Dowse,et al.  Developing visual images for communicating information aboutantiretroviral side effects to a low-literate population , 2010, African journal of AIDS research : AJAR.

[78]  Joachim Meyer,et al.  Self-initiated and respondent actions in a simulated control task , 2007, Ergonomics.

[79]  Thomas E. Nygren,et al.  Framing of Task Performance Strategies: Effects on Performance in a Multiattribute Dynamic Decision Making Environment , 1997, Hum. Factors.

[80]  Craig Bonaceto,et al.  Displaying Contextual Information Reduces the Costs of Imperfect Decision Automation in Rapid Retasking of ISR Assets , 2014, Hum. Factors.

[81]  Harvey S. Smallman,et al.  Proactive Supervisory Decision Support from Trend-Based Monitoring of Autonomous and Automated Systems: A Tale of Two Domains , 2013, HCI.