A Survey of Mental Modeling Techniques in Human–Robot Teaming

As robots become increasingly prevalent and capable, the complexity of roles and responsibilities assigned to them as well as our expectations for them will increase in kind. For these autonomous systems to operate safely and efficiently in human-populated environments, they will need to cooperate and coordinate with human teammates. Mental models provide a formal mechanism for achieving fluent and effective teamwork during human–robot interaction by enabling awareness between teammates and allowing for coordinated action. Much recent research in human–robot interaction has made use of standardized and formalized mental modeling techniques to great effect, allowing for a wider breadth of scenarios in which a robotic agent can act as an effective and trustworthy teammate. This paper provides a structured overview of mental model theory and methodology as applied to human–robot teaming. Also discussed are evaluation methods and metrics for various aspects of mental modeling during human–robot interaction, as well as recent emerging applications and open challenges in the field.

[1]  Daniel Szafir,et al.  Building Second-Order Mental Models for Human-Robot Interaction , 2019, ArXiv.

[2]  Subbarao Kambhampati,et al.  Explicablility as Minimizing Distance from Expected Behavior , 2016 .

[3]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[4]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[5]  Barbara Deml,et al.  Human-Aware Robotic Assistant for Collaborative Assembly: Integrating Human Motion Prediction With Planning in Time , 2018, IEEE Robotics and Automation Letters.

[6]  Chris L. Baker,et al.  Goal Inference as Inverse Planning , 2007 .

[7]  Yu Zhang,et al.  Planning with Resource Conflicts in Human-Robot Cohabitation , 2016, AAMAS.

[8]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[9]  Takayuki Osogami,et al.  A Deep Choice Model , 2016, AAAI.

[10]  Yorick Wilks,et al.  Multiple Agents and the Heuristic Ascription of Belief , 1987, IJCAI.

[11]  Siddhartha S. Srinivasa,et al.  Human-Robot Mutual Adaptation in Shared Autonomy , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[12]  Katia Sycara,et al.  The role of trust in human-robot interaction , 2018 .

[13]  J. Mathieu,et al.  Performance implications of leader briefings and team-interaction training for team adaptation to novel environments. , 2000, The Journal of applied psychology.

[14]  Ross A. Knepper,et al.  Human expectations of social robots , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Joshua B. Tenenbaum,et al.  Bayesian Theory of Mind: Modeling Joint Belief-Desire Attribution , 2011, CogSci.

[16]  Qin Zhu,et al.  The Confucian Matador: Three Defenses Against the Mechanical Bull , 2020, HRI.

[17]  Matthias Scheutz,et al.  Towards morally sensitive action selection for autonomous social robots , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[18]  Edmund H. Durfee,et al.  Rational Coordination in Multi-Agent Environments , 2000, Autonomous Agents and Multi-Agent Systems.

[19]  Anca D. Dragan,et al.  Cooperative Inverse Reinforcement Learning , 2016, NIPS.

[20]  Catholijn M. Jonker,et al.  Shared Mental Models - A Conceptual Analysis , 2010, COIN@AAMAS&MALLOW.

[21]  Guy Hoffman,et al.  Evaluating Fluency in Human–Robot Collaboration , 2019, IEEE Transactions on Human-Machine Systems.

[22]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[23]  Siddhartha S. Srinivasa,et al.  Game-Theoretic Modeling of Human Adaptation in Human-Robot Collaboration , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[24]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[25]  Julie A. Shah,et al.  Fast Scheduling of Multi-Robot Teams with Temporospatial Constraints , 2013, Robotics: Science and Systems.

[26]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[27]  Siddhartha S. Srinivasa,et al.  Human-robot shared workspace collaboration via hindsight optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Chris L. Baker,et al.  Modeling Human Plan Recognition Using Bayesian Theory of Mind , 2014 .

[29]  Illah R. Nourbakhsh,et al.  Human-robot teaming for search and rescue , 2005, IEEE Pervasive Computing.

[30]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[31]  David Whitney,et al.  Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays , 2017, ISRR.

[32]  Ross A. Knepper,et al.  Asking for Help Using Inverse Semantics , 2014, Robotics: Science and Systems.

[33]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[34]  Jaime Banks,et al.  A perceived moral agency scale: Development and validation of a metric for humans and social machines , 2019, Comput. Hum. Behav..

[35]  D. Dennett The Intentional Stance. , 1987 .

[36]  H. Grice Logic and conversation , 1975 .

[37]  Brian Scassellati,et al.  Personalizing Robot Tutors to Individuals’ Learning Differences , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[38]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[39]  Tim Miller,et al.  Explanation in Artificial Intelligence: Insights from the Social Sciences , 2017, Artif. Intell..

[40]  Subbarao Kambhampati,et al.  Explicable Planning as Minimizing Distance from Expected Behavior , 2019, AAMAS.

[41]  Bradley Hayes,et al.  Improving Human-Robot Interaction Through Explainable Reinforcement Learning , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[42]  Bradley Hayes,et al.  Explanation-Based Reward Coaching to Improve Human Performance via Reinforcement Learning , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[43]  David M. Sobel,et al.  Causal learning mechanisms in very young children: two-, three-, and four-year-olds infer causal relations from patterns of variation and covariation. , 2001, Developmental psychology.

[44]  Luca Viganò,et al.  Explainable Security , 2018, 2020 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW).

[45]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[46]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[47]  Adriana Tapus,et al.  Human-Robot Team: Effects of Communication in Analyzing Trust , 2019, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[48]  Dorsa Sadigh,et al.  Learning Reward Functions by Integrating Human Demonstrations and Preferences , 2019, Robotics: Science and Systems.

[49]  Subbarao Kambhampati,et al.  Algorithms for the Greater Good ! On Mental Modeling and Acceptable Symbiosis in Human-AI Collaboration Tathagata Chakraborti , 2018 .

[50]  Matthias Scheutz,et al.  Facilitating Mental Modeling in Collaborative Human-Robot Interaction through Adverbial Cues , 2011, SIGDIAL Conference.

[51]  Guy Hoffman,et al.  Computational Human-Robot Interaction , 2016, Found. Trends Robotics.

[52]  Jennifer Lee,et al.  Communicating Robot Motion Intent with Augmented Reality , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Carlos Martínez,et al.  Human-robot collaboration in manufacturing: Quantitative evaluation of predictable, convergent joint action , 2013, IEEE ISR 2013.

[54]  Yu Zhang,et al.  AI Challenges in Human-Robot Cognitive Teaming , 2017, ArXiv.

[55]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[56]  Brian Scassellati,et al.  The Effect of Personalization in Longer-Term Robot Tutoring , 2018, ACM Trans. Hum. Robot Interact..

[57]  Anca D. Dragan,et al.  Active Preference-Based Learning of Reward Functions , 2017, Robotics: Science and Systems.

[58]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[59]  Stuart Armstrong,et al.  Occam's razor is insufficient to infer the preferences of irrational agents , 2017, NeurIPS.

[60]  Stefanos Nikolaidis,et al.  Human-robot cross-training: Computational formulation, modeling and evaluation of a human team training strategy , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[61]  Z. Nadasdy,et al.  Taking the intentional stance at 12 months of age , 1995, Cognition.

[62]  Subbarao Kambhampati,et al.  Plan Explanations as Model Reconciliation , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[63]  Anca D. Dragan,et al.  Expressing Robot Incapability , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[64]  Ana Paiva,et al.  Explainable Agents Through Social Cues: A Review , 2020, ArXiv.

[65]  P. J. Gmytrasiewicz,et al.  A Framework for Sequential Planning in Multi-Agent Settings , 2005, AI&M.

[66]  Bradley Hayes,et al.  Automated Failure-Mode Clustering and Labeling for Informed Car-To-Driver Handover in Autonomous Vehicles , 2020, ArXiv.

[67]  Cynthia Breazeal,et al.  A Bayesian Theory of Mind Approach to Nonverbal Communication , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[68]  Yu Zhang,et al.  Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy , 2017, IJCAI.

[69]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[70]  Cynthia Breazeal,et al.  Cost-Based Anticipatory Action Selection for Human–Robot Fluency , 2007, IEEE Transactions on Robotics.

[71]  Takayuki Osogami,et al.  Restricted Boltzmann machines modeling human choice , 2014, NIPS.

[72]  Sahin Albayrak,et al.  Social Cobots: Anticipatory Decision-Making for Collaborative Robots Incorporating Unexpected Human Behaviors , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[73]  Brian Scassellati,et al.  “I Don't Believe You”: Investigating the Effects of Robot Trust Violation and Repair , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[74]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[75]  Ning Wang,et al.  Trust calibration within a human-robot team: Comparing automatically generated explanations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[76]  John R. Wilson,et al.  Mental Models: Theory and Application in Human Factors , 1989 .

[77]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[78]  H. Simon Rational Decision Making in Business Organizations , 1978 .

[79]  Tom Williams,et al.  Language-Capable Robots may Inadvertently Weaken Human Moral Norms , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[80]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[81]  Bradley Hayes,et al.  Improving Robot Controller Transparency Through Autonomous Policy Explanation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[82]  Brian Scassellati,et al.  Effective robot teammate behaviors for supporting sequential manipulation tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[83]  Tao Gao,et al.  Represent and Infer Human Theory of Mind for Human-Robot Interaction , 2015, AAAI Fall Symposia.

[84]  Rachid Alami,et al.  An implemented theory of mind to improve human-robot shared plans execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[85]  Sahin Albayrak,et al.  Toward integrating Theory of Mind into adaptive decision-making of social robots to understand human intention , 2017 .

[86]  Minoru Asada,et al.  Initiative in robot assistance during collaborative task execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[87]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[88]  Subbarao Kambhampati,et al.  Towards Understanding User Preferences for Explanation Types in Model Reconciliation , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[89]  Mica R. Endsley,et al.  Shared Mental Models and Shared Displays: An Empirical Evaluation of Team Performance , 1999 .

[90]  Anca D. Dragan,et al.  Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state , 2018, Autonomous Robots.