Authoring and Verifying Human-Robot Interactions

As social agents, robots designed for human interaction must adhere to human social norms. How can we enable designers, engineers, and roboticists to design robot behaviors that adhere to human social norms and do not result in interaction breakdowns? In this paper, we use automated formal-verification methods to facilitate the encoding of appropriate social norms into the interaction design of social robots and the detection of breakdowns and norm violations in order to prevent them. We have developed an authoring environment that utilizes these methods to provide developers of social-robot applications with feedback at design time and evaluated the benefits of their use in reducing such breakdowns and violations in human-robot interactions. Our evaluation with application developers (N=9) shows that the use of formal-verification methods increases designers' ability to identify and contextualize social-norm violations. We discuss the implications of our approach for the future development of tools for effective design of social-robot applications.

[1]  Gérard Bailly,et al.  Learning multimodal behavioral models for face-to-face social interaction , 2015, Journal on Multimodal User Interfaces.

[2]  A. Kendon.  Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[3]  Arjun Guha,et al.  Interactive Robot Transition Repair With SMT , 2018, IJCAI.

[4]  Bruno Maisonnier,et al.  Choregraphe: a graphical tool for humanoid robot programming , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Sean Andrist,et al.  Conversational Gaze Aversion for Virtual Agents , 2013, IVA.

[6]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[7]  Britta Wrede,et al.  Modeling Human-Robot Interaction Based on Generic Interaction Patterns , 2010, AAAI Fall Symposium: Dialog with Robots.

[8]  Bilge Mutlu,et al.  Designing Embodied Cues for Dialog with Robots , 2011, AI Mag..

[9]  Sean Andrist,et al.  Designing effective gaze mechanisms for virtual agents , 2012, CHI.

[10]  Bilge Mutlu,et al.  Robots in organizations: The role of workflow, social, and environmental factors in human-robot interaction , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Ufuk Topcu,et al.  Counter-strategy guided refinement of GR(1) temporal logic specifications , 2013, 2013 Formal Methods in Computer-Aided Design.

[12]  Emilia I. Barakova,et al.  End-user programming architecture facilitates the uptake of robots in social therapies , 2013, Robotics Auton. Syst..

[13]  Sanjit A. Seshia,et al.  Mining assumptions for synthesis , 2011, Ninth ACM/IEEE International Conference on Formal Methods and Models for Codesign (MEMPCODE2011).

[14]  Roderick Bloem,et al.  Program Repair as a Game , 2005, CAV.

[15]  Allison Sauppé,et al.  Design patterns for exploring and prototyping human-robot interactions , 2014, CHI.

[16]  Maya Cakmak,et al.  RoboFlow: A flow-based visual programming language for mobile manipulation tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[18]  Emilia I. Barakova,et al.  User-Friendly Robot Environment for Creation of Social Scenarios , 2011, IWINAC.

[19]  Jeannette M. Wing.  A specifier's introduction to formal methods , 1990, Computer.

[20]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[21]  Maarten Sierhuis,et al.  Formal verification of human-robot teamwork , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Takayuki Kanda,et al.  Human-robot interaction design using Interaction Composer eight years of lessons learned , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Bilge Mutlu,et al.  Learning-Based Modeling of Multimodal Behaviors for Humanlike Robots , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Marek P. Michalowski,et al.  Robots in the wild: observing human-robot social interaction outside the lab , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[25]  Clare Dixon,et al.  Formal Verification of an Autonomous Personal Robotic Assistant , 2014, AAAI Spring Symposia.

[26]  Maya Cakmak,et al.  Iterative Design of a System for Programming Socially Interactive Service Robots , 2016, ICSR.

[27]  Hadas Kress-Gazit,et al.  Translating Structured English to Robot Controllers , 2008, Adv. Robotics.

[28]  Bruce A. MacDonald,et al.  RoboStudio: A visual programming environment for rapid authoring and customization of complex services on a personal service robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Jodi Forlizzi,et al.  Ripple effects of an embedded social agent: a field study of a social robot in the workplace , 2012, CHI.

[30]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[31]  Jean-Christophe Baillie,et al.  URBI: towards a universal robotic low-level programming language , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Allison Sauppé,et al.  The Social Impact of a Robot Co-Worker in Industrial Settings , 2015, CHI.

[33]  A. M. Turing,et al.  Checking a large routine , 1989 .

[34]  Clare Dixon,et al.  "The Fridge Door is Open"-Temporal Verification of a Robotic Assistant's Behaviours , 2014, TAROS.

[35]  S. Shankar Sastry,et al.  Synthesis for Human-in-the-Loop Control Systems , 2014, TACAS.

[36]  Bilge Mutlu,et al.  The repertoire of robot behavior , 2013, J. Hum. Robot Interact..

[37]  Hadas Kress-Gazit,et al.  Temporal Logic Motion Planning for Mobile Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[38]  Ehud Sharlin,et al.  Designing social greetings in human robot interaction , 2014, Conference on Designing Interactive Systems.

[39]  Amir Pnueli,et al.  The temporal logic of programs , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[40]  Takayuki Kanda,et al.  Design patterns for sociality in human-robot interaction , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[41]  Bernard Espiau,et al.  Formal Veriication in Robotics: Why and How? , 1995 .

[42]  Xiaowei Huang,et al.  Reasoning about Cognitive Trust in Stochastic Multiagent Systems , 2017, AAAI.

[43]  Takayuki Kanda,et al.  How to approach humans?-strategies for social robots to initiate interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[44]  Karon E. MacLean,et al.  Meet Me where I’m Gazing: How Shared Attention Gaze Affects Human-Robot Handover Timing , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[45]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[46]  Sean Andrist,et al.  Conversational Gaze Aversion for Humanlike Robots , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[47]  Bilge Mutlu,et al.  Robot behavior toolkit: Generating effective social behaviors for robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[48]  Clare Dixon,et al.  Toward Reliable Autonomous Robotic Assistants Through Formal Verification: A Case Study , 2016, IEEE Transactions on Human-Machine Systems.

[49]  Takayuki Kanda,et al.  Conversational gaze mechanisms for humanlike robots , 2012, TIIS.

[50]  Marta Z. Kwiatkowska.  Cognitive Reasoning and Trust in Human-Robot Interactions , 2017, TAMC.