Mental Models of a Mobile Shoe Rack

Most people do not have direct access to knowledge about the inner workings of robots. Instead, they must develop mental models of the robot, a process that is not well understood. This article presents findings from a long-term, in-the-wild, qualitative, hypothesis-generating study of the mental model formation process. The focus was on how (qualitatively) users form mental models of the robot—specifically its perceptual capabilities, rules of behavior, and communication with other humans. Participants of diverse ages had multiple interactions with the robot over six weeks in a non-laboratory setting. The robot’s rules of behavior were changed every two weeks. A novel, non-anthropomorphic robot was created for the study with a realistic use case: storing people’s shoes during a yoga class. This article reports findings from a case study analysis of 28 interviews conducted over six weeks with six participants. These findings are organized into six topics: (1) variability in the rate at which mental models are updated to be more predictive, (2) types of reasoning and hypothesizing about the robot, (3) borrowing from existing mental models and use of imagination, (4) attributing sensing capabilities where there are no visible sensors, (5) judgments about whether the robot is autonomous or teleoperated, and (6) experimenting with the robot. Specific suggestions for future research are given throughout, culminating in a set of study design recommendations. This work demonstrates the fruitfulness of long-term, in-the-wild studies of human-robot interaction, of which mental model formation is a foundational aspect.

[1]  Burkhard Schafer,et al.  “I spy, with my little sensor”: fair data handling practices for robots between privacy, copyright and security , 2017, Connect. Sci..

[2]  Sara Ljungblad,et al.  How do you play with a robotic toy animal?: a long-term study of Pleo , 2010, IDC.

[3]  David C. Funder On the accuracy of personality judgment: a realistic approach. , 1995 .

[4]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[5]  Illah R. Nourbakhsh,et al.  Long-Term Human-Robot Interaction: The Personal Exploration Rover and Museum Docents , 2005, AIED.

[6]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device , 1990, Cogn. Sci..

[7]  Ross A. Knepper,et al.  Human expectations of social robots , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Thomas P. Moran,et al.  Analogy considered harmful , 1982, CHI '82.

[9]  Pierre Dillenbourg,et al.  Living with a Vacuum Cleaning Robot , 2013, Int. J. Soc. Robotics.

[10]  Wendy Ju,et al.  Experiences developing socially acceptable interactions for a robotic trash barrel , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[11]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Christoph Bartneck,et al.  Anthropomorphism: Opportunities and Challenges in Human–Robot Interaction , 2014, International Journal of Social Robotics.

[13]  M. Gill,et al.  On the genesis of confidence. , 1998 .

[14]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.

[15]  Stephanie Rosenthal,et al.  Designing robots for long-term social interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Sara B. Kiesler,et al.  The advisor robot: tracing people's mental model from a robot's physical attributes , 2006, HRI '06.

[17]  S. Brison The Intentional Stance , 1989 .

[18]  Christine L. Borgman The user's mental model of an information retrieval system: an experiment on a prototype online catalog , 1999, Int. J. Hum. Comput. Stud..

[19]  Sara B. Kiesler,et al.  Fostering common ground in human-robot interaction , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[20]  Wendy Ju,et al.  Mechanical Ottoman: How Robotic Furniture Offers and Withdraws Support , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  William D. Smart,et al.  How the law will think about robots (and why you should care) , 2014, 2014 IEEE International Workshop on Advanced Robotics and its Social Impacts.

[22]  Maartje M. A. de Graaf,et al.  Why Do They Refuse to Use My Robot?: Reasons for Non-Use Derived from a Long-Term Home Study , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[23]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[24]  Wendy Ju,et al.  Designing the Behavior of Interactive Objects , 2016, TEI.

[25]  Siddhartha S. Srinivasa,et al.  Perceived robot capability , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[26]  Andreas Theodorou,et al.  What Does the Robot Think? Transparency as a Fundamental Design Requirement for Intelligent Systems , 2016, IJCAI 2016.

[27]  Kerstin Dautenhahn,et al.  Living with Robots: Investigating the Habituation Effect in Participants' Preferences During a Longitudinal Human-Robot Interaction Study , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[28]  Scott S. Snibbe,et al.  Experiences with Sparky, a Social Robot , 2002 .

[29]  Paul E. Dux,et al.  What do we know about implicit false-belief tracking? , 2015, Psychonomic bulletin & review.

[30]  Joseph A. Maxwell,et al.  Qualitative Research Design: An Interactive Approach , 1996 .

[31]  Wendy Ju,et al.  Touching a mechanical body , 2017, HRI 2017.

[32]  Henrik I. Christensen,et al.  Robots in the wild: Understanding long-term use , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[33]  Jodi Forlizzi,et al.  Understanding users! Perception of privacy in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Stephen J. Payne,et al.  CHAPTER 6 – Users' Mental Models: The Very Ideas , 2003 .

[35]  Wendy Ju,et al.  A place for every tool and every tool in its place: Performing collaborative tasks with interactive robotic drawers , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[36]  D. Levin,et al.  Cognitive dissonance as a measure of reactions to human-robot interaction , 2013, HRI 2013.

[37]  P. Dillenbourg,et al.  The Cognitive Correlates of Anthropomorphism , 2014, HRI 2014.

[38]  Sara B. Kiesler,et al.  Eliciting information from people with a gendered humanoid robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[39]  Sara B. Kiesler,et al.  Mental models of robotic assistants , 2002, CHI Extended Abstracts.

[40]  K. Weick FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[41]  Marek P. Michalowski,et al.  Robots in the wild: observing human-robot social interaction outside the lab , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[42]  Ronald E. Rice,et al.  Evaluating video as a technology for informal communication , 1992, CHI.

[43]  Robert K. Yin,et al.  Case Study Research and Applications: Design and Methods , 2017 .

[44]  Florian Jentsch,et al.  From Tools to Teammates , 2011 .

[45]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[46]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[47]  Cynthia Breazeal,et al.  Affective Personalization of a Social Robot Tutor for Children's Second Language Skills , 2016, AAAI.

[48]  Matthias Scheutz,et al.  A Framework for Developing and Using Shared Mental Models in Human-Agent Teams , 2017 .

[49]  Leila Takayama,et al.  Judging a bot by its cover: An experiment on expectation setting for personal robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[50]  Tom Ziemke,et al.  Embodiment is a Double-Edged Sword in Human-Robot Interaction : Ascribed vs. Intrinsic Intentionality , 2015, HRI 2015.

[51]  Susan R. Fussell,et al.  How people anthropomorphize robots , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[52]  Sara B. Kiesler,et al.  Human Mental Models of Humanoid Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.