The role of mental model and shared grounds in human-robot interaction

This paper investigates the role of mental model and shared grounds in human-robot interaction and the relation between them for efficient communication as well as collaboration between human and robot. We tried to conceptualize 3 way relationship among human, robot and world, and to link them in terms of the construction of shared grounds. Based on our conceptual framework of shared grounds, we developed a mediate interface that allows human users to communicate and coordinate with a robot using multimodal icon symbols. A pilot experiment was carried out to examine how people acquire a mental model about 'what' and 'how' a robot can do, and what it knows. The experimental results show that, for the efficient and cooperative human-robot interaction (HRI), a proper linkage between human and robot is required to share perceptual experience, object or procedural knowledge on a task.

[1]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[2]  Nancy Staggers,et al.  Mental Models: Concepts for Human-Computer Interaction Research , 1993, Int. J. Man Mach. Stud..

[3]  M. Fujita,et al.  An autonomous robot that eats information via interaction with humans and environments , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[4]  M. Angela Sasse,et al.  Eliciting and describing users' models of computer systems , 1997 .

[5]  Helge J. Ritter,et al.  Multi-modal human-machine communication for instructing robot grasping tasks , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Michaël Dubois,et al.  How to Fit the Man-Machine Interface and Mental Models of the Operators , 1993 .

[7]  Marjorie Skubic,et al.  Sketch-based navigation for mobile robots , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[8]  Stevan Harnad.  The Symbol Grounding Problem , 1999, ArXiv.

[9]  Deb Roy,et al.  Learning visually grounded words and syntax of natural spoken language , 2000 .

[10]  E. A. Sonenberg,et al.  Case study: an empirical investigation of thumbnail image recognition , 1995, Proceedings of Visualization 1995 Conference.

[11]  B. Herbig,et al.  The Role of Explicit and Implicit Knowledge in Work Performance1 , 2004 .

[12]  Hande Kaymaz-Keskinpala,et al.  PDA-based human-robotic interface , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[13]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .