Human to robot demonstrations of routine home tasks: Exploring the role of the robot's feedback

In this paper, we explore some conceptual issues, relevant for the design of robotic systems aimed at interacting with humans in domestic environments. More specifically, we study the role of the robot's feedback (positive or negative acknowledgment of understanding) on a human teacher's demonstration of a routine home task (laying a table). Both the human and the system's perspectives are considered in the analysis and discussion of results from a human-robot user study, highlighting some important conceptual and practical issues. These include the lack of explicitness and consistency on people's demonstration strategies. Furthermore, we discuss the need to investigate design strategies to elicit people's knowledge about the task and also successfully advertize the robot's abilities in order to promote people's ability to provide appropriate demonstrations.

[1]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[2]  P. Barnard.  The contributions of applied cognitive psychology to the study of human-computer interaction , 1991 .

[3]  Benedict du Boulay,et al.  Fallible, Distractible, Forgetful, Willful, and Irrational Learners , 2000 .

[4]  Chrystopher L. Nehaniv,et al.  6th Ieee International Conference on Robot & Human Interactive Communication Issues in Human/robot Task Structuring and Teaching , 2022 .

[5]  W. Prinz,et al.  Goal representations in imitative actions , 2002 .

[6]  Kerstin Dautenhahn,et al.  The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop , 1998, Appl. Artif. Intell..

[7]  K. Dautenhahn,et al.  The correspondence problem , 2002 .

[8]  J. Cassell.  Computer Vision for Human–Machine Interaction: A Framework for Gesture Generation and Interpretation , 1998 .

[9]  Anders Green,et al.  Social and collaborative aspects of interaction with a service robot , 2003, Robotics Auton. Syst..

[10]  Rachid Alami,et al.  A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  Kerstin Fischer,et al.  Cognitive Modeling of Spatial Reference for Human-Robot Interaction , 2001, Int. J. Artif. Intell. Tools.

[12]  G. Butterworth.  Pointing Is the Royal Road to Language for Babies , 2003 .

[13]  D. McNeill.  Hand and Mind , 1995 .

[14]  Rüdiger Dillmann,et al.  Distribution and Recognition of Gestures in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[15]  D. McNeill.  Gesture and Thought , 2005 .

[16]  B. Tversky,et al.  Hierarchical encoding of behavior: translating perception into action. , 2006, Journal of experimental psychology. General.

[17]  C. Y. Thielman,et al.  Natural Language with Integrated Deictic and Graphic Gestures , 1989, HLT.

[18]  Chrystopher L. Nehaniv,et al.  Correspondence Mapping Induced State and Action Metrics for Robotic Imitation , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  K. Dautenhahn,et al.  Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions , 2009 .

[20]  Michael Kipp,et al.  Gesture generation by imitation: from human behavior to computer character animation , 2005 .

[21]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[22]  Kerstin Dautenhahn,et al.  Mapping between dissim ilar bodies: Affordances and the algebraic foundations of imitation , 1998 .

[23]  Stefan Kopp,et al.  Trading Spaces: How Humans and Humanoids Use Speech and Gesture to Give Directions , 2007 .

[24]  Bum-Jae You,et al.  Gesture Recognition by Attention Control Method for Intelligent Humanoid Robot , 2005, KES.

[25]  M. Carpenter,et al.  Three sources of information in social learning , 2002 .

[26]  Toshi Takamori,et al.  Multi-Modal Interaction of Human and Home Robot in the Context of Room Map Generation , 2002, Auton. Robots.

[27]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[28]  Chrystopher L. Nehaniv,et al.  Teaching robots by moulding behavior and scaffolding the environment , 2006, HRI '06.

[29]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[30]  B. Scassellati.  Imitation and mechanisms of joint attention: a developmental structure for building social skills on a humanoid robot , 1999 .

[31]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[32]  Gordon Cheng,et al.  Discovering optimal imitation strategies , 2004, Robotics Auton. Syst..

[33]  Chrystopher L. Nehaniv,et al.  Naturally Occurring Gestures in a Human-Robot Teaching Scenario , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.