St Reading Humanoid Robots as Cooperative Partners for People

Received Accepted This paper presents an overview of our work towards building socially intelligent, cooperative humanoid robots that can work and learn in partnership with people. People understand each other in social terms, allowing us to engage others in a variety of complex social interactions including communication, social learning, and cooperation. We present our theoretical framework that is a novel combination of Joint Intention Theory and Situated Learning Theory and demonstrate how it can be applied to develop our sociable humanoid robot, Leonardo. We demonstrate the robot's ability to learn quickly and effectively from natural human instruction using gesture and dialog, and then cooperate to perform a learned task jointly with a person. Such issues must be addressed to enable many new and exciting applications for robots that require them to play a long-term role in people's daily lives.

[1]  Cynthia Breazeal,et al.  Social interactions in HRI: the robot view , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[3]  David R. Traum,et al.  Negotiation over tasks in hybrid human-agent teams for simulation-based training , 2003, AAMAS '03.

[4]  Fredrik Rehnmark,et al.  Robonaut: A Robot Designed to Work with Humans in Space , 2003, Auton. Robots.

[5]  Stephen M. Rock,et al.  Dialogue-based human-robot interaction for space construction teams , 2002, Proceedings, IEEE Aerospace Conference.

[6]  Bruce Blumberg,et al.  Integrated learning for interactive synthetic characters , 2002, SIGGRAPH.

[7]  Guido Bugmann,et al.  Mobile robot programming using natural language , 2002, Robotics Auton. Syst..

[8]  W. Johnson,et al.  Task-oriented collaboration with embodied agents in virtual worlds , 2001 .

[9]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[10]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[11]  A. Meltzoff,et al.  Children's coding of human action: cognitive factors influencing imitation in 3-year-olds. , 2000, Developmental science.

[12]  Cynthia Breazeal,et al.  Proto-conversations with an anthropomorphic robot , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[13]  Katsushi Ikeuchi,et al.  Task-model based human robot cooperation using vision , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[14]  Brian Scassellati,et al.  A Context-Dependent Attention System for a Social Robot , 1999, IJCAI.

[15]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[16]  Mitsuo Kawato,et al.  A tennis serve and upswing learning robot based on bi-directional theory , 1998, Neural Networks.

[17]  Aude Billard,et al.  Grounding communication in autonomous robots: An experimental study , 1998, Robotics Auton. Syst..

[18]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[19]  Kerstin Dautenhahn,et al.  Getting to know each other - Artificial social intelligence for autonomous robots , 1995, Robotics Auton. Syst..

[20]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[21]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[22]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[23]  P. Bloom.  Mindreading, Communication and the Learning of Names for Things , 2002 .

[24]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[25]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[26]  Brian Scassellati,et al.  Foundations for a theory of mind for a humanoid robot , 2001 .

[27]  Terrence Fong,et al.  Collaboration, Dialogue, and Human-Robot Interaction , 2001 .

[28]  H. Woern,et al.  COOPERATION BETWEEN HUMAN BEINGS AND ROBOT SYSTEMS IN AN INDUSTRIAL ENVIRONMENT , 2001 .

[29]  J. J. Guajardo,et al.  How infants make sense of intentional action , 2001 .

[30]  B. Scassellati.  Imitation and mechanisms of joint attention: a developmental structure for building social skills on a humanoid robot , 1999 .

[31]  B. Grosz.  Collaborative Systems , 1996 .

[32]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[33]  S. Baron-Cohen.  Precursors to a theory of mind: Understanding attention in others. , 1991 .

[34]  Michael E. Bratman,et al.  Shared Cooperative Activity , 1991 .

[35]  L. S. Vygotksy.  Mind in society: the development of higher psychological processes , 1978 .