Cognition and Multi-Agent Interaction: Communicating and Collaborating with Robotic Agents

Introduction For the last few years, our lab has been attempting to build robots that are similar to humans in a variety of ways. Our goal has been to build systems that think and act like a person rather than look like a person since the state of the art is not sufficient for a robot to look (even superficially) like a human person. We believe that there are at least two reasons to build robots that think and act like a human. First, how an artificial system acts has a profound effect on how people act toward the system. Second, how an artificial system thinks has a profound effect on how people interact with the system.

[1]  Alan C. Schultz,et al.  Continuous localization using evidence grids , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[2]  Laura A. Carlson-Radvansky,et al.  The Influence of Reference Frame Selection on Spatial Template Construction , 1997 .

[3]  Alade O. Tokuta,et al.  trulla : An Algorithm For Path Planning Among Weighted Regions By Localized Propagations , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Alan C. Schultz,et al.  Integrating Exploration, Localization, Navigation and Planning with a Common Representation , 1999, Auton. Robots.

[5]  H. H. Clark,et al.  Common ground at the understanding of demonstrative reference , 1983 .

[6]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[7]  J. Gregory Trafton,et al.  Choosing Frames of Referenece: Perspective-Taking in a 2D and 3D Navigational Task , 2004 .

[8]  Susan Bell Trickett,et al.  Connecting Internal and External Representations: Spatial Transformations of Scientific Visualizations , 2005 .

[9]  Philip R. Cohen,et al.  Referring as a Collaborative Process , 2003 .

[10]  Marvin Minsky,et al.  Polyscheme: a cognitive architecture for integrating multiple representation and inference schemes , 2002 .

[11]  Susan Bell Trickett,et al.  Extracting Explicit and Implict Information from Complex Visualizations , 2002, Diagrams.

[12]  Kenneth Wauchope,et al.  Eucalyptus: Integrating Natural Language Input with a Graphical User Interface , 1994 .

[13]  Stephane Gamard,et al.  Hide and Seek: Using Computational Cognitive Models to Develop and Test Autonomous Cognitive Agents for Complex and Dynamic Tasks , 2003 .

[14]  B. Tversky,et al.  Switching points of view in spatial mental models , 1992, Memory & cognition.

[15]  J. Gregory Trafton,et al.  Integrating cognition, perception and action through mental simulation in robots , 2004, Robotics Auton. Syst..

[16]  Hobart R. Everett,et al.  After Action Report to the Joint Program Office: Center for the Robotic Assisted Search and Rescue (CRASAR) Related Efforts at the World Trade Center , 2002 .

[17]  Marjorie Skubic,et al.  Communicating with Teams of Cooperative Robots , 2002 .

[18]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[19]  J. Gregory Trafton,et al.  A hybrid cognitive-reactive multi-agent controller , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Susan E. Brennan,et al.  The Grounding Problem in Conversations With and Through Computers , 2000 .

[21]  Alan C. Schultz,et al.  Mobile robot exploration and map-building with continuous localization , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[22]  Magdalena D. Bugajska,et al.  An Investigation of How Humans and Machines Deal with Increases in Reactivity , 2001 .

[23]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[24]  Laura A. Carlson-Radvansky,et al.  The Influence of Functional Relations on Spatial Term Selection , 1996 .

[25]  Manuela M. Veloso,et al.  Fast and inexpensive color image segmentation for interactive robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[26]  Yoram Koren,et al.  The vector field histogram-fast obstacle avoidance for mobile robots , 1991, IEEE Trans. Robotics Autom..

[27]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.

[28]  Susan Brennan,et al.  Interaction and feedback in a spoken language system: a theoretical framework , 1995, Knowl. Based Syst..

[29]  John R. Anderson,et al.  Skill Acquisition and the LISP Tutor , 1989, Cogn. Sci..

[30]  F. Previc.  The neuropsychology of 3-D space. , 1998, Psychological bulletin.

[31]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[32]  Charles E. Thorpe,et al.  Robot as Partner: Vehicle Teleoperation with Collaborative Control , 2002 .

[33]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[34]  Magdalena D. Bugajska,et al.  Building Adaptive Computer-Generated Forces: The Effect of Increasing Task Reactivity on Human and Machine Control Abilities , 2001 .

[35]  Alan C. Schultz,et al.  Goal tracking in a natural language interface: towards achieving adjustable autonomy , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[36]  Marjorie Skubic,et al.  Spatial language for human-robot dialogs , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[38]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[39]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[40]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[41]  Alan C. Schultz,et al.  Using a natural language and gesture interface for unmanned vehicles , 2000, Defense, Security, and Sensing.

[42]  Stanford Universi.  Common Ground and the Understanding of Demonstrative Reference , 2004 .

[43]  Alan C. Schultz,et al.  Integrating natural language and gesture in a robotics domain , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[44]  Holly A. Taylorandbarbaratversky.  Spatial Mental Models Derived from Survey and Route Descriptions , 1992 .

[45]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[46]  Clark C. Presson,et al.  The coding and transformation of spatial information , 1979, Cognitive Psychology.

[47]  J. Gregory Trafton,et al.  Children and robots learning to play hide and seek , 2006, HRI '06.

[48]  J. Huttenlocher,et al.  Children's Early Ability to Solve Perspective-Taking Problems. , 1992 .

[49]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[50]  S. Goldin-Meadow,et al.  When Gestures and Words Speak Differently , 1997 .

[51]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[52]  James R. Wallace,et al.  Spatial Perspective-Taking Errors in Children , 2001, Perceptual and motor skills.

[53]  J. Gregory Trafton,et al.  Turning pictures into numbers: extracting and generating information from complex visualizations , 2000, Int. J. Hum. Comput. Stud..

[54]  Willem J. M. Levelt,et al.  Some Perceptual Limitations on Talking About Space , 1984 .

[55]  Dare A. Baldwin,et al.  Infants' contribution to the achievement of joint reference. , 1991, Child development.

[56]  Christian D. Schunn,et al.  ACT-R/S: A Computational and Neurologically Inspired Model of Spatial Reasoning , 2002 .