Introduction to the Special Issue on Human-Robot Interaction

THIS SPECIAL issue is one of the products of the 2001 DARPA/NSF Study on Human–Robot Interaction. That study was commissioned by Jean Scholtz, then at the Defense Advanced Research Projects Agency (DARPA), and Vladmir Lumelsky, then at the National Science Foundation (NSF). The intent of the study and the details of the workshop that pro­ vided most of the source material are presented in the report by Burke, Murphy, Rogers, Scholtz, and Lumelsky, but the need for a survey of the state of the art of human–robot interaction should be clear. The past five years has seen an acceleration of the insertion of robots into the “everyday” world. Robots are no longer confined to the factory floor or Mars, but are serving as our museum guides, vacuuming our floors, searching for us in the aftermath of a disaster, and even acting as pets. The collection is intended to be a sampling of research efforts focused on human–robot interaction (HRI). The articles show that HRI has moved beyond the shallow interpretation of “in­ teraction,” meaning how to navigate around people in a room. HRI now embraces a richer perspective, including how to be able to directly aid a person with individual needs and prefer­ ences (see Hüttenrauch et al.), or how technology is inserted into complex tasks such as space exploration (Clancey), or existing organizations such as emergency response (see Murphy). Like­ wise human–robot interaction goes beyond multimodal user in­ terfaces which create a mechanism by which a human can direct a robot and instead drills into what a robot and person need to say to each other to accomplish a task (see Skubic et al.), how the system can help a user configure and coordinate multiple robots (see Endo et al.), and what the flavor of such interactions might be (see the two articles by Breazeal and the one by Lisetti et al.). Perhaps one lesson from the 2001 study is that HRI may be best thought of as a world view, a view much broader than even human-centered design. If we follow the taxonomy pos­ tulated in the article by Woods et al., there are three views of a human–robot system: that of the roboticist, the cognitive engineer, and the problem holder. The roboticist is concerned with making and programming robots. The cognitive engineer is interested in abstracting and applying lessons learned in how people adapt to technology. The problem holder is focused on how the technology solves the problem. HRI is a fusion of these three perspectives into a systems-oriented viewpoint. That said, perhaps the most telling indication of the state of the art of HRI is that almost each article in this issue takes a roboticist view­ point. Even in the most human-centered article, the needs and constraints of the robot continue to dominates any discussion of the system. As HRI research matures and robots become more capable, it is expected that neither the human nor the robot will be “centric,” but rather the system will be the true focus. This special issue finds that the field of human–robot interac­ tion is off to a good start but now must broaden its perspective to fully engage cognitive science, human-computer interaction, usability engineering, and the requirements of specific domains in order to fulfill the promise of truly usable robotic systems. We trust that you will find these articles a useful foundation for your investigations into this emerging area of inquiry.

[1]  Terrence Fong,et al.  Novel interfaces for remote driving: gesture, haptic, and PDA , 2001, SPIE Optics East.

[2]  Marjorie Skubic,et al.  Robot navigation using qualitative landmark states from sketched route maps , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  Robert C. Anderson,et al.  The (in)accuracy of novice rover operators' perception of obstacle height from monoscopic images , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Julie A. Adams,et al.  Human Management of a Hierarchical System for the Control of Multiple Mobile Robots ( Dissertation Proposal ) MS-CIS-95-17 GRASP Lab 392 , 1994 .

[5]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[6]  Geir Hovland,et al.  Skill acquisition from human demonstration using a hidden Markov model , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[7]  Jean Scholtz,et al.  Implementation of a situation awareness assessment tool for evaluation of human-robot interfaces , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[8]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[9]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[10]  Marjorie Skubic,et al.  Spatial language for human-robot dialogs , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[12]  Richard P. Paul,et al.  An Operator Interface for Teleprogramming Employing Synthetic Fixtures , 1994, Presence: Teleoperators & Virtual Environments.

[13]  David Kortenkamp,et al.  Recognizing and Interpreting Gestures on a Mobile Robot , 1996, AAAI/IAAI, Vol. 2.

[14]  Thomas B. Sheridan,et al.  Human supervisory control of robot systems , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[15]  Gerd Hirzinger,et al.  Sensor-based space robotics-ROTEX and its telerobotic features , 1993, IEEE Trans. Robotics Autom..

[16]  Ronald C. Arkin,et al.  Usability evaluation of high-level user assistance for robot mission specification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Ralf Koeppe,et al.  Skill representation and acquisition of compliant motions using a teach device , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[18]  Mark R. Cutkosky,et al.  Dynamic tactile sensing: perception of fine surface features with stress rate sensing , 1993, IEEE Trans. Robotics Autom..

[19]  Pamela J. Hinds,et al.  Introduction to This Special Issue on Human-Robot Interaction , 2004, Hum. Comput. Interact..

[20]  Terrence Fong,et al.  Multi-robot remote driving with collaborative control , 2003, IEEE Trans. Ind. Electron..

[21]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[23]  Yoshiyuki Tanaka,et al.  Tracking control properties of human-robotic systems based on impedance control , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[24]  N. Lesh,et al.  The Role of Dialog in Human Robot Interaction , 2003 .

[25]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Allison M. Okamura,et al.  Force modeling for needle insertion into soft tissue , 2004, IEEE Transactions on Biomedical Engineering.

[27]  Candace L. Sidner,et al.  Engagement rules for human-robot collaborative interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[28]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Ronald L. Boring,et al.  Shared understanding for collaborative control , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[30]  Maria Gini,et al.  Sharing control: Presenting a framework for the operation and coordination of multiple miniature rob , 2002 .

[31]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[33]  Stefano Caselli,et al.  Evaluation of virtual fixtures for a robot programming by demonstration interface , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[34]  Richard A. Volz,et al.  Acquiring robust, force-based assembly skills from human demonstration , 2000, IEEE Trans. Robotics Autom..

[35]  Gordon Cheng,et al.  Supervised Autonomy: A Framework for Human-Robot Systems Development , 2001, Auton. Robots.

[36]  Thomas B. Sheridan,et al.  Supervisory control of remote manipulation , 1967, IEEE Spectrum.

[37]  Michael Lewis,et al.  Task-driven camera operations for robotic exploration , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  Ruzena Bajcsy,et al.  Cooperative material handling by human and robotic agents: module development and system synthesis , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[39]  Dinesh K. Pai,et al.  Programming contact tasks using a reality-based virtual environment integrated with vision , 1999, IEEE Trans. Robotics Autom..

[40]  Russell H. Taylor,et al.  Medical Robotics and Computer-Integrated Surgery: Information-driven Systems for 21 st Century Operating Rooms , 2000 .

[41]  Julie A. Adams,et al.  Critical Considerations for Human-Robot Interface Development , 2002 .

[42]  Richard A. Volz,et al.  Teleautonomous systems: projecting and coordinating intelligent action at a distance , 1990, IEEE Trans. Robotics Autom..

[43]  Dominic Létourneau,et al.  Autonomous spherical mobile robot for child-development studies , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[44]  Vincent Hayward,et al.  Measurement, Analysis, and Display of Haptic Signals During Surgical Cutting , 2002, Presence: Teleoperators & Virtual Environments.

[45]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[46]  Robin R. Murphy,et al.  Emotion-based control of cooperating heterogeneous mobile robots , 2002, IEEE Trans. Robotics Autom..