Extending Commands Embedded in Actions for Human-Robot Cooperative Tasks

In this paper, we propose a novel method to control a robot without robot manipulation. Users do not need to precisely manipulate the robot and to learn the manipulation method. The proposed method can send commands to a robot by using a human action sequence that achieves their own task. In order to enable the robot to achieve tasks, we introduce a keep-based interaction in which a human keeps an action in the sequence for a certain period. The advantages of our method are efficiency improved by not requiring additional human actions, and functionality to enable a robot to perform further actions. We consider that the efficiency is supported by users’ physical workloads and cognitive loads. Users’ physical workloads would not be increased because the proposed method does not require additional human actions. However, the effect of the proposed method on users’ cognitive loads is unknown. We applied the method to a desktop sweeping task by a human and a small mobile robot, and conducted an experiment with participants to measure users’ cognitive loads in a cooperative sweeping task. As a result, we found that the proposed method had a lower cognitive load than a typical conventional method.

[1]  Sebastian Thrun,et al.  A Gesture Based Interface for Human-Robot Interaction , 2000, Auton. Robots.

[2]  Seiji Yamada,et al.  Active teaching for an interactive learning robot , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[3]  Darren Newtson.  Attribution and the unit of perception of ongoing behavior. , 1973 .

[4]  Yoshifumi Nishida,et al.  Active understanding of human intention by a robot through monitoring of human behavior , 1994 .

[5]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[6]  Cynthia Breazeal,et al.  Recognition of Affective Communicative Intent in Robot-Directed Speech , 2002, Auton. Robots.

[7]  Kazuo Tanie,et al.  Human-Robot Cooperative Manipulation Using a Virtual Nonholonomic Constraint , 2002, Int. J. Robotics Res..

[8]  Francisco J. Rodríguez,et al.  Remote Interaction with Mobile Robots , 2003, Auton. Robots.

[9]  Jörg Illmann,et al.  Gesture Recognition in a Spatial Context for Commanding a Domestic Service Robot , 2002 .

[10]  Toyoaki Nishida,et al.  A Method for Human-Artifact Communication based on Active Affordance , 2002 .

[11]  Zhe Xu,et al.  A point-and-click interface for the real world: Laser designation of objects for mobile manipulation , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Fumio Kanehiro,et al.  Cooperative works by a human and a humanoid robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[13]  H. Strobel,et al.  CleaningAssistant-a service robot designed for cleaning tasks , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[14]  Kentaro Ishii,et al.  Magic cards: a paper tag interface for implicit robot control , 2009, CHI.

[15]  Kazuo Tanie,et al.  Assist system for carrying a long object with a human-analysis of a human cooperative behavior in the vertical direction , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[16]  Hikaru Inooka,et al.  Robot position control via voice instruction including ambiguous expressions of degree , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[17]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[18]  Jochen Triesch,et al.  Robotic Gesture Recognition , 1997, Gesture Workshop.

[19]  K. Hill,et al.  Reliability and Validity of a Dual‐Task Force Platform Assessment of Balance Performance: Effect of Age, Balance Impairment, and Cognitive Task , 2002, Journal of the American Geriatrics Society.

[20]  ThrunSebastian,et al.  A Gesture Based Interface for Human-Robot Interaction , 2000 .

[21]  Darren Newtson,et al.  The objective basis of behavior units. , 1977 .

[22]  Michael W. Montgomery,et al.  The quantitative description of action disorganisation after brain damage: a case study , 1991 .

[23]  Guido Bugmann,et al.  Mobile robot programming using natural language , 2002, Robotics Auton. Syst..

[24]  Kazuhiro Kosuge,et al.  Control of robot in singular configurations for human-robot coordination , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[25]  Michael A. Goodrich,et al.  Characterizing efficiency of human robot interaction: a case study of shared-control teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[27]  Darren Newtson,et al.  The perceptual organization of ongoing behavior , 1976 .

[28]  Monica N. Nicolescu,et al.  Learning and interacting in human-robot domains , 2001, IEEE Trans. Syst. Man Cybern. Part A.