Hand it over or set it down: A user study of object delivery with an assistive mobile manipulator

Delivering an object to a user would be a generally useful capability for service robots. Within this paper, we look at this capability in the context of assistive object retrieval for motor-impaired users. We first describe a behavior-based system that enables our mobile robot EL-E to autonomously deliver an object to a motor-impaired user. We then present our evaluation of this system with 8 motor-impaired patients from the Emory ALS Center. As part of this study, we compared handing the object to the user (direct delivery) with placing the object on a nearby table (indirect delivery). We tested the robot delivering a cordless phone, a medicine bottle, and a TV remote, which were ranked as three of the top four most important objects for robotic delivery by ALS patients in a previous study. Overall, the robot successfully delivered these objects in 126 out of 144 trials (88%) with a success rate of 97% for indirect delivery and 78% for direct delivery. In an accompanying survey, participants showed high satisfaction with the robot with 4 people preferring direct delivery and 4 people preferring indirect delivery. Our results indicate that indirect delivery to a surface can be a robust and reliable delivery method with high user satisfaction, and that robust direct delivery will require methods that handle diverse postures and body types.

[1]  Kazuo Tanie,et al.  Human interaction with a service robot: mobile-manipulator handing over an object to a human , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  Andrea H. Mason,et al.  Grip forces when passing an object to a partner , 2005, Experimental Brain Research.

[3]  Hideo Tsukune,et al.  Delivery by hand between human and robot based on fingertip force-torque information , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[4]  Charles C. Kemp,et al.  A list of household objects for robotic retrieval prioritized by people with ALS , 2008, 2009 IEEE International Conference on Rehabilitation Robotics.

[5]  Tomio Watanabe,et al.  A Study on Robot-Human System with Consideration of Individual Preferences : 2nd Report, Multimodal Human-Machine Interface for Object-Handing Robot System , 2006 .

[6]  Rachid Alami,et al.  Supervision and motion planning for a mobile manipulator interacting with humans , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  H. Nguyen.  El-E: An Assistive Robot that Fetches Objects from Flat Surfaces , 2008 .

[8]  Axel Gräser,et al.  The Rehabilitation Robots FRIEND-I & II: Daily Life Independency through Semi-Autonomous Task-Execution , 2007 .

[9]  S. Iiajiliawa,et al.  Motion Planning for Hand-Over between Human and Robot , 1995 .

[10]  Advait Jain,et al.  A clickable world: Behavior selection through pointing and context for mobile manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Rolf Dieter Schraft,et al.  Care-O-bot II—Development of a Next Generation Robotic Home Assistant , 2004, Auton. Robots.

[12]  Kerstin Dautenhahn,et al.  Robotic etiquette: Results from user studies involving a fetch and carry task , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Advait Jain,et al.  EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces , 2010, Auton. Robots.

[14]  William Harwin,et al.  Devices for assisting manipulation: a summary of user task priorities , 1994 .

[15]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[16]  Zhe Xu,et al.  A point-and-click interface for the real world: Laser designation of objects for mobile manipulation , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Kazuhiro Kosuge,et al.  Development of service robot for fetching objects in home environment , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[18]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[19]  H. Huttenrauch,et al.  Fetch-and-carry with CERO: observations from a long-term user study with a service robot , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[20]  Kanya Tanaka,et al.  Experimental analysis of handing over , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[21]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[22]  Charles C. Kemp,et al.  Laser pointers and a touch screen: intuitive interfaces for autonomous mobile manipulation for the motor impaired , 2008, Assets '08.

[23]  Katherine M. Tsui,et al.  Development and evaluation of a flexible interface for a wheelchair mounted robotic arm , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[25]  Rachid Alami,et al.  How may I serve you?: a robot companion approaching a seated person in a helping context , 2006, HRI '06.

[26]  Christophe Leroux,et al.  SAM: A robotic butler for handicapped people , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.