A Comparison of Remote Robot Teleoperation Interfaces for General Object Manipulation

Robust remote teleoperation of high-DOF manipulators is of critical importance across a wide range of robotics applications. Contemporary robot manipulation interfaces primarily utilize a free-positioning pose specification approach to independently control each axis of translation and orientation in free space. In this work, we present two novel interfaces, constrained positioning and point-and-click, which incorporate scene information, including points-of-interest and local surface geometry, into the grasp specification process. We also present results of a user study evaluation comparing the effects of increased use of scene information in grasp pose specification algorithms for general object manipulation. The results of our study show that constrained positioning and point-and-click significantly outperform the widely used free positioning approach by significantly reducing the number of grasping errors and the number of user interactions required to specify poses. Furthermore, the point-and-click interface significantly increased the number of tasks users were able to complete.

[1]  Sonia Chernova,et al.  Robot Web Tools: Efficient messaging for cloud robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Christopher G. Atkeson,et al.  Human‐in‐the‐loop Control of a Humanoid Robot for Disaster Response: A Report from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[3]  L. Parsons Inability to Reason About an Object's Orientation Using an Axis and Angle of Rotation , 1995 .

[4]  Leila Takayama,et al.  Strategies for human-in-the-loop robotic grasping , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[6]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[7]  Matei T. Ciocarlie,et al.  Mobile manipulation through an assistive home robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Mark Billinghurst,et al.  Using a mobile phone for 6 DOF mesh editing , 2007, CHINZ.

[9]  Martin Hachet,et al.  Navidget for Easy 3D Camera Positioning from 2D Inputs , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[10]  Sonia Chernova,et al.  Construction of a 3D object recognition and manipulation database from grasp demonstrations , 2016, Auton. Robots.

[11]  Eric Huang,et al.  A General‐purpose System for Teleoperation of the DRC‐HUBO Humanoid Robot , 2015, J. Field Robotics.

[12]  Dmitry Berenson,et al.  Toward a user-guided manipulation framework for high-DOF robots with limited communication , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[13]  Masahiro Hori,et al.  Smartphone game controller (マルチメディア・仮想環境基礎) , 2011 .

[14]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[15]  Paul Milgram,et al.  Measuring the allocation of control in a 6 degree-of-freedom docking experiment , 2000, CHI.

[16]  Doug A. Bowman,et al.  Human‐robot Teaming for Rescue Missions: Team ViGIR's Approach to the 2013 DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[17]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[18]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Robert Platt,et al.  Localizing Handle-Like Grasp Affordances in 3D Point Clouds , 2014, ISER.

[20]  William D. Smart,et al.  Robots for humanity: User-centered design for assistive mobile manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  J. Edward Colgate,et al.  Improving teleoperation: reducing mental rotations and translations , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[22]  Charles C. Kemp,et al.  Assistive Mobile Manipulation : Designing for Operators with Motor Impairments Phillip , 2016 .

[23]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[24]  William D. Smart,et al.  Robots for humanity: using assistive robotics to empower people with disabilities , 2013, IEEE Robotics & Automation Magazine.

[25]  References , 1971 .

[26]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[27]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[28]  Robert Platt,et al.  Using Geometry to Detect Grasp Poses in 3D Point Clouds , 2015, ISRR.

[29]  Tiffany L. Chen,et al.  Robots for Humanity : A Case Study in Assistive Mobile Manipulation , 2012 .