Semiautonomous dual-arm mobile manipulator system with intuitive supervisory user interfaces

This paper presents the VaultBot dual-arm mobile manipulator and its integration with Robot Operating System, MoveIt!, and RViz, and thus demonstrate how two chronic issues with similar systems were addressed: overly complex integration and user control. Multiple levels of semi-autonomous control were developed for the base, manipulator(s), and coordinated motions involving both. Lower levels of autonomy are always available to increase operator comfort. In order to combat cognitive load increases from context switching the control methods take a human-centered approach by automatically adjusting perspective to keep tasks visualized relative to the operator. Sensor data is fused into a single window alongside the current robot state. These approaches are considered highly intuitive and can be used as effectively as socially well-established mouse-based interactive markers for teleoperation in even high-precision tasks.

[1]  Mitch Pryor,et al.  Intelligent navigation of a skid steer dual-arm mobile manipulator with dynamic center of gravity , 2016 .

[2]  Donald D. Dudenhoeffer,et al.  Intelligent Robots for Use in Hazardous DOE Environments , 2002 .

[3]  Jess R. Kerlin,et al.  Towards the Principled Study of Variable Autonomy in Mobile Robots , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[4]  Guanglong Du,et al.  A Markerless Human–Robot Interface Using Particle Filter and Kalman Filter for Dual Robots , 2015, IEEE Transactions on Industrial Electronics.

[5]  Andrew Sharp,et al.  Variable normal surface virtual fixtures (VNSVF) for semi-autonomous task completion , 2016 .

[6]  William D. Smart,et al.  Programming Robots with ROS: A Practical Introduction to the Robot Operating System , 2015 .

[7]  Matei T. Ciocarlie,et al.  Interactive Markers: 3-D User Interfaces for ROS Applications [ROS Topics] , 2011, IEEE Robotics Autom. Mag..

[8]  R. C. Goertz,et al.  MECHANICAL MASTER-SLAVE MANIPULATOR , 1954 .

[9]  Karl Kruusamäe,et al.  High-precision telerobot with human-centered variable perspective and scalable gestural interface , 2016, 2016 9th International Conference on Human System Interactions (HSI).

[10]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[11]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[12]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[13]  Karl Kruusamäe,et al.  Spatially-Mapped Human-Robot interface for teleoperation of high-precision tasks , 2016 .

[14]  Mitch Pryor,et al.  Demonstrations of a generalized contact control framework: Follow-the-leader and Grasping/inserting a peg in a hole , 2016 .