Towards a 3D simulation-based operator interface for teleoperated robots in disaster scenarios

Beyond robot hardware and control, one major element for an efficient, constructive and safe mission of teleoperated robots in disaster scenarios such as Fukushima is the quality of the interface between operator and robot. In this contribution, we present the concept of utilizing 3D simulation as a central interface component for the operator to intuitively collaborate with teleoperated robots. Thus, means of 3D simulation are not only used during the development but also in the deployment of the final field system. Based on this notion, we will discuss operator interfaces with regards a) to direct interaction with the robot, b) communication between control station and real robot and c) the integration of already acquired knowledge and existing libraries in the robotics community.

[1]  Mahdi Tavakoli,et al.  PHANSIM: A Simulink Toolkit For the SenSable PHANToM Haptic Devices , 2011 .

[2]  Jürgen Roßmann,et al.  A Virtual Testbed for Human-Robot Interaction , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[3]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[4]  Jürgen Roßmann,et al.  Advanced Mobile Robot Engineering with Virtual Testbeds , 2012, ROBOTIK.

[5]  Marc Priggemeyer,et al.  Simulation-Based Control and Simulation-Based Support in eRobotics Applications , 2016 .

[6]  Jürgen Roßmann,et al.  Developing Virtual Testbeds for mobile robotic applications in the woods and on the moon , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  W. Marsden.  I and J , 2012 .

[8]  Sven Behnke,et al.  Hybrid driving-stepping locomotion with the wheeled-legged robot Momaro , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Juergen Rossmann,et al.  A Universal Approach for the Intuitive Control of Mobile Robots using an AR/VR-based Interface , 2010 .

[10]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[11]  Kup-Sze Choi,et al.  Integrating PhysX and OpenHaptics: Efficient force feedback generation using physics engine and haptic devices , 2009, 2009 Joint Conferences on Pervasive Computing (JCPC).

[12]  Weihang Zhu,et al.  The OpenHaptics/spl trade/ toolkit: a library for adding 3D Touch/spl trade/ navigation and haptics to graphics applications , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[13]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Grigore C. Burdea.  Haptic Feedback for Virtual Reality 1 , 1999 .

[15]  Jürgen Roßmann,et al.  A Real-Time Optical Sensor Simulation Framework for Development and Testing of Industrial and Mobile Robot Applications , 2012, ROBOTIK.

[17]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[18]  John Kenneth Salisbury,et al.  Haptic Rendering: Introductory Concepts , 2004, IEEE Computer Graphics and Applications.

[19]  Jun-Ho Oh,et al.  Robotic software system for the disaster circumstances: System of team KAIST in the DARPA Robotics Challenge Finals , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[20]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[21]  Christopher G. Atkeson,et al.  Human‐in‐the‐loop Control of a Humanoid Robot for Disaster Response: A Report from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[22]  Sven Behnke,et al.  Intuitive bimanual telemanipulation under communication restrictions by immersive 3D visualization and motion tracking , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[23]  Thomas B. Sheridan,et al.  Human–Robot Interaction , 2016, Hum. Factors.