Look where you're going: Visual interfaces for robot teleoperation

Two related challenges with current teleoperated robotic systems are lack of peripheral vision and awareness, and difficulty or tedium of navigating through remote spaces. We address these challenges by providing an interface with a focus plus context (F+C) view of the robot location, and where the user can navigate simply by looking where they want to go, and clicking or drawing a path on the view to indicate the desired trajectory or destination. The F+C view provides an undistorted, perspectively correct central region surrounded by a wide field of view peripheral portion, and avoids the need for separate views. The navigation method is direct and intuitive in comparison to keyboard or joystick based navigation, which require the user to be in a control loop as the robot moves. Both the F+C views and the direct click navigation were evaluated in a preliminary user study.

[1]  Manuela M. Veloso,et al.  Effective Semi-autonomous Telepresence , 2012, RoboCup.

[2]  Qiong Liu,et al.  Reach-Through-the-Screen: A New Metaphor for Remote Collaboration , 2004, PCM.

[3]  Marjorie Skubic,et al.  Sketch-based navigation for mobile robots , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[4]  Wei Zeng,et al.  Conformal Magnifier: A Focus+Context Technique with Local Shape Preservation , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[6]  Takeo Igarashi,et al.  Sketch and run: a stroke-based interface for home robots , 2009, CHI.

[7]  Jae Wook Jeon,et al.  A sketch-based interface for remote robot control on an online video screen , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[8]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[9]  Matthias Trapp Interactive rendering techniques for focus+context visualization of 3D geovirtual environment , 2013 .

[10]  Mark A. Schulze,et al.  A New Monotonic and Clone-Independent Single-Winner Election Method , 2003 .

[11]  Patrick Baudisch,et al.  Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming , 2002, CHI.

[12]  Philippe A. Palanque,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2014, International Conference on Human Factors in Computing Systems.

[13]  Holly A. Yanco,et al.  Improved interfaces for human-robot interaction in urban search and rescue , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[14]  Frederick Heckel,et al.  A Human-Robot Interface for Urban Search and Rescue , 2003, AAAI Mobile Robot Competition.