Development of the human interactive autonomy for the shared teleoperation of mobile robots

Manipulation complexity of teleoperation increases the necessity of shared autonomy. However, designing an autonomy while keeping in mind the environmental uncertainty is challenging. This paper proposes a human interactive autonomy for a shared teleoperation. The central concept is a novel methodology of combining the innate cognitive ability of a human operator to arrive at an accurate, and precise solution of an autonomous system for mobile robot shared teleoperation. The resulting system is more efficient and less fatigued than direct teleoperation. This combined approach transfers the human operator's intention, shaped by his cognition about remote environment, to the autonomous system. The intention information input from the operator helps autonomous system perform the given teleoperation tasks more efficiently. For initial feasibility and proof of concept, the intention information is provided to the autonomous system in the form of a path which is acquired by our proposed sketch method. Our novel proposed sketch method allows the operator to sketch the path on the visual feedback image of the remote environments and the information is then transmitted to the autonomous system. Experimental results provide the feasibility and effectiveness of proposed method against prevalent control methods.

[1]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[2]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[3]  Jee-Hwan Ryu,et al.  A user study of command strategies for mobile robot teleoperation , 2009, Intell. Serv. Robotics.

[4]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[5]  Michel Taïx,et al.  Human Interaction with Motion Planning Algorithm , 2012, J. Intell. Robotic Syst..

[6]  Yoram Koren,et al.  Potential field methods and their inherent limitations for mobile robot navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[7]  Thomas B. Sheridan Teleoperation, Telerobotics, and Telepresence: A Progress Report , 1992 .

[8]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[9]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[10]  David B. Kaber,et al.  Effects of Visual Interface Design, and Control Mode and Latency on Performance, Telepresence and Workload in a Teleoperation Task , 2000 .

[11]  Massimo Bertozzi,et al.  Real-time lane and obstacle detection on the GOLD system , 1996, Proceedings of Conference on Intelligent Vehicles.

[12]  Americo De Jesus Caves Human-Automation Collaborative RRT for UAV Mission Path Planning , 2010 .

[13]  Jee-Hwan Ryu,et al.  Shared teleoperation of a vehicle with a virtual driving interface , 2013, 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013).

[14]  Dana R. Yoerger,et al.  Supervisory control architecture for underwater teleoperation , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[15]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.

[16]  A. Robin Forrest,et al.  Interactive interpolation and approximation by Bézier polynomials , 1990, Comput. Aided Des..

[17]  J. Edward Colgate,et al.  Semi‐autonomous Telerobotic Manipulation: A Viable Approach for Space Structure Deployment and Maintenance , 2005 .

[18]  Peter I. Corke,et al.  Reactive navigation and opportunistic localization for autonomous underground mining vehicles , 2002, Inf. Sci..

[19]  Masaru Uchiyama,et al.  Model-based space robot teleoperation of ETS-VII manipulator , 2004, IEEE Transactions on Robotics and Automation.

[20]  Terrence Fong,et al.  Vehicle Teleoperation Interfaces , 2001, Auton. Robots.

[21]  R. C. Goertz,et al.  ELECTRONICALLY CONTROLLED MANIPULATOR , 1954 .