Teleoperation system for a mobile robot arm with visual servomechanism based on turning radius determination using angle information of image

This paper considers the development of a teleoperation system for a mobile robot arm with visual servo mechanism. The robot to be operated mainly consists of a mobile robot and a robot arm with USB camera. The robot is teleoperated according to the control command which is generated by combining the manual operation with the autonomous control via the vision system based on the USB camera images. In this paper, a control method of determining the turning radius of the mobile robot is proposed based on the angle information of image corresponding to the error of a target position from the reference one. To evaluate the proposed teleoperation system, experiments of pressing a button were conducted by using an actual robot. It was verified from the experimental results that sufficiently high success rate of teleoperation could be obtained by the proposed method.

[1]  Satoru Goto,et al.  Human direct teaching of industrial articulated robot arms based on force-free control , 2006, Artificial Life and Robotics.

[2]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[3]  Satoru Goto,et al.  Teleoperation system for a mobile robot with visual servo mechanism based on automatic template generation , 2017, Artificial Life and Robotics.

[4]  Ying Wang,et al.  A modified image-based visual servo controller with hybrid camera configuration for robust robotic grasping , 2014, Robotics Auton. Syst..

[5]  Satoru Goto,et al.  Experimental evaluation of teleoperation system with force-free control and visual servo control by human operator perception , 2012, Artificial Life and Robotics.

[6]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[7]  Seul Jung,et al.  Neural network-based Smith predictor design for the time-delay in a tele-operated control system , 2009, Artificial Life and Robotics.

[8]  Satoru Goto.  Teleoperation System of Industrial Articulated Robot Arms by Using Forcefree Control , 2010 .

[9]  Yongchun Fang,et al.  Vision-based minimum-time planning of mobile robots with kinematic and visibility constraints , 2014 .

[10]  Satoru Goto,et al.  Development of Hands-free Remote Operation System for a Mobile Robot Using EOG and EMG , 2016 .

[11]  Thomas B. Sheridan.  Teleoperation, Telerobotics, and Telepresence: A Progress Report , 1992 .

[12]  Wen-Chung Chang,et al.  Robotic assembly of smartphone back shells with eye-in-hand visual servoing , 2018 .

[13]  Adrian Kaehler,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[14]  Sung-Hyun Han,et al.  Intelligent control of a robot manipulator by visual feedback , 2006, Artificial Life and Robotics.

[15]  Satoru Goto,et al.  Teleoperation of robot arm with position measurement via angle-pixel characteristic and visual supporting function , 2016, Artificial Life and Robotics.