Teleoperation of a Mobile Robot Using a Force-Reflection Joystick With Sensing Mechanism of Rotating Magnetic Field

Operators' intelligent and skillful decisions are necessary for the teleoperation of a mobile robot when there are many scattered obstacles. Among the sensors used for environment recognition, the camera is the most popular and powerful. However, there are several limitations in the camera-based teleoperation of a mobile robot. For example, shadowed and curved areas cannot be viewed using a narrow view-angle camera, especially in an environment with bad illumination and several obstacles. Therefore, it is necessary to have other sensory information for reliable teleoperations. In this study, 16 ultrasonic sensors are attached around a mobile robot in a ring pattern to measure the distances to the obstacles and a collision vector is introduced as a new tool for obstacle avoidance, which is defined as the normal vector from an obstacle to the mobile robot. Based on this collision vector, a virtual reflection force is generated to avoid the obstacles and then the reflection force is transferred to the operator who is holding the joystick used to control the mobile robot. Based on this reflection force, the operator can control the mobile robot more smoothly and safely. For this bidirectional teleoperation, a master joystick system using a two-axis hall sensor was designed to eliminate the nonlinear region, which exists in a general joystick with two motors and potentiometers. The effectiveness of the collision vector and force-reflection joystick is verified by comparing two vision-based teleoperation experiments, with and without force reflection.

[1]  Ya-Jun Pan,et al.  Teleoperation of a Mobile Robot using Predictive Control Approach , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[2]  Chih-Lyang Hwang,et al.  Trajectory Tracking and Obstacle Avoidance of Car-Like Mobile Robots in an Intelligent Space Using Mixed $H_{2}/H_{\infty}$ Decentralized Control , 2007, IEEE/ASME Transactions on Mechatronics.

[3]  Jang Myung Lee,et al.  Implementation of a Remote Peg-in-Hole Operation Using a Two Degrees of Freedom Force-Reflective Joystick , 1999 .

[4]  Ren C. Luo,et al.  Force reflective feedback control for intelligent wheelchairs , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[5]  Kazuo Tanie,et al.  Macro-micro bilateral teleoperation based on operational force feedforward-operational force feedforward bilateral teleoperation and its dexterity , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[6]  Petros A. Ioannou,et al.  New Potential Functions for Mobile Robot Path Planning , 2000 .

[7]  Ming-Chang Tsai,et al.  A low-cost force feedback joystick and its use in PC video games , 1995 .

[8]  Wolfram Burgard,et al.  Web interfaces for mobile robots in public places , 2000, IEEE Robotics Autom. Mag..

[9]  Christopher R. Wagner,et al.  Force Feedback in a Three-Dimensional Ultrasound-Guided Surgical Task , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  Cagatay Basdogan,et al.  Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration , 2001 .

[11]  Yoram Koren,et al.  Teleautonomous guidance for mobile robots , 1990, IEEE Trans. Syst. Man Cybern..

[12]  K. Ohnishi,et al.  Haptic Consensus in Bilateral Teleoperation , 2007, 2007 IEEE International Conference on Mechatronics.

[13]  Hao Lu,et al.  Nonlinear Compensation of a New Noncontact Joystick Using the Universal Joint Mechanism , 2007, IEEE/ASME Transactions on Mechatronics.

[14]  Thomas Bock,et al.  Contact task by space teleoperation using force reflection of communication time delay , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[15]  Peter Xiaoping Liu,et al.  Force reflection algorithm for improved transparency in bilateral teleoperation with communication delay , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..